Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-calgary-compress.xml
chartType: barchart
dateTime: 23 Nov 2011/08:26:47 PST
hostName: TS-MacMini.local
inputDir: testdata/calgary
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/calgary-compress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Apple Inc. 20.4-b02-402
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
Snappy(JNI)/block	95.683	54.646	91.637	52.052	88.767	48.678	true
Snappy(iq80)/block	120.678	54.646	115.923	52.052	112.484	48.678	n/a
LZF/block	98.422	52.407	94.363	49.899	91.497	46.429	n/a
LZF/stream	98.244	52.407	94.238	49.899	91.476	46.429	n/a
LZO-java/block	81.54	52.669	77.744	49.904	75.054	46.405	n/a
LZO-java/stream	86.425	52.669	77.813	49.904	73.39	46.405	n/a
QuickLZ/L1/block	60.109	50.391	56.195	47.878	52.775	44.619	n/a
QuickLZ/L3/block	16.232	43.566	15.801	41.12	15.438	38.154	n/a
Gzip/JDK/stream	15.661	35.042	14.636	32.894	13.396	30.274	n/a
Gzip/jzlib/stream	14.518	35.346	13.758	33.221	12.985	30.622	n/a
BZip2/stream	4.939	31.604	4.648	29.668	4.443	27.289	n/a
LZMA-orig/block	1.209	30.89	1.178	28.822	1.143	25.945	n/a
LZMA-java/stream	1.59	31.87	1.57	29.829	1.554	26.938	n/a

Driver: Snappy(JNI)/block

Snappy-java, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	22939	29.961	81.239	55.445
C:book1	2811	29.953	68.804	68.25
C:book2	3911	29.967	76.029	56.758
C:geo	43578	29.961	142.042	95.636
C:news	6877	29.965	82.538	59.775
C:obj1	149532	29.961	102.352	61.221
C:obj2	12069	29.962	94.815	49.794
C:paper1	46555	29.961	78.778	55.332
C:paper2	28101	29.962	73.523	59.339
C:paper3	49298	29.961	73.007	62.006
C:paper4	182771	29.961	77.294	61.749
C:paper5	202991	29.961	77.239	60.842
C:paper6	66327	29.962	80.446	53.906
C:pic	12974	29.95	212.023	18.21
C:progc	65947	29.948	83.185	52.258
C:progl	44359	29.962	101.158	37.93
C:progp	67372	29.962	105.889	37.121
C:trans	37532	29.962	111.93	38.058

Driver: Snappy(iq80)/block

Snappy-iq80, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	29361	29.962	103.979	55.445
C:book1	3556	29.965	87.005	68.25
C:book2	5152	29.962	100.172	56.758
C:geo	51796	29.961	168.825	95.636
C:news	8483	29.962	101.823	59.775
C:obj1	171031	29.961	117.066	61.221
C:obj2	15042	29.962	118.171	49.794
C:paper1	60892	29.961	103.037	55.332
C:paper2	37722	29.962	98.695	59.339
C:paper3	63912	29.961	94.649	62.006
C:paper4	218311	29.96	92.326	61.749
C:paper5	241772	29.961	91.995	60.842
C:paper6	86909	29.955	105.433	53.906
C:pic	16040	29.962	262.017	18.21
C:progc	84908	29.961	107.054	52.258
C:progl	60411	29.962	137.767	37.93
C:progp	89212	29.958	140.232	37.121
C:trans	47597	29.958	141.966	38.058

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	23743	29.962	84.084	53.88
C:book1	2971	29.966	72.689	62.647
C:book2	4294	29.967	83.475	54.604
C:geo	19176	29.963	62.5	90.913
C:news	6781	29.964	81.389	56.901
C:obj1	134966	29.962	92.38	61.142
C:obj2	11995	29.962	94.231	49.695
C:paper1	52410	29.962	88.683	52.725
C:paper2	31015	29.962	81.146	56.491
C:paper3	55809	29.962	82.648	57.918
C:paper4	205753	29.962	87.011	58.513
C:paper5	234054	29.962	89.056	58.357
C:paper6	75421	29.962	91.476	51.815
C:pic	13806	29.962	225.524	16.283
C:progc	74374	29.961	93.773	50.307
C:progl	51488	29.961	117.418	37.135
C:progp	80419	29.962	126.397	35.77
C:trans	39473	29.962	117.719	38.226

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	23749	29.962	84.104	53.88
C:book1	3129	29.967	76.554	62.647
C:book2	4312	29.962	83.839	54.604
C:geo	19579	29.961	63.816	90.913
C:news	6858	29.961	82.32	56.901
C:obj1	133361	29.961	91.282	61.142
C:obj2	12135	29.962	95.331	49.695
C:paper1	51210	29.962	86.653	52.725
C:paper2	31386	29.961	82.119	56.491
C:paper3	54630	29.961	80.904	57.918
C:paper4	204640	29.961	86.543	58.513
C:paper5	229497	29.961	87.325	58.357
C:paper6	73418	29.962	89.047	51.815
C:pic	13886	29.963	226.825	16.283
C:progc	72811	29.961	91.802	50.307
C:progl	51677	29.962	117.848	37.135
C:progp	78323	29.962	123.102	35.77
C:trans	39896	29.962	118.98	38.226

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	20101	29.962	71.186	52.3
C:book1	2627	29.97	64.264	64.587
C:book2	3694	29.964	71.819	54.299
C:geo	54393	29.96	177.294	98.392
C:news	5627	29.963	67.539	57.396
C:obj1	98807	29.961	67.632	60.114
C:obj2	9868	29.963	77.519	47.691
C:paper1	40967	29.961	69.323	53.024
C:paper2	26092	29.961	68.267	56.682
C:paper3	43942	29.961	65.075	58.363
C:paper4	134749	29.96	56.988	60.477
C:paper5	147166	29.961	55.998	59.637
C:paper6	57580	29.961	69.838	51.382
C:pic	8501	29.962	138.866	16.991
C:progc	56518	29.961	71.26	49.966
C:progl	39191	29.961	89.376	37.346
C:progp	57844	29.961	90.916	34.899
C:trans	31709	29.961	94.566	34.505

Driver: LZO-java/stream

LZO-java, streaming

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	19319	29.962	68.417	52.3
C:book1	2564	29.963	62.739	64.587
C:book2	3600	29.964	69.99	54.299
C:geo	90999	29.961	296.607	98.392
C:news	5691	29.964	68.305	57.396
C:obj1	95907	29.961	65.647	60.114
C:obj2	10103	29.963	79.366	47.691
C:paper1	39393	29.961	66.657	53.024
C:paper2	25189	29.961	65.906	56.682
C:paper3	42058	29.961	62.285	58.363
C:paper4	127842	29.961	54.065	60.477
C:paper5	138857	29.961	52.836	59.637
C:paper6	54412	29.961	65.997	51.382
C:pic	8912	29.963	145.578	16.991
C:progc	53840	29.961	67.884	49.966
C:progl	38428	29.961	87.636	37.346
C:progp	55651	29.962	87.468	34.899
C:trans	29596	29.961	88.265	34.505

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver1
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	17133	29.962	60.675	48.719
C:book1	2583	29.968	63.193	60.88
C:book2	3515	29.963	68.341	51.648
C:geo	12949	29.962	42.205	85.732
C:news	5181	29.963	62.186	53.256
C:obj1	53288	29.962	36.474	59.561
C:obj2	8770	29.962	68.896	45.079
C:paper1	31423	29.961	53.172	52.253
C:paper2	21607	29.962	56.532	55.485
C:paper3	33218	29.962	49.193	58.277
C:paper4	72334	29.962	30.59	59.612
C:paper5	75672	29.961	28.793	59.219
C:paper6	40567	29.962	49.203	51.455
C:pic	8644	29.963	141.199	16.852
C:progc	40234	29.961	50.728	49.13
C:progl	31712	29.962	72.318	35.818
C:progp	42579	29.962	66.922	33.925
C:trans	27277	29.963	81.346	30.138

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	4514	29.966	15.984	39.534
C:book1	464	30.021	11.332	53.581
C:book2	689	29.968	13.394	42.955
C:geo	3599	29.967	11.728	79.199
C:news	1164	29.982	13.962	45.733
C:obj1	24261	29.962	16.606	54.157
C:obj2	2180	29.968	17.123	39.541
C:paper1	8982	29.963	15.198	44.164
C:paper2	5254	29.963	13.746	47.04
C:paper3	9374	29.963	13.881	50.217
C:paper4	32374	29.961	13.691	52.928
C:paper5	36122	29.962	13.744	52.434
C:paper6	12926	29.964	15.677	43.923
C:pic	1757	29.973	28.691	14.781
C:progc	12701	29.963	16.013	42.041
C:progl	8313	29.962	18.957	28.846
C:progp	12560	29.961	19.741	28.237
C:trans	7612	29.962	22.701	24.868

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	3643	29.966	12.9	31.657
C:book1	345	29.991	8.434	40.789
C:book2	575	29.994	11.168	33.831
C:geo	1488	29.978	4.847	66.823
C:news	1100	29.987	13.192	38.396
C:obj1	29639	29.962	20.287	47.949
C:obj2	1568	29.978	12.312	33.02
C:paper1	8637	29.965	14.613	34.898
C:paper2	4303	29.962	11.258	36.198
C:paper3	8528	29.962	12.629	38.843
C:paper4	45199	29.962	19.114	41.48
C:paper5	54354	29.962	20.681	41.576
C:paper6	13333	29.962	16.171	34.893
C:pic	1575	29.975	25.717	11.001
C:progc	13196	29.964	16.637	33.67
C:progl	7621	29.962	17.379	22.68
C:progp	13491	29.963	21.203	22.726
C:trans	7834	29.962	23.363	20.32

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

classPath: build/classes lib/jzlib/*.jar
driverClass: com.ning.jcbm.gzip.JCraftGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	3801	29.964	13.46	32.309
C:book1	397	30.014	9.697	41.427
C:book2	627	29.992	12.179	34.274
C:geo	1719	29.973	5.601	67.149
C:news	1005	29.977	12.057	38.605
C:obj1	20656	29.962	14.138	47.949
C:obj2	1682	29.974	13.209	33.519
C:paper1	8149	29.962	13.789	35.131
C:paper2	4522	29.963	11.831	36.685
C:paper3	8238	29.964	12.199	39.036
C:paper4	29927	29.961	12.656	41.653
C:paper5	34039	29.961	12.952	41.651
C:paper6	11763	29.963	14.266	35.079
C:pic	1770	29.963	28.912	11.178
C:progc	11917	29.962	15.025	33.849
C:progl	7984	29.961	18.207	23.038
C:progp	12662	29.961	19.902	22.99
C:trans	7125	29.965	21.246	20.712

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	1450	29.976	5.133	24.615
C:book1	207	30.037	5.053	33.322
C:book2	278	29.979	5.402	28.307
C:geo	1432	29.973	4.666	55.537
C:news	426	29.963	5.113	33.564
C:obj1	4611	29.968	3.155	50.219
C:obj2	662	29.963	5.2	31.825
C:paper1	2718	29.961	4.599	31.156
C:paper2	1840	29.967	4.813	30.506
C:paper3	3023	29.965	4.476	34.086
C:paper4	6800	29.964	2.875	39.049
C:paper5	7161	29.96	2.725	40.43
C:paper6	3531	29.965	4.282	32.295
C:pic	810	29.96	13.232	9.696
C:progc	3370	29.964	4.249	31.648
C:progl	2057	29.966	4.69	21.743
C:progp	2884	29.961	4.533	21.748
C:trans	1576	29.961	4.7	19.13

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	301	29.993	1.065	27.453
C:book1	37	30.018	0.904	33.96
C:book2	49	30.047	0.95	27.794
C:geo	485	29.964	1.581	51.952
C:news	92	29.979	1.104	31.514
C:obj1	2287	29.971	1.565	43.694
C:obj2	139	30.088	1.087	24.871
C:paper1	764	29.969	1.292	32.43
C:paper2	479	29.965	1.253	33.086
C:paper3	936	29.965	1.386	36.61
C:paper4	3571	29.966	1.51	40.351
C:paper5	4014	29.966	1.527	40.572
C:paper6	1115	29.979	1.352	32.712
C:pic	37	30.146	0.601	7.96
C:progc	1068	29.966	1.346	31.597
C:progl	441	30.026	1.004	20.829
C:progp	757	29.992	1.189	20.881
C:trans	351	30.019	1.045	17.76

Driver: LZMA-java/stream

LZMA-java, streaming

classPath: build/classes lib/lzma-java/*.jar
driverClass: com.ning.jcbm.lzma.LzmaJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:bib	398	30.024	1.407	29.049
C:book1	56	30.118	1.363	38.342
C:book2	70	30.016	1.359	31.421
C:geo	531	29.967	1.73	51.931
C:news	136	30.151	1.622	35.817
C:obj1	2708	29.966	1.853	43.61
C:obj2	204	29.967	1.602	25.933
C:paper1	846	29.966	1.431	32.725
C:paper2	515	29.973	1.347	33.857
C:paper3	944	29.976	1.397	36.689
C:paper4	3463	29.966	1.464	40.313
C:paper5	3920	29.967	1.491	40.514
C:paper6	1196	29.981	1.45	32.71
C:pic	157	30.063	2.556	8.368
C:progc	1169	29.976	1.473	31.602
C:progl	720	30	1.64	21.065
C:progp	1043	29.972	1.639	21.199
C:trans	604	29.97	1.801	18.516

Results Per Test

Generated using Japex version 1.2.2