Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-calgary-uncompress.xml
chartType: barchart
dateTime: 23 Nov 2011/22:13:17 PST
hostName: TS-MacMini.local
inputDir: testdata/calgary
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/calgary-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Apple Inc. 20.4-b02-402
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
Snappy(JNI)/block	422.486	54.646	416.609	52.052	411.409	48.678	true
Snappy(iq80)/block	355.348	54.646	347.374	52.052	340.901	48.678	n/a
LZF/block	312.817	52.407	310.927	49.899	308.899	46.429	n/a
LZF/stream	351.256	52.407	348.204	49.899	344.97	46.429	n/a
LZO-java/block	116.088	52.669	113.27	49.904	110.965	46.405	n/a
LZO-java/stream	159.464	52.669	149.407	49.904	142.749	46.405	n/a
QuickLZ/L1/block	89.406	50.391	86.02	47.878	83.601	44.619	n/a
QuickLZ/L3/block	115.93	43.566	111.094	41.12	107.403	38.154	n/a
Gzip/JDK/stream	139.391	35.042	133.741	32.894	129.018	30.274	n/a
Gzip/jzlib/stream	62.562	35.346	58.866	33.221	55.897	30.622	n/a
BZip2/stream	14.789	31.604	14.281	29.668	13.898	27.289	n/a
LZMA-orig/block	19.264	30.89	18.153	28.822	17.279	25.945	n/a
LZMA-java/stream	13.812	31.87	13.241	29.829	12.77	26.938	n/a

Driver: Snappy(JNI)/block

Snappy-java, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	110762	29.96	392.277	55.445
U:book1	13505	29.949	330.602	68.25
U:book2	19226	29.962	373.816	56.758
U:geo	230842	29.961	599.9	95.636
U:news	32745	29.961	393.063	59.775
U:obj1	707087	29.961	483.993	61.221
U:obj2	55541	29.961	436.344	49.794
U:paper1	224539	29.96	379.961	55.332
U:paper2	137549	29.961	359.893	59.339
U:paper3	239751	29.961	355.06	62.006
U:paper4	883094	29.961	373.462	61.749
U:paper5	999098	29.961	380.158	60.842
U:paper6	317574	29.962	385.176	53.906
U:pic	37638	29.952	599.9	18.21
U:progc	308046	29.962	388.386	52.258
U:progl	194060	29.962	442.548	37.93
U:progp	290723	29.961	456.94	37.121
U:trans	158692	29.962	473.266	38.058

Driver: Snappy(iq80)/block

Snappy-iq80, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	90887	29.962	321.87	55.445
U:book1	10947	29.96	267.884	68.25
U:book2	15756	29.963	306.338	56.758
U:geo	185537	29.961	599.9	95.636
U:news	26418	29.962	317.102	59.775
U:obj1	565041	29.961	386.757	61.221
U:obj2	44882	29.961	352.598	49.794
U:paper1	184156	29.961	311.615	55.332
U:paper2	112119	29.962	293.347	59.339
U:paper3	196789	29.961	291.43	62.006
U:paper4	722185	29.961	305.409	61.749
U:paper5	810439	29.962	308.368	60.842
U:paper6	263284	29.961	319.335	53.906
U:pic	32712	29.961	534.373	18.21
U:progc	254508	29.961	320.892	52.258
U:progl	164527	29.962	375.201	37.93
U:progp	246162	29.962	386.9	37.121
U:trans	133098	29.961	396.942	38.058

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	83043	29.961	294.092	53.88
U:book1	12220	29.96	299.034	62.647
U:book2	15833	29.962	307.844	54.604
U:geo	67757	29.962	220.845	90.913
U:news	23693	29.962	284.388	56.901
U:obj1	433683	29.961	296.85	61.142
U:obj2	37208	29.961	292.31	49.695
U:paper1	188163	29.961	318.395	52.725
U:paper2	120275	29.961	314.688	56.491
U:paper3	208042	29.961	308.098	57.918
U:paper4	745104	29.961	315.104	58.513
U:paper5	820349	29.961	312.142	58.357
U:paper6	261988	29.961	317.764	51.815
U:pic	23658	29.961	386.473	16.283
U:progc	248739	29.961	313.618	50.307
U:progl	154589	29.961	352.545	37.135
U:progp	223926	29.961	351.956	35.77
U:trans	115537	29.962	344.567	38.226

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	93015	29.961	329.413	53.88
U:book1	13345	29.959	326.577	62.647
U:book2	17614	29.961	342.481	54.604
U:geo	71983	29.961	234.627	90.913
U:news	26133	29.961	313.694	56.901
U:obj1	480494	29.96	328.899	61.142
U:obj2	41387	29.961	325.144	49.695
U:paper1	211032	29.961	357.099	52.725
U:paper2	134220	29.961	351.179	56.491
U:paper3	230952	29.96	342.034	57.918
U:paper4	829093	29.96	350.637	58.513
U:paper5	915115	29.961	348.203	58.357
U:paper6	292570	29.961	354.855	51.815
U:pic	28212	29.961	460.876	16.283
U:progc	279246	29.961	352.08	50.307
U:progl	177930	29.961	405.771	37.135
U:progp	257512	29.961	404.745	35.77
U:trans	132207	29.961	394.288	38.226

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	29216	29.961	103.47	52.3
U:book1	3613	29.968	88.391	64.587
U:book2	5012	29.963	97.447	54.299
U:geo	59001	29.96	192.318	98.392
U:news	8718	29.96	104.649	57.396
U:obj1	223100	29.96	152.715	60.114
U:obj2	13507	29.962	106.11	47.691
U:paper1	59099	29.96	100.009	53.024
U:paper2	36040	29.961	94.298	56.682
U:paper3	63021	29.96	93.333	58.363
U:paper4	258673	29.96	109.396	60.477
U:paper5	291744	29.96	111.014	59.637
U:paper6	90108	29.961	109.293	51.382
U:pic	10775	29.961	176.021	16.991
U:progc	73623	29.961	92.828	49.966
U:progl	49441	29.961	112.752	37.346
U:progp	75657	29.961	118.915	34.899
U:trans	42460	29.961	126.631	34.505

Driver: LZO-java/stream

LZO-java, streaming

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	35876	29.961	127.056	52.3
U:book1	4430	29.967	108.381	64.587
U:book2	6075	29.962	118.116	54.299
U:geo	116716	29.96	380.441	98.392
U:news	10731	29.961	128.809	57.396
U:obj1	277562	29.96	189.99	60.114
U:obj2	19318	29.961	151.764	47.691
U:paper1	71856	29.961	121.592	53.024
U:paper2	43523	29.961	113.876	56.682
U:paper3	76119	29.96	112.73	58.363
U:paper4	305483	29.961	129.191	60.477
U:paper5	346526	29.961	131.856	59.637
U:paper6	104015	29.96	126.163	51.382
U:pic	18528	29.962	302.665	16.991
U:progc	102407	29.961	129.121	49.966
U:progl	68053	29.961	155.198	37.346
U:progp	104728	29.96	164.611	34.899
U:trans	59947	29.96	178.787	34.505

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver1
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	23440	29.961	83.012	48.719
U:book1	3045	29.964	74.504	60.88
U:book2	4199	29.963	81.64	51.648
U:geo	19138	29.963	62.376	85.732
U:news	6636	29.961	79.656	53.256
U:obj1	108814	29.961	74.48	59.561
U:obj2	11555	29.958	90.786	45.079
U:paper1	46588	29.961	78.833	52.253
U:paper2	29608	29.961	77.466	55.485
U:paper3	50182	29.961	74.316	58.277
U:paper4	165289	29.961	69.9	59.612
U:paper5	181716	29.961	69.142	59.219
U:paper6	65402	29.962	79.325	51.455
U:pic	11901	29.963	194.401	16.852
U:progc	64680	29.961	81.55	49.13
U:progl	46730	29.961	106.568	35.818
U:progp	69331	29.961	108.97	33.925
U:trans	41037	29.962	122.384	30.138

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	33897	29.962	120.042	39.534
U:book1	4007	29.962	98.051	53.581
U:book2	5708	29.963	110.98	42.955
U:geo	22674	29.961	73.904	79.199
U:news	8937	29.961	107.276	45.733
U:obj1	127278	29.961	87.119	54.157
U:obj2	14635	29.962	114.973	39.541
U:paper1	61535	29.961	104.125	44.164
U:paper2	38917	29.962	101.822	47.04
U:paper3	64431	29.961	95.418	50.217
U:paper4	200850	29.961	84.939	52.928
U:paper5	221908	29.961	84.436	52.434
U:paper6	84105	29.961	102.01	43.923
U:pic	15164	29.961	247.715	14.781
U:progc	83498	29.961	105.277	42.041
U:progl	62593	29.961	142.744	28.846
U:progp	89617	29.961	140.855	28.237
U:trans	55342	29.961	165.048	24.868

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	39779	29.961	140.877	31.657
U:book1	4602	29.965	112.597	40.789
U:book2	6839	29.964	132.963	33.831
U:geo	24898	29.962	81.151	66.823
U:news	9889	29.963	118.696	38.396
U:obj1	149172	29.961	102.105	47.949
U:obj2	17578	29.961	138.096	33.02
U:paper1	77661	29.961	131.412	34.898
U:paper2	47807	29.962	125.081	36.198
U:paper3	79766	29.961	118.128	38.843
U:paper4	246354	29.961	104.182	41.48
U:paper5	271275	29.961	103.22	41.576
U:paper6	106050	29.961	128.627	34.893
U:pic	16555	29.962	270.429	11.001
U:progc	105007	29.961	132.395	33.67
U:progl	80765	29.961	184.186	22.68
U:progp	116032	29.961	182.372	22.726
U:trans	67908	29.961	202.524	20.32

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

classPath: build/classes lib/jzlib/*.jar
driverClass: com.ning.jcbm.gzip.JCraftGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	18033	29.962	63.862	32.309
U:book1	2077	29.972	50.806	41.427
U:book2	3119	29.969	60.629	34.274
U:geo	9607	29.961	31.313	67.149
U:news	4499	29.961	54.003	38.605
U:obj1	60585	29.961	41.47	47.949
U:obj2	7751	29.963	60.889	33.519
U:paper1	33869	29.961	57.311	35.131
U:paper2	21175	29.962	55.402	36.685
U:paper3	34684	29.961	51.365	39.036
U:paper4	101463	29.961	42.909	41.653
U:paper5	111784	29.961	42.535	41.651
U:paper6	45844	29.961	55.604	35.079
U:pic	8724	29.961	142.515	11.178
U:progc	45525	29.961	57.4	33.849
U:progl	36414	29.961	83.044	23.038
U:progp	52021	29.961	81.764	22.99
U:trans	31284	29.961	93.3	20.712

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	4531	29.965	16.044	24.615
U:book1	569	29.999	13.906	33.322
U:book2	795	29.968	15.455	28.307
U:geo	3348	29.964	10.911	55.537
U:news	1139	29.966	13.67	33.564
U:obj1	14875	29.962	10.181	50.219
U:obj2	1790	29.961	14.062	31.825
U:paper1	8146	29.963	13.783	31.156
U:paper2	5349	29.963	13.994	30.506
U:paper3	8684	29.961	12.86	34.086
U:paper4	26298	29.961	11.122	39.049
U:paper5	28240	29.961	10.745	40.43
U:paper6	10965	29.961	13.299	32.295
U:pic	1930	29.969	31.52	9.696
U:progc	10654	29.963	13.432	31.648
U:progl	7276	29.961	16.593	21.743
U:progp	10602	29.963	16.663	21.748
U:trans	6021	29.962	17.956	19.13

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	5462	29.962	19.343	27.453
U:book1	718	29.979	17.559	33.96
U:book2	1029	29.964	20.006	27.794
U:geo	2965	29.961	9.664	51.952
U:news	1483	29.977	17.792	31.514
U:obj1	19167	29.961	13.119	43.694
U:obj2	2488	29.965	19.544	24.871
U:paper1	9915	29.962	16.777	32.43
U:paper2	6358	29.963	16.634	33.086
U:paper3	10143	29.963	15.02	36.61
U:paper4	32034	29.961	13.547	40.351
U:paper5	35554	29.961	13.528	40.572
U:paper6	13513	29.961	16.39	32.712
U:pic	2782	29.972	45.43	7.96
U:progc	13358	29.96	16.843	31.597
U:progl	10487	29.961	23.916	20.829
U:progp	15333	29.961	24.1	20.881
U:trans	9236	29.961	27.545	17.76

Driver: LZMA-java/stream

LZMA-java, streaming

classPath: build/classes lib/lzma-java/*.jar
driverClass: com.ning.jcbm.lzma.LzmaJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	3943	29.964	13.963	29.049
U:book1	488	29.965	11.94	38.342
U:book2	710	29.993	13.79	31.421
U:geo	2490	29.965	8.115	51.931
U:news	1026	29.965	12.314	35.817
U:obj1	14513	29.96	9.934	43.61
U:obj2	1863	29.974	14.63	25.933
U:paper1	7570	29.963	12.808	32.725
U:paper2	4860	29.964	12.715	33.857
U:paper3	7884	29.96	11.676	36.689
U:paper4	22977	29.96	9.717	40.313
U:paper5	25731	29.96	9.791	40.514
U:paper6	10408	29.961	12.624	32.71
U:pic	1733	29.976	28.296	8.368
U:progc	10265	29.962	12.942	31.602
U:progl	7602	29.962	17.336	21.065
U:progp	10866	29.961	17.079	21.199
U:trans	6352	29.961	18.944	18.516

Results Per Test

Generated using Japex version 1.2.2