Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-max-comp-uncompress.xml
chartType: barchart
dateTime: 21 Nov 2011/18:57:30 PST
hostName: TS-MacMini.local
inputDir: testdata/maximumcompression
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 5
reportsDirectory: reports/maxcomp-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Apple Inc. 20.4-b02-402
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
Snappy(JNI)/block	492.147	56.726	483.68	50.191	475.409	42.542	true
Snappy(iq80)/block	410.831	56.726	388.155	50.191	368.249	42.542	n/a
LZF/block	409.424	56.143	386.572	49.437	365.947	41.573	n/a
LZF/stream	432.321	56.143	409.21	49.437	387.836	41.573	n/a
LZO-java/block	117.758	56.966	111.777	49.259	107.499	40.384	n/a
LZO-java/stream	199.376	56.966	181.404	49.259	166.781	40.384	n/a
QuickLZ/L1/block	180.473	54.499	110.194	45.496	80.422	34.531	n/a
QuickLZ/L3/block	218.429	48.965	158.502	39.758	126.172	30.275	n/a
Gzip/JDK/stream	185.123	42.446	167.555	33.46	153.649	25.033	n/a
Gzip/jzlib/stream	92.198	42.744	81.25	33.924	73.343	25.658	n/a
BZip2/stream	17.602	40.582	15.816	30.252	14.305	20.231	n/a
LZMA-orig/block	22.235	36.854	18.481	26.256	15.702	17.21	n/a
LZMA-java/stream	14.435	39.1	13.245	29.686	12.192	21.729	n/a

Driver: Snappy(JNI)/block

Snappy-java, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	57122	29.96	599.9	99.996
U:AcroRd32.exe	3522	29.948	434.125	62.662
U:FP.LOG	970	29.991	599.9	14.714
U:FlashMX.pdf	4711	29.957	599.9	89.326
U:MSO97.DLL	3758	29.961	452.452	76.396
U:english.dic	3127	29.959	404.88	43.695
U:ohs.doc	5424	29.959	599.9	32.685
U:rafale.bmp	2727	29.958	360.209	55.903
U:vcfiu.hlp	3475	29.965	455.807	36.421
U:world95.txt	4357	29.966	414.398	55.458

Driver: Snappy(iq80)/block

Snappy-iq80, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	50540	29.961	599.9	99.996
U:AcroRd32.exe	2461	29.963	303.199	62.662
U:FP.LOG	819	29.984	537.063	14.714
U:FlashMX.pdf	4085	29.959	588.665	89.326
U:MSO97.DLL	2448	29.963	294.707	76.396
U:english.dic	2330	29.971	301.563	43.695
U:ohs.doc	4492	29.959	596.01	32.685
U:rafale.bmp	2010	29.971	265.385	55.903
U:vcfiu.hlp	2560	29.959	335.859	36.421
U:world95.txt	3006	29.961	285.957	55.458

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	50243	29.962	599.9	100.008
U:AcroRd32.exe	2282	29.958	281.195	61.752
U:FP.LOG	845	29.964	554.48	14.069
U:FlashMX.pdf	4293	29.964	599.9	89.136
U:MSO97.DLL	2254	29.966	271.327	75.167
U:english.dic	2854	29.952	369.616	40.626
U:ohs.doc	4099	29.961	543.843	32.029
U:rafale.bmp	1938	29.974	255.857	53.207
U:vcfiu.hlp	2497	29.965	327.527	37.054
U:world95.txt	3054	29.953	290.595	58.387

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	121721	29.96	599.9	100.008
U:AcroRd32.exe	2428	29.945	299.312	61.752
U:FP.LOG	1099	29.968	599.9	14.069
U:FlashMX.pdf	6377	29.95	599.9	89.136
U:MSO97.DLL	2355	29.966	283.481	75.167
U:english.dic	3186	29.955	412.566	40.626
U:ohs.doc	4595	29.96	599.9	32.029
U:rafale.bmp	2040	29.966	269.393	53.207
U:vcfiu.hlp	2716	29.958	356.341	37.054
U:world95.txt	3178	29.941	302.522	58.387

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	8844	29.958	237.183	100.381
U:AcroRd32.exe	821	29.965	101.142	64.016
U:FP.LOG	153	30.013	100.231	13.02
U:FlashMX.pdf	887	29.97	127.776	99.703
U:MSO97.DLL	784	29.96	94.394	76.552
U:english.dic	630	29.987	81.494	43.803
U:ohs.doc	1130	29.972	149.867	30.493
U:rafale.bmp	680	29.982	89.75	55.661
U:vcfiu.hlp	757	29.976	99.259	34.153
U:world95.txt	1015	29.982	96.486	51.878

Driver: LZO-java/stream

LZO-java, streaming

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	8002	29.961	214.583	100.381
U:AcroRd32.exe	896	29.946	110.45	64.016
U:FP.LOG	490	30.007	321.074	13.02
U:FlashMX.pdf	2327	29.961	335.311	99.703
U:MSO97.DLL	1180	29.959	142.076	76.552
U:english.dic	959	29.98	124.083	43.803
U:ohs.doc	2480	29.958	329.063	30.493
U:rafale.bmp	902	29.956	119.155	55.661
U:vcfiu.hlp	1272	29.973	166.801	34.153
U:world95.txt	1379	29.964	131.169	51.878

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver1
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	29970	29.961	599.9	100.001
U:AcroRd32.exe	421	29.979	51.84	58.864
U:FP.LOG	347	30.033	227.173	9.265
U:FlashMX.pdf	3621	29.962	521.749	100
U:MSO97.DLL	358	30.032	42.999	73.409
U:english.dic	501	29.993	64.795	40.024
U:ohs.doc	775	29.961	102.825	28.601
U:rafale.bmp	393	29.963	51.904	55.881
U:vcfiu.hlp	646	30.003	84.627	30.859
U:world95.txt	599	29.996	56.914	48.081

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	29775	29.96	599.9	100.001
U:AcroRd32.exe	650	29.99	80.009	52.073
U:FP.LOG	430	29.966	282.145	8.589
U:FlashMX.pdf	3956	29.963	570.006	100
U:MSO97.DLL	553	29.976	66.545	65.653
U:english.dic	740	29.962	95.803	35.502
U:ohs.doc	1244	29.973	164.98	25.717
U:rafale.bmp	676	29.964	89.275	42.061
U:vcfiu.hlp	962	29.945	126.269	24.883
U:world95.txt	1150	29.973	109.355	35.169

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	9154	29.962	245.468	99.92
U:AcroRd32.exe	881	29.983	108.469	44.756
U:FP.LOG	626	29.965	410.759	7.03
U:FlashMX.pdf	1027	29.979	147.896	84.658
U:MSO97.DLL	725	29.96	87.29	57.887
U:english.dic	1155	29.967	149.505	25.801
U:ohs.doc	1769	29.961	234.707	24.21
U:rafale.bmp	881	29.972	116.317	30.406
U:vcfiu.hlp	1509	29.978	197.85	20.565
U:world95.txt	1609	29.978	152.974	29.23

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

classPath: build/classes lib/jzlib/*.jar
driverClass: com.ning.jcbm.gzip.JCraftGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	5150	29.962	138.097	99.92
U:AcroRd32.exe	401	30.01	49.325	44.85
U:FP.LOG	348	29.98	228.234	7.359
U:FlashMX.pdf	428	29.996	61.601	84.723
U:MSO97.DLL	334	29.979	40.189	58.032
U:english.dic	547	30.005	70.716	25.778
U:ohs.doc	726	29.981	96.257	24.61
U:rafale.bmp	508	29.986	67.04	31.217
U:vcfiu.hlp	738	29.996	96.704	20.97
U:world95.txt	776	29.962	73.818	29.979

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	299	30.055	7.993	99.687
U:AcroRd32.exe	105	30.091	12.881	43.696
U:FP.LOG	60	29.975	39.357	4.689
U:FlashMX.pdf	60	30.122	8.6	84.641
U:MSO97.DLL	88	29.969	10.592	56.559
U:english.dic	137	30.159	17.621	28.469
U:ohs.doc	149	30.152	19.644	23.096
U:rafale.bmp	139	30.026	18.319	22.451
U:vcfiu.hlp	167	29.987	21.889	18.538
U:world95.txt	202	30.103	19.125	23.994

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	280	29.971	7.506	100.412
U:AcroRd32.exe	116	29.96	14.293	36.369
U:FP.LOG	95	29.961	62.345	4.021
U:FlashMX.pdf	62	30.38	8.811	81.929
U:MSO97.DLL	97	30.14	11.609	48.162
U:english.dic	149	30.081	19.214	20.951
U:ohs.doc	195	30.074	25.774	19.265
U:rafale.bmp	144	30.109	18.926	23.496
U:vcfiu.hlp	212	30.002	27.774	14.83
U:world95.txt	275	30.028	26.102	19.103

Driver: LZMA-java/stream

LZMA-java, streaming

classPath: build/classes lib/lzma-java/*.jar
driverClass: com.ning.jcbm.lzma.LzmaJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:A10.jpg	256	30.056	6.843	100.495
U:AcroRd32.exe	92	30.1	11.283	37.954
U:FP.LOG	45	30.055	29.439	6.073
U:FlashMX.pdf	56	30.467	7.935	83.063
U:MSO97.DLL	78	30.256	9.299	51.358
U:english.dic	114	29.989	14.746	21.153
U:ohs.doc	136	30.041	17.996	22.703
U:rafale.bmp	105	30.03	13.836	24.816
U:vcfiu.hlp	137	30.016	17.94	17.318
U:world95.txt	159	30.143	15.034	26.063

Results Per Test

Generated using Japex version 1.2.2