Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-max-comp-compress.xml
chartType: barchart
dateTime: 21 Nov 2011/17:15:33 PST
hostName: TS-MacMini.local
inputDir: testdata/maximumcompression
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 5
reportsDirectory: reports/maxcomp-compress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Apple Inc. 20.4-b02-402
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
Snappy(JNI)/block	178.085	56.726	142.036	50.191	121.52	42.542	true
Snappy(iq80)/block	199.546	56.726	168.141	50.191	148.007	42.542	n/a
LZF/block	93.524	56.143	85.802	49.437	80.081	41.573	n/a
LZF/stream	104.401	56.143	94.669	49.437	87.973	41.573	n/a
LZO-java/block	177.527	56.966	137.63	49.259	115.701	40.384	n/a
LZO-java/stream	160.993	56.966	129.901	49.259	112.244	40.384	n/a
QuickLZ/L1/block	81.877	54.499	74.001	45.496	67.888	34.531	n/a
QuickLZ/L3/block	16.039	48.965	15.557	39.758	15.147	30.275	n/a
Gzip/JDK/stream	17.673	42.446	15.582	33.46	14.134	25.033	n/a
Gzip/jzlib/stream	16.791	42.744	14.906	33.924	13.756	25.658	n/a
BZip2/stream	3.948	40.582	3.762	30.252	3.526	20.231	n/a
LZMA-orig/block	1.209	36.854	1.1	26.256	1.01	17.21	n/a
LZMA-java/stream	2.245	39.1	2.047	29.686	1.867	21.729	n/a

Driver: Snappy(JNI)/block

Snappy-java, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	21202	29.961	568.55	99.996
C:AcroRd32.exe	770	29.992	94.774	62.662
C:FP.LOG	354	30.008	231.947	14.714
C:FlashMX.pdf	1483	29.98	213.556	89.326
C:MSO97.DLL	697	29.979	83.865	76.396
C:english.dic	648	30	83.786	43.695
C:ohs.doc	1684	29.971	223.35	32.685
C:rafale.bmp	630	29.984	83.146	55.903
C:vcfiu.hlp	861	29.984	112.864	36.421
C:world95.txt	894	29.972	85.012	55.458

Driver: Snappy(iq80)/block

Snappy-iq80, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	20678	29.962	554.486	99.996
C:AcroRd32.exe	871	29.99	107.212	62.662
C:FP.LOG	408	30	267.406	14.714
C:FlashMX.pdf	1661	29.959	239.355	89.326
C:MSO97.DLL	820	29.972	98.687	76.396
C:english.dic	870	29.956	112.658	43.695
C:ohs.doc	1908	29.957	253.18	32.685
C:rafale.bmp	812	29.981	107.174	55.903
C:vcfiu.hlp	1154	29.972	151.333	36.421
C:world95.txt	1093	29.962	103.97	55.458

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	2162	29.968	57.962	100.008
C:AcroRd32.exe	592	29.972	72.913	61.752
C:FP.LOG	308	29.984	201.971	14.069
C:FlashMX.pdf	373	29.982	53.71	89.136
C:MSO97.DLL	515	30.005	61.913	75.167
C:english.dic	722	29.991	93.384	40.626
C:ohs.doc	1036	29.968	137.421	32.029
C:rafale.bmp	587	30.003	77.421	53.207
C:vcfiu.hlp	813	29.967	106.634	37.054
C:world95.txt	756	29.962	71.914	58.387

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	2250	29.956	60.348	100.008
C:AcroRd32.exe	647	29.974	79.682	61.752
C:FP.LOG	372	29.957	244.159	14.069
C:FlashMX.pdf	454	29.951	65.441	89.136
C:MSO97.DLL	557	29.972	67.037	75.167
C:english.dic	772	29.989	99.856	40.626
C:ohs.doc	1137	29.958	150.869	32.029
C:rafale.bmp	632	29.969	83.452	53.207
C:vcfiu.hlp	889	29.982	116.544	37.054
C:world95.txt	806	29.982	76.619	58.387

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	20023	29.952	537.099	100.381
C:AcroRd32.exe	684	29.975	84.235	64.016
C:FP.LOG	282	30.037	184.597	13.02
C:FlashMX.pdf	2562	29.967	369.1	99.703
C:MSO97.DLL	571	29.989	68.682	76.552
C:english.dic	717	29.973	92.793	43.803
C:ohs.doc	1212	29.961	160.803	30.493
C:rafale.bmp	650	29.98	85.795	55.661
C:vcfiu.hlp	850	29.988	111.408	34.153
C:world95.txt	849	29.962	80.76	51.878

Driver: LZO-java/stream

LZO-java, streaming

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	18525	29.962	496.76	100.381
C:AcroRd32.exe	680	29.968	83.762	64.016
C:FP.LOG	274	30.048	179.294	13.02
C:FlashMX.pdf	1837	29.96	264.711	99.703
C:MSO97.DLL	629	29.962	75.727	76.552
C:english.dic	708	29.966	91.648	43.803
C:ohs.doc	1181	29.975	156.618	30.493
C:rafale.bmp	631	29.982	83.284	55.661
C:vcfiu.hlp	807	29.987	105.777	34.153
C:world95.txt	761	29.98	72.347	51.878

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver1
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	1551	29.97	41.58	100.001
C:AcroRd32.exe	488	29.988	60.073	58.864
C:FP.LOG	284	29.987	186.211	9.265
C:FlashMX.pdf	314	30.038	45.129	100
C:MSO97.DLL	406	30.031	48.767	73.409
C:english.dic	701	29.985	90.684	40.024
C:ohs.doc	735	29.98	97.456	28.601
C:rafale.bmp	552	29.974	72.876	55.881
C:vcfiu.hlp	797	29.967	104.534	30.859
C:world95.txt	752	29.993	71.46	48.081

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	470	30.011	12.582	100.001
C:AcroRd32.exe	112	30.21	13.686	52.073
C:FP.LOG	39	29.975	25.582	8.589
C:FlashMX.pdf	88	30.003	12.663	100
C:MSO97.DLL	99	30.092	11.867	65.653
C:english.dic	109	30.211	13.995	35.502
C:ohs.doc	146	30.012	19.338	25.717
C:rafale.bmp	107	30.03	14.1	42.061
C:vcfiu.hlp	158	30.023	20.685	24.883
C:world95.txt	168	30.123	15.895	35.169

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	658	29.972	17.638	99.92
C:AcroRd32.exe	101	29.971	12.44	44.756
C:FP.LOG	67	30.041	43.852	7.03
C:FlashMX.pdf	115	30.032	16.532	84.658
C:MSO97.DLL	90	30.153	10.767	57.887
C:english.dic	77	30.162	9.903	25.801
C:ohs.doc	211	30.055	27.907	24.21
C:rafale.bmp	63	30.281	8.233	30.406
C:vcfiu.hlp	117	30.011	15.323	20.565
C:world95.txt	149	30.044	14.135	29.23

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

classPath: build/classes lib/jzlib/*.jar
driverClass: com.ning.jcbm.gzip.JCraftGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	476	29.993	12.751	99.92
C:AcroRd32.exe	94	30.117	11.522	44.85
C:FP.LOG	68	30.13	44.375	7.359
C:FlashMX.pdf	86	30.022	12.367	84.723
C:MSO97.DLL	81	30.003	9.739	58.032
C:english.dic	105	30.042	13.558	25.778
C:ohs.doc	178	29.967	23.611	24.61
C:rafale.bmp	73	30.086	9.602	31.217
C:vcfiu.hlp	136	30.168	17.719	20.97
C:world95.txt	134	30.154	12.666	29.979

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	152	30.142	4.052	99.687
C:AcroRd32.exe	41	30.635	4.94	43.696
C:FP.LOG	5	36.001	2.731	4.689
C:FlashMX.pdf	30	30.396	4.261	84.641
C:MSO97.DLL	38	30.72	4.462	56.559
C:english.dic	42	30.324	5.373	28.469
C:ohs.doc	13	31.375	1.647	23.096
C:rafale.bmp	29	30.277	3.79	22.451
C:vcfiu.hlp	26	30.691	3.33	18.538
C:world95.txt	52	30.307	4.89	23.994

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	90	30.224	2.392	100.412
C:AcroRd32.exe	9	31.949	1.04	36.369
C:FP.LOG	2	42.067	0.935	4.021
C:FlashMX.pdf	11	31.929	1.487	81.929
C:MSO97.DLL	9	31.765	1.022	48.162
C:english.dic	8	31.223	0.994	20.951
C:ohs.doc	16	31.491	2.02	19.265
C:rafale.bmp	5	36.171	0.547	23.496
C:vcfiu.hlp	8	33.277	0.945	14.83
C:world95.txt	8	32.199	0.708	19.103

Driver: LZMA-java/stream

LZMA-java, streaming

classPath: build/classes lib/lzma-java/*.jar
driverClass: com.ning.jcbm.lzma.LzmaJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	136	30.031	3.638	100.495
C:AcroRd32.exe	14	31.544	1.638	37.954
C:FP.LOG	6	32.32	3.65	6.073
C:FlashMX.pdf	20	30.992	2.786	83.063
C:MSO97.DLL	13	30.883	1.518	51.358
C:english.dic	12	31.853	1.461	21.153
C:ohs.doc	25	29.985	3.314	22.703
C:rafale.bmp	8	33.049	0.958	24.816
C:vcfiu.hlp	14	30.855	1.783	17.318
C:world95.txt	18	30.201	1.699	26.063

Results Per Test

Generated using Japex version 1.2.2