Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-max-comp-roundtrip.xml
chartType: barchart
dateTime: 21 Nov 2011/20:56:25 PST
hostName: TS-MacMini.local
inputDir: testdata/maximumcompression
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 5
reportsDirectory: reports/maxcomp-roundtrip
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Apple Inc. 20.4-b02-402
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
Snappy(JNI)/block	129.659	56.726	109.349	50.191	96.518	42.542	true
Snappy(iq80)/block	142.184	56.726	121.657	50.191	108.374	42.542	n/a
LZF/block	77.524	56.143	72.248	49.437	68.456	41.573	n/a
LZF/stream	77.953	56.143	71.466	49.437	66.576	41.573	n/a
LZO-java/block	66.657	56.966	58.984	49.259	54.225	40.384	n/a
LZO-java/stream	92.468	56.966	78.718	49.259	69.497	40.384	n/a
QuickLZ/L1/block	47.516	54.499	44.227	45.496	41.903	34.531	n/a
QuickLZ/L3/block	14.605	48.965	14.165	39.758	13.792	30.275	n/a
Gzip/JDK/stream	16.007	42.446	14.157	33.46	12.882	25.033	n/a
Gzip/jzlib/stream	14.229	42.744	12.713	33.924	11.762	25.658	n/a
BZip2/stream	3.073	40.582	2.983	30.252	2.874	20.231	n/a
LZMA-orig/block	1.093	36.854	1.017	26.256	0.95	17.21	n/a
LZMA-java/stream	1.852	39.1	1.734	29.686	1.626	21.729	n/a

Driver: Snappy(JNI)/block

Snappy-java, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	13509	29.961	362.255	99.996
R:AcroRd32.exe	615	29.938	75.832	62.662
R:FP.LOG	256	30.05	167.505	14.714
R:FlashMX.pdf	1093	29.965	157.477	89.326
R:MSO97.DLL	578	30.007	69.483	76.396
R:english.dic	537	30.011	69.41	43.695
R:ohs.doc	1272	29.965	168.739	32.685
R:rafale.bmp	493	29.982	65.07	55.903
R:vcfiu.hlp	688	29.979	90.202	36.421
R:world95.txt	743	29.986	70.622	55.458

Driver: Snappy(iq80)/block

Snappy-iq80, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	14324	29.963	384.088	99.996
R:AcroRd32.exe	673	29.97	82.894	62.662
R:FP.LOG	288	29.965	188.977	14.714
R:FlashMX.pdf	1181	29.972	170.116	89.326
R:MSO97.DLL	617	29.97	74.262	76.396
R:english.dic	663	29.993	85.746	43.695
R:ohs.doc	1351	29.971	179.183	32.685
R:rafale.bmp	577	30.008	76.09	55.903
R:vcfiu.hlp	782	29.964	102.579	36.421
R:world95.txt	819	29.962	77.908	55.458

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	2096	29.961	56.206	100.008
R:AcroRd32.exe	481	29.961	59.263	61.752
R:FP.LOG	246	30.061	160.9	14.069
R:FlashMX.pdf	387	29.955	55.776	89.136
R:MSO97.DLL	427	30.016	51.315	75.167
R:english.dic	595	29.968	77.016	40.626
R:ohs.doc	858	29.974	113.785	32.029
R:rafale.bmp	456	29.992	60.166	53.207
R:vcfiu.hlp	635	29.974	83.269	37.054
R:world95.txt	605	29.968	57.539	58.387

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	2187	29.971	58.627	100.008
R:AcroRd32.exe	503	29.999	61.896	61.752
R:FP.LOG	261	29.947	171.363	14.069
R:FlashMX.pdf	396	29.958	57.068	89.136
R:MSO97.DLL	322	30.035	38.672	75.167
R:english.dic	579	29.991	74.888	40.626
R:ohs.doc	843	29.973	111.802	32.029
R:rafale.bmp	430	29.983	56.752	53.207
R:vcfiu.hlp	669	29.995	87.663	37.054
R:world95.txt	640	30.002	60.799	58.387

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	6612	29.964	177.289	100.381
R:AcroRd32.exe	368	29.949	45.359	64.016
R:FP.LOG	99	30.106	64.655	13.02
R:FlashMX.pdf	592	30.003	85.186	99.703
R:MSO97.DLL	323	29.971	38.875	76.552
R:english.dic	317	30.043	40.929	43.803
R:ohs.doc	584	29.965	77.473	30.493
R:rafale.bmp	317	30.031	41.771	55.661
R:vcfiu.hlp	399	29.989	52.294	34.153
R:world95.txt	450	30.008	42.74	51.878

Driver: LZO-java/stream

LZO-java, streaming

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	8706	29.961	233.462	100.381
R:AcroRd32.exe	446	30.026	54.833	64.016
R:FP.LOG	178	30.088	116.32	13.02
R:FlashMX.pdf	1050	29.973	151.24	99.703
R:MSO97.DLL	414	29.966	49.836	76.552
R:english.dic	412	30.019	53.239	43.803
R:ohs.doc	814	29.967	107.975	30.493
R:rafale.bmp	373	29.969	49.252	55.661
R:vcfiu.hlp	477	29.959	62.581	34.153
R:world95.txt	483	29.965	45.941	51.878

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver1
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	1453	29.973	38.948	100.001
R:AcroRd32.exe	272	30.054	33.409	58.864
R:FP.LOG	163	30.116	106.418	9.265
R:FlashMX.pdf	277	30.06	39.783	100
R:MSO97.DLL	225	30	27.054	73.409
R:english.dic	359	30.023	46.383	40.024
R:ohs.doc	383	29.98	50.782	28.601
R:rafale.bmp	284	30.027	37.427	55.881
R:vcfiu.hlp	428	29.97	56.132	30.859
R:world95.txt	409	30.023	38.827	48.081

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	455	29.97	12.198	100.001
R:AcroRd32.exe	99	30.057	12.159	52.073
R:FP.LOG	37	30.676	23.716	8.589
R:FlashMX.pdf	84	30.108	12.045	100
R:MSO97.DLL	87	30.116	10.42	65.653
R:english.dic	97	30.138	12.485	35.502
R:ohs.doc	133	30.094	17.568	25.717
R:rafale.bmp	98	30.244	12.823	42.061
R:vcfiu.hlp	141	30.062	18.435	24.883
R:world95.txt	150	30.1	14.204	35.169

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	602	30.005	16.12	99.92
R:AcroRd32.exe	90	30.068	11.049	44.756
R:FP.LOG	61	30.275	39.617	7.03
R:FlashMX.pdf	103	30.209	14.72	84.658
R:MSO97.DLL	80	30.226	9.547	57.887
R:english.dic	72	30.229	9.239	25.801
R:ohs.doc	188	29.959	24.944	24.21
R:rafale.bmp	59	30.294	7.707	30.406
R:vcfiu.hlp	108	30.073	14.116	20.565
R:world95.txt	137	30.018	13.008	29.23

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

classPath: build/classes lib/jzlib/*.jar
driverClass: com.ning.jcbm.gzip.JCraftGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	437	29.985	11.709	99.92
R:AcroRd32.exe	77	30.137	9.432	44.85
R:FP.LOG	57	30.344	36.934	7.359
R:FlashMX.pdf	71	30.043	10.203	84.723
R:MSO97.DLL	66	30.199	7.883	58.032
R:english.dic	88	30.048	11.36	25.778
R:ohs.doc	145	30.035	19.191	24.61
R:rafale.bmp	66	30.313	8.616	31.217
R:vcfiu.hlp	116	30.131	15.132	20.97
R:world95.txt	125	30.116	11.83	29.979

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	102	30.07	2.725	99.687
R:AcroRd32.exe	30	30.386	3.645	43.696
R:FP.LOG	5	36.509	2.693	4.689
R:FlashMX.pdf	20	29.951	2.883	84.641
R:MSO97.DLL	27	30.487	3.195	56.559
R:english.dic	32	30.35	4.09	28.469
R:ohs.doc	12	30.719	1.553	23.096
R:rafale.bmp	24	30.157	3.149	22.451
R:vcfiu.hlp	23	31.228	2.895	18.538
R:world95.txt	42	30.637	3.907	23.994

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	69	30.06	1.844	100.412
R:AcroRd32.exe	9	33.114	1.003	36.369
R:FP.LOG	2	41.864	0.939	4.021
R:FlashMX.pdf	9	30.218	1.286	81.929
R:MSO97.DLL	8	30.747	0.939	48.162
R:english.dic	8	33.304	0.932	20.951
R:ohs.doc	15	31.785	1.876	19.265
R:rafale.bmp	5	36.992	0.535	23.496
R:vcfiu.hlp	7	30.318	0.907	14.83
R:world95.txt	7	29.986	0.665	19.103

Driver: LZMA-java/stream

LZMA-java, streaming

classPath: build/classes lib/lzma-java/*.jar
driverClass: com.ning.jcbm.lzma.LzmaJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	83	30.251	2.204	100.495
R:AcroRd32.exe	12	31.799	1.393	37.954
R:FP.LOG	5	30.189	3.257	6.073
R:FlashMX.pdf	14	30.431	1.986	83.063
R:MSO97.DLL	13	32.078	1.462	51.358
R:english.dic	12	32.466	1.434	21.153
R:ohs.doc	22	31.153	2.807	22.703
R:rafale.bmp	7	31.525	0.879	24.816
R:vcfiu.hlp	13	32.092	1.592	17.318
R:world95.txt	16	30.367	1.502	26.063

Results Per Test

Generated using Japex version 1.2.2