Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-max-comp-compress.xml
chartType: barchart
dateTime: 08 Jun 2013/14:54:30 PDT
hostName: TS-MacMini.local
inputDir: testdata/maximumcompression
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 5
reportsDirectory: reports/maxcomp-compress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Oracle Corporation 23.6-b04
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	426.698	55.885	343.388	48.213	290.668	38.711	n/a
LZ4 (Java+Unsafe)/block	313.029	55.885	224.597	48.213	181.712	38.711	n/a
Snappy(JNI)/block	296.487	56.726	207.254	50.191	166.791	42.542	true
Snappy(iq80)/block	285.986	56.726	195.011	50.191	155.033	42.542	n/a
LZF/block	135.441	56.142	116.188	49.434	103.305	41.57	n/a
LZF/stream	130.456	56.142	111.777	49.434	99.47	41.57	n/a
LZO-java/block	313.545	56.966	169.252	49.259	123.119	40.384	n/a
LZ4 HC (JNI)/block	18.418	46.999	16.989	38.037	15.147	28.328	n/a
QuickLZ/L3/block	16.312	48.965	15.851	39.758	15.456	30.275	n/a
Gzip/JDK/stream	16.836	42.446	15.086	33.46	13.843	25.033	n/a
BZip2/stream	4.082	40.582	3.881	30.252	3.621	20.231	n/a
LZMA-orig/block	1.227	36.854	1.108	26.256	1.011	17.21	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	112123	29.968	1199.9	100.379
C:AcroRd32.exe	1752	29.955	215.907	62.131
C:FP.LOG	1054	29.928	692.442	11.685
C:FlashMX.pdf	3943	29.944	568.49	88.933
C:MSO97.DLL	1568	29.966	188.751	76.104
C:english.dic	1740	29.959	225.293	48.552
C:ohs.doc	3851	29.96	510.959	28.078
C:rafale.bmp	1479	29.966	195.311	57.851
C:vcfiu.hlp	2175	29.964	285.3	34.349
C:world95.txt	1941	29.964	184.623	50.788

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	112293	29.968	1199.9	100.379
C:AcroRd32.exe	1058	29.966	130.335	62.131
C:FP.LOG	639	29.934	419.727	11.685
C:FlashMX.pdf	2698	29.962	388.752	88.933
C:MSO97.DLL	944	29.97	113.621	76.104
C:english.dic	1078	29.968	139.533	48.552
C:ohs.doc	2440	29.97	323.627	28.078
C:rafale.bmp	910	29.988	120.082	57.851
C:vcfiu.hlp	1357	29.966	177.992	34.349
C:world95.txt	1228	29.986	116.718	50.788

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	72301	29.968	1199.9	99.996
C:AcroRd32.exe	1029	29.965	126.764	62.662
C:FP.LOG	512	29.974	335.855	14.714
C:FlashMX.pdf	2738	29.965	394.48	89.326
C:MSO97.DLL	935	29.989	112.467	76.396
C:english.dic	889	29.975	115.043	43.695
C:ohs.doc	2341	29.966	310.544	32.685
C:rafale.bmp	811	29.979	107.051	55.903
C:vcfiu.hlp	1153	29.983	151.146	36.421
C:world95.txt	1174	29.978	111.616	55.458

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	66309	29.968	1199.9	99.996
C:AcroRd32.exe	873	29.969	107.534	62.662
C:FP.LOG	517	30.014	338.688	14.714
C:FlashMX.pdf	2483	29.963	357.766	89.326
C:MSO97.DLL	781	29.966	94.014	76.396
C:english.dic	902	29.995	116.648	43.695
C:ohs.doc	2184	29.966	289.712	32.685
C:rafale.bmp	826	29.963	109.088	55.903
C:vcfiu.hlp	1113	29.981	145.912	36.421
C:world95.txt	1058	29.974	100.602	55.458

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	2229	29.98	59.735	100.008
C:AcroRd32.exe	746	29.971	91.883	61.749
C:FP.LOG	568	29.984	372.462	14.067
C:FlashMX.pdf	467	30.011	67.18	89.135
C:MSO97.DLL	616	29.988	74.096	75.166
C:english.dic	1116	29.975	144.42	40.624
C:ohs.doc	1363	29.98	180.723	32.026
C:rafale.bmp	872	29.973	115.125	53.205
C:vcfiu.hlp	1166	29.982	152.857	37.052
C:world95.txt	1009	29.979	95.927	58.385

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	2170	29.976	58.162	100.008
C:AcroRd32.exe	718	29.969	88.442	61.749
C:FP.LOG	551	29.941	361.837	14.067
C:FlashMX.pdf	452	29.986	65.077	89.135
C:MSO97.DLL	593	29.961	71.394	75.166
C:english.dic	1045	29.985	135.186	40.624
C:ohs.doc	1320	29.971	175.073	32.026
C:rafale.bmp	820	29.965	108.29	53.205
C:vcfiu.hlp	1134	29.963	148.755	37.052
C:world95.txt	971	29.97	92.341	58.385

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	48754	29.968	1199.9	100.381
C:AcroRd32.exe	721	29.993	88.738	64.016
C:FP.LOG	292	30.014	191.285	13.02
C:FlashMX.pdf	7235	29.959	1042.613	99.703
C:MSO97.DLL	610	30	73.346	76.552
C:english.dic	722	30.004	93.342	43.803
C:ohs.doc	1236	29.963	163.974	30.493
C:rafale.bmp	661	29.99	87.218	55.661
C:vcfiu.hlp	860	29.985	112.73	34.153
C:world95.txt	866	29.99	82.3	51.878

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	823	29.984	22.053	100.305
C:AcroRd32.exe	160	29.995	19.691	53.156
C:FP.LOG	33	29.939	21.672	7.605
C:FlashMX.pdf	145	30.152	20.762	85.494
C:MSO97.DLL	166	30.131	19.873	66.45
C:english.dic	65	30.077	8.383	40.028
C:ohs.doc	212	30.009	28.083	24.764
C:rafale.bmp	49	30.033	6.456	36.458
C:vcfiu.hlp	123	30.201	16.008	23.982
C:world95.txt	223	29.978	21.202	31.752

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	486	30.009	13.012	100.001
C:AcroRd32.exe	113	29.976	13.916	52.073
C:FP.LOG	40	30.657	25.654	8.589
C:FlashMX.pdf	91	30.159	13.027	100
C:MSO97.DLL	102	30.128	12.212	65.653
C:english.dic	110	30.144	14.155	35.502
C:ohs.doc	148	30.022	19.596	25.717
C:rafale.bmp	110	30.169	14.428	42.061
C:vcfiu.hlp	161	30.126	21.005	24.883
C:world95.txt	170	30.068	16.114	35.169

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	609	29.991	16.315	99.92
C:AcroRd32.exe	100	30.121	12.255	44.756
C:FP.LOG	60	29.956	39.382	7.03
C:FlashMX.pdf	108	30.211	15.433	84.658
C:MSO97.DLL	87	30.059	10.44	57.887
C:english.dic	78	30.001	10.085	25.801
C:ohs.doc	203	30.018	26.882	24.21
C:rafale.bmp	64	30.352	8.344	30.406
C:vcfiu.hlp	118	30.092	15.413	20.565
C:world95.txt	146	30.14	13.806	29.23

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	162	29.984	4.341	99.687
C:AcroRd32.exe	42	30.044	5.16	43.696
C:FP.LOG	5	33.928	2.898	4.689
C:FlashMX.pdf	31	30.068	4.451	84.641
C:MSO97.DLL	39	30.121	4.671	56.559
C:english.dic	43	30.288	5.507	28.469
C:ohs.doc	13	31.596	1.636	23.096
C:rafale.bmp	30	30.923	3.839	22.451
C:vcfiu.hlp	26	30.621	3.337	18.538
C:world95.txt	53	30.314	4.983	23.994

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:A10.jpg	94	30	2.517	100.412
C:AcroRd32.exe	9	31.415	1.058	36.369
C:FP.LOG	2	42.083	0.934	4.021
C:FlashMX.pdf	11	31.24	1.52	81.929
C:MSO97.DLL	9	31.877	1.018	48.162
C:english.dic	8	31.035	1	20.951
C:ohs.doc	16	30.887	2.059	19.265
C:rafale.bmp	5	35.877	0.551	23.496
C:vcfiu.hlp	8	33.78	0.931	14.83
C:world95.txt	8	33.387	0.683	19.103

Results Per Test

Generated using Japex version 1.2.2