Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-max-comp-roundtrip.xml
chartType: barchart
dateTime: 08 Jun 2013/17:34:35 PDT
hostName: TS-MacMini.local
inputDir: testdata/maximumcompression
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 5
reportsDirectory: reports/maxcomp-roundtrip
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Oracle Corporation 23.6-b04
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	300.277	55.885	251.186	48.213	218.752	38.711	n/a
LZ4 (Java+Unsafe)/block	209.453	55.885	151.197	48.213	122.876	38.711	n/a
Snappy(JNI)/block	212.216	56.726	155.677	50.191	128.098	42.542	true
Snappy(iq80)/block	214.632	56.726	158.235	50.191	130.382	42.542	n/a
LZF/block	105.736	56.142	93.838	49.434	85.933	41.57	n/a
LZF/stream	101.18	56.142	90.224	49.434	82.898	41.57	n/a
LZO-java/block	106.856	56.966	85.888	49.259	73.467	40.384	n/a
LZ4 HC (JNI)/block	17.811	46.999	16.422	38.037	14.65	28.328	n/a
QuickLZ/L3/block	14.81	48.965	14.409	39.758	14.067	30.275	n/a
Gzip/JDK/stream	16.031	42.446	14.232	33.46	13.016	25.033	n/a
BZip2/stream	3.037	40.582	2.941	30.252	2.825	20.231	n/a
LZMA-orig/block	1.111	36.854	1.032	26.256	0.963	17.21	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	62908	29.965	799.9	100.379
R:AcroRd32.exe	1387	29.965	170.867	62.131
R:FP.LOG	679	29.927	446.108	11.685
R:FlashMX.pdf	2710	29.943	390.726	88.933
R:MSO97.DLL	1270	29.968	152.869	76.104
R:english.dic	1277	29.972	165.269	48.552
R:ohs.doc	2853	29.962	378.507	28.078
R:rafale.bmp	1096	29.958	144.772	57.851
R:vcfiu.hlp	1586	29.971	207.996	34.349
R:world95.txt	1533	29.977	145.754	50.788

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	40414	29.971	799.9	100.379
R:AcroRd32.exe	764	29.98	94.073	62.131
R:FP.LOG	402	29.925	264.127	11.685
R:FlashMX.pdf	1786	29.965	257.32	88.933
R:MSO97.DLL	708	29.992	85.154	76.104
R:english.dic	669	29.989	86.534	48.552
R:ohs.doc	1783	29.96	236.568	28.078
R:rafale.bmp	577	29.966	76.196	57.851
R:vcfiu.hlp	870	29.964	114.12	34.349
R:world95.txt	847	29.974	80.538	50.788

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	38164	29.97	799.9	99.996
R:AcroRd32.exe	810	29.974	99.757	62.662
R:FP.LOG	374	29.977	245.305	14.714
R:FlashMX.pdf	1934	29.965	278.644	89.326
R:MSO97.DLL	749	29.958	90.186	76.396
R:english.dic	686	29.967	88.797	43.695
R:ohs.doc	1788	29.974	237.122	32.685
R:rafale.bmp	617	29.997	81.394	55.903
R:vcfiu.hlp	871	29.969	114.233	36.421
R:world95.txt	913	29.973	86.817	55.458

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	35845	29.969	799.9	99.996
R:AcroRd32.exe	777	29.999	95.612	62.662
R:FP.LOG	397	30.024	259.988	14.714
R:FlashMX.pdf	1927	29.961	277.67	89.326
R:MSO97.DLL	711	29.984	85.537	76.396
R:english.dic	746	29.982	96.518	43.695
R:ohs.doc	1788	29.974	237.119	32.685
R:rafale.bmp	663	29.974	87.529	55.903
R:vcfiu.hlp	909	29.987	119.147	36.421
R:world95.txt	918	29.97	87.303	55.458

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	2156	29.981	57.776	100.008
R:AcroRd32.exe	598	29.959	73.684	61.749
R:FP.LOG	406	29.909	266.905	14.067
R:FlashMX.pdf	437	30.002	62.883	89.135
R:MSO97.DLL	513	29.979	61.725	75.166
R:english.dic	861	29.98	111.401	40.624
R:ohs.doc	1131	29.959	150.067	32.026
R:rafale.bmp	622	29.983	82.093	53.205
R:vcfiu.hlp	872	29.978	114.329	37.052
R:world95.txt	805	29.992	76.499	58.385

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	2117	29.979	56.735	100.008
R:AcroRd32.exe	575	29.979	70.804	61.749
R:FP.LOG	384	29.939	252.185	14.067
R:FlashMX.pdf	424	30.009	60.999	89.135
R:MSO97.DLL	492	30.012	59.135	75.166
R:english.dic	827	29.958	107.082	40.624
R:ohs.doc	1076	29.956	142.785	32.026
R:rafale.bmp	606	29.943	80.089	53.205
R:vcfiu.hlp	824	29.967	108.076	37.052
R:world95.txt	777	29.962	73.912	58.385

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	10606	29.967	284.357	100.381
R:AcroRd32.exe	465	29.997	57.223	64.016
R:FP.LOG	177	29.966	116.139	13.02
R:FlashMX.pdf	1603	29.976	230.868	99.703
R:MSO97.DLL	408	29.976	49.097	76.552
R:english.dic	418	29.967	54.107	43.803
R:ohs.doc	808	29.964	107.192	30.493
R:rafale.bmp	387	30.021	51.012	55.661
R:vcfiu.hlp	515	29.984	67.51	34.153
R:world95.txt	537	29.977	51.057	51.878

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	808	29.983	21.651	100.305
R:AcroRd32.exe	156	30.022	19.181	53.156
R:FP.LOG	33	30.737	21.11	7.605
R:FlashMX.pdf	142	30.009	20.429	85.494
R:MSO97.DLL	149	29.942	17.95	66.45
R:english.dic	61	30.028	7.88	40.028
R:ohs.doc	206	30.091	27.213	24.764
R:rafale.bmp	49	30.329	6.393	36.458
R:vcfiu.hlp	120	30.009	15.717	23.982
R:world95.txt	217	30.041	20.587	31.752

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	476	30.023	12.738	100.001
R:AcroRd32.exe	101	30.192	12.349	52.073
R:FP.LOG	36	30.158	23.47	8.589
R:FlashMX.pdf	88	30.042	12.646	100
R:MSO97.DLL	89	29.964	10.714	65.653
R:english.dic	99	30.216	12.709	35.502
R:ohs.doc	134	30.177	17.651	25.717
R:rafale.bmp	98	30.114	12.878	42.061
R:vcfiu.hlp	142	30.072	18.56	24.883
R:world95.txt	152	30.114	14.386	35.169

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	573	29.977	15.358	99.92
R:AcroRd32.exe	91	29.973	11.208	44.756
R:FP.LOG	61	30.076	39.878	7.03
R:FlashMX.pdf	100	30.251	14.271	84.658
R:MSO97.DLL	80	30.188	9.559	57.887
R:english.dic	75	30.175	9.641	25.801
R:ohs.doc	187	30.114	24.684	24.21
R:rafale.bmp	61	30.242	7.982	30.406
R:vcfiu.hlp	112	30.12	14.615	20.565
R:world95.txt	138	29.994	13.113	29.23

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	106	30.046	2.834	99.687
R:AcroRd32.exe	30	30.635	3.615	43.696
R:FP.LOG	4	31.207	2.52	4.689
R:FlashMX.pdf	21	30.896	2.934	84.641
R:MSO97.DLL	27	30.263	3.218	56.559
R:english.dic	32	30.091	4.125	28.469
R:ohs.doc	12	31.877	1.496	23.096
R:rafale.bmp	23	29.974	3.036	22.451
R:vcfiu.hlp	22	31.182	2.773	18.538
R:world95.txt	41	30.587	3.82	23.994

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:A10.jpg	71	30.311	1.882	100.412
R:AcroRd32.exe	9	33.228	1	36.369
R:FP.LOG	2	42.018	0.936	4.021
R:FlashMX.pdf	10	33.248	1.299	81.929
R:MSO97.DLL	8	30.147	0.957	48.162
R:english.dic	8	32.263	0.962	20.951
R:ohs.doc	15	30.775	1.937	19.265
R:rafale.bmp	5	36.374	0.544	23.496
R:vcfiu.hlp	7	30.143	0.913	14.83
R:world95.txt	8	33.73	0.676	19.103

Results Per Test

Generated using Japex version 1.2.2