Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-canterbury-compress.xml
chartType: barchart
dateTime: 07 Jun 2013/17:18:32 PDT
hostName: TS-MacMini.local
inputDir: testdata/canterbury
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/canterbury-compress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Oracle Corporation 23.6-b04
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	247.249	50.701	229.407	48.004	216.321	44.003	n/a
LZ4 (Java+Unsafe)/block	166.427	50.701	154.762	48.004	146.823	44.003	n/a
Snappy(JNI)/block	134.851	50.82	125.594	48.41	119.614	44.947	true
Snappy(iq80)/block	146.714	50.82	138.603	48.41	132.879	44.947	n/a
LZF/block	151.747	49.283	142.193	46.876	135.491	43.104	n/a
LZF/stream	142.938	49.283	134.039	46.876	127.821	43.104	n/a
LZO-java/block	81.927	48.48	76.924	46.044	72.651	42.537	n/a
LZ4 HC (JNI)/block	17.502	40.535	15.916	38.426	14.34	35.173	n/a
QuickLZ/L3/block	15.035	41.294	14.308	39.393	13.69	36.611	n/a
Gzip/JDK/stream	17.171	31.632	15.648	29.918	14.181	27.481	n/a
BZip2/stream	4.668	28.177	3.843	26.1	3.122	23.301	n/a
LZMA-orig/block	1.085	27.334	1.043	23.695	0.991	18.295	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	34311	29.967	166.066	59.662
C:asyoulik.txt	38991	29.974	155.295	63.134
C:cp.html	305914	29.971	239.493	48.405
C:fields.c	727296	29.974	258.012	46.807
C:grammar.lsp	2014133	29.974	238.453	51.492
C:kennedy.xls	10041	29.968	329.045	36.486
C:lcet10.txt	12922	29.973	175.46	55.61
C:plrabn12.txt	9759	29.973	149.622	67.11
C:ptt5	33952	29.972	554.425	16.822
C:sum	206806	29.974	251.615	49.205
C:xargs.1	1503826	29.974	202.25	62.976

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	25855	29.974	125.111	59.662
C:asyoulik.txt	29176	29.974	116.202	63.134
C:cp.html	206856	29.974	161.926	48.405
C:fields.c	482099	29.96	171.107	46.807
C:grammar.lsp	1098776	29.974	130.084	51.492
C:kennedy.xls	6794	29.974	222.595	36.486
C:lcet10.txt	9583	29.974	130.116	55.61
C:plrabn12.txt	7123	29.975	109.202	67.11
C:ptt5	23369	29.973	381.601	16.822
C:sum	137909	29.974	167.79	49.205
C:xargs.1	854658	29.969	114.961	62.976

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	20007	29.973	96.818	59.81
C:asyoulik.txt	23581	29.974	93.918	64.074
C:cp.html	161893	29.969	126.75	48.116
C:fields.c	356979	29.969	126.662	42.404
C:grammar.lsp	1042457	29.974	123.417	48.374
C:kennedy.xls	5138	29.973	168.34	41.344
C:lcet10.txt	7470	29.974	101.426	57.108
C:plrabn12.txt	5858	29.976	89.805	68.347
C:ptt5	19570	29.972	319.572	18.21
C:sum	105843	29.974	128.776	51.875
C:xargs.1	802147	29.974	107.882	59.357

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	22512	29.972	108.941	59.81
C:asyoulik.txt	25963	29.974	103.404	64.074
C:cp.html	172331	29.97	134.918	48.116
C:fields.c	437254	29.974	155.121	42.404
C:grammar.lsp	1221853	29.974	144.656	48.374
C:kennedy.xls	5489	29.973	179.845	41.344
C:lcet10.txt	8324	29.974	113.024	57.108
C:plrabn12.txt	6413	29.976	98.311	68.347
C:ptt5	19358	29.973	316.106	18.21
C:sum	108545	29.974	132.065	51.875
C:xargs.1	947782	29.974	127.468	59.357

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	23517	29.973	113.8	56.216
C:asyoulik.txt	26479	29.972	105.466	59.172
C:cp.html	158390	29.973	123.99	48.632
C:fields.c	457394	29.973	162.269	42.448
C:grammar.lsp	1395526	29.973	165.22	47.89
C:kennedy.xls	6267	29.974	205.327	40.737
C:lcet10.txt	8451	29.974	114.745	54.463
C:plrabn12.txt	6884	29.975	105.536	62.431
C:ptt5	20213	29.972	330.082	16.283
C:sum	93221	29.973	113.423	55.267
C:xargs.1	961866	29.974	129.363	58.576

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	22056	29.973	106.733	56.216
C:asyoulik.txt	25629	29.973	102.077	59.172
C:cp.html	149406	29.973	116.957	48.632
C:fields.c	436620	29.972	154.906	42.448
C:grammar.lsp	1288036	29.973	152.496	47.89
C:kennedy.xls	5899	29.971	193.291	40.737
C:lcet10.txt	8016	29.971	108.85	54.463
C:plrabn12.txt	6480	29.974	99.347	62.431
C:ptt5	19022	29.971	310.633	16.283
C:sum	87641	29.973	106.634	55.267
C:xargs.1	895198	29.973	120.398	58.576

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	15525	29.969	75.137	56.998
C:asyoulik.txt	17965	29.973	71.554	60.913
C:cp.html	97072	29.973	75.989	47.641
C:fields.c	205015	29.971	72.738	42.197
C:grammar.lsp	389931	29.973	46.166	48.804
C:kennedy.xls	3969	29.976	130.028	35.118
C:lcet10.txt	5755	29.969	78.153	54.901
C:plrabn12.txt	4612	29.973	70.71	64.214
C:ptt5	9455	29.974	154.388	16.991
C:sum	66669	29.968	81.13	47.191
C:xargs.1	336063	29.973	45.199	58.316

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	2570	29.973	12.437	41.877
C:asyoulik.txt	3338	29.978	13.293	47.067
C:cp.html	36089	29.973	28.251	42.036
C:fields.c	81721	29.972	28.993	37.955
C:grammar.lsp	169817	29.973	20.105	46.439
C:kennedy.xls	202	29.997	6.613	31.483
C:lcet10.txt	935	29.997	12.686	38.864
C:plrabn12.txt	618	29.991	9.469	47.215
C:ptt5	889	30.005	14.502	13.094
C:sum	20529	29.974	24.977	42.751
C:xargs.1	157602	29.974	21.196	57.109

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	2740	29.977	13.257	46.73
C:asyoulik.txt	3238	29.981	12.893	51.222
C:cp.html	22222	29.974	17.395	40.377
C:fields.c	41788	29.974	14.825	34.996
C:grammar.lsp	76125	29.974	9.012	41.602
C:kennedy.xls	517	29.997	16.925	34.142
C:lcet10.txt	986	30	13.376	43.398
C:plrabn12.txt	759	29.978	11.635	54.016
C:ptt5	1750	29.984	28.566	14.781
C:sum	14694	29.974	17.878	40.902
C:xargs.1	71578	29.974	9.627	52.07

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	2096	29.987	10.138	35.767
C:asyoulik.txt	2308	29.981	9.19	39.057
C:cp.html	29593	29.975	23.165	32.333
C:fields.c	71538	29.974	25.379	27.946
C:grammar.lsp	203678	29.969	24.118	32.679
C:kennedy.xls	473	30.027	15.47	19.809
C:lcet10.txt	767	29.995	10.407	33.954
C:plrabn12.txt	505	29.984	7.74	40.521
C:ptt5	1605	29.976	26.206	11.001
C:sum	11192	29.974	13.617	33.954
C:xargs.1	174371	29.974	23.451	40.927

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	1033	29.99	4.996	28.429
C:asyoulik.txt	1269	29.978	5.053	31.644
C:cp.html	4658	29.973	3.646	31.008
C:fields.c	7293	29.976	2.587	27.256
C:grammar.lsp	10220	29.974	1.21	34.507
C:kennedy.xls	141	30.177	4.589	11.988
C:lcet10.txt	399	30.026	5.408	27.343
C:plrabn12.txt	342	30.013	5.236	32.6
C:ptt5	822	29.995	13.413	9.696
C:sum	3121	29.973	3.797	33.768
C:xargs.1	10532	29.973	1.417	41.708

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	240	30.065	1.158	31.874
C:asyoulik.txt	317	30.009	1.261	35.555
C:cp.html	1526	29.974	1.195	30.886
C:fields.c	3564	29.975	1.264	26.753
C:grammar.lsp	10451	29.974	1.237	33.539
C:kennedy.xls	17	31.055	0.538	5.341
C:lcet10.txt	74	30.32	0.993	27.985
C:plrabn12.txt	66	30.295	1.001	34.319
C:ptt5	38	30.564	0.609	7.96
C:sum	1031	29.99	1.254	24.66
C:xargs.1	10562	29.974	1.42	41.803

Results Per Test

Generated using Japex version 1.2.2