Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-canterbury-roundtrip.xml
chartType: barchart
dateTime: 08 Jun 2013/08:47:28 PDT
hostName: TS-MacMini.local
inputDir: testdata/canterbury
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/canterbury-roundtrip
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Oracle Corporation 23.6-b04
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	183.737	50.701	173.983	48.004	166.626	44.003	n/a
LZ4 (Java+Unsafe)/block	126.847	50.701	119.455	48.004	114.302	44.003	n/a
Snappy(JNI)/block	102.276	50.82	96.416	48.41	92.378	44.947	true
Snappy(iq80)/block	111.447	50.82	106.35	48.41	102.57	44.947	n/a
LZF/block	110.283	49.283	105.87	46.876	102.435	43.104	n/a
LZF/stream	103.453	49.283	99.204	46.876	95.937	43.104	n/a
LZO-java/block	53.671	48.48	50.882	46.044	48.663	42.537	n/a
LZ4 HC (JNI)/block	17.017	40.535	15.527	38.426	14.041	35.173	n/a
QuickLZ/L3/block	13.081	41.294	12.412	39.393	11.824	36.611	n/a
Gzip/JDK/stream	14.601	31.632	13.559	29.918	12.546	27.481	n/a
BZip2/stream	3.471	28.177	2.901	26.1	2.383	23.301	n/a
LZMA-orig/block	1	27.334	0.966	23.695	0.924	18.295	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	27477	29.968	132.989	59.662
R:asyoulik.txt	32090	29.957	127.881	63.134
R:cp.html	228732	29.968	179.087	48.405
R:fields.c	525437	29.969	186.436	46.807
R:grammar.lsp	1477005	29.967	174.904	51.492
R:kennedy.xls	7170	29.967	234.967	36.486
R:lcet10.txt	10112	29.968	137.326	55.61
R:plrabn12.txt	7884	29.971	120.882	67.11
R:ptt5	23079	29.969	376.918	16.822
R:sum	157762	29.969	191.977	49.205
R:xargs.1	1172651	29.968	157.742	62.976

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	20181	29.968	97.675	59.662
R:asyoulik.txt	23316	29.969	92.878	63.134
R:cp.html	156362	29.966	122.432	48.405
R:fields.c	359064	29.969	127.403	46.807
R:grammar.lsp	868016	29.963	102.801	51.492
R:kennedy.xls	5167	29.972	169.296	36.486
R:lcet10.txt	7520	29.971	102.116	55.61
R:plrabn12.txt	5780	29.972	88.619	67.11
R:ptt5	16762	29.97	273.739	16.822
R:sum	104798	29.97	127.523	49.205
R:xargs.1	675339	29.969	90.84	62.976

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	15437	29.969	74.712	59.81
R:asyoulik.txt	18212	29.97	72.544	64.074
R:cp.html	127041	29.966	99.471	48.116
R:fields.c	275240	29.969	97.659	42.404
R:grammar.lsp	823228	29.969	97.477	48.374
R:kennedy.xls	3808	29.972	124.77	41.344
R:lcet10.txt	5784	29.971	78.543	57.108
R:plrabn12.txt	4492	29.973	68.871	68.347
R:ptt5	13793	29.969	225.265	18.21
R:sum	81797	29.969	99.537	51.875
R:xargs.1	640726	29.969	86.186	59.357

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	17655	29.962	85.466	59.81
R:asyoulik.txt	20139	29.964	80.236	64.074
R:cp.html	138655	29.958	108.595	48.116
R:fields.c	334386	29.965	118.661	42.404
R:grammar.lsp	935000	29.967	110.722	48.374
R:kennedy.xls	3970	29.971	130.084	41.344
R:lcet10.txt	6552	29.968	88.979	57.108
R:plrabn12.txt	4910	29.964	75.301	68.347
R:ptt5	13806	29.966	225.493	18.21
R:sum	84680	29.969	103.044	51.875
R:xargs.1	738383	29.964	99.336	59.357

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	18130	29.969	87.744	56.216
R:asyoulik.txt	21071	29.968	83.938	59.172
R:cp.html	122028	29.967	95.543	48.632
R:fields.c	333636	29.963	118.401	42.448
R:grammar.lsp	1019179	29.965	120.697	47.89
R:kennedy.xls	4563	29.967	149.533	40.737
R:lcet10.txt	6544	29.968	88.872	54.463
R:plrabn12.txt	5335	29.971	81.801	62.431
R:ptt5	12372	29.97	202.049	16.283
R:sum	71019	29.968	86.424	55.267
R:xargs.1	729360	29.968	98.111	58.576

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	17066	29.967	82.602	56.216
R:asyoulik.txt	19630	29.965	78.207	59.172
R:cp.html	112435	29.966	88.036	48.632
R:fields.c	320556	29.965	113.752	42.448
R:grammar.lsp	933085	29.963	110.509	47.89
R:kennedy.xls	4263	29.973	139.675	40.737
R:lcet10.txt	6250	29.969	84.875	54.463
R:plrabn12.txt	5051	29.971	77.445	62.431
R:ptt5	11770	29.968	192.231	16.283
R:sum	66265	29.964	80.65	55.267
R:xargs.1	669037	29.968	89.998	58.576

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	9678	29.968	46.841	56.998
R:asyoulik.txt	11381	29.966	45.341	60.913
R:cp.html	65719	29.968	51.455	47.641
R:fields.c	137084	29.966	48.644	42.197
R:grammar.lsp	290142	29.968	34.357	48.804
R:kennedy.xls	2466	29.975	80.792	35.118
R:lcet10.txt	3566	29.967	48.429	54.901
R:plrabn12.txt	2877	29.971	44.113	64.214
R:ptt5	6241	29.968	101.929	16.991
R:sum	45185	29.968	54.986	47.191
R:xargs.1	249041	29.968	33.5	58.316

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	2511	29.98	12.148	41.877
R:asyoulik.txt	3260	29.971	12.985	47.067
R:cp.html	34733	29.969	27.193	42.036
R:fields.c	78243	29.969	27.762	37.955
R:grammar.lsp	165581	29.967	19.607	46.439
R:kennedy.xls	201	30.101	6.558	31.483
R:lcet10.txt	914	29.991	12.403	38.864
R:plrabn12.txt	606	29.986	9.287	47.215
R:ptt5	877	29.973	14.321	13.094
R:sum	20034	29.97	24.378	42.751
R:xargs.1	152727	29.969	20.544	57.109

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	2448	29.97	11.847	46.73
R:asyoulik.txt	2868	29.968	11.425	51.222
R:cp.html	18850	29.967	14.759	40.377
R:fields.c	35464	29.967	12.584	34.996
R:grammar.lsp	62706	29.968	7.425	41.602
R:kennedy.xls	467	30.002	15.286	34.142
R:lcet10.txt	883	29.976	11.988	43.398
R:plrabn12.txt	683	29.989	10.466	54.016
R:ptt5	1529	29.969	24.971	14.781
R:sum	12506	29.967	15.219	40.902
R:xargs.1	58842	29.968	7.915	52.07

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	1932	29.976	9.348	35.767
R:asyoulik.txt	2145	29.979	8.542	39.057
R:cp.html	24244	29.969	18.981	32.333
R:fields.c	57836	29.969	20.521	27.946
R:grammar.lsp	156494	29.968	18.531	32.679
R:kennedy.xls	434	29.997	14.208	19.809
R:lcet10.txt	695	29.974	9.437	33.954
R:plrabn12.txt	464	30.031	7.1	40.521
R:ptt5	1462	29.984	23.864	11.001
R:sum	9942	29.968	12.098	33.954
R:xargs.1	133683	29.969	17.982	40.927

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	778	29.974	3.765	28.429
R:asyoulik.txt	933	29.985	3.715	31.644
R:cp.html	3483	29.983	2.726	31.008
R:fields.c	5508	29.97	1.954	27.256
R:grammar.lsp	7992	29.971	0.946	34.507
R:kennedy.xls	117	30.118	3.815	11.988
R:lcet10.txt	298	30.034	4.038	27.343
R:plrabn12.txt	251	30.039	3.84	32.6
R:ptt5	578	30	9.43	9.696
R:sum	2357	29.98	2.867	33.768
R:xargs.1	8076	29.969	1.086	41.708

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	224	30.066	1.081	31.874
R:asyoulik.txt	295	30.067	1.171	35.555
R:cp.html	1425	29.989	1.115	30.886
R:fields.c	3332	29.972	1.182	26.753
R:grammar.lsp	9371	29.969	1.11	33.539
R:kennedy.xls	16	30.31	0.518	5.341
R:lcet10.txt	68	30.245	0.915	27.985
R:plrabn12.txt	60	30.102	0.916	34.319
R:ptt5	37	30.78	0.588	7.96
R:sum	956	29.979	1.163	24.66
R:xargs.1	9241	29.969	1.243	41.803

Results Per Test

Generated using Japex version 1.2.2