Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-canterbury-roundtrip.xml
chartType: barchart
dateTime: 28 Jul 2011/08:51:25 PDT
hostName: TS-MacMini.local
inputDir: testdata/canterbury
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/canterbury-roundtrip
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Apple Inc. 20.1-b02-384
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX
Snappy(JNI)/block	81.12	50.82	77.208	48.41	74.386	44.947
LZO-java/block	46.812	48.48	45.173	46.044	43.914	42.537
LZO-java/stream	51.178	48.48	48.211	46.044	46.045	42.537
LZF/block	70.86	49.284	68.065	46.876	65.882	43.104
LZF/stream	72.243	49.284	69.188	46.876	66.882	43.104
QuickLZ/L1/block	31.998	46.877	28.332	44.467	24.273	41.081
QuickLZ/L3/block	12.316	41.294	11.609	39.393	11.058	36.611
Gzip/JDK/stream	14.347	31.632	13.351	29.918	12.39	27.481
Gzip/jzlib/stream	11.631	31.958	10.966	30.228	10.476	27.783
BZip2/stream	3.509	28.177	3.004	26.1	2.551	23.301
LZMA-orig/block	1.026	27.334	0.991	23.695	0.948	18.295
LZMA-java/stream	1.14	28.226	1.105	24.169	1.071	17.927

Driver: Snappy(JNI)/block

Snappy-java, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	12569	29.962	60.845	59.81
R:asyoulik.txt	14789	29.95	58.948	64.074
R:cp.html	100254	29.96	78.513	48.116
R:fields.c	217385	29.961	77.152	42.404
R:grammar.lsp	662741	29.961	78.497	48.374
R:kennedy.xls	3153	29.961	103.347	41.344
R:lcet10.txt	4723	29.966	64.145	57.108
R:plrabn12.txt	3711	29.956	56.928	68.347
R:ptt5	10179	29.963	166.273	18.21
R:sum	64463	29.962	78.462	51.875
R:xargs.1	514399	29.962	69.209	59.357

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	8479	29.961	41.047	56.998
R:asyoulik.txt	9923	29.962	39.537	60.913
R:cp.html	55299	29.96	43.307	47.641
R:fields.c	120338	29.961	42.709	42.197
R:grammar.lsp	308006	29.961	36.481	48.804
R:kennedy.xls	2066	29.973	67.69	35.118
R:lcet10.txt	3160	29.967	42.916	54.901
R:plrabn12.txt	2535	29.972	38.867	64.214
R:ptt5	5046	29.964	82.422	16.991
R:sum	37349	29.961	45.461	47.191
R:xargs.1	256413	29.961	34.5	58.316

Driver: LZO-java/stream

LZO-java, streaming

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	8876	29.962	42.968	56.998
R:asyoulik.txt	10404	29.961	41.454	60.913
R:cp.html	60279	29.961	47.206	47.641
R:fields.c	128256	29.961	45.52	42.197
R:grammar.lsp	292997	29.961	34.703	48.804
R:kennedy.xls	2461	29.97	80.64	35.118
R:lcet10.txt	3285	29.965	44.617	54.901
R:plrabn12.txt	2640	29.963	40.489	64.214
R:ptt5	6271	29.962	102.439	16.991
R:sum	40892	29.962	49.773	47.191
R:xargs.1	246366	29.961	33.148	58.316

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	11175	29.962	54.097	56.217
R:asyoulik.txt	13279	29.962	52.909	59.172
R:cp.html	81232	29.962	63.614	48.632
R:fields.c	200851	29.961	71.283	42.448
R:grammar.lsp	644712	29.961	76.359	47.89
R:kennedy.xls	2999	29.964	98.289	40.738
R:lcet10.txt	4126	29.961	56.046	54.464
R:plrabn12.txt	3410	29.968	52.29	62.431
R:ptt5	7889	29.964	128.86	16.283
R:sum	50574	29.961	61.558	55.267
R:xargs.1	476780	29.961	64.15	58.576

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	11544	29.963	55.881	56.217
R:asyoulik.txt	13664	29.961	54.445	59.172
R:cp.html	81771	29.961	64.037	48.632
R:fields.c	203740	29.961	72.309	42.448
R:grammar.lsp	634049	29.961	75.097	47.89
R:kennedy.xls	3112	29.965	101.988	40.738
R:lcet10.txt	4213	29.965	57.221	54.464
R:plrabn12.txt	3482	29.965	53.4	62.431
R:ptt5	8295	29.963	135.497	16.283
R:sum	50591	29.961	61.58	55.267
R:xargs.1	469890	29.961	63.222	58.576

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver1
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	7138	29.963	34.553	54.898
R:asyoulik.txt	8335	29.962	33.21	57.899
R:cp.html	36667	29.961	28.715	45.994
R:fields.c	65164	29.961	23.127	42.305
R:grammar.lsp	97108	29.961	11.502	47.702
R:kennedy.xls	1826	29.97	59.833	30.163
R:lcet10.txt	2753	29.964	37.393	51.901
R:plrabn12.txt	2160	29.975	33.115	61.238
R:ptt5	3252	29.937	53.167	16.852
R:sum	22485	29.947	27.381	48.217
R:xargs.1	74216	29.956	9.987	58.481

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	1936	29.962	9.372	46.73
R:asyoulik.txt	2212	29.964	8.813	51.222
R:cp.html	16645	29.956	13.037	40.377
R:fields.c	32288	29.952	11.463	34.996
R:grammar.lsp	62525	29.952	7.408	41.602
R:kennedy.xls	443	30.015	14.494	34.142
R:lcet10.txt	839	29.975	11.392	43.398
R:plrabn12.txt	675	29.991	10.343	54.016
R:ptt5	1548	29.964	25.286	14.781
R:sum	12613	29.962	15.352	40.902
R:xargs.1	63263	29.961	8.512	52.07

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	1901	29.965	9.202	35.767
R:asyoulik.txt	2110	29.964	8.406	39.057
R:cp.html	24166	29.962	18.924	32.333
R:fields.c	56683	29.962	20.117	27.946
R:grammar.lsp	151917	29.962	17.993	32.679
R:kennedy.xls	419	29.988	13.721	19.809
R:lcet10.txt	703	29.994	9.539	33.954
R:plrabn12.txt	467	30.024	7.148	40.521
R:ptt5	1434	29.965	23.422	11.001
R:sum	9695	29.963	11.8	33.954
R:xargs.1	130372	29.962	17.541	40.927

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

classPath: build/classes lib/jzlib/*.jar
driverClass: com.ning.jcbm.gzip.JCraftGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	1953	29.963	9.454	36.568
R:asyoulik.txt	2160	29.965	8.606	39.641
R:cp.html	16619	29.962	13.015	32.52
R:fields.c	34035	29.962	12.079	28.161
R:grammar.lsp	71184	29.961	8.431	32.679
R:kennedy.xls	482	30.009	15.773	19.977
R:lcet10.txt	724	29.975	9.83	34.492
R:plrabn12.txt	512	29.998	7.843	41.337
R:ptt5	1475	29.976	24.083	11.178
R:sum	8669	29.964	10.551	34.059
R:xargs.1	61501	29.961	8.275	40.927

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	769	29.969	3.722	28.429
R:asyoulik.txt	924	29.993	3.678	31.644
R:cp.html	3655	29.962	2.862	31.008
R:fields.c	6102	29.963	2.166	27.256
R:grammar.lsp	9116	29.961	1.08	34.507
R:kennedy.xls	119	29.984	3.897	11.988
R:lcet10.txt	294	30.04	3.983	27.343
R:plrabn12.txt	246	30.061	3.761	32.6
R:ptt5	568	29.988	9.27	9.696
R:sum	2421	29.971	2.946	33.768
R:xargs.1	9142	29.963	1.23	41.708

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	228	30.037	1.101	31.874
R:asyoulik.txt	297	30.016	1.181	35.555
R:cp.html	1449	29.979	1.134	30.886
R:fields.c	3401	29.966	1.207	26.753
R:grammar.lsp	9833	29.961	1.165	33.539
R:kennedy.xls	17	31.626	0.528	5.341
R:lcet10.txt	70	30.007	0.949	27.985
R:plrabn12.txt	62	30.285	0.941	34.319
R:ptt5	38	30.678	0.606	7.96
R:sum	973	29.973	1.184	24.66
R:xargs.1	9618	29.961	1.294	41.803

Driver: LZMA-java/stream

LZMA-java, streaming

classPath: build/classes lib/lzma-java/*.jar
driverClass: com.ning.jcbm.lzma.LzmaJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	222	30.02	1.073	33.471
R:asyoulik.txt	282	29.993	1.122	36.739
R:cp.html	1588	29.976	1.243	31.078
R:fields.c	3244	29.964	1.151	26.717
R:grammar.lsp	8436	29.961	0.999	33.512
R:kennedy.xls	19	30.281	0.616	4.65
R:lcet10.txt	83	30.201	1.118	31.634
R:plrabn12.txt	72	30.273	1.093	37.864
R:ptt5	117	29.985	1.91	8.368
R:sum	982	29.984	1.194	24.668
R:xargs.1	7554	29.962	1.016	41.779

Results Per Test

Generated using Japex version 1.2.2