Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-canterbury-compress.xml
chartType: barchart
dateTime: 22 Nov 2011/07:21:18 PST
hostName: TS-MacMini.local
inputDir: testdata/canterbury
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/canterbury-compress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Apple Inc. 20.4-b02-402
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
Snappy(JNI)/block	100.322	50.82	94.39	48.41	90.319	44.947	true
Snappy(iq80)/block	120.366	50.82	114.19	48.41	109.883	44.947	n/a
LZF/block	108.074	49.284	102.349	46.876	98.047	43.104	n/a
LZF/stream	109.573	49.284	103.638	46.876	99.213	43.104	n/a
LZO-java/block	79.86	48.48	75.455	46.044	71.729	42.537	n/a
LZO-java/stream	75.852	48.48	69.984	46.044	64.926	42.537	n/a
QuickLZ/L1/block	58.862	46.877	47.805	44.467	37.048	41.081	n/a
QuickLZ/L3/block	15.039	41.294	14.342	39.393	13.732	36.611	n/a
Gzip/JDK/stream	16.337	31.632	14.962	29.918	13.643	27.481	n/a
Gzip/jzlib/stream	14.221	31.958	13.401	30.228	12.778	27.783	n/a
BZip2/stream	4.622	28.177	3.82	26.1	3.119	23.301	n/a
LZMA-orig/block	1.096	27.334	1.054	23.695	1.002	18.295	n/a
LZMA-java/stream	1.44	28.226	1.382	24.169	1.321	17.927	n/a

Driver: Snappy(JNI)/block

Snappy-java, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	15414	29.956	74.633	59.81
C:asyoulik.txt	17710	29.951	70.589	64.074
C:cp.html	120629	29.961	94.467	48.116
C:fields.c	261636	29.961	92.857	42.404
C:grammar.lsp	789462	29.961	93.505	48.374
C:kennedy.xls	4022	29.965	131.812	41.344
C:lcet10.txt	5619	29.961	76.327	57.108
C:plrabn12.txt	4421	29.964	67.802	68.347
C:ptt5	13505	29.963	220.606	18.21
C:sum	79303	29.961	96.528	51.875
C:xargs.1	627425	29.961	84.419	59.357

Driver: Snappy(iq80)/block

Snappy-iq80, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	19392	29.962	93.876	59.81
C:asyoulik.txt	22208	29.962	88.484	64.074
C:cp.html	141819	29.961	111.062	48.116
C:fields.c	324017	29.961	114.996	42.404
C:grammar.lsp	972903	29.961	115.231	48.374
C:kennedy.xls	4874	29.965	159.738	41.344
C:lcet10.txt	7250	29.964	98.473	57.108
C:plrabn12.txt	5551	29.964	85.131	68.347
C:ptt5	15438	29.961	252.19	18.21
C:sum	90738	29.961	110.445	51.875
C:xargs.1	701644	29.961	94.403	59.357

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	16219	29.962	78.515	56.217
C:asyoulik.txt	19097	29.962	76.089	59.172
C:cp.html	125651	29.961	98.4	48.632
C:fields.c	318895	29.962	113.177	42.448
C:grammar.lsp	958962	29.962	113.579	47.89
C:kennedy.xls	4557	29.965	149.349	40.738
C:lcet10.txt	5975	29.961	81.164	54.464
C:plrabn12.txt	4799	29.967	73.592	62.431
C:ptt5	13282	29.962	216.965	16.283
C:sum	75009	29.961	91.3	55.267
C:xargs.1	718601	29.961	96.685	58.576

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	16672	29.961	80.709	56.217
C:asyoulik.txt	19449	29.961	77.495	59.172
C:cp.html	124886	29.961	97.801	48.632
C:fields.c	317813	29.961	112.794	42.448
C:grammar.lsp	998976	29.961	118.319	47.89
C:kennedy.xls	4658	29.962	152.672	40.738
C:lcet10.txt	6090	29.962	82.723	54.464
C:plrabn12.txt	4828	29.962	74.049	62.431
C:ptt5	13552	29.962	221.377	16.283
C:sum	74225	29.961	90.347	55.267
C:xargs.1	721087	29.961	97.02	58.576

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	15189	29.96	73.533	56.998
C:asyoulik.txt	17469	29.961	69.606	60.913
C:cp.html	94956	29.961	74.364	47.641
C:fields.c	201854	29.96	71.642	42.197
C:grammar.lsp	419547	29.96	49.693	48.804
C:kennedy.xls	3734	29.963	122.383	35.118
C:lcet10.txt	5626	29.96	76.424	54.901
C:plrabn12.txt	4479	29.964	68.691	64.214
C:ptt5	9151	29.963	149.481	16.991
C:sum	64397	29.96	78.386	47.191
C:xargs.1	328885	29.96	44.252	58.316

Driver: LZO-java/stream

LZO-java, streaming

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	14638	29.96	70.866	56.998
C:asyoulik.txt	16903	29.961	67.351	60.913
C:cp.html	86288	29.96	67.576	47.641
C:fields.c	183638	29.959	65.18	42.197
C:grammar.lsp	317295	29.96	37.582	48.804
C:kennedy.xls	3666	29.96	120.165	35.118
C:lcet10.txt	5361	29.96	72.824	54.901
C:plrabn12.txt	4335	29.965	66.481	64.214
C:ptt5	9511	29.962	155.366	16.991
C:sum	60226	29.96	73.309	47.191
C:xargs.1	280009	29.961	37.675	58.316

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver1
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	11739	29.963	56.826	54.898
C:asyoulik.txt	13866	29.958	55.254	57.899
C:cp.html	54611	29.941	42.796	45.994
C:fields.c	89484	29.961	31.758	42.305
C:grammar.lsp	116507	29.96	13.8	47.702
C:kennedy.xls	3294	29.953	107.997	30.163
C:lcet10.txt	5059	29.966	68.709	51.901
C:plrabn12.txt	4097	29.963	62.836	61.238
C:ptt5	8575	29.962	140.075	16.852
C:sum	43327	29.961	52.738	48.217
C:xargs.1	109186	29.961	14.691	58.481

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	2778	29.967	13.446	46.73
C:asyoulik.txt	3249	29.966	12.944	51.222
C:cp.html	22163	29.961	17.357	40.377
C:fields.c	42192	29.962	14.974	34.996
C:grammar.lsp	75696	29.96	8.966	41.602
C:kennedy.xls	526	29.985	17.227	34.142
C:lcet10.txt	980	29.962	13.312	43.398
C:plrabn12.txt	775	29.968	11.884	54.016
C:ptt5	1699	29.972	27.745	14.781
C:sum	14811	29.963	18.027	40.902
C:xargs.1	70992	29.955	9.554	52.07

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	2011	29.976	9.731	35.767
C:asyoulik.txt	2238	29.966	8.916	39.057
C:cp.html	27309	29.962	21.385	32.333
C:fields.c	66385	29.957	23.564	27.946
C:grammar.lsp	190364	29.961	22.547	32.679
C:kennedy.xls	450	30.015	14.723	19.809
C:lcet10.txt	753	29.993	10.218	33.954
C:plrabn12.txt	497	30.021	7.608	40.521
C:ptt5	1575	29.973	25.719	11.001
C:sum	10696	29.961	13.019	33.954
C:xargs.1	165574	29.961	22.277	40.927

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

classPath: build/classes lib/jzlib/*.jar
driverClass: com.ning.jcbm.gzip.JCraftGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	2349	29.97	11.368	36.568
C:asyoulik.txt	2584	29.971	10.293	39.641
C:cp.html	21500	29.962	16.837	32.52
C:fields.c	43573	29.961	15.464	28.161
C:grammar.lsp	86510	29.961	10.246	32.679
C:kennedy.xls	582	29.977	19.066	19.977
C:lcet10.txt	866	29.985	11.754	34.492
C:plrabn12.txt	605	29.983	9.273	41.337
C:ptt5	1767	29.964	28.863	11.178
C:sum	10626	29.963	12.933	34.059
C:xargs.1	76843	29.961	10.339	40.927

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	1018	29.975	4.926	28.429
C:asyoulik.txt	1243	29.98	4.95	31.644
C:cp.html	4660	29.962	3.649	31.008
C:fields.c	7297	29.961	2.59	27.256
C:grammar.lsp	10297	29.961	1.22	34.507
C:kennedy.xls	143	30.137	4.66	11.988
C:lcet10.txt	392	30.009	5.316	27.343
C:plrabn12.txt	334	30.013	5.114	32.6
C:ptt5	809	29.989	13.204	9.696
C:sum	3113	29.964	3.789	33.768
C:xargs.1	10555	29.959	1.42	41.708

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	242	30.014	1.169	31.874
C:asyoulik.txt	319	29.975	1.27	35.555
C:cp.html	1559	29.977	1.22	30.886
C:fields.c	3604	29.965	1.279	26.753
C:grammar.lsp	10561	29.961	1.251	33.539
C:kennedy.xls	17	30.894	0.54	5.341
C:lcet10.txt	74	30.075	1.001	27.985
C:plrabn12.txt	66	30.262	1.002	34.319
C:ptt5	39	30.485	0.626	7.96
C:sum	1047	29.979	1.274	24.66
C:xargs.1	10601	29.963	1.426	41.803

Driver: LZMA-java/stream

LZMA-java, streaming

classPath: build/classes lib/lzma-java/*.jar
driverClass: com.ning.jcbm.lzma.LzmaJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
C:alice29.txt	274	29.977	1.326	33.471
C:asyoulik.txt	355	29.998	1.413	36.739
C:cp.html	2058	29.972	1.611	31.078
C:fields.c	4058	29.966	1.44	26.717
C:grammar.lsp	10615	29.962	1.257	33.512
C:kennedy.xls	21	30.537	0.675	4.65
C:lcet10.txt	102	29.979	1.385	31.634
C:plrabn12.txt	90	30.26	1.367	37.864
C:ptt5	156	29.974	2.547	8.368
C:sum	1238	29.965	1.507	24.668
C:xargs.1	9715	29.961	1.307	41.779

Results Per Test

Generated using Japex version 1.2.2