Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-canterbury-uncompress.xml
chartType: barchart
dateTime: 26 Jul 2011/22:57:34 PDT
hostName: TS-MacMini.local
inputDir: testdata/canterbury
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/canterbury-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Apple Inc. 20.1-b02-384
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX
Snappy(JNI)/block	403.279	50.82	399.996	48.41	396.691	44.947
LZO-java/block	115.368	48.48	112.751	46.044	110.385	42.537
LZO-java/stream	161.919	48.48	153.429	46.044	146.277	42.537
LZF/block	196.3	49.284	190.486	46.876	185.482	43.104
LZF/stream	209.457	49.284	202.062	46.876	195.912	43.104
QuickLZ/L1/block	90.466	46.877	85.867	44.467	82.581	41.081
QuickLZ/L3/block	120.073	41.294	113.23	39.393	108.315	36.611
Gzip/JDK/stream	143.606	31.632	136.118	29.918	130.18	27.481
Gzip/jzlib/stream	65.566	31.958	60.473	30.228	56.769	27.783
BZip2/stream	15.532	28.177	14.551	26.1	13.78	23.301
LZMA-orig/block	20.666	27.334	19.24	23.695	18.249	18.295
LZMA-java/stream	14.381	28.226	13.415	24.169	12.628	17.927

Driver: Snappy(JNI)/block

Snappy-java, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	72903	29.96	352.935	59.81
U:asyoulik.txt	84852	29.95	338.224	64.074
U:cp.html	553292	29.961	433.303	48.116
U:fields.c	1221008	29.961	433.353	42.404
U:grammar.lsp	3650612	29.958	432.43	48.374
U:kennedy.xls	13718	29.962	449.631	41.344
U:lcet10.txt	27419	29.962	372.447	57.108
U:plrabn12.txt	20855	29.961	319.867	68.347
U:ptt5	37787	29.961	499.9	18.21
U:sum	333468	29.961	405.895	51.875
U:xargs.1	2958658	29.961	398.084	59.357

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	19063	29.951	92.317	56.998
U:asyoulik.txt	22637	29.961	90.198	60.913
U:cp.html	135290	29.961	105.95	47.641
U:fields.c	311128	29.961	110.422	42.197
U:grammar.lsp	1164592	29.958	137.95	48.804
U:kennedy.xls	4450	29.964	145.845	35.118
U:lcet10.txt	7041	29.961	95.642	54.901
U:plrabn12.txt	5628	29.963	86.315	64.214
U:ptt5	10528	29.959	171.997	16.991
U:sum	89557	29.961	109.009	47.191
U:xargs.1	917195	29.961	123.408	58.316

Driver: LZO-java/stream

LZO-java, streaming

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	22427	29.953	108.6	56.998
U:asyoulik.txt	27346	29.961	108.96	60.913
U:cp.html	193658	29.96	151.662	47.641
U:fields.c	438183	29.961	155.515	42.197
U:grammar.lsp	1577089	29.951	186.858	48.804
U:kennedy.xls	6822	29.957	223.635	35.118
U:lcet10.txt	8446	29.958	114.741	54.901
U:plrabn12.txt	6758	29.958	103.662	64.214
U:ptt5	18483	29.96	301.952	16.991
U:sum	130888	29.959	159.325	47.191
U:xargs.1	1235208	29.96	166.201	58.316

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	31457	29.961	152.283	56.217
U:asyoulik.txt	37829	29.962	150.726	59.172
U:cp.html	220626	29.953	172.826	48.632
U:fields.c	542547	29.959	192.568	42.448
U:grammar.lsp	1916544	29.962	226.994	47.89
U:kennedy.xls	8580	29.963	281.21	40.738
U:lcet10.txt	11472	29.962	155.83	54.464
U:plrabn12.txt	9707	29.958	148.899	62.431
U:ptt5	18545	29.962	302.941	16.283
U:sum	142237	29.958	173.147	55.267
U:xargs.1	1500175	29.956	201.876	58.576

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	33087	29.961	160.176	56.217
U:asyoulik.txt	39715	29.96	158.25	59.172
U:cp.html	232579	29.961	182.138	48.632
U:fields.c	580109	29.961	205.885	42.448
U:grammar.lsp	2062337	29.961	244.263	47.89
U:kennedy.xls	9368	29.962	307.049	40.738
U:lcet10.txt	12062	29.962	163.843	54.464
U:plrabn12.txt	10119	29.962	155.2	62.431
U:ptt5	20943	29.961	342.119	16.283
U:sum	149620	29.961	182.118	55.267
U:xargs.1	1508595	29.961	202.98	58.576

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver1
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	15679	29.961	75.902	54.898
U:asyoulik.txt	18471	29.96	73.6	57.899
U:cp.html	105641	29.961	82.73	45.994
U:fields.c	239909	29.961	85.146	42.305
U:grammar.lsp	576523	29.961	68.284	47.702
U:kennedy.xls	4019	29.967	131.707	30.163
U:lcet10.txt	5823	29.962	79.096	51.901
U:plrabn12.txt	4671	29.966	71.631	61.238
U:ptt5	11153	29.961	182.192	16.852
U:sum	68591	29.96	83.492	48.217
U:xargs.1	455910	29.961	61.342	58.481

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	21359	29.961	103.401	46.73
U:asyoulik.txt	24043	29.956	95.814	51.222
U:cp.html	137028	29.958	107.322	40.377
U:fields.c	315000	29.961	111.796	34.996
U:grammar.lsp	728965	29.961	86.339	41.602
U:kennedy.xls	5631	29.964	184.553	34.142
U:lcet10.txt	8061	29.965	109.486	43.398
U:plrabn12.txt	6240	29.966	95.692	54.016
U:ptt5	14955	29.962	244.299	14.781
U:sum	86409	29.962	105.175	40.902
U:xargs.1	571770	29.961	76.929	52.07

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	26772	29.961	129.604	35.767
U:asyoulik.txt	29869	29.962	119.011	39.057
U:cp.html	173577	29.962	135.929	32.333
U:fields.c	396625	29.962	140.764	27.946
U:grammar.lsp	792501	29.961	93.864	32.679
U:kennedy.xls	6661	29.958	218.355	19.809
U:lcet10.txt	9834	29.962	133.578	33.954
U:plrabn12.txt	7474	29.964	114.625	40.521
U:ptt5	16676	29.96	272.43	11.001
U:sum	109106	29.96	132.809	33.954
U:xargs.1	658856	29.946	88.693	40.927

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

classPath: build/classes lib/jzlib/*.jar
driverClass: com.ning.jcbm.gzip.JCraftGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	12103	29.963	58.588	36.568
U:asyoulik.txt	13564	29.963	54.043	39.641
U:cp.html	76135	29.961	59.623	32.52
U:fields.c	164827	29.961	58.499	28.161
U:grammar.lsp	323489	29.961	38.314	32.679
U:kennedy.xls	2888	29.965	94.649	19.977
U:lcet10.txt	4613	29.966	62.652	34.492
U:plrabn12.txt	3427	29.967	52.553	41.337
U:ptt5	9222	29.962	150.647	11.178
U:sum	46242	29.961	56.285	34.059
U:xargs.1	262924	29.961	35.376	40.927

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	3104	29.968	15.023	28.429
U:asyoulik.txt	3560	29.969	14.181	31.644
U:cp.html	17017	29.961	13.326	31.008
U:fields.c	36826	29.961	13.07	27.256
U:grammar.lsp	80816	29.961	9.572	34.507
U:kennedy.xls	735	29.985	24.072	11.988
U:lcet10.txt	1110	29.963	15.077	27.343
U:plrabn12.txt	891	29.979	13.658	32.6
U:ptt5	1913	29.968	31.243	9.696
U:sum	10595	29.962	12.896	33.768
U:xargs.1	64888	29.961	8.731	41.708

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	3573	29.962	17.297	31.874
U:asyoulik.txt	3875	29.968	15.437	35.555
U:cp.html	20407	29.962	15.981	30.886
U:fields.c	52692	29.961	18.701	26.753
U:grammar.lsp	126172	29.961	14.944	33.539
U:kennedy.xls	964	29.961	31.597	5.341
U:lcet10.txt	1496	29.975	20.312	27.985
U:plrabn12.txt	1116	29.962	17.116	34.319
U:ptt5	2778	29.967	45.372	7.96
U:sum	14979	29.961	18.232	24.66
U:xargs.1	91725	29.961	12.341	41.803

Driver: LZMA-java/stream

LZMA-java, streaming

classPath: build/classes lib/lzma-java/*.jar
driverClass: com.ning.jcbm.lzma.LzmaJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	2737	29.968	13.247	33.471
U:asyoulik.txt	3070	29.964	12.231	36.739
U:cp.html	15450	29.961	12.099	31.078
U:fields.c	36055	29.961	12.796	26.717
U:grammar.lsp	71081	29.96	8.419	33.512
U:kennedy.xls	717	29.98	23.486	4.65
U:lcet10.txt	1028	29.979	13.956	31.634
U:plrabn12.txt	791	29.961	12.132	37.864
U:ptt5	1729	29.962	28.244	8.368
U:sum	11416	29.962	13.895	24.668
U:xargs.1	57083	29.96	7.681	41.779

Results Per Test

Generated using Japex version 1.2.2