Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-canterbury-roundtrip.xml
chartType: barchart
dateTime: 22 Nov 2011/19:26:42 PST
hostName: TS-MacMini.local
inputDir: testdata/canterbury
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/canterbury-roundtrip
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Apple Inc. 20.4-b02-402
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
Snappy(JNI)/block	79.193	50.82	75.176	48.41	72.278	44.947	true
Snappy(iq80)/block	90.366	50.82	86.842	48.41	84.214	44.947	n/a
LZF/block	80.746	49.284	78.07	46.876	75.879	43.104	n/a
LZF/stream	80.287	49.284	77.476	46.876	75.288	43.104	n/a
LZO-java/block	45.696	48.48	44.206	46.044	43.04	42.537	n/a
LZO-java/stream	50.241	48.48	47.316	46.044	45.155	42.537	n/a
QuickLZ/L1/block	34.666	46.877	29.971	44.467	25.555	41.081	n/a
QuickLZ/L3/block	12.979	41.294	12.356	39.393	11.833	36.611	n/a
Gzip/JDK/stream	13.808	31.632	12.851	29.918	11.925	27.481	n/a
Gzip/jzlib/stream	11.449	31.958	10.801	30.228	10.319	27.783	n/a
BZip2/stream	3.384	28.177	2.906	26.1	2.474	23.301	n/a
LZMA-orig/block	0.973	27.334	0.937	23.695	0.895	18.295	n/a
LZMA-java/stream	1.217	28.226	1.169	24.169	1.124	17.927	n/a

Driver: Snappy(JNI)/block

Snappy-java, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	12046	29.962	58.313	59.81
R:asyoulik.txt	14244	29.951	56.775	64.074
R:cp.html	96723	29.947	75.782	48.116
R:fields.c	208307	29.96	73.932	42.404
R:grammar.lsp	637413	29.96	75.499	48.374
R:kennedy.xls	3174	29.968	104.012	41.344
R:lcet10.txt	4553	29.96	61.85	57.108
R:plrabn12.txt	3592	29.964	55.088	68.347
R:ptt5	10004	29.954	163.464	18.21
R:sum	63531	29.962	77.327	51.875
R:xargs.1	513427	29.962	69.079	59.357

Driver: Snappy(iq80)/block

Snappy-iq80, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	14719	29.962	71.253	59.81
R:asyoulik.txt	16964	29.962	67.591	64.074
R:cp.html	112933	29.961	88.44	48.116
R:fields.c	251572	29.962	89.284	42.404
R:grammar.lsp	779703	29.961	92.348	48.374
R:kennedy.xls	3285	29.965	107.659	41.344
R:lcet10.txt	5521	29.963	74.99	57.108
R:plrabn12.txt	4217	29.962	64.679	68.347
R:ptt5	10721	29.961	175.136	18.21
R:sum	70301	29.961	85.57	51.875
R:xargs.1	572903	29.962	77.081	59.357

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	13106	29.963	63.443	56.217
R:asyoulik.txt	15440	29.962	61.519	59.172
R:cp.html	94888	29.961	74.309	48.632
R:fields.c	243023	29.961	86.25	42.448
R:grammar.lsp	757745	29.961	89.749	47.89
R:kennedy.xls	3207	29.97	105.086	40.738
R:lcet10.txt	4759	29.965	64.636	54.464
R:plrabn12.txt	3883	29.967	59.545	62.431
R:ptt5	8542	29.962	139.537	16.283
R:sum	56527	29.961	68.805	55.267
R:xargs.1	559859	29.961	75.328	58.576

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	13476	29.96	65.24	56.217
R:asyoulik.txt	15770	29.962	62.835	59.172
R:cp.html	90688	29.956	71.033	48.632
R:fields.c	236364	29.96	83.891	42.448
R:grammar.lsp	716359	29.96	84.851	47.89
R:kennedy.xls	3236	29.946	106.12	40.738
R:lcet10.txt	4796	29.952	65.168	54.464
R:plrabn12.txt	3892	29.959	59.699	62.431
R:ptt5	8845	29.962	144.486	16.283
R:sum	55476	29.941	67.57	55.267
R:xargs.1	537047	29.96	72.26	58.576

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	8296	29.962	40.161	56.998
R:asyoulik.txt	9761	29.961	38.892	60.913
R:cp.html	54391	29.934	42.633	47.641
R:fields.c	124036	29.959	44.024	42.197
R:grammar.lsp	297783	29.959	35.272	48.804
R:kennedy.xls	1939	29.972	63.532	35.118
R:lcet10.txt	3083	29.944	41.902	54.901
R:plrabn12.txt	2466	29.967	37.816	64.214
R:ptt5	4878	29.964	79.68	16.991
R:sum	36943	29.96	44.968	47.191
R:xargs.1	250901	29.946	33.775	58.316

Driver: LZO-java/stream

LZO-java, streaming

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	8765	29.961	42.432	56.998
R:asyoulik.txt	10242	29.96	40.811	60.913
R:cp.html	59837	29.96	46.862	47.641
R:fields.c	126673	29.95	44.974	42.197
R:grammar.lsp	281131	29.96	33.299	48.804
R:kennedy.xls	2380	29.97	77.986	35.118
R:lcet10.txt	3236	29.95	43.973	54.901
R:plrabn12.txt	2608	29.965	39.995	64.214
R:ptt5	6178	29.963	100.917	16.991
R:sum	40529	29.96	49.334	47.191
R:xargs.1	238202	29.946	32.066	58.316

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver1
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	7017	29.961	33.97	54.898
R:asyoulik.txt	8175	29.958	32.577	57.899
R:cp.html	36111	29.961	28.279	45.994
R:fields.c	64289	29.946	22.828	42.305
R:grammar.lsp	96176	29.96	11.392	47.702
R:kennedy.xls	1794	29.959	58.806	30.163
R:lcet10.txt	2692	29.961	36.568	51.901
R:plrabn12.txt	2175	29.954	33.367	61.238
R:ptt5	4876	29.965	79.642	16.852
R:sum	26450	29.961	32.195	48.217
R:xargs.1	87002	29.961	11.706	58.481

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	2378	29.967	11.51	46.73
R:asyoulik.txt	2783	29.966	11.087	51.222
R:cp.html	18723	29.961	14.662	40.377
R:fields.c	36057	29.946	12.804	34.996
R:grammar.lsp	66850	29.96	7.918	41.602
R:kennedy.xls	461	29.967	15.107	34.142
R:lcet10.txt	852	29.964	11.572	43.398
R:plrabn12.txt	658	29.947	10.097	54.016
R:ptt5	1520	29.977	24.817	14.781
R:sum	12267	29.96	14.932	40.902
R:xargs.1	61413	29.959	8.263	52.07

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	1860	29.953	9.007	35.767
R:asyoulik.txt	2055	29.969	8.186	39.057
R:cp.html	23231	29.961	18.193	32.333
R:fields.c	54729	29.961	19.424	27.946
R:grammar.lsp	146917	29.946	17.41	32.679
R:kennedy.xls	407	30.036	13.307	19.809
R:lcet10.txt	669	29.998	9.076	33.954
R:plrabn12.txt	444	29.947	6.813	40.521
R:ptt5	1377	29.961	22.495	11.001
R:sum	9225	29.962	11.228	33.954
R:xargs.1	124453	29.96	16.745	40.927

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

classPath: build/classes lib/jzlib/*.jar
driverClass: com.ning.jcbm.gzip.JCraftGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	1910	29.96	9.247	36.568
R:asyoulik.txt	2113	29.97	8.417	39.641
R:cp.html	16505	29.96	12.926	32.52
R:fields.c	34425	29.946	12.224	28.161
R:grammar.lsp	70466	29.96	8.346	32.679
R:kennedy.xls	469	29.987	15.359	19.977
R:lcet10.txt	709	29.998	9.619	34.492
R:plrabn12.txt	501	29.987	7.678	41.337
R:ptt5	1441	29.96	23.541	11.178
R:sum	8532	29.959	10.386	34.059
R:xargs.1	60928	29.96	8.198	40.927

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	746	29.994	3.607	28.429
R:asyoulik.txt	896	29.98	3.568	31.644
R:cp.html	3588	29.959	2.81	31.008
R:fields.c	5976	29.95	2.122	27.256
R:grammar.lsp	8876	29.961	1.051	34.507
R:kennedy.xls	114	30.055	3.725	11.988
R:lcet10.txt	279	30	3.785	27.343
R:plrabn12.txt	236	30.065	3.607	32.6
R:ptt5	545	30.008	8.889	9.696
R:sum	2359	29.961	2.871	33.768
R:xargs.1	8837	29.943	1.19	41.708

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	210	30.096	1.012	31.874
R:asyoulik.txt	276	30.018	1.098	35.555
R:cp.html	1389	29.965	1.088	30.886
R:fields.c	3306	29.966	1.173	26.753
R:grammar.lsp	9562	29.961	1.133	33.539
R:kennedy.xls	15	30.105	0.489	5.341
R:lcet10.txt	64	30.104	0.865	27.985
R:plrabn12.txt	55	30.066	0.841	34.319
R:ptt5	37	30.434	0.595	7.96
R:sum	940	29.972	1.144	24.66
R:xargs.1	9393	29.961	1.264	41.803

Driver: LZMA-java/stream

LZMA-java, streaming

classPath: build/classes lib/lzma-java/*.jar
driverClass: com.ning.jcbm.lzma.LzmaJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:alice29.txt	235	30.041	1.135	33.471
R:asyoulik.txt	298	29.976	1.187	36.739
R:cp.html	1704	29.965	1.334	31.078
R:fields.c	3418	29.952	1.213	26.717
R:grammar.lsp	8385	29.961	0.993	33.512
R:kennedy.xls	20	31.154	0.63	4.65
R:lcet10.txt	87	29.972	1.181	31.634
R:plrabn12.txt	76	30.117	1.16	37.864
R:ptt5	137	30.022	2.233	8.368
R:sum	1053	29.949	1.282	24.668
R:xargs.1	7717	29.962	1.038	41.779

Results Per Test

Generated using Japex version 1.2.2