Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-canterbury-uncompress.xml
chartType: barchart
dateTime: 22 Nov 2011/17:55:18 PST
hostName: TS-MacMini.local
inputDir: testdata/canterbury
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/canterbury-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Apple Inc. 20.4-b02-402
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
Snappy(JNI)/block	415.663	50.82	409.667	48.41	404.174	44.947	true
Snappy(iq80)/block	349.097	50.82	342.577	48.41	336.747	44.947	n/a
LZF/block	326.444	49.284	323.957	46.876	321.541	43.104	n/a
LZF/stream	361.794	49.284	358.009	46.876	354.348	43.104	n/a
LZO-java/block	115.446	48.48	112.8	46.044	110.443	42.537	n/a
LZO-java/stream	163.995	48.48	155.272	46.044	147.93	42.537	n/a
QuickLZ/L1/block	90.045	46.877	85.487	44.467	82.205	41.081	n/a
QuickLZ/L3/block	119.939	41.294	112.877	39.393	107.757	36.611	n/a
Gzip/JDK/stream	137.911	31.632	130.288	29.918	124.47	27.481	n/a
Gzip/jzlib/stream	63.835	31.958	59.053	30.228	55.474	27.783	n/a
BZip2/stream	15.213	28.177	14.337	26.1	13.648	23.301	n/a
LZMA-orig/block	20.555	27.334	19.148	23.695	18.176	18.295	n/a
LZMA-java/stream	14.035	28.226	13.058	24.169	12.246	17.927	n/a

Driver: Snappy(JNI)/block

Snappy-java, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	72739	29.96	352.148	59.81
U:asyoulik.txt	85040	29.949	338.976	64.074
U:cp.html	565267	29.961	442.683	48.116
U:fields.c	1212263	29.96	430.254	42.404
U:grammar.lsp	3527201	29.96	417.775	48.374
U:kennedy.xls	14580	29.962	477.87	41.344
U:lcet10.txt	27334	29.962	371.293	57.108
U:plrabn12.txt	20951	29.961	321.344	68.347
U:ptt5	37856	29.961	599.9	18.21
U:sum	349470	29.96	425.382	51.875
U:xargs.1	2933261	29.961	394.667	59.357

Driver: Snappy(iq80)/block

Snappy-iq80, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	59583	29.951	288.54	59.81
U:asyoulik.txt	69131	29.961	275.45	64.074
U:cp.html	469767	29.961	367.886	48.116
U:fields.c	1024130	29.961	363.47	42.404
U:grammar.lsp	3243334	29.961	384.143	48.374
U:kennedy.xls	11282	29.962	369.785	41.344
U:lcet10.txt	22438	29.962	304.784	57.108
U:plrabn12.txt	16987	29.962	260.534	68.347
U:ptt5	32882	29.962	537.148	18.21
U:sum	281201	29.962	342.269	51.875
U:xargs.1	2572035	29.961	346.058	59.357

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	62940	29.961	304.694	56.217
U:asyoulik.txt	73561	29.961	293.103	59.172
U:cp.html	389497	29.961	305.027	48.632
U:fields.c	1038982	29.961	368.749	42.448
U:grammar.lsp	3341309	29.961	395.75	47.89
U:kennedy.xls	10696	29.963	350.564	40.738
U:lcet10.txt	22371	29.961	303.879	54.464
U:plrabn12.txt	18863	29.961	289.316	62.431
U:ptt5	23641	29.962	386.184	16.283
U:sum	218794	29.961	266.315	55.267
U:xargs.1	2432615	29.961	327.304	58.576

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	68991	29.961	333.993	56.217
U:asyoulik.txt	80334	29.959	320.108	59.172
U:cp.html	431427	29.961	337.864	48.632
U:fields.c	1189572	29.961	422.195	42.448
U:grammar.lsp	3709142	29.961	439.318	47.89
U:kennedy.xls	11871	29.96	389.115	40.738
U:lcet10.txt	24322	29.961	330.384	54.464
U:plrabn12.txt	20174	29.961	309.431	62.431
U:ptt5	27536	29.961	449.833	16.283
U:sum	233909	29.96	284.719	55.267
U:xargs.1	2696138	29.96	362.772	58.576

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	19137	29.958	92.652	56.998
U:asyoulik.txt	22867	29.96	91.115	60.913
U:cp.html	135315	29.96	105.971	47.641
U:fields.c	302291	29.96	107.29	42.197
U:grammar.lsp	1163167	29.96	137.772	48.804
U:kennedy.xls	4465	29.961	146.351	35.118
U:lcet10.txt	7055	29.962	95.829	54.901
U:plrabn12.txt	5680	29.963	87.114	64.214
U:ptt5	10659	29.961	174.125	16.991
U:sum	89578	29.96	109.037	47.191
U:xargs.1	911503	29.96	122.644	58.316

Driver: LZO-java/stream

LZO-java, streaming

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	22828	29.962	110.51	56.998
U:asyoulik.txt	27477	29.961	109.484	60.913
U:cp.html	196591	29.96	153.96	47.641
U:fields.c	434642	29.961	154.261	42.197
U:grammar.lsp	1648459	29.961	195.248	48.804
U:kennedy.xls	6998	29.961	229.375	35.118
U:lcet10.txt	8510	30.002	115.439	54.901
U:plrabn12.txt	6865	29.964	105.284	64.214
U:ptt5	18626	29.96	304.279	16.991
U:sum	131355	29.96	159.888	47.191
U:xargs.1	1235347	29.96	166.216	58.316

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver1
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	15692	29.963	75.961	54.898
U:asyoulik.txt	18537	29.961	73.86	57.899
U:cp.html	105883	29.961	82.92	45.994
U:fields.c	241251	29.961	85.622	42.305
U:grammar.lsp	578675	29.961	68.539	47.702
U:kennedy.xls	4004	29.968	131.212	30.163
U:lcet10.txt	5723	29.962	77.736	51.901
U:plrabn12.txt	4609	29.967	70.678	61.238
U:ptt5	11048	29.963	180.467	16.852
U:sum	68352	29.96	83.201	48.217
U:xargs.1	448125	29.961	60.295	58.481

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	20988	29.962	101.601	46.73
U:asyoulik.txt	23580	29.962	93.953	51.222
U:cp.html	138391	29.961	108.378	40.377
U:fields.c	323512	29.961	114.818	34.996
U:grammar.lsp	754728	29.961	89.391	41.602
U:kennedy.xls	5638	29.964	184.779	34.142
U:lcet10.txt	8012	29.963	108.825	43.398
U:plrabn12.txt	6215	29.964	95.316	54.016
U:ptt5	15024	29.961	245.434	14.781
U:sum	85104	29.96	103.591	40.902
U:xargs.1	544359	29.958	73.249	52.07

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	25491	29.961	123.405	35.767
U:asyoulik.txt	28513	29.96	113.613	39.057
U:cp.html	167489	29.945	131.233	32.333
U:fields.c	376023	29.961	133.456	27.946
U:grammar.lsp	801896	29.961	94.978	32.679
U:kennedy.xls	6651	29.964	217.976	19.809
U:lcet10.txt	8981	29.961	121.996	33.954
U:plrabn12.txt	6412	29.945	98.399	40.521
U:ptt5	16221	29.958	265.008	11.001
U:sum	105788	29.954	128.796	33.954
U:xargs.1	655257	29.961	88.163	40.927

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

classPath: build/classes lib/jzlib/*.jar
driverClass: com.ning.jcbm.gzip.JCraftGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	11949	29.962	57.845	36.568
U:asyoulik.txt	13417	29.962	53.458	39.641
U:cp.html	75416	29.961	59.061	32.52
U:fields.c	162353	29.961	57.622	28.161
U:grammar.lsp	311021	29.961	36.838	32.679
U:kennedy.xls	2760	29.962	90.462	19.977
U:lcet10.txt	4549	29.964	61.786	34.492
U:plrabn12.txt	3369	29.962	51.671	41.337
U:ptt5	8820	29.96	144.087	11.178
U:sum	45258	29.96	55.09	34.059
U:xargs.1	254632	29.954	34.268	40.927

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	3037	29.968	14.699	28.429
U:asyoulik.txt	3415	29.956	13.609	31.644
U:cp.html	16957	29.961	13.28	31.008
U:fields.c	37223	29.955	13.213	27.256
U:grammar.lsp	80393	29.946	9.527	34.507
U:kennedy.xls	712	29.962	23.336	11.988
U:lcet10.txt	1071	29.977	14.54	27.343
U:plrabn12.txt	882	29.969	13.525	32.6
U:ptt5	1827	29.963	29.844	9.696
U:sum	10485	29.956	12.764	33.768
U:xargs.1	66892	29.96	9.001	41.708

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	3504	29.96	16.963	31.874
U:asyoulik.txt	3907	29.937	15.58	35.555
U:cp.html	20505	29.96	16.058	30.886
U:fields.c	52383	29.942	18.603	26.753
U:grammar.lsp	127244	29.95	15.076	33.539
U:kennedy.xls	968	29.988	31.7	5.341
U:lcet10.txt	1452	29.969	19.718	27.985
U:plrabn12.txt	1122	29.97	17.204	34.319
U:ptt5	2756	29.962	45.02	7.96
U:sum	14664	29.952	17.854	24.66
U:xargs.1	91631	29.961	12.329	41.803

Driver: LZMA-java/stream

LZMA-java, streaming

classPath: build/classes lib/lzma-java/*.jar
driverClass: com.ning.jcbm.lzma.LzmaJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	2723	29.963	13.181	33.471
U:asyoulik.txt	2993	29.961	11.926	36.739
U:cp.html	14934	29.959	11.696	31.078
U:fields.c	34452	29.96	12.228	26.717
U:grammar.lsp	68848	29.96	8.155	33.512
U:kennedy.xls	710	30	23.241	4.65
U:lcet10.txt	1028	29.976	13.957	31.634
U:plrabn12.txt	791	29.992	12.12	37.864
U:ptt5	1677	29.965	27.392	8.368
U:sum	10957	29.957	13.339	24.668
U:xargs.1	53097	29.956	7.145	41.779

Results Per Test

Generated using Japex version 1.2.2