Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-canterbury-uncompress.xml
chartType: barchart
dateTime: 07 Jun 2013/19:06:00 PDT
hostName: TS-MacMini.local
inputDir: testdata/canterbury
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/canterbury-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Oracle Corporation 23.6-b04
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	756.164	50.701	742.483	48.004	731.298	44.003	n/a
LZ4 (Java+Unsafe)/block	508.453	50.701	493.962	48.004	481.467	44.003	n/a
Snappy(JNI)/block	431.653	50.82	417.664	48.41	405.695	44.947	true
Snappy(iq80)/block	440.827	50.82	428.539	48.41	417.875	44.947	n/a
LZF/block	457.602	49.283	452.881	46.876	448.402	43.104	n/a
LZF/stream	416.951	49.283	412.984	46.876	409.209	43.104	n/a
LZO-java/block	174.58	48.48	167.25	46.044	161.078	42.537	n/a
LZ4 HC (JNI)/block	829.889	40.535	797.78	38.426	771.563	35.173	n/a
QuickLZ/L3/block	122.858	41.294	117.343	39.393	113.137	36.611	n/a
Gzip/JDK/stream	164.341	31.632	155.209	29.918	148.452	27.481	n/a
BZip2/stream	16.309	28.177	15.291	26.1	14.5	23.301	n/a
LZMA-orig/block	21.824	27.334	20.261	23.695	19.189	18.295	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	129963	29.972	628.938	59.662
U:asyoulik.txt	163356	29.973	650.627	63.134
U:cp.html	992264	29.971	776.799	48.405
U:fields.c	1955847	29.969	693.964	46.807
U:grammar.lsp	5910584	29.974	699.755	51.492
U:kennedy.xls	25681	29.967	841.572	36.486
U:lcet10.txt	46909	29.973	636.957	55.61
U:plrabn12.txt	42227	29.973	647.422	67.11
U:ptt5	73596	29.972	1201.801	16.822
U:sum	694700	29.974	845.224	49.205
U:xargs.1	5165832	29.974	694.749	62.976

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	81016	29.973	392.042	59.662
U:asyoulik.txt	96962	29.973	386.187	63.134
U:cp.html	662185	29.974	518.356	48.405
U:fields.c	1379674	29.96	489.681	46.807
U:grammar.lsp	5154040	29.974	610.182	51.492
U:kennedy.xls	17315	29.971	567.346	36.486
U:lcet10.txt	29710	29.973	403.411	55.61
U:plrabn12.txt	24205	29.974	371.098	67.11
U:ptt5	51815	29.973	846.104	16.822
U:sum	437665	29.974	532.493	49.205
U:xargs.1	3539916	29.974	476.078	62.976

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	67430	29.971	326.32	59.81
U:asyoulik.txt	78672	29.972	313.349	64.074
U:cp.html	589608	29.974	461.543	48.116
U:fields.c	1241105	29.974	440.292	42.404
U:grammar.lsp	3891979	29.974	460.777	48.374
U:kennedy.xls	15032	29.971	492.547	41.344
U:lcet10.txt	26168	29.972	355.328	57.108
U:plrabn12.txt	19444	29.973	298.108	68.347
U:ptt5	46040	29.968	751.933	18.21
U:sum	358576	29.972	436.299	51.875
U:xargs.1	3058597	29.95	411.683	59.357

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	73616	29.971	356.258	59.81
U:asyoulik.txt	84357	29.974	335.981	64.074
U:cp.html	607519	29.974	475.56	48.116
U:fields.c	1345041	29.974	477.169	42.404
U:grammar.lsp	4100264	29.974	485.432	48.374
U:kennedy.xls	14083	29.969	461.484	41.344
U:lcet10.txt	26844	29.972	364.51	57.108
U:plrabn12.txt	19698	29.966	302.08	68.347
U:ptt5	45409	29.971	741.546	18.21
U:sum	342489	29.974	416.702	51.875
U:xargs.1	3214883	29.974	432.371	59.357

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	86478	29.973	418.483	56.216
U:asyoulik.txt	100361	29.973	399.733	59.172
U:cp.html	564352	29.973	441.782	48.632
U:fields.c	1516010	29.971	537.866	42.448
U:grammar.lsp	4291019	29.974	508.022	47.89
U:kennedy.xls	17897	29.969	586.45	40.737
U:lcet10.txt	30818	29.972	418.473	54.463
U:plrabn12.txt	25331	29.972	388.381	62.431
U:ptt5	32383	29.972	528.812	16.283
U:sum	308413	29.973	375.244	55.267
U:xargs.1	3199978	29.973	430.371	58.576

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	78649	29.972	380.608	56.216
U:asyoulik.txt	91601	29.971	364.859	59.172
U:cp.html	512273	29.973	401.018	48.632
U:fields.c	1354643	29.973	480.587	42.448
U:grammar.lsp	3865851	29.973	457.696	47.89
U:kennedy.xls	16092	29.97	527.298	40.737
U:lcet10.txt	28223	29.971	383.243	54.463
U:plrabn12.txt	23286	29.971	357.034	62.431
U:ptt5	30076	29.971	491.148	16.283
U:sum	283674	29.973	345.151	55.267
U:xargs.1	2957917	29.973	397.819	58.576

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	25879	29.97	125.246	56.998
U:asyoulik.txt	31142	29.972	124.04	60.913
U:cp.html	213466	29.972	167.109	47.641
U:fields.c	458366	29.973	162.615	42.197
U:grammar.lsp	1609544	29.973	190.563	48.804
U:kennedy.xls	7282	29.974	238.584	35.118
U:lcet10.txt	9544	29.973	129.59	54.901
U:plrabn12.txt	7767	29.973	119.083	64.214
U:ptt5	19014	29.973	310.483	16.991
U:sum	148586	29.973	180.789	47.191
U:xargs.1	1280883	29.973	172.272	58.316

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	127935	29.973	619.092	41.877
U:asyoulik.txt	156256	29.973	622.356	47.067
U:cp.html	1061318	29.973	830.804	42.036
U:fields.c	2219307	29.972	787.363	37.955
U:grammar.lsp	6650076	29.972	787.343	46.439
U:kennedy.xls	32212	29.972	1055.44	31.483
U:lcet10.txt	45381	29.973	616.207	38.864
U:plrabn12.txt	38297	29.972	587.187	47.215
U:ptt5	98998	29.972	1499.9	13.094
U:sum	787302	29.972	957.939	42.751
U:xargs.1	5689041	29.973	765.148	57.109

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	22918	29.974	110.898	46.73
U:asyoulik.txt	26008	29.974	103.584	51.222
U:cp.html	143860	29.974	112.613	40.377
U:fields.c	331059	29.972	117.452	34.996
U:grammar.lsp	823397	29.974	97.483	41.602
U:kennedy.xls	5382	29.977	176.314	34.142
U:lcet10.txt	8647	29.974	117.407	43.398
U:plrabn12.txt	6108	30	93.561	54.016
U:ptt5	14309	29.96	233.758	14.781
U:sum	89314	29.974	108.668	40.902
U:xargs.1	592607	29.972	79.703	52.07

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	28535	29.97	138.1	35.767
U:asyoulik.txt	32820	29.974	130.717	39.057
U:cp.html	192981	29.974	151.065	32.333
U:fields.c	447247	29.974	158.666	27.946
U:grammar.lsp	1012278	29.973	119.846	32.679
U:kennedy.xls	8153	29.973	267.125	19.809
U:lcet10.txt	10767	29.973	146.197	33.954
U:plrabn12.txt	8350	29.972	128.024	40.521
U:ptt5	19389	29.971	316.635	11.001
U:sum	120892	29.974	147.088	33.954
U:xargs.1	775416	29.974	104.285	40.927

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	3118	29.975	15.088	28.429
U:asyoulik.txt	3628	29.975	14.449	31.644
U:cp.html	17666	29.959	13.836	31.008
U:fields.c	38698	29.973	13.729	27.256
U:grammar.lsp	84827	29.973	10.043	34.507
U:kennedy.xls	774	30.002	25.335	11.988
U:lcet10.txt	1208	29.994	16.391	27.343
U:plrabn12.txt	964	29.983	14.775	32.6
U:ptt5	2008	29.979	32.783	9.696
U:sum	11105	29.974	13.511	33.768
U:xargs.1	70300	29.973	9.455	41.708

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:alice29.txt	3770	29.98	18.239	31.874
U:asyoulik.txt	4126	29.973	16.433	35.555
U:cp.html	21627	29.974	16.929	30.886
U:fields.c	55610	29.973	19.728	26.753
U:grammar.lsp	132458	29.973	15.682	33.539
U:kennedy.xls	1019	29.971	33.389	5.341
U:lcet10.txt	1563	29.988	21.212	27.985
U:plrabn12.txt	1163	29.995	17.818	34.319
U:ptt5	2987	29.977	48.77	7.96
U:sum	15594	29.973	18.973	24.66
U:xargs.1	95807	29.972	12.886	41.803

Results Per Test

Generated using Japex version 1.2.2