Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-quicklz-roundtrip.xml
chartType: barchart
dateTime: 08 Jun 2013/22:58:19 PDT
hostName: TS-MacMini.local
inputDir: testdata/quicklz
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 5
reportsDirectory: reports/quicklz-roundtrip
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Oracle Corporation 23.6-b04
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	188.511	51.599	180.921	47.31	175.074	43.239	n/a
LZ4 (Java+Unsafe)/block	134.599	51.599	128.406	47.31	123.525	43.239	n/a
Snappy(JNI)/block	108.978	52.952	104.997	48.834	101.971	45.036	true
Snappy(iq80)/block	108.822	52.952	104.411	48.834	100.841	45.036	n/a
LZF/block	98.305	52.7	92.469	48.558	86.832	44.621	n/a
LZF/stream	93.428	52.7	87.91	48.558	82.589	44.621	n/a
LZO-java/block	100.032	52.794	83.314	47.237	73.572	42.466	n/a
LZ4 HC (JNI)/block	17.119	38.043	16.343	34.627	15.432	31.686	n/a
QuickLZ/L3/block	14.489	39.945	14.185	36.555	13.901	33.565	n/a
Gzip/JDK/stream	14.047	33.241	13.681	29.912	13.381	27.17	n/a
BZip2/stream	4.4	25.953	4.349	23.926	4.305	22.113	n/a
LZMA-orig/block	0.78	21.946	0.748	19.076	0.715	17.02	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	790	29.987	148.807	89.578
R:gdb.exe	582	29.958	164.386	51.231
R:northwind.mdf	3492	29.968	305.873	24.051
R:plaintext.txt	1580	29.966	145.796	51.183
R:proteins.txt	770	29.981	177.692	41.952

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	521	29.984	98.148	89.578
R:gdb.exe	413	30.025	116.392	51.231
R:northwind.mdf	2524	29.973	221.051	24.051
R:plaintext.txt	1110	29.979	102.383	51.183
R:proteins.txt	585	29.976	135.021	41.952

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	483	29.977	91.011	90.657
R:gdb.exe	333	30.001	93.922	51.066
R:northwind.mdf	1997	29.976	174.877	26.392
R:plaintext.txt	947	29.983	87.337	56.197
R:proteins.txt	424	30.011	97.746	40.448

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	423	29.967	79.73	90.657
R:gdb.exe	329	30.006	92.776	51.066
R:northwind.mdf	1975	29.967	173.005	26.392
R:plaintext.txt	937	29.956	86.492	56.197
R:proteins.txt	486	29.993	112.106	40.448

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	287	30.019	54.003	87.958
R:gdb.exe	318	29.983	89.744	51.892
R:northwind.mdf	1725	29.971	151.086	25.895
R:plaintext.txt	839	29.977	77.391	59.121
R:proteins.txt	517	29.983	119.3	38.636

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	274	30.032	51.535	87.958
R:gdb.exe	302	30.051	85.036	51.892
R:northwind.mdf	1637	29.972	143.369	25.895
R:plaintext.txt	797	29.987	73.492	59.121
R:proteins.txt	493	29.997	113.707	38.636

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	1260	29.986	237.346	100.255
R:gdb.exe	202	30.057	56.866	48.129
R:northwind.mdf	1039	29.986	90.953	23.41
R:plaintext.txt	558	29.968	51.487	52.578
R:proteins.txt	276	30.067	63.51	39.599

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	111	29.997	20.901	69.3
R:gdb.exe	56	30.014	15.787	40.081
R:northwind.mdf	202	29.988	17.682	18.437
R:plaintext.txt	241	29.97	22.236	32.268
R:proteins.txt	39	30.027	8.986	30.127

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	57	30.499	10.556	71.76
R:gdb.exe	48	30.028	13.526	40.151
R:northwind.mdf	229	30.068	19.992	19.417
R:plaintext.txt	154	30.022	14.184	35.879
R:proteins.txt	62	30.238	14.186	32.517

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	70	30.34	13.032	63.107
R:gdb.exe	41	30.301	11.449	33.493
R:northwind.mdf	239	30.05	20.878	15.799
R:plaintext.txt	145	30.017	13.357	29.476
R:proteins.txt	50	30.036	11.517	24.328

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	21	30.093	3.942	43.284
R:gdb.exe	14	29.955	3.955	30.994
R:northwind.mdf	67	30.204	5.823	14.168
R:plaintext.txt	45	30.185	4.122	24.445
R:proteins.txt	18	29.959	4.157	16.875

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	5	33.575	0.841	46.066
R:gdb.exe	3	32.134	0.79	20.829
R:northwind.mdf	13	29.979	1.138	10.675
R:plaintext.txt	8	33.185	0.667	19.529
R:proteins.txt	3	44.8	0.463	12.63

Results Per Test

Generated using Japex version 1.2.2