Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-quicklz-roundtrip.xml
chartType: barchart
dateTime: 20 Nov 2011/20:00:10 PST
hostName: TS-MacMini.local
inputDir: testdata/quicklz
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 5
reportsDirectory: reports/quicklz-roundtrip
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Apple Inc. 20.4-b02-402
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
Snappy(JNI)/block	85.433	52.952	82.471	48.834	80.205	45.036	true
Snappy(iq80)/block	96.4	52.952	93.18	48.834	90.603	45.036	n/a
LZF/block	73.419	52.702	70.624	48.56	68.028	44.623	n/a
LZF/stream	76.635	52.702	73.839	48.56	71.239	44.623	n/a
LZO-java/block	62.599	52.794	56.445	47.237	52.201	42.466	n/a
LZO-java/stream	77.029	52.794	70.969	47.237	66.207	42.466	n/a
QuickLZ/L1/block	44.579	47.811	42.205	43.485	39.814	39.615	n/a
QuickLZ/L3/block	10.329	39.945	3.429	36.555	0.087	33.565	n/a
Gzip/JDK/stream	13.68	33.241	13.358	29.912	13.08	27.17	n/a
Gzip/jzlib/stream	12.876	33.517	12.433	30.223	12.04	27.476	n/a
BZip2/stream	4.175	25.953	4.123	23.926	4.078	22.113	n/a
LZMA-orig/block	0.748	21.946	0.717	19.076	0.685	17.02	n/a
LZMA-java/stream	1.354	25.851	1.304	22.856	1.255	20.405	n/a

Driver: Snappy(JNI)/block

Snappy-java, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	374	29.977	70.47	90.657
R:gdb.exe	257	30.076	72.303	51.066
R:northwind.mdf	1548	29.964	135.613	26.392
R:plaintext.txt	768	29.963	70.875	56.197
R:proteins.txt	338	30.018	77.904	40.448

Driver: Snappy(iq80)/block

Snappy-iq80, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	396	29.976	74.618	90.657
R:gdb.exe	293	30.01	82.613	51.066
R:northwind.mdf	1708	29.953	149.686	26.392
R:plaintext.txt	872	29.986	80.412	56.197
R:proteins.txt	410	29.964	94.669	40.448

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	253	30.016	47.61	87.959
R:gdb.exe	239	29.976	67.465	51.894
R:northwind.mdf	1245	29.979	109.015	25.897
R:plaintext.txt	670	29.994	61.768	59.122
R:proteins.txt	352	29.979	81.235	38.637

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	269	30.021	50.613	87.959
R:gdb.exe	253	30.016	71.321	51.894
R:northwind.mdf	1285	29.977	112.525	25.897
R:plaintext.txt	685	29.987	63.166	59.122
R:proteins.txt	371	30.004	85.548	38.637

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	661	29.975	124.558	100.255
R:gdb.exe	134	30.116	37.649	48.129
R:northwind.mdf	706	29.967	61.843	23.41
R:plaintext.txt	466	30.004	42.946	52.578
R:proteins.txt	200	30.081	46	39.599

Driver: LZO-java/stream

LZO-java, streaming

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	729	29.984	137.329	100.255
R:gdb.exe	191	30.022	53.832	48.129
R:northwind.mdf	1005	29.981	87.992	23.41
R:plaintext.txt	505	29.967	46.598	52.578
R:proteins.txt	258	30.054	59.393	39.599

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver1
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	130	30.06	24.428	85.832
R:gdb.exe	145	30.1	40.762	45.717
R:northwind.mdf	765	29.982	66.977	22.551
R:plaintext.txt	415	29.963	38.298	49.348
R:proteins.txt	228	30.086	52.431	35.608

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	56	30.291	10.443	71.76
R:gdb.exe	48	30.32	13.395	40.151
R:northwind.mdf	34	5087.956	0.018	19.417
R:plaintext.txt	151	29.985	13.925	35.879
R:proteins.txt	61	30.44	13.865	32.517

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	71	30.232	13.265	63.107
R:gdb.exe	39	30.323	10.883	33.493
R:northwind.mdf	225	30.054	19.652	15.799
R:plaintext.txt	147	30.161	13.477	29.476
R:proteins.txt	49	30.479	11.123	24.328

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

classPath: build/classes lib/jzlib/*.jar
driverClass: com.ning.jcbm.gzip.JCraftGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	47	30.289	8.765	63.111
R:gdb.exe	40	30.563	11.074	33.813
R:northwind.mdf	222	30.018	19.413	15.922
R:plaintext.txt	132	30.089	12.131	29.994
R:proteins.txt	57	30.338	12.999	24.745

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	20	30.497	3.704	43.284
R:gdb.exe	14	31.568	3.753	30.994
R:northwind.mdf	64	30.143	5.573	14.168
R:plaintext.txt	43	30.647	3.88	24.445
R:proteins.txt	18	31.426	3.963	16.875

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	5	35.201	0.802	46.066
R:gdb.exe	3	33.579	0.756	20.829
R:northwind.mdf	13	31.038	1.099	10.675
R:plaintext.txt	7	30.378	0.637	19.529
R:proteins.txt	2	31.108	0.445	12.63

Driver: LZMA-java/stream

LZMA-java, streaming

classPath: build/classes lib/lzma-java/*.jar
driverClass: com.ning.jcbm.lzma.LzmaJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:flower.bmp	8	33.941	1.331	49.73
R:gdb.exe	5	35.826	1.181	25.751
R:northwind.mdf	23	30.445	1.983	12.212
R:plaintext.txt	16	30.967	1.429	26.524
R:proteins.txt	4	32.735	0.845	15.036

Results Per Test

Generated using Japex version 1.2.2