Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-calgary-roundtrip.xml
chartType: barchart
dateTime: 23 Nov 2011/18:32:52 PST
hostName: TS-MacMini.local
inputDir: testdata/calgary
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/calgary-roundtrip
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Apple Inc. 20.4-b02-402
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
Snappy(JNI)/block	78.456	54.646	75.472	52.052	73.301	48.678	true
Snappy(iq80)/block	90.185	54.646	87.171	52.052	84.861	48.678	n/a
LZF/block	74.316	52.407	72.345	49.899	70.794	46.429	n/a
LZF/stream	75.791	52.407	73.55	49.899	71.846	46.429	n/a
LZO-java/block	46.449	52.669	44.781	49.904	43.554	46.405	n/a
LZO-java/stream	53.935	52.669	49.466	49.904	46.968	46.405	n/a
QuickLZ/L1/block	35.444	50.391	33.533	47.878	31.951	44.619	n/a
QuickLZ/L3/block	13.964	43.566	13.579	41.12	13.257	38.154	n/a
Gzip/JDK/stream	13.582	35.042	12.801	32.894	11.876	30.274	n/a
Gzip/jzlib/stream	11.857	35.346	11.23	33.221	10.628	30.622	n/a
BZip2/stream	3.681	31.604	3.498	29.668	3.367	27.289	n/a
LZMA-orig/block	1.109	30.89	1.088	28.822	1.062	25.945	n/a
LZMA-java/stream	1.403	31.87	1.386	29.829	1.373	26.938	n/a

Driver: Snappy(JNI)/block

Snappy-java, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	18992	29.961	67.261	55.445
R:book1	2342	29.958	57.316	68.25
R:book2	3269	29.962	63.559	56.758
R:geo	36501	29.961	118.973	95.636
R:news	5695	29.965	68.352	59.775
R:obj1	123305	29.961	84.401	61.221
R:obj2	9945	29.962	78.128	49.794
R:paper1	38597	29.961	65.311	55.332
R:paper2	23374	29.962	61.154	59.339
R:paper3	40912	29.962	60.587	62.006
R:paper4	150704	29.952	63.753	61.749
R:paper5	169336	29.962	64.431	60.842
R:paper6	55054	29.962	66.774	53.906
R:pic	10097	29.963	164.932	18.21
R:progc	54466	29.962	68.671	52.258
R:progl	36118	29.962	82.367	37.93
R:progp	54406	29.961	85.512	37.121
R:trans	30422	29.962	90.726	38.058

Driver: Snappy(iq80)/block

Snappy-iq80, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	21916	29.962	77.613	55.445
R:book1	2680	29.965	65.572	68.25
R:book2	3885	29.966	75.526	56.758
R:geo	40821	29.961	133.052	95.636
R:news	6384	29.965	76.621	59.775
R:obj1	130934	29.959	89.628	61.221
R:obj2	11269	29.962	88.529	49.794
R:paper1	46163	29.961	78.114	55.332
R:paper2	27815	29.962	72.774	59.339
R:paper3	48264	29.962	71.475	62.006
R:paper4	169206	29.961	71.557	61.749
R:paper5	188606	29.961	71.764	60.842
R:paper6	65693	29.961	79.679	53.906
R:pic	10828	29.964	176.868	18.21
R:progc	64132	29.961	80.86	52.258
R:progl	44826	29.961	102.227	37.93
R:progp	66183	29.961	104.024	37.121
R:trans	36026	29.961	107.441	38.058

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	18543	29.962	65.668	53.88
R:book1	2486	29.972	60.812	62.647
R:book2	3391	29.965	65.925	54.604
R:geo	15016	29.961	48.943	90.913
R:news	5308	29.965	63.706	56.901
R:obj1	103114	29.96	70.581	61.142
R:obj2	9153	29.964	71.901	49.695
R:paper1	41004	29.961	69.384	52.725
R:paper2	24823	29.961	64.948	56.491
R:paper3	43845	29.961	64.933	57.918
R:paper4	159703	29.961	67.539	58.513
R:paper5	178466	29.961	67.907	58.357
R:paper6	58034	29.961	70.389	51.815
R:pic	8781	29.962	143.442	16.283
R:progc	57123	29.961	72.023	50.307
R:progl	38719	29.961	88.299	37.135
R:progp	59281	29.961	93.175	35.77
R:trans	29544	29.962	88.109	38.226

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	18689	29.96	66.189	53.88
R:book1	2523	29.969	61.723	62.647
R:book2	3485	29.963	67.757	54.604
R:geo	15426	29.952	50.295	90.913
R:news	5404	29.959	64.872	56.901
R:obj1	100582	29.96	68.848	61.142
R:obj2	9195	29.96	72.24	49.695
R:paper1	40651	29.937	68.842	52.725
R:paper2	25602	29.951	67.008	56.491
R:paper3	42841	29.939	63.491	57.918
R:paper4	161765	29.961	68.412	58.513
R:paper5	182673	29.961	69.507	58.357
R:paper6	58975	29.961	71.531	51.815
R:pic	9325	29.961	152.332	16.283
R:progc	57948	29.961	73.063	50.307
R:progl	40223	29.961	91.729	37.135
R:progp	60103	29.962	94.466	35.77
R:trans	30823	29.961	91.925	38.226

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	11956	29.961	42.343	52.3
R:book1	1536	29.965	37.582	64.587
R:book2	2150	29.961	41.804	54.299
R:geo	27861	29.96	90.814	98.392
R:news	3440	29.956	41.299	57.396
R:obj1	65530	29.96	44.856	60.114
R:obj2	5690	29.963	44.698	47.691
R:paper1	21837	30.012	36.889	53.024
R:paper2	14482	29.951	37.904	56.682
R:paper3	25455	29.949	37.713	58.363
R:paper4	83128	29.96	35.155	60.477
R:paper5	91340	29.96	34.756	59.637
R:paper6	33692	29.958	40.869	51.382
R:pic	4788	29.965	78.206	16.991
R:progc	31492	29.96	39.707	49.966
R:progl	20888	29.946	47.659	37.346
R:progp	31657	29.961	49.758	34.899
R:trans	18131	29.962	54.071	34.505

Driver: LZO-java/stream

LZO-java, streaming

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	11959	29.959	42.355	52.3
R:book1	1544	29.964	37.778	64.587
R:book2	2129	29.953	41.408	54.299
R:geo	50292	29.961	163.926	98.392
R:news	3602	29.961	43.238	57.396
R:obj1	69661	29.952	47.696	60.114
R:obj2	6474	29.963	50.858	47.691
R:paper1	24938	29.945	42.221	53.024
R:paper2	15579	29.96	40.762	56.682
R:paper3	26222	29.96	38.835	58.363
R:paper4	87168	29.96	36.865	60.477
R:paper5	95910	29.96	36.495	59.637
R:paper6	35134	29.959	42.616	51.382
R:pic	5745	29.964	93.839	16.991
R:progc	34254	29.96	43.19	49.966
R:progl	24152	29.961	55.079	37.346
R:progp	35059	29.96	55.107	34.899
R:trans	19633	29.961	58.553	34.505

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver1
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	9824	29.961	34.791	48.719
R:book1	1408	29.965	34.45	60.88
R:book2	1907	29.971	37.067	51.648
R:geo	7838	29.964	25.545	85.732
R:news	2933	29.958	35.21	53.256
R:obj1	35642	29.958	24.399	59.561
R:obj2	5015	29.961	39.399	45.079
R:paper1	18525	29.967	31.34	52.253
R:paper2	12569	29.962	32.885	55.485
R:paper3	19864	29.962	29.417	58.277
R:paper4	49875	29.959	21.094	59.612
R:paper5	48064	29.949	18.296	59.219
R:paper6	24809	29.961	30.091	51.455
R:pic	4951	29.965	80.868	16.852
R:progc	24624	29.956	31.052	49.13
R:progl	18661	29.962	42.555	35.818
R:progp	25963	29.96	40.809	33.925
R:trans	16337	29.961	48.723	30.138

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	3854	29.965	13.647	39.534
R:book1	410	29.988	10.024	53.581
R:book2	594	29.971	11.546	42.955
R:geo	3038	29.97	9.899	79.199
R:news	1021	29.986	12.245	45.733
R:obj1	19657	29.961	13.455	54.157
R:obj2	1871	29.963	14.698	39.541
R:paper1	7575	29.963	12.817	44.164
R:paper2	4575	29.952	11.974	47.04
R:paper3	8172	29.961	12.102	50.217
R:paper4	27061	29.961	11.444	52.928
R:paper5	30256	29.962	11.512	52.434
R:paper6	10982	29.945	13.327	43.923
R:pic	1507	29.978	24.605	14.781
R:progc	11041	29.963	13.92	42.041
R:progl	7367	29.962	16.8	28.846
R:progp	11029	29.964	17.333	28.237
R:trans	6709	29.964	20.007	24.868

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	3303	29.962	11.697	31.657
R:book1	319	29.99	7.798	40.789
R:book2	526	29.977	10.222	33.831
R:geo	1400	29.975	4.561	66.823
R:news	981	29.984	11.767	38.396
R:obj1	24039	29.962	16.454	47.949
R:obj2	1427	29.978	11.204	33.02
R:paper1	7581	29.963	12.827	34.898
R:paper2	3827	29.965	10.012	36.198
R:paper3	7438	29.962	11.015	38.843
R:paper4	36324	29.961	15.361	41.48
R:paper5	42872	29.961	16.313	41.576
R:paper6	11418	29.962	13.848	34.893
R:pic	1417	29.966	23.145	11.001
R:progc	11200	29.961	14.121	33.67
R:progl	6730	29.964	15.347	22.68
R:progp	11610	29.962	18.248	22.726
R:trans	6887	29.962	20.539	20.32

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

classPath: build/classes lib/jzlib/*.jar
driverClass: com.ning.jcbm.gzip.JCraftGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	3177	29.967	11.249	32.309
R:book1	335	30.009	8.184	41.427
R:book2	524	30.006	10.173	34.274
R:geo	1469	29.963	4.788	67.149
R:news	827	29.995	9.916	38.605
R:obj1	15658	29.961	10.718	47.949
R:obj2	1392	29.969	10.933	33.519
R:paper1	6626	29.961	11.212	35.131
R:paper2	3770	29.968	9.862	36.685
R:paper3	6706	29.96	9.931	39.036
R:paper4	23257	29.96	9.836	41.653
R:paper5	26161	29.96	9.955	41.651
R:paper6	9459	29.964	11.472	35.079
R:pic	1484	29.966	24.239	11.178
R:progc	9546	29.963	12.035	33.849
R:progl	6589	29.965	15.025	23.038
R:progp	10280	29.961	16.158	22.99
R:trans	5948	29.964	17.737	20.712

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	1099	29.986	3.889	24.615
R:book1	152	29.994	3.715	33.322
R:book2	199	30.05	3.858	28.307
R:geo	1017	29.975	3.313	55.537
R:news	311	29.997	3.729	33.564
R:obj1	3532	29.967	2.417	50.219
R:obj2	486	29.992	3.814	31.825
R:paper1	2041	29.961	3.454	31.156
R:paper2	1371	29.96	3.587	30.506
R:paper3	2239	29.967	3.315	34.086
R:paper4	5409	29.96	2.288	39.049
R:paper5	5720	29.963	2.176	40.43
R:paper6	2675	29.968	3.244	32.295
R:pic	568	29.971	9.276	9.696
R:progc	2564	29.964	3.232	31.648
R:progl	1604	29.965	3.657	21.743
R:progp	2269	29.963	3.566	21.748
R:trans	1250	29.983	3.725	19.13

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	283	29.998	1.001	27.453
R:book1	35	30.159	0.851	33.96
R:book2	47	30.475	0.898	27.794
R:geo	412	29.972	1.342	51.952
R:news	85	29.983	1.02	31.514
R:obj1	2019	29.966	1.382	43.694
R:obj2	130	30.124	1.016	24.871
R:paper1	705	29.976	1.192	32.43
R:paper2	443	29.984	1.158	33.086
R:paper3	851	29.97	1.26	36.61
R:paper4	3176	29.969	1.343	40.351
R:paper5	3560	29.965	1.354	40.572
R:paper6	1021	29.984	1.237	32.712
R:pic	37	30.673	0.59	7.96
R:progc	983	29.986	1.238	31.597
R:progl	420	29.971	0.958	20.829
R:progp	716	29.967	1.125	20.881
R:trans	336	30.046	0.999	17.76

Driver: LZMA-java/stream

LZMA-java, streaming

classPath: build/classes lib/lzma-java/*.jar
driverClass: com.ning.jcbm.lzma.LzmaJavaDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
R:bib	361	30.038	1.275	29.049
R:book1	51	30.539	1.224	38.342
R:book2	64	30.047	1.241	31.421
R:geo	437	29.987	1.423	51.931
R:news	120	30.145	1.432	35.817
R:obj1	2279	29.961	1.56	43.61
R:obj2	185	30.066	1.448	25.933
R:paper1	765	29.983	1.294	32.725
R:paper2	468	29.982	1.224	33.857
R:paper3	847	29.979	1.254	36.689
R:paper4	3006	29.962	1.271	40.313
R:paper5	3348	29.966	1.274	40.514
R:paper6	1076	29.978	1.304	32.71
R:pic	143	30.029	2.331	8.368
R:progc	1048	29.967	1.321	31.602
R:progl	615	30.011	1.4	21.065
R:progp	899	29.964	1.413	21.199
R:trans	525	29.985	1.565	18.516

Results Per Test

Generated using Japex version 1.2.2