Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-calgary-uncompress.xml
chartType: barchart
dateTime: 07 Jun 2013/22:53:13 PDT
hostName: TS-MacMini.local
inputDir: testdata/calgary
numberOfCpus: 2
numberOfThreads: 1
osArchitecture: x86_64
osName: Mac OS X
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/calgary-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Oracle Corporation 23.6-b04
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	786.224	53.919	764.22	51.136	748.051	47.415	n/a
LZ4 (Java+Unsafe)/block	543.484	53.919	521.211	51.136	505.821	47.415	n/a
Snappy(JNI)/block	460.999	54.646	436.571	52.052	419.968	48.678	true
Snappy(iq80)/block	472.899	54.646	454.041	52.052	440.175	48.678	n/a
LZF/block	437.639	52.406	434.747	49.898	431.807	46.429	n/a
LZF/stream	402.151	52.406	399.5	49.898	396.828	46.429	n/a
LZO-java/block	175.003	52.669	164.415	49.904	157.444	46.405	n/a
LZ4 HC (JNI)/block	793.916	43.336	774.073	40.538	758.421	37.137	n/a
QuickLZ/L3/block	121.72	43.566	117.035	41.12	113.375	38.154	n/a
Gzip/JDK/stream	154.387	35.042	147.926	32.894	142.735	30.274	n/a
BZip2/stream	15.428	31.604	14.925	29.668	14.538	27.289	n/a
LZMA-orig/block	19.486	30.89	18.247	28.822	17.286	25.945	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	192683	29.961	682.393	52.188
U:book1	27097	29.967	662.944	66.935
U:book2	33454	29.969	650.292	55.37
U:geo	498442	29.973	1499.9	94.989
U:news	62080	29.972	744.896	57.688
U:obj1	1339617	29.974	916.561	60.152
U:obj2	97460	29.972	765.376	48.723
U:paper1	389869	29.973	659.449	54.433
U:paper2	248713	29.973	650.471	59.097
U:paper3	434212	29.973	642.783	60.822
U:paper4	1682566	29.973	711.262	63.812
U:paper5	1844834	29.974	701.669	62.406
U:paper6	552939	29.973	670.394	54.095
U:pic	73576	29.973	1201.471	16.822
U:progc	535084	29.96	674.677	52.781
U:progl	318790	29.974	726.694	39.459
U:progp	479988	29.974	754.096	37.913
U:trans	280669	29.974	836.697	32.864

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	128523	29.973	454.976	52.188
U:book1	16235	29.972	397.136	66.935
U:book2	21918	29.972	426.019	55.37
U:geo	372049	29.973	1212.185	94.989
U:news	39061	29.972	468.695	57.688
U:obj1	976638	29.974	668.21	60.152
U:obj2	64598	29.97	507.336	48.723
U:paper1	266190	29.974	450.238	54.433
U:paper2	163970	29.973	428.843	59.097
U:paper3	285909	29.974	423.234	60.822
U:paper4	1111656	29.971	469.967	63.812
U:paper5	1281232	29.973	487.319	62.406
U:paper6	381429	29.974	462.436	54.095
U:pic	49014	29.972	800.396	16.822
U:progc	369245	29.974	465.361	52.781
U:progl	228945	29.973	521.899	39.459
U:progp	342574	29.974	538.211	37.913
U:trans	201349	29.974	600.242	32.864

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	110663	29.971	391.776	55.445
U:book1	12561	29.973	307.255	68.25
U:book2	18527	29.972	360.107	56.758
U:geo	334501	29.973	1089.841	95.636
U:news	32719	29.972	392.599	59.775
U:obj1	783204	29.973	535.87	61.221
U:obj2	57299	29.973	449.976	49.794
U:paper1	218909	29.973	370.273	55.332
U:paper2	131454	29.973	343.799	59.339
U:paper3	230116	29.974	340.647	62.006
U:paper4	869222	29.973	367.441	61.749
U:paper5	967355	29.971	367.959	60.842
U:paper6	316062	29.974	383.189	53.906
U:pic	46698	29.972	762.57	18.21
U:progc	304805	29.972	384.169	52.258
U:progl	202545	29.973	461.719	37.93
U:progp	305111	29.973	479.363	37.121
U:trans	170885	29.974	509.428	38.058

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	114433	29.97	405.143	55.445
U:book1	13182	29.972	322.449	68.25
U:book2	19864	29.971	386.1	56.758
U:geo	298664	29.973	973.081	95.636
U:news	33242	29.972	398.875	59.775
U:obj1	744393	29.973	509.314	61.221
U:obj2	58288	29.973	457.743	49.794
U:paper1	236589	29.973	400.179	55.332
U:paper2	142727	29.973	373.284	59.339
U:paper3	247123	29.973	365.826	62.006
U:paper4	908357	29.969	384.045	61.749
U:paper5	1023459	29.974	389.266	60.842
U:paper6	335515	29.974	406.776	53.906
U:pic	47464	29.972	775.084	18.21
U:progc	330597	29.973	416.659	52.258
U:progl	217274	29.973	495.294	37.93
U:progp	332229	29.974	521.965	37.121
U:trans	178152	29.973	531.092	38.058

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	116149	29.965	411.287	53.879
U:book1	15883	29.97	388.55	62.646
U:book2	21632	29.971	420.465	54.603
U:geo	98428	29.973	320.693	90.913
U:news	33496	29.971	401.932	56.899
U:obj1	625840	29.973	428.205	61.142
U:obj2	54705	29.972	429.612	49.693
U:paper1	260176	29.968	440.152	52.725
U:paper2	162284	29.973	424.436	56.491
U:paper3	281059	29.973	416.068	57.918
U:paper4	1014640	29.973	428.919	58.513
U:paper5	1122008	29.973	426.754	58.357
U:paper6	362096	29.966	439.12	51.815
U:pic	32868	29.972	536.736	16.283
U:progc	343768	29.973	433.264	50.307
U:progl	221291	29.972	504.471	37.134
U:progp	329649	29.973	517.918	35.77
U:trans	170711	29.973	508.913	38.221

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	106728	29.972	377.836	53.879
U:book1	14614	29.969	357.512	62.646
U:book2	19878	29.971	386.379	54.603
U:geo	91255	29.972	297.329	90.913
U:news	30675	29.971	368.084	56.899
U:obj1	579761	29.973	396.683	61.142
U:obj2	50161	29.972	393.934	49.693
U:paper1	236626	29.972	400.258	52.725
U:paper2	147969	29.973	387.002	56.491
U:paper3	254972	29.972	377.457	57.918
U:paper4	929940	29.972	393.127	58.513
U:paper5	1031432	29.97	392.347	58.357
U:paper6	334596	29.972	405.688	51.815
U:pic	30632	29.971	500.237	16.283
U:progc	320522	29.972	403.972	50.307
U:progl	203335	29.973	463.527	37.134
U:progp	299222	29.973	470.117	35.77
U:trans	156725	29.973	467.225	38.221

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	39878	29.97	141.185	52.3
U:book1	4825	29.975	118.016	64.587
U:book2	6695	29.971	130.132	54.299
U:geo	130778	29.972	426.107	98.392
U:news	11847	29.971	142.159	57.396
U:obj1	297946	29.973	203.86	60.114
U:obj2	21314	29.973	167.378	47.691
U:paper1	80016	29.972	135.348	53.024
U:paper2	48763	29.972	127.537	56.682
U:paper3	85281	29.972	126.25	58.363
U:paper4	338863	29.972	143.251	60.477
U:paper5	388141	29.972	147.632	59.637
U:paper6	114960	29.972	139.383	51.382
U:pic	19230	29.971	314.04	16.991
U:progc	113556	29.971	143.13	49.966
U:progl	74667	29.973	170.213	37.346
U:progp	114395	29.973	179.73	34.899
U:trans	65311	29.973	194.705	34.505

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	198987	29.973	704.433	36.093
U:book1	23797	29.972	582.116	47.247
U:book2	32040	29.972	622.758	38.875
U:geo	274978	29.973	895.916	83.655
U:news	57256	29.972	687.024	44.002
U:obj1	1357356	29.973	928.715	57.445
U:obj2	104060	29.972	817.216	39.334
U:paper1	409472	29.973	692.6	43.538
U:paper2	247159	29.973	646.417	43.846
U:paper3	444424	29.973	657.912	49.222
U:paper4	1705211	29.973	720.852	56.255
U:paper5	1884210	29.973	716.656	56.266
U:paper6	591537	29.973	717.187	44.821
U:pic	101328	29.972	1499.9	13.094
U:progc	565865	29.972	713.206	43.549
U:progl	364937	29.973	831.912	28.953
U:progp	565218	29.973	888.028	29.101
U:trans	324586	29.973	967.644	24.753

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	35487	29.974	125.625	39.534
U:book1	4316	29.977	105.557	53.581
U:book2	6043	29.976	117.441	42.955
U:geo	23592	29.973	76.866	79.199
U:news	9445	29.974	113.326	45.733
U:obj1	132272	29.972	90.505	54.157
U:obj2	15260	29.974	119.832	39.541
U:paper1	65228	29.973	110.331	44.164
U:paper2	41779	29.974	109.266	47.04
U:paper3	69196	29.973	102.435	50.217
U:paper4	213467	29.973	90.238	52.928
U:paper5	240522	29.974	91.481	52.434
U:paper6	89011	29.974	107.917	43.923
U:pic	15457	29.973	252.401	14.781
U:progc	88296	29.972	111.288	42.041
U:progl	65421	29.973	149.133	28.846
U:progp	93337	29.973	146.645	28.237
U:trans	57243	29.971	170.664	24.868

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	43459	29.973	153.846	31.657
U:book1	5145	29.974	125.845	40.789
U:book2	7423	29.972	144.28	33.831
U:geo	27443	29.973	89.413	66.823
U:news	11024	29.972	132.28	38.396
U:obj1	174468	29.973	119.372	47.949
U:obj2	19453	29.973	152.764	33.02
U:paper1	83747	29.973	141.655	34.898
U:paper2	52197	29.973	136.517	36.198
U:paper3	87378	29.973	129.348	38.843
U:paper4	276575	29.973	116.917	41.48
U:paper5	305480	29.973	116.189	41.576
U:paper6	115797	29.973	140.393	34.893
U:pic	19308	29.974	315.282	11.001
U:progc	114138	29.973	143.852	33.67
U:progl	87164	29.971	198.713	22.68
U:progp	125968	29.973	197.912	22.726
U:trans	75264	29.973	224.377	20.32

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	4756	29.975	16.835	24.615
U:book1	602	30.014	14.705	33.322
U:book2	828	29.99	16.084	28.307
U:geo	3395	29.974	11.061	55.537
U:news	1200	29.972	14.399	33.564
U:obj1	15544	29.974	10.635	50.219
U:obj2	1896	29.978	14.887	31.825
U:paper1	8522	29.973	14.415	31.156
U:paper2	5651	29.973	14.78	30.506
U:paper3	9148	29.975	13.541	34.086
U:paper4	27572	29.972	11.656	39.049
U:paper5	30133	29.973	11.461	40.43
U:paper6	11474	29.971	13.912	32.295
U:pic	1965	29.98	32.08	9.696
U:progc	11140	29.972	14.041	31.648
U:progl	7599	29.975	17.322	21.743
U:progp	11027	29.974	17.324	21.748
U:trans	6229	29.975	18.568	19.13

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	5490	29.977	19.432	27.453
U:book1	723	29.975	17.684	33.96
U:book2	1053	29.987	20.456	27.794
U:geo	2916	29.978	9.499	51.952
U:news	1491	29.977	17.888	31.514
U:obj1	18859	29.974	12.903	43.694
U:obj2	2523	29.983	19.807	24.871
U:paper1	9976	29.973	16.874	32.43
U:paper2	6408	29.975	16.759	33.086
U:paper3	10185	29.975	15.076	36.61
U:paper4	31175	29.973	13.178	40.351
U:paper5	34760	29.972	13.222	40.572
U:paper6	13591	29.973	16.478	32.712
U:pic	2930	29.975	47.842	7.96
U:progc	13404	29.973	16.894	31.597
U:progl	10672	29.974	24.327	20.829
U:progp	15613	29.973	24.53	20.881
U:trans	9359	29.976	27.898	17.76

Results Per Test

Generated using Japex version 1.2.2