Skip to content

Commit 7a52ce7

Browse files
yaooqinnyaooqinn
committed
fix DateTimeBenchmark
1 parent 7759b80 commit 7a52ce7

File tree

9 files changed

+574
-1381
lines changed

9 files changed

+574
-1381
lines changed

‎sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt‎

Lines changed: 60 additions & 60 deletions
Large diffs are not rendered by default.

‎sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt‎

Lines changed: 196 additions & 238 deletions
Large diffs are not rendered by default.

‎sql/core/benchmarks/DateTimeBenchmark-results.txt‎

Lines changed: 217 additions & 217 deletions
Large diffs are not rendered by default.

‎sql/core/benchmarks/FilterPushdownBenchmark-results.txt‎

Lines changed: 66 additions & 633 deletions
Large diffs are not rendered by default.

‎sql/core/benchmarks/JsonBenchmark-jdk11-results.txt‎

Lines changed: 8 additions & 99 deletions
Original file line numberDiff line numberDiff line change
@@ -3,110 +3,19 @@ Benchmark for performance of JSON parsing
33
================================================================================================
44

55
Preparing data for benchmarking ...
6-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
7-
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
6+
Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Mac OS X 10.15.3
7+
Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz
88
JSON schema inferring: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
99
------------------------------------------------------------------------------------------------------------------------
10-
No encoding 84774 84927 264 1.2 847.7 1.0X
11-
UTF-8 is set 119081 120155 1773 0.8 1190.8 0.7X
10+
No encoding 48797 54900 516 2.0 488.0 1.0X
11+
UTF-8 is set 63167 63580 372 1.6 631.7 0.8X
1212

1313
Preparing data for benchmarking ...
14-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
15-
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
14+
Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Mac OS X 10.15.3
15+
Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz
1616
count a short column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
1717
------------------------------------------------------------------------------------------------------------------------
18-
No encoding 49293 49356 70 2.0 492.9 1.0X
19-
UTF-8 is set 80183 80211 25 1.2 801.8 0.6X
18+
No encoding 32247 32308 81 3.1 322.5 1.0X
19+
UTF-8 is set 45996 46027 27 2.2 460.0 0.7X
2020

2121
Preparing data for benchmarking ...
22-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
23-
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
24-
count a wide column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
25-
------------------------------------------------------------------------------------------------------------------------
26-
No encoding 61070 61476 536 0.2 6107.0 1.0X
27-
UTF-8 is set 109765 109881 102 0.1 10976.5 0.6X
28-
29-
Preparing data for benchmarking ...
30-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
31-
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
32-
select wide row: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
33-
------------------------------------------------------------------------------------------------------------------------
34-
No encoding 176999 178163 1008 0.0 353997.9 1.0X
35-
UTF-8 is set 201209 201641 614 0.0 402419.0 0.9X
36-
37-
Preparing data for benchmarking ...
38-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
39-
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
40-
Select a subset of 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
41-
------------------------------------------------------------------------------------------------------------------------
42-
Select 10 columns 18768 20587 496 0.5 1876.8 1.0X
43-
Select 1 column 22642 22644 3 0.4 2264.2 0.8X
44-
45-
Preparing data for benchmarking ...
46-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
47-
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
48-
creation of JSON parser per line: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
49-
------------------------------------------------------------------------------------------------------------------------
50-
Short column without encoding 7697 7738 55 1.3 769.7 1.0X
51-
Short column with UTF-8 14051 14189 176 0.7 1405.1 0.5X
52-
Wide column without encoding 108999 110075 1085 0.1 10899.9 0.1X
53-
Wide column with UTF-8 157433 157779 308 0.1 15743.3 0.0X
54-
55-
Preparing data for benchmarking ...
56-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
57-
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
58-
JSON functions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
59-
------------------------------------------------------------------------------------------------------------------------
60-
Text read 644 647 4 15.5 64.4 1.0X
61-
from_json 25859 25872 12 0.4 2585.9 0.0X
62-
json_tuple 31679 31761 71 0.3 3167.9 0.0X
63-
get_json_object 24772 25220 389 0.4 2477.2 0.0X
64-
65-
Preparing data for benchmarking ...
66-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
67-
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
68-
Dataset of json strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
69-
------------------------------------------------------------------------------------------------------------------------
70-
Text read 3135 3165 52 15.9 62.7 1.0X
71-
schema inferring 29383 29389 10 1.7 587.7 0.1X
72-
parsing 32623 35183 NaN 1.5 652.5 0.1X
73-
74-
Preparing data for benchmarking ...
75-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
76-
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
77-
Json files in the per-line mode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
78-
------------------------------------------------------------------------------------------------------------------------
79-
Text read 11874 11948 82 4.2 237.5 1.0X
80-
Schema inferring 42382 42398 23 1.2 847.6 0.3X
81-
Parsing without charset 36410 36442 54 1.4 728.2 0.3X
82-
Parsing with UTF-8 62412 62463 48 0.8 1248.2 0.2X
83-
84-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
85-
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
86-
Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
87-
------------------------------------------------------------------------------------------------------------------------
88-
Create a dataset of timestamps 2191 2209 20 4.6 219.1 1.0X
89-
to_json(timestamp) 18670 19042 565 0.5 1867.0 0.1X
90-
write timestamps to files 11836 13156 NaN 0.8 1183.6 0.2X
91-
Create a dataset of dates 2321 2351 33 4.3 232.1 0.9X
92-
to_json(date) 12703 12726 24 0.8 1270.3 0.2X
93-
write dates to files 8230 8303 76 1.2 823.0 0.3X
94-
95-
OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws
96-
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
97-
Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
98-
------------------------------------------------------------------------------------------------------------------------
99-
read timestamp text from files 2780 2795 13 3.6 278.0 1.0X
100-
read timestamps from files 37158 37305 137 0.3 3715.8 0.1X
101-
infer timestamps from files 73666 73838 149 0.1 7366.6 0.0X
102-
read date text from files 2597 2609 10 3.9 259.7 1.1X
103-
read date from files 24439 24501 56 0.4 2443.9 0.1X
104-
timestamp strings 3052 3064 12 3.3 305.2 0.9X
105-
parse timestamps from Dataset[String] 43611 43665 52 0.2 4361.1 0.1X
106-
infer timestamps from Dataset[String] 83745 84153 376 0.1 8374.5 0.0X
107-
date strings 4068 4076 10 2.5 406.8 0.7X
108-
parse dates from Dataset[String] 34700 34807 118 0.3 3470.0 0.1X
109-
from_json(timestamp) 64074 64124 53 0.2 6407.4 0.0X
110-
from_json(date) 52520 52617 101 0.2 5252.0 0.1X
111-
112-

0 commit comments

Comments
 (0)