Skip to content

[bench] Snappy tweaks#9541

Open
Dandandan wants to merge 5 commits intoapache:mainfrom
Dandandan:upgrade_snappy
Open

[bench] Snappy tweaks#9541
Dandandan wants to merge 5 commits intoapache:mainfrom
Dandandan:upgrade_snappy

Conversation

@Dandandan
Copy link
Contributor

Which issue does this PR close?

  • Closes #NNN.

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

@github-actions github-actions bot added parquet Changes to the parquet crate arrow Changes to the arrow crate arrow-avro arrow-avro crate labels Mar 11, 2026
@Dandandan
Copy link
Contributor Author

run benchmark arrow_reader_clickbench

@alamb-ghbot
Copy link

🤖 ./gh_compare_arrow.sh gh_compare_arrow.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing upgrade_snappy (9fec2b7) to d3c7900 diff
BENCH_NAME=arrow_reader_clickbench
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader_clickbench
BENCH_FILTER=
BENCH_BRANCH_NAME=upgrade_snappy
Results will be posted here when complete

@alamb-ghbot
Copy link

🤖: Benchmark completed

Details

group                                             main                                   upgrade_snappy
-----                                             ----                                   --------------
arrow_reader_clickbench/async/Q1                  1.01      2.2±0.02ms        ? ?/sec    1.00      2.2±0.02ms        ? ?/sec
arrow_reader_clickbench/async/Q10                 1.02     10.6±0.16ms        ? ?/sec    1.00     10.4±0.16ms        ? ?/sec
arrow_reader_clickbench/async/Q11                 1.04     12.3±0.28ms        ? ?/sec    1.00     11.8±0.12ms        ? ?/sec
arrow_reader_clickbench/async/Q12                 1.00     22.0±0.20ms        ? ?/sec    1.03     22.7±0.34ms        ? ?/sec
arrow_reader_clickbench/async/Q13                 1.00     27.2±0.27ms        ? ?/sec    1.02     27.8±0.22ms        ? ?/sec
arrow_reader_clickbench/async/Q14                 1.00     24.5±0.29ms        ? ?/sec    1.03     25.1±0.22ms        ? ?/sec
arrow_reader_clickbench/async/Q19                 1.00      5.2±0.07ms        ? ?/sec    1.00      5.2±0.06ms        ? ?/sec
arrow_reader_clickbench/async/Q20                 1.00    112.1±0.83ms        ? ?/sec    1.17    130.6±0.80ms        ? ?/sec
arrow_reader_clickbench/async/Q21                 1.00    124.5±0.77ms        ? ?/sec    1.30   161.7±12.43ms        ? ?/sec
arrow_reader_clickbench/async/Q22                 1.00    177.1±2.61ms        ? ?/sec    1.26    222.9±2.45ms        ? ?/sec
arrow_reader_clickbench/async/Q23                 1.00    399.0±2.12ms        ? ?/sec    1.03    412.5±2.57ms        ? ?/sec
arrow_reader_clickbench/async/Q24                 1.00     30.1±0.40ms        ? ?/sec    1.04     31.4±0.30ms        ? ?/sec
arrow_reader_clickbench/async/Q27                 1.00     97.0±0.53ms        ? ?/sec    1.03    100.0±0.43ms        ? ?/sec
arrow_reader_clickbench/async/Q28                 1.00     94.8±0.79ms        ? ?/sec    1.03     97.9±0.56ms        ? ?/sec
arrow_reader_clickbench/async/Q30                 1.00     26.6±0.20ms        ? ?/sec    1.05     27.8±0.79ms        ? ?/sec
arrow_reader_clickbench/async/Q36                 1.00     28.8±0.27ms        ? ?/sec    1.02     29.5±0.28ms        ? ?/sec
arrow_reader_clickbench/async/Q37                 1.00      9.4±0.09ms        ? ?/sec    1.02      9.5±0.15ms        ? ?/sec
arrow_reader_clickbench/async/Q38                 1.00     24.8±0.18ms        ? ?/sec    1.04     25.8±0.46ms        ? ?/sec
arrow_reader_clickbench/async/Q39                 1.00     43.0±0.43ms        ? ?/sec    1.02     43.7±0.35ms        ? ?/sec
arrow_reader_clickbench/async/Q40                 1.01     13.3±0.15ms        ? ?/sec    1.00     13.2±0.22ms        ? ?/sec
arrow_reader_clickbench/async/Q41                 1.00     10.5±0.12ms        ? ?/sec    1.00     10.5±0.17ms        ? ?/sec
arrow_reader_clickbench/async/Q42                 1.01      5.8±0.04ms        ? ?/sec    1.00      5.8±0.12ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q1     1.00      2.2±0.01ms        ? ?/sec    1.00      2.2±0.03ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q10    1.04     10.7±0.17ms        ? ?/sec    1.00     10.3±0.22ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q11    1.05     12.2±0.22ms        ? ?/sec    1.00     11.7±0.33ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q12    1.00     22.0±0.19ms        ? ?/sec    1.03     22.6±0.17ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q13    1.00     26.5±0.22ms        ? ?/sec    1.03     27.3±0.27ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q14    1.00     24.0±0.36ms        ? ?/sec    1.05     25.2±0.78ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q19    1.01      5.0±0.07ms        ? ?/sec    1.00      5.0±0.05ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q20    1.00    107.5±1.02ms        ? ?/sec    1.03    111.1±0.82ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q21    1.00    119.3±0.60ms        ? ?/sec    1.04    124.1±0.66ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q22    1.00    148.9±1.54ms        ? ?/sec    1.04    154.9±1.41ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q23    1.00    361.9±1.75ms        ? ?/sec    1.03    372.2±2.23ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q24    1.00     29.6±0.39ms        ? ?/sec    1.02     30.1±0.31ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q27    1.00     92.6±0.71ms        ? ?/sec    1.04     96.0±0.93ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q28    1.00     90.3±0.63ms        ? ?/sec    1.04     94.1±0.69ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q30    1.00     25.6±0.15ms        ? ?/sec    1.05     26.7±0.21ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q36    1.00     26.1±0.23ms        ? ?/sec    1.01     26.4±0.27ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q37    1.00      9.2±0.04ms        ? ?/sec    1.02      9.4±0.04ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q38    1.00     22.3±0.18ms        ? ?/sec    1.02     22.8±0.37ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q39    1.00     38.3±0.32ms        ? ?/sec    1.03     39.3±0.35ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q40    1.00     12.5±0.14ms        ? ?/sec    1.01     12.7±0.17ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q41    1.00      9.9±0.11ms        ? ?/sec    1.01      9.9±0.27ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q42    1.01      5.7±0.07ms        ? ?/sec    1.00      5.6±0.14ms        ? ?/sec
arrow_reader_clickbench/sync/Q1                   1.00  1990.2±20.67µs        ? ?/sec    1.00   1989.7±4.80µs        ? ?/sec
arrow_reader_clickbench/sync/Q10                  1.00      7.5±0.05ms        ? ?/sec    1.01      7.6±0.03ms        ? ?/sec
arrow_reader_clickbench/sync/Q11                  1.00      8.8±0.04ms        ? ?/sec    1.01      8.9±0.03ms        ? ?/sec
arrow_reader_clickbench/sync/Q12                  1.00     28.2±1.42ms        ? ?/sec    1.05     29.8±0.25ms        ? ?/sec
arrow_reader_clickbench/sync/Q13                  1.00     42.1±0.46ms        ? ?/sec    1.03     43.5±0.51ms        ? ?/sec
arrow_reader_clickbench/sync/Q14                  1.14     36.3±0.47ms        ? ?/sec    1.00     31.7±0.18ms        ? ?/sec
arrow_reader_clickbench/sync/Q19                  1.00      4.1±0.02ms        ? ?/sec    1.02      4.2±0.01ms        ? ?/sec
arrow_reader_clickbench/sync/Q20                  1.00    172.1±0.84ms        ? ?/sec    1.03    176.6±1.01ms        ? ?/sec
arrow_reader_clickbench/sync/Q21                  1.00    129.1±0.63ms        ? ?/sec    1.03    133.5±0.76ms        ? ?/sec
arrow_reader_clickbench/sync/Q22                  1.00    203.4±1.50ms        ? ?/sec    1.04    211.9±1.00ms        ? ?/sec
arrow_reader_clickbench/sync/Q23                  1.00    405.3±4.64ms        ? ?/sec    1.12   452.7±15.51ms        ? ?/sec
arrow_reader_clickbench/sync/Q24                  1.00     40.1±0.55ms        ? ?/sec    1.03     41.4±0.39ms        ? ?/sec
arrow_reader_clickbench/sync/Q27                  1.00    147.1±0.86ms        ? ?/sec    1.05    154.0±0.89ms        ? ?/sec
arrow_reader_clickbench/sync/Q28                  1.00    142.3±0.82ms        ? ?/sec    1.04    148.2±0.87ms        ? ?/sec
arrow_reader_clickbench/sync/Q30                  1.00     26.7±0.32ms        ? ?/sec    1.04     27.9±0.34ms        ? ?/sec
arrow_reader_clickbench/sync/Q36                  1.00     32.2±0.56ms        ? ?/sec    1.01     32.5±0.41ms        ? ?/sec
arrow_reader_clickbench/sync/Q37                  1.00     10.3±0.28ms        ? ?/sec    1.03     10.6±0.11ms        ? ?/sec
arrow_reader_clickbench/sync/Q38                  1.00     18.0±0.30ms        ? ?/sec    1.01     18.2±0.32ms        ? ?/sec
arrow_reader_clickbench/sync/Q39                  1.00     30.2±0.47ms        ? ?/sec    1.02     30.9±0.40ms        ? ?/sec
arrow_reader_clickbench/sync/Q40                  1.00      8.8±0.12ms        ? ?/sec    1.00      8.8±0.06ms        ? ?/sec
arrow_reader_clickbench/sync/Q41                  1.00      9.0±0.06ms        ? ?/sec    1.01      9.1±0.18ms        ? ?/sec
arrow_reader_clickbench/sync/Q42                  1.00      6.7±0.03ms        ? ?/sec    1.01      6.7±0.05ms        ? ?/sec

@Dandandan
Copy link
Contributor Author

run benchmark arrow_reader_clickbench

@alamb-ghbot
Copy link

🤖 ./gh_compare_arrow.sh gh_compare_arrow.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing upgrade_snappy (9fec2b7) to d3c7900 diff
BENCH_NAME=arrow_reader_clickbench
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader_clickbench
BENCH_FILTER=
BENCH_BRANCH_NAME=upgrade_snappy
Results will be posted here when complete

@alamb-ghbot
Copy link

🤖: Benchmark completed

Details

group                                             main                                   upgrade_snappy
-----                                             ----                                   --------------
arrow_reader_clickbench/async/Q1                  1.02      2.3±0.03ms        ? ?/sec    1.00      2.2±0.01ms        ? ?/sec
arrow_reader_clickbench/async/Q10                 1.01     10.4±0.26ms        ? ?/sec    1.00     10.3±0.12ms        ? ?/sec
arrow_reader_clickbench/async/Q11                 1.00     11.9±0.13ms        ? ?/sec    1.01     12.0±0.29ms        ? ?/sec
arrow_reader_clickbench/async/Q12                 1.00     21.5±0.30ms        ? ?/sec    1.08     23.2±0.29ms        ? ?/sec
arrow_reader_clickbench/async/Q13                 1.00     26.9±0.49ms        ? ?/sec    1.06     28.5±0.53ms        ? ?/sec
arrow_reader_clickbench/async/Q14                 1.00     23.8±0.20ms        ? ?/sec    1.09     25.9±0.72ms        ? ?/sec
arrow_reader_clickbench/async/Q19                 1.00      5.2±0.07ms        ? ?/sec    1.01      5.2±0.10ms        ? ?/sec
arrow_reader_clickbench/async/Q20                 1.00    111.4±0.58ms        ? ?/sec    1.40    155.6±1.46ms        ? ?/sec
arrow_reader_clickbench/async/Q21                 1.00    124.1±0.48ms        ? ?/sec    1.39   172.1±15.95ms        ? ?/sec
arrow_reader_clickbench/async/Q22                 1.00    176.5±2.46ms        ? ?/sec    1.28   226.6±15.49ms        ? ?/sec
arrow_reader_clickbench/async/Q23                 1.00    399.9±2.95ms        ? ?/sec    1.05    420.3±2.88ms        ? ?/sec
arrow_reader_clickbench/async/Q24                 1.00     29.7±0.38ms        ? ?/sec    1.09     32.3±0.33ms        ? ?/sec
arrow_reader_clickbench/async/Q27                 1.00     96.5±0.60ms        ? ?/sec    1.06    102.2±1.15ms        ? ?/sec
arrow_reader_clickbench/async/Q28                 1.00     94.8±1.24ms        ? ?/sec    1.05     99.5±0.63ms        ? ?/sec
arrow_reader_clickbench/async/Q30                 1.00     26.1±0.44ms        ? ?/sec    1.09     28.4±0.99ms        ? ?/sec
arrow_reader_clickbench/async/Q36                 1.00     28.6±0.27ms        ? ?/sec    1.02     29.1±0.34ms        ? ?/sec
arrow_reader_clickbench/async/Q37                 1.00      9.3±0.08ms        ? ?/sec    1.03      9.6±0.08ms        ? ?/sec
arrow_reader_clickbench/async/Q38                 1.00     24.7±0.20ms        ? ?/sec    1.03     25.4±0.38ms        ? ?/sec
arrow_reader_clickbench/async/Q39                 1.00     42.6±0.45ms        ? ?/sec    1.03     44.1±0.30ms        ? ?/sec
arrow_reader_clickbench/async/Q40                 1.00     13.0±0.36ms        ? ?/sec    1.01     13.1±0.32ms        ? ?/sec
arrow_reader_clickbench/async/Q41                 1.00     10.2±0.29ms        ? ?/sec    1.01     10.3±0.12ms        ? ?/sec
arrow_reader_clickbench/async/Q42                 1.00      5.8±0.12ms        ? ?/sec    1.01      5.9±0.08ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q1     1.00      2.2±0.03ms        ? ?/sec    1.01      2.2±0.05ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q10    1.00     10.0±0.26ms        ? ?/sec    1.00     10.0±0.21ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q11    1.00     11.3±0.15ms        ? ?/sec    1.00     11.3±0.18ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q12    1.00     20.8±0.45ms        ? ?/sec    1.09     22.7±0.25ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q13    1.00     25.4±0.44ms        ? ?/sec    1.08     27.6±0.44ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q14    1.00     23.1±0.34ms        ? ?/sec    1.09     25.3±0.46ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q19    1.00      4.8±0.04ms        ? ?/sec    1.03      5.0±0.06ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q20    1.00    107.0±0.55ms        ? ?/sec    1.05    112.4±0.89ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q21    1.00    119.6±0.75ms        ? ?/sec    1.06    126.5±1.55ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q22    1.00    147.3±1.99ms        ? ?/sec    1.09    160.4±1.25ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q23    1.00   353.6±14.07ms        ? ?/sec    1.02   361.8±10.43ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q24    1.00     28.1±0.25ms        ? ?/sec    1.08     30.4±0.29ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q27    1.00     92.3±0.52ms        ? ?/sec    1.06     97.8±1.06ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q28    1.00     89.9±0.60ms        ? ?/sec    1.06     95.5±0.72ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q30    1.00     24.9±0.25ms        ? ?/sec    1.09     27.2±0.30ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q36    1.00     25.3±0.36ms        ? ?/sec    1.04     26.4±0.32ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q37    1.00      9.2±0.23ms        ? ?/sec    1.04      9.5±0.11ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q38    1.00     21.6±0.50ms        ? ?/sec    1.04     22.5±0.30ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q39    1.00     37.1±0.43ms        ? ?/sec    1.07     39.8±0.99ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q40    1.00     12.2±0.17ms        ? ?/sec    1.02     12.5±0.11ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q41    1.00      9.6±0.17ms        ? ?/sec    1.01      9.7±0.06ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q42    1.00      5.5±0.04ms        ? ?/sec    1.02      5.6±0.03ms        ? ?/sec
arrow_reader_clickbench/sync/Q1                   1.00   1976.5±5.34µs        ? ?/sec    1.01  1998.3±51.90µs        ? ?/sec
arrow_reader_clickbench/sync/Q10                  1.00      7.5±0.03ms        ? ?/sec    1.01      7.6±0.03ms        ? ?/sec
arrow_reader_clickbench/sync/Q11                  1.00      8.8±0.05ms        ? ?/sec    1.01      8.9±0.03ms        ? ?/sec
arrow_reader_clickbench/sync/Q12                  1.00     27.8±1.41ms        ? ?/sec    1.18     32.9±1.96ms        ? ?/sec
arrow_reader_clickbench/sync/Q13                  1.15     40.6±0.49ms        ? ?/sec    1.00     35.5±0.38ms        ? ?/sec
arrow_reader_clickbench/sync/Q14                  1.06     35.4±0.60ms        ? ?/sec    1.00     33.3±0.38ms        ? ?/sec
arrow_reader_clickbench/sync/Q19                  1.00      4.1±0.03ms        ? ?/sec    1.02      4.2±0.02ms        ? ?/sec
arrow_reader_clickbench/sync/Q20                  1.00    172.1±0.97ms        ? ?/sec    1.05    179.9±0.92ms        ? ?/sec
arrow_reader_clickbench/sync/Q21                  1.00    127.6±0.91ms        ? ?/sec    1.07    136.3±0.94ms        ? ?/sec
arrow_reader_clickbench/sync/Q22                  1.00    202.3±1.73ms        ? ?/sec    1.08    218.4±2.39ms        ? ?/sec
arrow_reader_clickbench/sync/Q23                  1.00    405.0±4.42ms        ? ?/sec    1.13   456.3±14.87ms        ? ?/sec
arrow_reader_clickbench/sync/Q24                  1.00     39.7±0.37ms        ? ?/sec    1.02     40.6±0.51ms        ? ?/sec
arrow_reader_clickbench/sync/Q27                  1.00    146.6±1.06ms        ? ?/sec    1.07    156.9±1.35ms        ? ?/sec
arrow_reader_clickbench/sync/Q28                  1.00    140.9±1.86ms        ? ?/sec    1.07    151.0±0.98ms        ? ?/sec
arrow_reader_clickbench/sync/Q30                  1.00     26.2±0.38ms        ? ?/sec    1.08     28.4±0.17ms        ? ?/sec
arrow_reader_clickbench/sync/Q36                  1.00     31.6±0.28ms        ? ?/sec    1.04     32.8±0.21ms        ? ?/sec
arrow_reader_clickbench/sync/Q37                  1.00     10.2±0.03ms        ? ?/sec    1.05     10.8±0.04ms        ? ?/sec
arrow_reader_clickbench/sync/Q38                  1.00     17.4±0.22ms        ? ?/sec    1.05     18.2±0.14ms        ? ?/sec
arrow_reader_clickbench/sync/Q39                  1.00     29.8±0.32ms        ? ?/sec    1.07     32.0±0.98ms        ? ?/sec
arrow_reader_clickbench/sync/Q40                  1.00      8.7±0.22ms        ? ?/sec    1.02      8.9±0.07ms        ? ?/sec
arrow_reader_clickbench/sync/Q41                  1.00      8.9±0.11ms        ? ?/sec    1.02      9.0±0.02ms        ? ?/sec
arrow_reader_clickbench/sync/Q42                  1.00      6.7±0.15ms        ? ?/sec    1.03      6.9±0.02ms        ? ?/sec

@Dandandan
Copy link
Contributor Author

run benchmark arrow_reader_clickbench

@alamb-ghbot
Copy link

🤖 ./gh_compare_arrow.sh gh_compare_arrow.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing upgrade_snappy (622b460) to d3c7900 diff
BENCH_NAME=arrow_reader_clickbench
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader_clickbench
BENCH_FILTER=
BENCH_BRANCH_NAME=upgrade_snappy
Results will be posted here when complete

@alamb-ghbot
Copy link

🤖: Benchmark completed

Details

group                                             main                                   upgrade_snappy
-----                                             ----                                   --------------
arrow_reader_clickbench/async/Q1                  1.00      2.3±0.04ms        ? ?/sec    1.00      2.3±0.03ms        ? ?/sec
arrow_reader_clickbench/async/Q10                 1.01     10.3±0.11ms        ? ?/sec    1.00     10.2±0.09ms        ? ?/sec
arrow_reader_clickbench/async/Q11                 1.01     11.9±0.17ms        ? ?/sec    1.00     11.8±0.21ms        ? ?/sec
arrow_reader_clickbench/async/Q12                 1.00     21.4±0.13ms        ? ?/sec    1.07     22.8±0.35ms        ? ?/sec
arrow_reader_clickbench/async/Q13                 1.00     26.7±0.17ms        ? ?/sec    1.05     27.9±0.38ms        ? ?/sec
arrow_reader_clickbench/async/Q14                 1.00     23.9±0.32ms        ? ?/sec    1.06     25.2±0.18ms        ? ?/sec
arrow_reader_clickbench/async/Q19                 1.00      5.2±0.05ms        ? ?/sec    1.01      5.2±0.05ms        ? ?/sec
arrow_reader_clickbench/async/Q20                 1.00    111.4±0.60ms        ? ?/sec    1.39    155.3±1.93ms        ? ?/sec
arrow_reader_clickbench/async/Q21                 1.00    124.4±0.68ms        ? ?/sec    1.40   173.8±13.51ms        ? ?/sec
arrow_reader_clickbench/async/Q22                 1.00    175.1±3.77ms        ? ?/sec    1.28   224.6±16.53ms        ? ?/sec
arrow_reader_clickbench/async/Q23                 1.00    400.5±6.02ms        ? ?/sec    1.06   425.2±14.15ms        ? ?/sec
arrow_reader_clickbench/async/Q24                 1.00     29.8±0.22ms        ? ?/sec    1.07     31.9±0.76ms        ? ?/sec
arrow_reader_clickbench/async/Q27                 1.00     96.2±0.63ms        ? ?/sec    1.05    101.3±1.09ms        ? ?/sec
arrow_reader_clickbench/async/Q28                 1.00     93.9±0.55ms        ? ?/sec    1.06     99.1±1.01ms        ? ?/sec
arrow_reader_clickbench/async/Q30                 1.00     26.1±0.21ms        ? ?/sec    1.08     28.1±0.19ms        ? ?/sec
arrow_reader_clickbench/async/Q36                 1.00     28.0±0.22ms        ? ?/sec    1.04     29.0±0.19ms        ? ?/sec
arrow_reader_clickbench/async/Q37                 1.00      9.3±0.06ms        ? ?/sec    1.04      9.7±0.08ms        ? ?/sec
arrow_reader_clickbench/async/Q38                 1.00     24.3±0.30ms        ? ?/sec    1.04     25.2±0.22ms        ? ?/sec
arrow_reader_clickbench/async/Q39                 1.00     42.2±0.70ms        ? ?/sec    1.03     43.6±0.26ms        ? ?/sec
arrow_reader_clickbench/async/Q40                 1.00     13.2±0.19ms        ? ?/sec    1.00     13.2±0.14ms        ? ?/sec
arrow_reader_clickbench/async/Q41                 1.00     10.3±0.08ms        ? ?/sec    1.00     10.3±0.10ms        ? ?/sec
arrow_reader_clickbench/async/Q42                 1.00      5.8±0.03ms        ? ?/sec    1.01      5.9±0.12ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q1     1.00      2.2±0.02ms        ? ?/sec    1.00      2.2±0.02ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q10    1.00      9.9±0.12ms        ? ?/sec    1.00      9.9±0.13ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q11    1.00     11.3±0.24ms        ? ?/sec    1.00     11.2±0.10ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q12    1.00     20.6±0.19ms        ? ?/sec    1.08     22.3±0.16ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q13    1.00     25.5±0.22ms        ? ?/sec    1.06     27.1±0.17ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q14    1.00     22.9±0.19ms        ? ?/sec    1.08     24.8±0.36ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q19    1.00      4.8±0.04ms        ? ?/sec    1.03      5.0±0.04ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q20    1.00    106.6±1.02ms        ? ?/sec    1.05    112.2±0.56ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q21    1.00    119.3±0.57ms        ? ?/sec    1.06    126.2±0.89ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q22    1.00    146.5±1.14ms        ? ?/sec    1.09    160.1±2.52ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q23    1.00    358.7±2.33ms        ? ?/sec    1.06    380.8±3.49ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q24    1.00     28.7±0.71ms        ? ?/sec    1.07     30.6±0.25ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q27    1.00     92.2±0.57ms        ? ?/sec    1.06     97.5±0.73ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q28    1.00     89.9±0.52ms        ? ?/sec    1.06     95.1±1.21ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q30    1.00     25.1±0.16ms        ? ?/sec    1.08     27.2±0.39ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q36    1.00     25.5±0.30ms        ? ?/sec    1.03     26.1±0.33ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q37    1.00      9.2±0.06ms        ? ?/sec    1.04      9.6±0.14ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q38    1.00     21.6±0.20ms        ? ?/sec    1.04     22.6±0.47ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q39    1.00     37.3±0.25ms        ? ?/sec    1.05     39.2±0.48ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q40    1.00     12.4±0.20ms        ? ?/sec    1.01     12.5±0.18ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q41    1.00      9.7±0.16ms        ? ?/sec    1.01      9.9±0.14ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q42    1.00      5.6±0.10ms        ? ?/sec    1.02      5.7±0.20ms        ? ?/sec
arrow_reader_clickbench/sync/Q1                   1.00  1985.6±20.66µs        ? ?/sec    1.01  1998.8±22.15µs        ? ?/sec
arrow_reader_clickbench/sync/Q10                  1.00      7.6±0.05ms        ? ?/sec    1.02      7.7±0.09ms        ? ?/sec
arrow_reader_clickbench/sync/Q11                  1.00      8.8±0.18ms        ? ?/sec    1.02      8.9±0.08ms        ? ?/sec
arrow_reader_clickbench/sync/Q12                  1.00     27.9±1.41ms        ? ?/sec    1.19     33.0±1.93ms        ? ?/sec
arrow_reader_clickbench/sync/Q13                  1.11     40.8±0.67ms        ? ?/sec    1.00     36.6±1.33ms        ? ?/sec
arrow_reader_clickbench/sync/Q14                  1.04     35.3±0.41ms        ? ?/sec    1.00     34.1±0.61ms        ? ?/sec
arrow_reader_clickbench/sync/Q19                  1.00      4.1±0.04ms        ? ?/sec    1.05      4.3±0.09ms        ? ?/sec
arrow_reader_clickbench/sync/Q20                  1.00    171.8±1.17ms        ? ?/sec    1.04    178.9±0.98ms        ? ?/sec
arrow_reader_clickbench/sync/Q21                  1.00    127.9±0.94ms        ? ?/sec    1.06    135.8±0.90ms        ? ?/sec
arrow_reader_clickbench/sync/Q22                  1.00    202.3±1.79ms        ? ?/sec    1.07    217.1±1.62ms        ? ?/sec
arrow_reader_clickbench/sync/Q23                  1.00    404.7±4.39ms        ? ?/sec    1.12   453.8±14.45ms        ? ?/sec
arrow_reader_clickbench/sync/Q24                  1.00     39.1±0.30ms        ? ?/sec    1.03     40.4±0.62ms        ? ?/sec
arrow_reader_clickbench/sync/Q27                  1.00    146.1±0.76ms        ? ?/sec    1.07    156.4±0.98ms        ? ?/sec
arrow_reader_clickbench/sync/Q28                  1.00    140.4±0.82ms        ? ?/sec    1.07    150.6±1.86ms        ? ?/sec
arrow_reader_clickbench/sync/Q30                  1.00     26.2±0.36ms        ? ?/sec    1.09     28.4±0.41ms        ? ?/sec
arrow_reader_clickbench/sync/Q36                  1.00     31.5±0.64ms        ? ?/sec    1.05     32.9±0.33ms        ? ?/sec
arrow_reader_clickbench/sync/Q37                  1.00     10.3±0.06ms        ? ?/sec    1.05     10.7±0.06ms        ? ?/sec
arrow_reader_clickbench/sync/Q38                  1.00     17.4±0.28ms        ? ?/sec    1.04     18.1±0.23ms        ? ?/sec
arrow_reader_clickbench/sync/Q39                  1.00     29.7±0.43ms        ? ?/sec    1.05     31.1±0.34ms        ? ?/sec
arrow_reader_clickbench/sync/Q40                  1.00      8.7±0.08ms        ? ?/sec    1.01      8.8±0.06ms        ? ?/sec
arrow_reader_clickbench/sync/Q41                  1.00      9.0±0.19ms        ? ?/sec    1.02      9.1±0.14ms        ? ?/sec
arrow_reader_clickbench/sync/Q42                  1.00      6.7±0.04ms        ? ?/sec    1.03      6.9±0.09ms        ? ?/sec

@Dandandan
Copy link
Contributor Author

run benchmark arrow_reader_clickbench

@alamb-ghbot
Copy link

🤖 ./gh_compare_arrow.sh gh_compare_arrow.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing upgrade_snappy (330f512) to d3c7900 diff
BENCH_NAME=arrow_reader_clickbench
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader_clickbench
BENCH_FILTER=
BENCH_BRANCH_NAME=upgrade_snappy
Results will be posted here when complete

@alamb-ghbot
Copy link

🤖: Benchmark completed

Details

group                                             main                                   upgrade_snappy
-----                                             ----                                   --------------
arrow_reader_clickbench/async/Q1                  1.00      2.2±0.05ms        ? ?/sec    1.01      2.3±0.03ms        ? ?/sec
arrow_reader_clickbench/async/Q10                 1.00     10.4±0.34ms        ? ?/sec    1.00     10.3±0.13ms        ? ?/sec
arrow_reader_clickbench/async/Q11                 1.00     12.0±0.19ms        ? ?/sec    1.00     12.0±0.16ms        ? ?/sec
arrow_reader_clickbench/async/Q12                 1.00     21.4±0.30ms        ? ?/sec    1.01     21.6±0.22ms        ? ?/sec
arrow_reader_clickbench/async/Q13                 1.00     26.5±0.20ms        ? ?/sec    1.01     26.7±0.13ms        ? ?/sec
arrow_reader_clickbench/async/Q14                 1.00     23.7±0.17ms        ? ?/sec    1.01     23.9±0.20ms        ? ?/sec
arrow_reader_clickbench/async/Q19                 1.00      5.1±0.03ms        ? ?/sec    1.00      5.1±0.07ms        ? ?/sec
arrow_reader_clickbench/async/Q20                 1.00    111.1±0.62ms        ? ?/sec    1.14    126.5±0.79ms        ? ?/sec
arrow_reader_clickbench/async/Q21                 1.00    123.2±0.65ms        ? ?/sec    1.27   156.7±12.97ms        ? ?/sec
arrow_reader_clickbench/async/Q22                 1.00    173.1±5.42ms        ? ?/sec    1.20   207.0±18.94ms        ? ?/sec
arrow_reader_clickbench/async/Q23                 1.00    396.4±2.94ms        ? ?/sec    1.00    397.0±2.40ms        ? ?/sec
arrow_reader_clickbench/async/Q24                 1.01     30.1±0.28ms        ? ?/sec    1.00     29.8±0.22ms        ? ?/sec
arrow_reader_clickbench/async/Q27                 1.00     95.9±0.51ms        ? ?/sec    1.00     95.6±0.75ms        ? ?/sec
arrow_reader_clickbench/async/Q28                 1.00     93.8±0.45ms        ? ?/sec    1.00     93.8±0.65ms        ? ?/sec
arrow_reader_clickbench/async/Q30                 1.00     25.9±0.20ms        ? ?/sec    1.00     26.0±0.25ms        ? ?/sec
arrow_reader_clickbench/async/Q36                 1.00     28.0±0.20ms        ? ?/sec    1.01     28.2±0.28ms        ? ?/sec
arrow_reader_clickbench/async/Q37                 1.00      9.3±0.08ms        ? ?/sec    1.01      9.4±0.20ms        ? ?/sec
arrow_reader_clickbench/async/Q38                 1.00     24.2±0.24ms        ? ?/sec    1.01     24.5±0.22ms        ? ?/sec
arrow_reader_clickbench/async/Q39                 1.00     42.0±0.18ms        ? ?/sec    1.00     42.0±0.27ms        ? ?/sec
arrow_reader_clickbench/async/Q40                 1.00     12.9±0.09ms        ? ?/sec    1.02     13.1±0.22ms        ? ?/sec
arrow_reader_clickbench/async/Q41                 1.00     10.1±0.05ms        ? ?/sec    1.01     10.1±0.10ms        ? ?/sec
arrow_reader_clickbench/async/Q42                 1.00      5.8±0.06ms        ? ?/sec    1.01      5.8±0.09ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q1     1.00      2.2±0.02ms        ? ?/sec    1.00      2.2±0.02ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q10    1.00      9.9±0.14ms        ? ?/sec    1.00      9.9±0.12ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q11    1.01     11.4±0.17ms        ? ?/sec    1.00     11.3±0.11ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q12    1.00     20.5±0.14ms        ? ?/sec    1.01     20.7±0.18ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q13    1.00     25.3±0.19ms        ? ?/sec    1.00     25.3±0.18ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q14    1.00     22.8±0.19ms        ? ?/sec    1.01     23.1±0.25ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q19    1.00      4.9±0.03ms        ? ?/sec    1.00      4.9±0.04ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q20    1.00    105.9±0.85ms        ? ?/sec    1.00    106.2±0.53ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q21    1.00    118.4±1.57ms        ? ?/sec    1.00    118.9±0.68ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q22    1.00    146.1±1.71ms        ? ?/sec    1.00    145.9±0.79ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q23    1.01   362.8±14.39ms        ? ?/sec    1.00    360.9±7.51ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q24    1.00     28.0±0.87ms        ? ?/sec    1.02     28.5±0.44ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q27    1.00     91.4±0.47ms        ? ?/sec    1.01     91.9±1.10ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q28    1.00     89.5±0.46ms        ? ?/sec    1.00     89.6±0.38ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q30    1.00     25.2±0.45ms        ? ?/sec    1.00     25.1±0.18ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q36    1.00     25.2±0.25ms        ? ?/sec    1.00     25.3±0.20ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q37    1.00      9.2±0.12ms        ? ?/sec    1.00      9.2±0.11ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q38    1.00     21.4±0.22ms        ? ?/sec    1.01     21.6±0.31ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q39    1.00     37.0±0.32ms        ? ?/sec    1.00     36.9±0.32ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q40    1.01     12.5±0.10ms        ? ?/sec    1.00     12.4±0.11ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q41    1.01      9.6±0.13ms        ? ?/sec    1.00      9.6±0.07ms        ? ?/sec
arrow_reader_clickbench/async_object_store/Q42    1.00      5.5±0.03ms        ? ?/sec    1.01      5.5±0.02ms        ? ?/sec
arrow_reader_clickbench/sync/Q1                   1.00   1980.3±8.60µs        ? ?/sec    1.00  1989.2±14.65µs        ? ?/sec
arrow_reader_clickbench/sync/Q10                  1.00      7.5±0.05ms        ? ?/sec    1.00      7.6±0.09ms        ? ?/sec
arrow_reader_clickbench/sync/Q11                  1.00      8.7±0.05ms        ? ?/sec    1.01      8.8±0.13ms        ? ?/sec
arrow_reader_clickbench/sync/Q12                  1.00     27.8±1.32ms        ? ?/sec    1.06     29.4±1.92ms        ? ?/sec
arrow_reader_clickbench/sync/Q13                  1.28     40.8±0.79ms        ? ?/sec    1.00     31.8±0.26ms        ? ?/sec
arrow_reader_clickbench/sync/Q14                  1.19     35.2±0.30ms        ? ?/sec    1.00     29.7±0.19ms        ? ?/sec
arrow_reader_clickbench/sync/Q19                  1.00      4.1±0.02ms        ? ?/sec    1.00      4.1±0.02ms        ? ?/sec
arrow_reader_clickbench/sync/Q20                  1.00    171.3±0.82ms        ? ?/sec    1.00    170.5±0.88ms        ? ?/sec
arrow_reader_clickbench/sync/Q21                  1.00    127.2±0.96ms        ? ?/sec    1.00    126.6±0.81ms        ? ?/sec
arrow_reader_clickbench/sync/Q22                  1.01    201.6±1.31ms        ? ?/sec    1.00    199.5±1.53ms        ? ?/sec
arrow_reader_clickbench/sync/Q23                  1.00    402.9±4.39ms        ? ?/sec    1.07   432.0±18.00ms        ? ?/sec
arrow_reader_clickbench/sync/Q24                  1.05     39.1±0.60ms        ? ?/sec    1.00     37.3±0.29ms        ? ?/sec
arrow_reader_clickbench/sync/Q27                  1.00    146.1±0.96ms        ? ?/sec    1.01    147.3±0.96ms        ? ?/sec
arrow_reader_clickbench/sync/Q28                  1.00    140.9±1.55ms        ? ?/sec    1.00    141.4±0.86ms        ? ?/sec
arrow_reader_clickbench/sync/Q30                  1.00     26.2±0.18ms        ? ?/sec    1.00     26.1±0.29ms        ? ?/sec
arrow_reader_clickbench/sync/Q36                  1.00     31.5±0.25ms        ? ?/sec    1.01     31.7±0.64ms        ? ?/sec
arrow_reader_clickbench/sync/Q37                  1.00     10.2±0.05ms        ? ?/sec    1.01     10.4±0.15ms        ? ?/sec
arrow_reader_clickbench/sync/Q38                  1.00     17.4±0.28ms        ? ?/sec    1.00     17.4±0.25ms        ? ?/sec
arrow_reader_clickbench/sync/Q39                  1.00     29.6±0.56ms        ? ?/sec    1.01     29.8±0.39ms        ? ?/sec
arrow_reader_clickbench/sync/Q40                  1.00      8.7±0.06ms        ? ?/sec    1.00      8.7±0.09ms        ? ?/sec
arrow_reader_clickbench/sync/Q41                  1.00      8.9±0.26ms        ? ?/sec    1.01      9.0±0.07ms        ? ?/sec
arrow_reader_clickbench/sync/Q42                  1.00      6.7±0.07ms        ? ?/sec    1.00      6.7±0.02ms        ? ?/sec

@Dandandan
Copy link
Contributor Author

run benchmark arrow_reader_clickbench

@alamb-ghbot
Copy link

🤖 ./gh_compare_arrow.sh gh_compare_arrow.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing upgrade_snappy (d4a3266) to d3c7900 diff
BENCH_NAME=arrow_reader_clickbench
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader_clickbench
BENCH_FILTER=
BENCH_BRANCH_NAME=upgrade_snappy
Results will be posted here when complete

@alamb-ghbot
Copy link

Benchmark script failed with exit code 101.

Last 10 lines of output:

Click to expand
Found 3 outliers among 100 measurements (3.00%)
  2 (2.00%) high mild
  1 (1.00%) high severe
Benchmarking arrow_reader_clickbench/sync/Q23
Benchmarking arrow_reader_clickbench/sync/Q23: Warming up for 3.0000 s
malloc(): corrupted top size
error: bench failed, to rerun pass `-p parquet --bench arrow_reader_clickbench`

Caused by:
  process didn't exit successfully: `/home/alamb/arrow-rs/target/release/deps/arrow_reader_clickbench-2a6c2fc05edef6e4 --save-baseline upgrade_snappy --bench` (signal: 6, SIGABRT: process abort signal)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

arrow Changes to the arrow crate arrow-avro arrow-avro crate parquet Changes to the parquet crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants