DO NOT MERGE: EXP: [C++] VisitTwoBitRuns changes #50392
Conversation
|
@ursabot please benchmark lang=C++ |
|
Benchmark runs are scheduled for commit 710cedd. Watch https://buildkite.com/apache-arrow and https://conbench.arrow-dev.org for updates. A comment will be posted here when the runs are complete. |
|
Thanks for your patience. Conbench analyzed the 2 benchmarking runs that have been run so far on PR commit 710cedd. There were 48 benchmark results indicating a performance regression:
The full Conbench report has more details. |
|
The results were somewhat unexpected. My standard local development environment is a MacBook, but I was unable to reproduce the |
|
Yes, compiler code generation can be quite fickle. But overall it seems to me that those benchmark numbers point to a significant improvement. |
Could you please explain how to interpret this report? It seems to me that there are many performance regressions when there are no null values. Incidentally, adding |
The ArrayArrayKernel benchmarks but also the ScalarTemporalBinary benchmarks exercise VisitTwoArrayValuesInline. The fact that some show regressions and some improvements hints that the compiler is not always able to do a good job here. However, there are also a number of large improvements on the Filter benchmarks.
Hmm, I could try it in this PR. |
|
@ursabot please benchmark lang=C++ |
|
Benchmark runs are scheduled for commit b0f622f. Watch https://buildkite.com/apache-arrow and https://conbench.arrow-dev.org for updates. A comment will be posted here when the runs are complete. |
Oh, I forgot: the z-score measures statistical significance. I personally only look at the numbers where abs(z) > 3. |
|
@pitrou yes, having a filter like that sounds like a good idea :) |
|
Thanks for your patience. Conbench analyzed the 4 benchmarking runs that have been run so far on PR commit b0f622f. There were 41 benchmark results indicating a performance regression:
The full Conbench report has more details. |
Based on #50281