Skip to content

WIP: Dummy PR to check maint-21.0.0 status#47024

Closed
amoeba wants to merge 7 commits into
mainfrom
maint-21.0.0
Closed

WIP: Dummy PR to check maint-21.0.0 status#47024
amoeba wants to merge 7 commits into
mainfrom
maint-21.0.0

Conversation

@amoeba

@amoeba amoeba commented Jul 8, 2025

Copy link
Copy Markdown
Member

Caution

Do not merge this PR.

This PR is being used to test the releasability of the 21 release branch on CI and should not be merged.

…47007)

### Rationale for this change

If we use non system memory allocator in sanitizer jobs, it may report false positives.

### What changes are included in this PR?

Disable mimalloc in sanitizer jobs.

### Are these changes tested?

Yes.

### Are there any user-facing changes?

No.
* GitHub Issue: #46995

Authored-by: Sutou Kouhei <kou@clear-code.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
@amoeba

amoeba commented Jul 8, 2025

Copy link
Copy Markdown
Member Author

@github-actions crossbow submit --group verify-rc-source --group packaging

@github-actions github-actions Bot added the awaiting review Awaiting review label Jul 8, 2025
@github-actions

github-actions Bot commented Jul 8, 2025

Copy link
Copy Markdown

Revision: aac90fa

Submitted crossbow builds: ursacomputing/crossbow @ actions-6ac6d6f035

Task Status
almalinux-10-amd64 GitHub Actions
almalinux-10-arm64 GitHub Actions
almalinux-8-amd64 GitHub Actions
almalinux-8-arm64 GitHub Actions
almalinux-9-amd64 GitHub Actions
almalinux-9-arm64 GitHub Actions
amazon-linux-2023-amd64 GitHub Actions
amazon-linux-2023-arm64 GitHub Actions
centos-7-amd64 GitHub Actions
centos-9-stream-amd64 GitHub Actions
centos-9-stream-arm64 GitHub Actions
conan-maximum GitHub Actions
conan-minimum GitHub Actions
debian-bookworm-amd64 GitHub Actions
debian-bookworm-arm64 GitHub Actions
debian-trixie-amd64 GitHub Actions
debian-trixie-arm64 GitHub Actions
matlab GitHub Actions
python-sdist GitHub Actions
r-binary-packages GitHub Actions
test-debian-12-docs GitHub Actions
ubuntu-jammy-amd64 GitHub Actions
ubuntu-jammy-arm64 GitHub Actions
ubuntu-noble-amd64 GitHub Actions
ubuntu-noble-arm64 GitHub Actions
verify-rc-source-cpp-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-cpp-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-cpp-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-cpp-linux-ubuntu-24.04-amd64 GitHub Actions
verify-rc-source-cpp-macos-amd64 GitHub Actions
verify-rc-source-cpp-macos-arm64 GitHub Actions
verify-rc-source-cpp-macos-conda-amd64 GitHub Actions
verify-rc-source-csharp-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-csharp-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-csharp-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-csharp-linux-ubuntu-24.04-amd64 GitHub Actions
verify-rc-source-csharp-macos-amd64 GitHub Actions
verify-rc-source-csharp-macos-arm64 GitHub Actions
verify-rc-source-integration-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-integration-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-integration-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-integration-linux-ubuntu-24.04-amd64 GitHub Actions
verify-rc-source-integration-macos-amd64 GitHub Actions
verify-rc-source-integration-macos-arm64 GitHub Actions
verify-rc-source-integration-macos-conda-amd64 GitHub Actions
verify-rc-source-python-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-python-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-python-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-python-linux-ubuntu-24.04-amd64 GitHub Actions
verify-rc-source-python-macos-amd64 GitHub Actions
verify-rc-source-python-macos-arm64 GitHub Actions
verify-rc-source-python-macos-conda-amd64 GitHub Actions
verify-rc-source-ruby-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-ruby-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-ruby-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-ruby-linux-ubuntu-24.04-amd64 GitHub Actions
verify-rc-source-ruby-macos-amd64 GitHub Actions
verify-rc-source-ruby-macos-arm64 GitHub Actions
verify-rc-source-windows GitHub Actions
wheel-macos-monterey-cp310-cp310-amd64 GitHub Actions
wheel-macos-monterey-cp310-cp310-arm64 GitHub Actions
wheel-macos-monterey-cp311-cp311-amd64 GitHub Actions
wheel-macos-monterey-cp311-cp311-arm64 GitHub Actions
wheel-macos-monterey-cp312-cp312-amd64 GitHub Actions
wheel-macos-monterey-cp312-cp312-arm64 GitHub Actions
wheel-macos-monterey-cp313-cp313-amd64 GitHub Actions
wheel-macos-monterey-cp313-cp313-arm64 GitHub Actions
wheel-macos-monterey-cp313-cp313t-amd64 GitHub Actions
wheel-macos-monterey-cp313-cp313t-arm64 GitHub Actions
wheel-macos-monterey-cp39-cp39-amd64 GitHub Actions
wheel-macos-monterey-cp39-cp39-arm64 GitHub Actions
wheel-manylinux-2-28-cp310-cp310-amd64 GitHub Actions
wheel-manylinux-2-28-cp310-cp310-arm64 GitHub Actions
wheel-manylinux-2-28-cp311-cp311-amd64 GitHub Actions
wheel-manylinux-2-28-cp311-cp311-arm64 GitHub Actions
wheel-manylinux-2-28-cp312-cp312-amd64 GitHub Actions
wheel-manylinux-2-28-cp312-cp312-arm64 GitHub Actions
wheel-manylinux-2-28-cp313-cp313-amd64 GitHub Actions
wheel-manylinux-2-28-cp313-cp313-arm64 GitHub Actions
wheel-manylinux-2-28-cp313-cp313t-amd64 GitHub Actions
wheel-manylinux-2-28-cp313-cp313t-arm64 GitHub Actions
wheel-manylinux-2-28-cp39-cp39-amd64 GitHub Actions
wheel-manylinux-2-28-cp39-cp39-arm64 GitHub Actions
wheel-musllinux-1-2-cp310-cp310-amd64 GitHub Actions
wheel-musllinux-1-2-cp310-cp310-arm64 GitHub Actions
wheel-musllinux-1-2-cp311-cp311-amd64 GitHub Actions
wheel-musllinux-1-2-cp311-cp311-arm64 GitHub Actions
wheel-musllinux-1-2-cp312-cp312-amd64 GitHub Actions
wheel-musllinux-1-2-cp312-cp312-arm64 GitHub Actions
wheel-musllinux-1-2-cp313-cp313-amd64 GitHub Actions
wheel-musllinux-1-2-cp313-cp313-arm64 GitHub Actions
wheel-musllinux-1-2-cp313-cp313t-amd64 GitHub Actions
wheel-musllinux-1-2-cp313-cp313t-arm64 GitHub Actions
wheel-musllinux-1-2-cp39-cp39-amd64 GitHub Actions
wheel-musllinux-1-2-cp39-cp39-arm64 GitHub Actions
wheel-windows-cp310-cp310-amd64 GitHub Actions
wheel-windows-cp311-cp311-amd64 GitHub Actions
wheel-windows-cp312-cp312-amd64 GitHub Actions
wheel-windows-cp313-cp313-amd64 GitHub Actions
wheel-windows-cp313-cp313t-amd64 GitHub Actions
wheel-windows-cp39-cp39-amd64 GitHub Actions

amoeba and others added 3 commits July 8, 2025 08:55
…#47026)

### Rationale for this change

See #47025.

### What changes are included in this PR?

- Updated developer docs on building Arrow C++

### Are these changes tested?

No.

### Are there any user-facing changes?

Yes. Users should be advised about the change.
* GitHub Issue: #47025

Authored-by: Bryce Mecum <petridish@gmail.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
…GNU ld (#47028)

### Rationale for this change

A particular combination of `gcc`, GNU `ld` and specific compiler flags leads to crashes when calling `std::call_once` in some compilation units:
https://gcc.gnu.org/bugzilla/show_bug.cgi?id=60662

The problem disappears when using another linker such `ld.gold` (which has been removed from GNU binutils) and `mold`.

### What changes are included in this PR?

Use `mold` on conda-based C++ builds.

### Are these changes tested?

By existing CI jobs.

### Are there any user-facing changes?

No.

* GitHub Issue: #47015

Authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
….22.0 (#46912)

### Rationale for this change

Bundled Boost 1.81.0 and Apache Thrift 0.22.0 are old.

It's difficult to upgrade only Boost because Apache Thrift depends on Boost. So this PR updates bundled Boost and Apache Thrift. 

### What changes are included in this PR?

* Update bundled Boost:
  * Use CMake based build instead of b2
  * Use FetchContent not ExternalProject 
  * Stop using our trimmed Boost source archive
* Update bundled Apache Thrift:
  * Use FetchContent not ExternalProject 

### Are these changes tested?

Yes.

### Are there any user-facing changes?

Yes.
* GitHub Issue: #46745
* GitHub Issue: #46740

Authored-by: Sutou Kouhei <kou@clear-code.com>
Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>
@amoeba

amoeba commented Jul 9, 2025

Copy link
Copy Markdown
Member Author

@github-actions crossbow submit r-binary-packages verify-rc-source-cpp-linux-almalinux-8-amd64 verify-rc-source-csharp-linux-ubuntu-22.04-amd64 verify-rc-source-integration-linux-ubuntu-24.04-amd64 verify-rc-source-python-linux-ubuntu-24.04-amd64 verify-rc-source-ruby-linux-ubuntu-22.04-amd64 verify-rc-source-windows wheel-musllinux-1-2-cp313-cp313t-amd64

@amoeba

amoeba commented Jul 9, 2025

Copy link
Copy Markdown
Member Author

I looked over the failing and jobs and all but one look like various flakiness, mostly timeouts. verify-rc-source-windows looks like something we may need to look into, I filed #47033.

@github-actions

github-actions Bot commented Jul 9, 2025

Copy link
Copy Markdown

Revision: 539a52d

Submitted crossbow builds: ursacomputing/crossbow @ actions-0851c175d8

Task Status
r-binary-packages GitHub Actions
verify-rc-source-cpp-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-csharp-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-integration-linux-ubuntu-24.04-amd64 GitHub Actions
verify-rc-source-python-linux-ubuntu-24.04-amd64 GitHub Actions
verify-rc-source-ruby-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-windows GitHub Actions
wheel-musllinux-1-2-cp313-cp313t-amd64 GitHub Actions

@amoeba

amoeba commented Jul 9, 2025

Copy link
Copy Markdown
Member Author

The last failing job is verify-rc-source-windows which can be fixed by whatever solution we find in #47033. There are only two issues left in the milestone (the windows one being one oft them): https://github.com/apache/arrow/issues?q=is%3Aissue%20state%3Aopen%20milestone%3A21.0.0. After those are resolved we can move onto RC0.

pitrou and others added 3 commits July 10, 2025 08:46
### Rationale for this change

The system package for xsimd is too old on Fedora 39, use bundled version instead.

### Are these changes tested?

By existing CI jobs.

### Are there any user-facing changes?

No.
* GitHub Issue: #47037

Authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
)

### Rationale for this change

OpenSUSE 15.5 ships old GCC (7.5) that doesn't have enough C++17 support.

### What changes are included in this PR?

Use Ubuntu 20.04 that ships GCC 9.3  instead of OpenSUSE 15.5.

Ubuntu 20.04 reached EOL but we can use it for now.

We discussed why we need OpenSUSE 15.5 based job at #45718 (comment) . We have the job because https://arrow.apache.org/docs/developers/cpp/building.html said "gcc 7.1 and higher should be sufficient".

We need require GCC 9 or later with #46813.

### Are these changes tested?

Yes.

### Are there any user-facing changes?

No.
* GitHub Issue: #46989

Lead-authored-by: Sutou Kouhei <kou@clear-code.com>
Co-authored-by: Sutou Kouhei <kou@cozmixng.org>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>
### Rationale for this change

If we use custom gtest main with MSVC, it always reports "SEH exception".

### What changes are included in this PR?

Remove MSVC version check.

### Are these changes tested?

Yes.

### Are there any user-facing changes?

No.

* GitHub Issue: #47033

Authored-by: Sutou Kouhei <kou@clear-code.com>
Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>
@amoeba

amoeba commented Jul 10, 2025

Copy link
Copy Markdown
Member Author

@github-actions crossbow submit --group verify-rc-source --group packaging

@github-actions

Copy link
Copy Markdown

Revision: c8b714f

Submitted crossbow builds: ursacomputing/crossbow @ actions-314f945730

Task Status
almalinux-10-amd64 GitHub Actions
almalinux-10-arm64 GitHub Actions
almalinux-8-amd64 GitHub Actions
almalinux-8-arm64 GitHub Actions
almalinux-9-amd64 GitHub Actions
almalinux-9-arm64 GitHub Actions
amazon-linux-2023-amd64 GitHub Actions
amazon-linux-2023-arm64 GitHub Actions
centos-7-amd64 GitHub Actions
centos-9-stream-amd64 GitHub Actions
centos-9-stream-arm64 GitHub Actions
conan-maximum GitHub Actions
conan-minimum GitHub Actions
debian-bookworm-amd64 GitHub Actions
debian-bookworm-arm64 GitHub Actions
debian-trixie-amd64 GitHub Actions
debian-trixie-arm64 GitHub Actions
matlab GitHub Actions
python-sdist GitHub Actions
r-binary-packages GitHub Actions
test-debian-12-docs GitHub Actions
ubuntu-jammy-amd64 GitHub Actions
ubuntu-jammy-arm64 GitHub Actions
ubuntu-noble-amd64 GitHub Actions
ubuntu-noble-arm64 GitHub Actions
verify-rc-source-cpp-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-cpp-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-cpp-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-cpp-linux-ubuntu-24.04-amd64 GitHub Actions
verify-rc-source-cpp-macos-amd64 GitHub Actions
verify-rc-source-cpp-macos-arm64 GitHub Actions
verify-rc-source-cpp-macos-conda-amd64 GitHub Actions
verify-rc-source-csharp-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-csharp-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-csharp-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-csharp-linux-ubuntu-24.04-amd64 GitHub Actions
verify-rc-source-csharp-macos-amd64 GitHub Actions
verify-rc-source-csharp-macos-arm64 GitHub Actions
verify-rc-source-integration-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-integration-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-integration-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-integration-linux-ubuntu-24.04-amd64 GitHub Actions
verify-rc-source-integration-macos-amd64 GitHub Actions
verify-rc-source-integration-macos-arm64 GitHub Actions
verify-rc-source-integration-macos-conda-amd64 GitHub Actions
verify-rc-source-python-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-python-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-python-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-python-linux-ubuntu-24.04-amd64 GitHub Actions
verify-rc-source-python-macos-amd64 GitHub Actions
verify-rc-source-python-macos-arm64 GitHub Actions
verify-rc-source-python-macos-conda-amd64 GitHub Actions
verify-rc-source-ruby-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-ruby-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-ruby-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-ruby-linux-ubuntu-24.04-amd64 GitHub Actions
verify-rc-source-ruby-macos-amd64 GitHub Actions
verify-rc-source-ruby-macos-arm64 GitHub Actions
verify-rc-source-windows GitHub Actions
wheel-macos-monterey-cp310-cp310-amd64 GitHub Actions
wheel-macos-monterey-cp310-cp310-arm64 GitHub Actions
wheel-macos-monterey-cp311-cp311-amd64 GitHub Actions
wheel-macos-monterey-cp311-cp311-arm64 GitHub Actions
wheel-macos-monterey-cp312-cp312-amd64 GitHub Actions
wheel-macos-monterey-cp312-cp312-arm64 GitHub Actions
wheel-macos-monterey-cp313-cp313-amd64 GitHub Actions
wheel-macos-monterey-cp313-cp313-arm64 GitHub Actions
wheel-macos-monterey-cp313-cp313t-amd64 GitHub Actions
wheel-macos-monterey-cp313-cp313t-arm64 GitHub Actions
wheel-macos-monterey-cp39-cp39-amd64 GitHub Actions
wheel-macos-monterey-cp39-cp39-arm64 GitHub Actions
wheel-manylinux-2-28-cp310-cp310-amd64 GitHub Actions
wheel-manylinux-2-28-cp310-cp310-arm64 GitHub Actions
wheel-manylinux-2-28-cp311-cp311-amd64 GitHub Actions
wheel-manylinux-2-28-cp311-cp311-arm64 GitHub Actions
wheel-manylinux-2-28-cp312-cp312-amd64 GitHub Actions
wheel-manylinux-2-28-cp312-cp312-arm64 GitHub Actions
wheel-manylinux-2-28-cp313-cp313-amd64 GitHub Actions
wheel-manylinux-2-28-cp313-cp313-arm64 GitHub Actions
wheel-manylinux-2-28-cp313-cp313t-amd64 GitHub Actions
wheel-manylinux-2-28-cp313-cp313t-arm64 GitHub Actions
wheel-manylinux-2-28-cp39-cp39-amd64 GitHub Actions
wheel-manylinux-2-28-cp39-cp39-arm64 GitHub Actions
wheel-musllinux-1-2-cp310-cp310-amd64 GitHub Actions
wheel-musllinux-1-2-cp310-cp310-arm64 GitHub Actions
wheel-musllinux-1-2-cp311-cp311-amd64 GitHub Actions
wheel-musllinux-1-2-cp311-cp311-arm64 GitHub Actions
wheel-musllinux-1-2-cp312-cp312-amd64 GitHub Actions
wheel-musllinux-1-2-cp312-cp312-arm64 GitHub Actions
wheel-musllinux-1-2-cp313-cp313-amd64 GitHub Actions
wheel-musllinux-1-2-cp313-cp313-arm64 GitHub Actions
wheel-musllinux-1-2-cp313-cp313t-amd64 GitHub Actions
wheel-musllinux-1-2-cp313-cp313t-arm64 GitHub Actions
wheel-musllinux-1-2-cp39-cp39-amd64 GitHub Actions
wheel-musllinux-1-2-cp39-cp39-arm64 GitHub Actions
wheel-windows-cp310-cp310-amd64 GitHub Actions
wheel-windows-cp311-cp311-amd64 GitHub Actions
wheel-windows-cp312-cp312-amd64 GitHub Actions
wheel-windows-cp313-cp313-amd64 GitHub Actions
wheel-windows-cp313-cp313t-amd64 GitHub Actions
wheel-windows-cp39-cp39-amd64 GitHub Actions

@amoeba

amoeba commented Jul 10, 2025

Copy link
Copy Markdown
Member Author

@github-actions crossbow submit verify-rc-source-cpp-macos-conda-amd64 wheel-macos-monterey-cp313-cp313t-arm64

@github-actions

Copy link
Copy Markdown

Revision: c8b714f

Submitted crossbow builds: ursacomputing/crossbow @ actions-b78a40bfd7

Task Status
verify-rc-source-cpp-macos-conda-amd64 GitHub Actions
wheel-macos-monterey-cp313-cp313t-arm64 GitHub Actions

@amoeba

amoeba commented Jul 10, 2025

Copy link
Copy Markdown
Member Author

Very strange errors,

verify-rc-source-cpp-macos-conda-amd64:

2025-07-10T15:50:45.5345360Z CMake Error: Generator: build tool execution failed, command was: /private/var/folders/vk/nx37ffx50hv5djclhltc26vw0000gn/T/arrow-HEAD.XXXXX.rP1e3pko/miniforge/envs/conda-source/bin/cmake -E env VERBOSE=1 /private/var/folders/vk/nx37ffx50hv5djclhltc26vw0000gn/T/arrow-HEAD.XXXXX.rP1e3pko/miniforge/envs/conda-source/bin/make -f Makefile cmTC_fb55f/fast
2025-07-10T15:50:45.5368430Z -- Detecting C compiler ABI info - failed

wheel-macos-monterey-cp313-cp313t-arm64:

test-env/lib/python3.13t/site-packages/pyarrow/tests/test_flight_async.py . [ 75%]
Fatal Python error: Segmentation fault

Thread 0x00000001f3760f80 (most recent call first):
  File "/Users/runner/work/crossbow/crossbow/test-env/lib/python3.13t/site-packages/_pytest/fixtures.py", line 53 in node
  File ???arrow/ci/scripts/python_wheel_unix_test.sh: line 110: 12982 Segmentation fault: 11  python -m pytest -r s --pyargs pyarrow
..

@amoeba

amoeba commented Jul 10, 2025

Copy link
Copy Markdown
Member Author

The last two jobs were flakes and the verify-rc-source-windows failure is expected due to #47051. We'll move onto an RC now.

@amoeba amoeba closed this Jul 10, 2025
@kou

kou commented Jul 10, 2025

Copy link
Copy Markdown
Member

@amoeba

amoeba commented Jul 10, 2025

Copy link
Copy Markdown
Member Author

@kou yes!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants