[Storage] Fix 103/104 Live Test Failures by weirongw23-msft · Pull Request #48376 · Azure/azure-sdk-for-python

Peter Wu (weirongw23-msft) · 2026-07-30T17:34:03Z

Will still expect smart tiers to fail, but the other tests should not be failing.

Peter Wu (weirongw23-msft) · 2026-07-30T17:34:16Z

/azp run python - storage - tests

azure-pipelines · 2026-07-30T17:34:38Z

Azure Pipelines: Successfully started running 1 pipeline(s).

azure-pipelines · 2026-07-30T17:34:41Z

Azure Pipelines: Successfully started running 1 pipeline(s). 9 pipeline(s) were filtered out due to trigger conditions. There may be pipelines that require an authorized user to comment /azp run to run.

azure-pipelines · 2026-07-30T17:34:43Z

Azure Pipelines: Successfully started running 1 pipeline(s). 9 pipeline(s) were filtered out due to trigger conditions. There may be pipelines that require an authorized user to comment /azp run to run.

Copilot

Pull request overview

Updates Blob Arrow live tests to allow an optional last_accessed_on value while still validating timezone information when present.

Changes:

Relax synchronous and asynchronous blob metadata assertions consistently.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File	Description
`sdk/storage/azure-storage-blob/tests/test_arrow.py`	Handles absent last-access timestamps.
`sdk/storage/azure-storage-blob/tests/test_arrow_async.py`	Applies equivalent asynchronous test behavior.

…t copy tests

Copilot

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated no new comments.

Comments suppressed due to low confidence (4)

sdk/storage/azure-storage-file-share/tests/test_file.py:2839

NO_PENDING_COPY_OPERATION only proves that the operation has ended; it does not prove that it finished successfully. If the OAuth copy fails before this abort request, this branch now treats that real live-test failure as a pass. Verify the final copy status and data in this race path instead of accepting every ended operation.

        except HttpResponseError as e:
            assert e.error_code == StorageErrorCode.NO_PENDING_COPY_OPERATION

sdk/storage/azure-storage-file-share/tests/test_file_async.py:2900

NO_PENDING_COPY_OPERATION only proves that the operation has ended; it does not prove that it finished successfully. If the OAuth copy fails before this abort request, this branch now treats that real live-test failure as a pass. Verify the final copy status and data in this race path instead of accepting every ended operation.

        except HttpResponseError as e:
            assert e.error_code == StorageErrorCode.NO_PENDING_COPY_OPERATION

sdk/storage/azure-storage-file-share/tests/test_file.py:2785

NO_PENDING_COPY_OPERATION only proves that the operation has ended; it does not prove that it finished successfully. If the remote copy fails before this abort request, this branch now treats that real live-test failure as a pass. Verify the final copy status and data in this race path instead of accepting every ended operation.

This issue also appears on line 2838 of the same file.

        except HttpResponseError as e:
            assert e.error_code == StorageErrorCode.NO_PENDING_COPY_OPERATION

sdk/storage/azure-storage-file-share/tests/test_file_async.py:2844

NO_PENDING_COPY_OPERATION only proves that the operation has ended; it does not prove that it finished successfully. If the remote copy fails before this abort request, this branch now treats that real live-test failure as a pass. Verify the final copy status and data in this race path instead of accepting every ended operation.

This issue also appears on line 2899 of the same file.

        except HttpResponseError as e:
            assert e.error_code == StorageErrorCode.NO_PENDING_COPY_OPERATION

Peter Wu (weirongw23-msft) · 2026-07-30T18:53:41Z

/azp run python - storage - tests

azure-pipelines · 2026-07-30T18:54:01Z

Azure Pipelines: Successfully started running 1 pipeline(s).

Copilot

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated no new comments.

github-actions · 2026-07-30T21:13:39Z

[Pilot] PR Pipeline Failure Analysis

A CI pipeline failed on this pull request. Here is an automated analysis of what went wrong and how to get the build green.

What failed

The same two tests failed consistently across all platforms (Ubuntu 24.04 Python 3.10/3.13/3.14, macOS Python 3.11, Windows 2022 Python 3.12) and all install modes (whl, sdist, mindependency):

sdk.storage.azure-storage-blob.tests.test_arrow.TestStorageApacheArrow.test_arrow_list_blobs_include_versions
sdk.storage.azure-storage-blob.tests.test_arrow_async.TestStorageApacheArrowAsync.test_arrow_list_blobs_include_versions

Category: test failure. The failures are reproducible across every OS/Python-version combination and all three install modes, which strongly suggests the tests are asserting behavior that this PR's code changes have affected (or a service-side response changed). The PR description notes "the other tests should not be failing," indicating these failures may be unintended regressions.

Recommended next steps

Investigate test_arrow_list_blobs_include_versions (sync and async) in sdk/storage/azure-storage-blob/tests/ — check what assertion is failing and whether it's related to the 103/104 fixes introduced by this PR.
Run the tests locally against a live or recorded endpoint to reproduce and diagnose the failure.
If the test expectations need updating to match new correct behavior, update the test recordings and/or assertions accordingly.
If these failures are pre-existing and unrelated to this PR, consider filing a separate issue and skipping/xfailing the tests with a tracking comment.
See the CI troubleshooting guide: https://aka.ms/ci-fix
Push new commits to address the failures; this comment updates automatically on the next failing run.

Raw pipeline analysis (azsdk ci analyze)

Analyzing pipeline https://github.com/Azure/azure-sdk-for-python/pull/48376...
--------------------------------------------------------------------------------
Failed Tests
--------------------------------------------------------------------------------
{
  "LLM Artifacts - Ubuntu2404_313": [
    "sdk.storage.azure-storage-blob.tests.test_arrow.TestStorageApacheArrow.test_arrow_list_blobs_include_versions",
    "sdk.storage.azure-storage-blob.tests.test_arrow_async.TestStorageApacheArrowAsync.test_arrow_list_blobs_include_versions"
  ],
  "LLM Artifacts - macos311": [
    "sdk.storage.azure-storage-blob.tests.test_arrow.TestStorageApacheArrow.test_arrow_list_blobs_include_versions",
    "sdk.storage.azure-storage-blob.tests.test_arrow_async.TestStorageApacheArrowAsync.test_arrow_list_blobs_include_versions"
  ],
  "LLM Artifacts - ubuntu2404_310": [
    "sdk.storage.azure-storage-blob.tests.test_arrow.TestStorageApacheArrow.test_arrow_list_blobs_include_versions",
    "sdk.storage.azure-storage-blob.tests.test_arrow_async.TestStorageApacheArrowAsync.test_arrow_list_blobs_include_versions"
  ],
  "LLM Artifacts - ubuntu2404_310_coverage": [
    "sdk.storage.azure-storage-blob.tests.test_arrow.TestStorageApacheArrow.test_arrow_list_blobs_include_versions",
    "sdk.storage.azure-storage-blob.tests.test_arrow_async.TestStorageApacheArrowAsync.test_arrow_list_blobs_include_versions"
  ],
  "LLM Artifacts - Ubuntu2404_314": [
    "sdk.storage.azure-storage-blob.tests.test_arrow.TestStorageApacheArrow.test_arrow_list_blobs_include_versions",
    "sdk.storage.azure-storage-blob.tests.test_arrow_async.TestStorageApacheArrowAsync.test_arrow_list_blobs_include_versions"
  ],
  "LLM Artifacts - windows2022_312": [
    "sdk.storage.azure-storage-blob.tests.test_arrow.TestStorageApacheArrow.test_arrow_list_blobs_include_versions",
    "sdk.storage.azure-storage-blob.tests.test_arrow_async.TestStorageApacheArrowAsync.test_arrow_list_blobs_include_versions"
  ]
}

Copilot detected the failing pipeline and generated the analysis above. To have it attempt a fix automatically, reply with @copilot please fix the failing pipeline on this PR.

Generated by Pipeline Analysis - Next Steps · 20.2 AIC · ⌖ 6.31 AIC · ⊞ 6.6K · ◷

… os urandom

Copilot

Pull request overview

Copilot reviewed 9 out of 9 changed files in this pull request and generated no new comments.

Suppressed comments (4)

sdk/storage/azure-storage-file-share/tests/test_file.py:2839

NoPendingCopyOperation also occurs when an asynchronous copy has ended in a failed state, so checking only this error code can turn a real copy failure into a passing test. Confirm the completed target and its contents before treating the exception as the benign completion race.

        except HttpResponseError as e:
            assert e.error_code == StorageErrorCode.NO_PENDING_COPY_OPERATION

sdk/storage/azure-storage-file-share/tests/test_file_async.py:2900

A completed failed copy can also cause abort_copy to return NoPendingCopyOperation, so this assertion alone lets that failure pass. Verify that this race ended with a successful copy and the expected content.

        except HttpResponseError as e:
            assert e.error_code == StorageErrorCode.NO_PENDING_COPY_OPERATION

sdk/storage/azure-storage-file-share/tests/test_file.py:2785

NoPendingCopyOperation only proves that the copy is no longer pending; an asynchronously failed copy produces the same abort error. As written, that failure path now passes the test. Verify that the target completed successfully (and contains the source data) before accepting this as the expected race.

This issue also appears on line 2838 of the same file.

        except HttpResponseError as e:
            assert e.error_code == StorageErrorCode.NO_PENDING_COPY_OPERATION

sdk/storage/azure-storage-file-share/tests/test_file_async.py:2844

NoPendingCopyOperation only indicates that the operation has ended; it does not distinguish a successful completion from a failed copy. This branch therefore masks failed-copy regressions. Check the target status and copied bytes before accepting the race.

This issue also appears on line 2899 of the same file.

        except HttpResponseError as e:
            assert e.error_code == StorageErrorCode.NO_PENDING_COPY_OPERATION

Copilot

Pull request overview

Copilot reviewed 13 out of 13 changed files in this pull request and generated no new comments.

Peter Wu (weirongw23-msft) · 2026-07-31T19:31:02Z

/azp run python - storage - tests

azure-pipelines · 2026-07-31T19:31:22Z

Azure Pipelines: Successfully started running 1 pipeline(s).

Fixed arrow tests

d105153

Peter Wu (weirongw23-msft) marked this pull request as ready for review July 30, 2026 17:34

Peter Wu (weirongw23-msft) requested review from Jacob Lauzon (jalauzon-msft) and vincenttran-msft as code owners July 30, 2026 17:34

Copilot AI review requested due to automatic review settings July 30, 2026 17:34

github-actions Bot added the Storage Storage Service (Queues, Blobs, Files) label Jul 30, 2026

Copilot started reviewing on behalf of Peter Wu (weirongw23-msft) July 30, 2026 17:34 View session

Copilot AI reviewed Jul 30, 2026

View reviewed changes

Peter Wu (weirongw23-msft) added 2 commits July 30, 2026 13:50

Added try-except to tolerate machines that finishes copy fast in abor…

96fe7f5

…t copy tests

Merge branch 'main' into weirongw23/103-104-fixes

c922de7

Copilot AI review requested due to automatic review settings July 30, 2026 18:00

Copilot started reviewing on behalf of Peter Wu (weirongw23-msft) July 30, 2026 18:01 View session

Copilot AI reviewed Jul 30, 2026

View reviewed changes

upload is 1 version, and set metadata is another version

842ddbb

Copilot AI review requested due to automatic review settings July 30, 2026 20:22

Copilot started reviewing on behalf of Peter Wu (weirongw23-msft) July 30, 2026 20:22 View session

Copilot AI reviewed Jul 30, 2026

View reviewed changes

Encryption tests failing due to partitioned uploads, fixed by mocking…

c2ed203

… os urandom

Copilot AI review requested due to automatic review settings July 31, 2026 18:41

Copilot started reviewing on behalf of Peter Wu (weirongw23-msft) July 31, 2026 18:42 View session

Copilot AI reviewed Jul 31, 2026

View reviewed changes

Refreshed test recordings

3a09010

Copilot AI review requested due to automatic review settings July 31, 2026 18:47

Copilot started reviewing on behalf of Peter Wu (weirongw23-msft) July 31, 2026 18:48 View session

Copilot AI reviewed Jul 31, 2026

View reviewed changes

Jacob Lauzon (jalauzon-msft) approved these changes Jul 31, 2026

View reviewed changes

Peter Wu (weirongw23-msft) merged commit f5033d5 into Azure:main Jul 31, 2026
35 of 50 checks passed

Peter Wu (weirongw23-msft) deleted the weirongw23/103-104-fixes branch July 31, 2026 22:54

Uh oh!

Conversation

Peter Wu (weirongw23-msft) commented Jul 30, 2026

Uh oh!

Peter Wu (weirongw23-msft) commented Jul 30, 2026

Uh oh!

azure-pipelines Bot commented Jul 30, 2026

Uh oh!

azure-pipelines Bot commented Jul 30, 2026

Uh oh!

azure-pipelines Bot commented Jul 30, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Peter Wu (weirongw23-msft) commented Jul 30, 2026

Uh oh!

azure-pipelines Bot commented Jul 30, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

github-actions Bot commented Jul 30, 2026

What failed

Recommended next steps

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Peter Wu (weirongw23-msft) commented Jul 31, 2026

Uh oh!

azure-pipelines Bot commented Jul 31, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants