Skip to content

Move patched evaluation TypedDicts to the azure.ai.projects.types namespace#48159

Open
dargilco wants to merge 3 commits into
feature/azure-ai-projects/vnextfrom
dargilco/move-evaluation-typeddicts
Open

Move patched evaluation TypedDicts to the azure.ai.projects.types namespace#48159
dargilco wants to merge 3 commits into
feature/azure-ai-projects/vnextfrom
dargilco/move-evaluation-typeddicts

Fix broken import in _patch.pyi

2d6126e
Select commit
Loading
Failed to load commit list.
Azure Pipelines / python - pullrequest failed Jul 21, 2026 in 29m 35s

Build #20260721.50 had test failures

16 errors / 2 warnings

Details

Tests

  • Failed: 1,353 (35.15%)
  • Passed: 2,178 (56.59%)
  • Other: 318 (8.26%)
  • Total: 3,849

Annotations

Check failure on line 7370 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / python - pullrequest

Build log #L7370 

PowerShell exited with code '1'.

Check failure on line 65925 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / python - pullrequest

Build log #L65925 

There are one or more test failures detected in result files. Detailed summary of published test results can be viewed in the Tests tab.

Check failure on line 70834 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / python - pullrequest

Build log #L70834 

There are one or more test failures detected in result files. Detailed summary of published test results can be viewed in the Tests tab.

Check failure on line 123 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / python - pullrequest

Build log #L123 

1ES PT Non-Blocking Error: This pipeline is using the deprecated BinSkim v1.9.5 which will be retired and upgraded to the latest version. Please address this issue to resolve the corresponding S360 item. For 1ES PT users, please visit https://aka.ms/1espt/binskim195 for the instructions to avoid any breaks

Check failure on line 1 in sdk.ai.azure-ai-projects.tests.agents.telemetry.test_ai_agents_instrumentor

See this annotation in the file changed.

@azure-pipelines azure-pipelines / python - pullrequest

sdk.ai.azure-ai-projects.tests.agents.telemetry.test_ai_agents_instrumentor 

collection failure
Raw output 
tests/agents/telemetry/test_ai_agents_instrumentor.py:14: in <module>
    from test_base import servicePreparer
<frozen importlib._bootstrap>:1176: in _find_and_load
    ???
<frozen importlib._bootstrap>:1147: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:690: in _load_unlocked
    ???
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/_pytest/assertion/rewrite.py:185: in exec_module
    exec(co, module.__dict__)
tests/test_base.py:16: in <module>
    from azure.ai.projects.models import (
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/__init__.py:32: in <module>
    _patch_sdk()
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/_patch.py:414: in patch_sdk
    patch_types_module = importlib.import_module(f"{__package__}._patch_types")
/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/_patch_types.py:60: in <module>
    class TargetCompletionEvalRunDataSource(TypedDict, total=False):
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/_patch_types.py:69: in TargetCompletionEvalRunDataSource
    target: Required[Union[AzureAIAgentTarget, AzureAIModelTarget, dict[str, Any]]]
E   NameError: name 'AzureAIAgentTarget' is not defined

Check failure on line 1 in sdk.ai.azure-ai-projects.tests.agents.telemetry.test_ai_agents_instrumentor_async

See this annotation in the file changed.

@azure-pipelines azure-pipelines / python - pullrequest

sdk.ai.azure-ai-projects.tests.agents.telemetry.test_ai_agents_instrumentor_async 

collection failure
Raw output 
tests/agents/telemetry/test_ai_agents_instrumentor_async.py:11: in <module>
    from test_base import servicePreparer
<frozen importlib._bootstrap>:1176: in _find_and_load
    ???
<frozen importlib._bootstrap>:1147: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:690: in _load_unlocked
    ???
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/_pytest/assertion/rewrite.py:185: in exec_module
    exec(co, module.__dict__)
tests/test_base.py:31: in <module>
    from azure.ai.projects import AIProjectClient
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/__init__.py:32: in <module>
    _patch_sdk()
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/_patch.py:414: in patch_sdk
    patch_types_module = importlib.import_module(f"{__package__}._patch_types")
/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/_patch_types.py:60: in <module>
    class TargetCompletionEvalRunDataSource(TypedDict, total=False):
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/_patch_types.py:69: in TargetCompletionEvalRunDataSource
    target: Required[Union[AzureAIAgentTarget, AzureAIModelTarget, dict[str, Any]]]
E   NameError: name 'AzureAIAgentTarget' is not defined

Check failure on line 1 in sdk.ai.azure-ai-projects.tests.agents.telemetry.test_ai_instrumentor_base

See this annotation in the file changed.

@azure-pipelines azure-pipelines / python - pullrequest

sdk.ai.azure-ai-projects.tests.agents.telemetry.test_ai_instrumentor_base 

collection failure
Raw output 
tests/agents/telemetry/test_ai_instrumentor_base.py:16: in <module>
    from test_base import TestBase
<frozen importlib._bootstrap>:1176: in _find_and_load
    ???
<frozen importlib._bootstrap>:1147: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:690: in _load_unlocked
    ???
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/_pytest/assertion/rewrite.py:185: in exec_module
    exec(co, module.__dict__)
tests/test_base.py:31: in <module>
    from azure.ai.projects import AIProjectClient
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/__init__.py:32: in <module>
    _patch_sdk()
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/_patch.py:414: in patch_sdk
    patch_types_module = importlib.import_module(f"{__package__}._patch_types")
/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/_patch_types.py:60: in <module>
    class TargetCompletionEvalRunDataSource(TypedDict, total=False):
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/_patch_types.py:69: in TargetCompletionEvalRunDataSource
    target: Required[Union[AzureAIAgentTarget, AzureAIModelTarget, dict[str, Any]]]
E   NameError: name 'AzureAIAgentTarget' is not defined

Check failure on line 1 in sdk.ai.azure-ai-projects.tests.agents.telemetry.test_non_recording_span

See this annotation in the file changed.

@azure-pipelines azure-pipelines / python - pullrequest

sdk.ai.azure-ai-projects.tests.agents.telemetry.test_non_recording_span 

collection failure
Raw output 
tests/agents/telemetry/test_non_recording_span.py:19: in <module>
    from azure.ai.projects.telemetry._ai_project_instrumentor import (
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/__init__.py:32: in <module>
    _patch_sdk()
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/_patch.py:414: in patch_sdk
    patch_types_module = importlib.import_module(f"{__package__}._patch_types")
/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/_patch_types.py:60: in <module>
    class TargetCompletionEvalRunDataSource(TypedDict, total=False):
../../../.venv/azure-ai-projects/.venv_mindependency/lib/python3.11/site-packages/azure/ai/projects/_patch_types.py:69: in TargetCompletionEvalRunDataSource
    target: Required[Union[AzureAIAgentTarget, AzureAIModelTarget, dict[str, Any]]]
E   NameError: name 'AzureAIAgentTarget' is not defined
View more details on Azure Pipelines