Route BYO admin-connected judge models through the project Responses API (prompty judge path)#48002

Merged

shrutiyer merged 27 commits into

mainfrom

shruti/byo-admin-judge

Jul 20, 2026

Commits on Jul 10, 2026

Prototype: BYO admin-connected judge models via project Responses API shim
Shruti Iyer
committed

Commits on Jul 15, 2026

Route admin-connected (BYO) judge models through the project Responses API (prompty judges)

Shruti Iyer
and
Copilot
committed
Forward response_format as text.format in BYO judge Responses shim

Shruti Iyer
and
Copilot
committed
Fix black formatting in test_byo_judge.py

Shruti Iyer
and
Copilot
committed

Commits on Jul 16, 2026

Fix: require both BYO markers (byo_model + project_endpoint)

Shruti Iyer
and
Copilot
committed
Fix: surface real finish_reason from the Responses result

Shruti Iyer
and
Copilot
committed
Fix: honor the per-request timeout in the BYO shim

Shruti Iyer
and
Copilot
committed
Fix: compute total_tokens fallback in the usage adapter

Shruti Iyer
and
Copilot
committed
Fix: await-safe project client creation; drop dead responses property

Shruti Iyer
and
Copilot
committed
Surface clear MissingRequiredPackage error when azure-ai-projects is absent

Shruti Iyer
and
Copilot
committed
Require BYO markers to be non-empty strings in is_byo_model_config

Shruti Iyer
and
Copilot
committed
Support optional additional headers in AsyncByoProjectResponsesClient

Shruti Iyer
and
Copilot
committed
Preserve server-provided created timestamp in BYO chat-completion shim

Shruti Iyer
and
Copilot
committed
Preserve SDK default headers on the BYO prompty path

Shruti Iyer
and
Copilot
committed
Cast BYO model config to Any in validate_model_config

Shruti Iyer
and
Copilot
committed

Commits on Jul 17, 2026

Forward per-request extra_headers in the BYO chat-completions shim

Shruti Iyer
and
Copilot
committed

Commits on Jul 20, 2026

Merge branch 'main' into shruti/byo-admin-judge
shrutiyer
authored
Make test_evaluate_output_path xdist-safe (fixes sdist/whl CI legs)

Shruti Iyer
and
Copilot
committed
Fix BYO shim: read Responses created_at and disable client-side retries

Shruti Iyer
and
Copilot
committed
Represent the BYO caller contract with a BYOModelConfiguration TypedDict

Shruti Iyer
and
Copilot
committed
Add CHANGELOG entry for admin-connected (BYO) judge models

Shruti Iyer
and
Copilot
committed
Keep BYOModelConfiguration internal (_BYOModelConfiguration)

Shruti Iyer
and
Copilot
committed
Drop BYO CHANGELOG entry; require azure-ai-projects>=2.0.0b1 for tests

Shruti Iyer
and
Copilot
committed
Make BYO inline comments concise

Shruti Iyer
and
Copilot
committed
Revert azure-ai-projects test pin to <=1.0.0b10

Shruti Iyer
and
Copilot
committed
Fix OTel event-logging test guard to detect the Events API submodule

Shruti Iyer
and
Copilot
committed
Build Responses input via openai SDK EasyInputMessageParam

Shruti Iyer
and
Copilot
committed