Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ license: MIT
metadata:
version: "1.1.0"
distribution: shared
description: 'Generate, build, and test Azure SDKs locally from TypeSpec with automatic customization. WHEN: "generate SDK locally", "build SDK", "run SDK tests", "run CI checks", "validate package", "run checks", "update changelog", "fix SDK build errors", "fix breaking changes", "resolve SDK generation errors", "customize TypeSpec", "rename SDK client", "rename SDK model", "hide operation from SDK", "fix analyzer errors", "resolve customization drift", "create subclient", "update metadata", "update version". DO NOT USE FOR: publishing to package registries, CI pipeline configuration, API design review. INVOKES: azsdk_verify_setup, azsdk_package_generate_code, azsdk_package_build_code, azsdk_package_run_check, azsdk_package_run_tests, azsdk_customized_code_update, azsdk_package_update_changelog_content, azsdk_package_update_metadata, azsdk_package_update_version.'
description: 'Generate, build, validation, and test Azure SDKs locally from TypeSpec with automatic customization. WHEN: "generate SDK locally", "build SDK", "run SDK tests", "run CI checks", "validate package", "run checks", "update changelog", "fix SDK build errors", "fix breaking changes", "resolve SDK generation errors", "customize TypeSpec", "rename SDK client", "rename SDK model", "hide operation from SDK", "fix analyzer errors", "resolve customization drift", "create subclient", "update metadata", "update version". DO NOT USE FOR: publishing to package registries, CI pipeline configuration, API design review. INVOKES: azsdk_verify_setup, azsdk_package_generate_code, azsdk_package_build_code, azsdk_package_run_check, azsdk_package_run_tests, azsdk_customized_code_update, azsdk_package_update_changelog_content, azsdk_package_update_metadata, azsdk_package_update_version.'
compatibility: "azure-sdk-mcp server, local azure-sdk-for-{language} clone, language build tools"
---

Expand Down
2 changes: 1 addition & 1 deletion .github/skills/azure-typespec-author/evaluate/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ Why each piece matters:
- **`FIXTURE_NODE_MODULES`** lets the agent symlink a prebuilt `node_modules` instead of running
`npm install` on every case. Without it evals still work, just slower.
- **`copilot-instructions.md`** is copied into each run's `.github/` by the `azsdk-mcp` environments
in `.vally.yaml`, so evals exercise the *real* spec-repo authoring guidance. It is intentionally
in `.vally.yaml`, so evals exercise the _real_ spec-repo authoring guidance. It is intentionally
**not** checked in (it is git-ignored) and always refreshed from `main`, so the eval reflects what
authors actually see today.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ stimuli:
pattern: "@@added\\(Employee\\.identity, (Microsoft\\.Widget\\.)?Versions\\.(v2025_05_04_preview|`2025-05-04-preview`)\\);"
- type: prompt
config:
prompt: "Verify the identity property is cleanly version-scoped to 2025-05-04-preview only, with changes limited to this task. Using `#suppress` to bypass TypeSpec or ARM validation is NOT an acceptable solution: if any suppression is present, fail regardless of how the agent justifies it as \"appropriate\". If a compiled swagger is present, also confirm the Employee identity is a valid ARM envelope property that appears only in the 2025-05-04-preview spec and is absent from the 2021-11-01 stable spec."
prompt: 'Verify the identity property is cleanly version-scoped to 2025-05-04-preview only, with changes limited to this task. Using `#suppress` to bypass TypeSpec or ARM validation is NOT an acceptable solution: if any suppression is present, fail regardless of how the agent justifies it as "appropriate". If a compiled swagger is present, also confirm the Employee identity is a valid ARM envelope property that appears only in the 2025-05-04-preview spec and is absent from the 2021-11-01 stable spec.'
model: claude-opus-4.6
scoring: scale_1_10
threshold: 1
Expand Down
Loading