Repository navigation
fix: update skills for current SDKs and frontier models - #53
Merged
Merged
Conversation
- nextjs: handleAuthkitHeaders is a deprecated alias of handleAuthkitProxy; recommend the current name and stop forbidding it
- radar: Node SDK v11 ships workos.radar.{createAttempt,updateAttempt,addListEntry,removeListEntry}
- webhooks: verifyEvent does not exist; use constructEvent
- go: module path is workos-go/v6
- ruby: gem 7+ uses WorkOS.client.* (config.api_key, get_authorization_url, widgets.create_token)
- kotlin/java: artifact is com.workos:workos (7.x); update getAuthorizationUrl and widgets token APIs
- standalone SSO migration: clientId requirement was reversed
- migrations: API accepts pbkdf2/ssha256 but Node SDK PasswordHashType omits them
- widgets: package exports UsersManagement; note WorkOsWidgets provider, peer deps, authToken
|
| - `auth_method` must be one of: `Password`, `Passkey`, `Authenticator`, `SMS_OTP`, `Email_OTP`, `Social`, `SSO`, `Other`. Claude tends to use lowercase or invented values. | ||
| - `action` accepts: `login`, `signup` (and variants like `sign-in`, `sign_up`). Use the simplest form. | ||
| - After a successful authentication, call `PUT /radar/attempts/:id` with `attempt_status: "success"` to improve Radar's model (enables impossible travel detection). | ||
| - After a successful authentication, update the attempt with `attempt_status: "success"` (`updateAttempt({ id, attemptStatus: 'success' })`) to improve Radar's model (enables impossible travel detection). |
There was a problem hiding this comment.
Correct Radar answers lose points
The guide now recommends workos.radar.updateAttempt, but scripts/eval/cases/radar.yaml still lists that exact method under hallucinations. scoreOutput() uses that list, so an answer following the updated guide gets marked as an invented API and loses points. Update the Radar cases' methods, parameters, and flow expectations alongside this SDK correction.
Prompt To Fix With AI
This is a comment left during a code review.
Path: plugins/workos/skills/workos/references/workos-radar.md
Line: 22
Comment:
**Correct Radar answers lose points**
The guide now recommends `workos.radar.updateAttempt`, but `scripts/eval/cases/radar.yaml` still lists that exact method under `hallucinations`. `scoreOutput()` uses that list, so an answer following the updated guide gets marked as an invented API and loses points. Update the Radar cases' methods, parameters, and flow expectations alongside this SDK correction.
---
For each issue above, determine whether it is valid and should be fixed. If so, fix it directly.Remove scaffolding that frontier models no longer need: STOP/BLOCKING/ CRITICAL banners, package-manager and framework detection trees, generic error-recovery tables, duplicated checklists, and long verbatim code blocks. Keep WorkOS-specific gotchas, env vars, security rules, and doc URLs. Backend SDK references now share one short shape (setup, gotchas, existing auth). No API facts changed.
… start path - directory-sync cases expect workos.webhooks.constructEvent - radar: workos.radar.updateAttempt is a real Node v11 method, not a hallucination - tanstack-start: legacy app/-rooted projects use app/start.ts
nicknisi
force-pushed
the
chore/skills-current-models
branch
from
October 9, 2026 21:46
dde8efd to
bcf5b8e
Compare
This was referenced Oct 19, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
A pass over the skills for current frontier models (Opus 4.5 / 5.5), in two commits.
1.
fix: correct stale SDK APIs in skill references(f0c6715)Every claim below was checked against the published SDKs (node 11.0.0, authkit-nextjs 4.4.0, widgets 1.20.0, Ruby gem 10.4.0, workos-go v6.5.0,
com.workos:workos7.4.0,@workos/openapi-spec0.123.0).handleAuthkitHeaders()"handleAuthkitProxy(handleAuthkitHeadersis a deprecated alias)workos.radar.*namespace"createAttempt/updateAttempt/addListEntry/removeListEntryworkos.webhooks.verifyEvent(doesn't exist)constructEventworkos-go/v4workos-go/v6config.keyWorkOS.client.*,config.api_key,widgets.create_token; note for gems below 7com.workos:workos-kotlin:4.18.1(not on Maven Central), builder APIcom.workos:workos7.x,AuthKitAuthorizationUrlOptions,widgets.createTokenclientIdrequirement reversedgetProfileAndTokenrequires it;authenticateWithCodefalls back to the client'spbkdf2is kept (the API accepts it),ssha256added, and a note that Node'sPasswordHashTypeomits both<UserManagement /><UsersManagement />, plus theWorkOsWidgetsprovider, peer deps, andauthToken2.
refactor: prune skill references for current models(dde8efd)Net about −2,900 lines. Removed: STOP/BLOCKING/CRITICAL/ALL MUST PASS banners, package-manager and framework detection trees, generic error-recovery tables, duplicated checklists, and long code blocks the agent copied verbatim. Kept: WorkOS-specific gotchas, env vars, security rules, doc URLs, and every string the tests assert. The 9 backend references now share one short shape (setup / gotchas / existing auth).
Installer prompt size for Next.js (base + nextjs + setup): 41.2 KB → 28.2 KB. Backend references went from about 6 KB to about 2 KB each.
Out of scope, flagged for follow-up:
/_widgetsplus an 11k-line spec and bundled parser, instead of the shipped components. I only fixed names here.Verification
pnpm test: 386 passed;pnpm format:checkandpnpm lintare clean. One test now splits on the renumbered Next.js steps (## Step 4:instead of## Step 6b:).#anchorresolves.@workos/skills. Requires chore(deps): bump claude-agent-sdk to 0.3.295 for Opus 5.5 support cli#261 (SDK bump for Opus 5.5) and test(evals): accept handleAuthkitProxy and app-owned AuthKitProvider modules cli#262, which acceptshandleAuthkitProxy.¹ Both failures were grader false negatives, fixed in workos/cli#262.
One run per model per condition, so treat the deltas as directional.