Skip to content

Keep tool argument headers and bodies in sync - #15

Merged
quinnj merged 1 commit into
mainfrom
perf/tool-header-arguments
Oct 2, 2026
Merged

quinnj merged 1 commit into
mainfrom
perf/tool-header-arguments

Conversation

@quinnj

@quinnj quinnj commented Sep 26, 2026 •

Copy link
Copy Markdown
Member

Modern call_tool encoded known tools' arguments twice: once for Mcp-Param-* headers and again for the request body. Custom JSON lowering could therefore send a routing header such as west with body value east, causing HTTP 400 / HeaderMismatch (-32020) before the tool ran.

Prepare one validated argument snapshot and reuse it for both representations through the existing JSON.JSONText API. Full object validation, duplicate-key/null semantics, schema discovery, omitted arguments, legacy calls and generic JSON-RPC behavior stay covered. This repairs the existing 2026-07-28 header/body contract; no exports or dependencies are added.

Validation:

  • Full suites: 607 checks on Julia 1.13.0; 601 on Julia 1.10.12.
  • 125 focused wire/error/side-effect checks also pass with HTTP 1.11.0 and JSON 1.0.0. The changing-value case fails against main with HTTP 400/-32020.
  • Official conformance runner 0.2.0-alpha.11: custom headers 18/18 and invalid tool headers 11/11.
  • Existing static-server JuliaC --trim=safe compile/run and Documenter build/doctests pass. The native gate does not cover the dynamic modern client.
  • Hosted CI: all 10 jobs and the documentation status are green at 9b31da6f65ba2510ce90a576c20f66748f7c8604, including Linux/macOS/Windows on minimum/current/nightly Julia.

Alternating same-process loopback calls, cached schema, HTTP 2.8 / JSON 1.9, median of 31 pairs:

Julia Routed arguments Full call Allocated bytes
1.13 10,000 integers 2.126 → 1.928 ms 1,319,616 → 1,326,784
1.10 10,000 integers 2.418 → 2.195 ms 4,592,176 → 2,837,408
1.13 1 MiB string 3.474 → 3.284 ms essentially unchanged
1.10 1 MiB string 4.091 → 3.885 ms essentially unchanged

These measurements include client/server JSON handling and actual TCP, excluding discovery, TLS and application work. Small warmed calls were unchanged. The first routed call added approximately 9 ms on Julia 1.13 and 22 ms on 1.10 in three fresh-process pairs; current-runtime numeric calls allocate about 7 KB more. Unrelated host work remained active, so these are bounded measurements, not a general throughput claim.

This is an AI-driven, researched change. An independent AI review traced the client, JSON-RPC serialization, schema validation and server header checks at the exact published head. Fresh complete suites pass on Julia 1.13.1 (607 checks, including the 7 static-server native checks) and Julia 1.10.12 (601 checks). All 11 hosted checks are green.

Co-authored by Codex

@quinnj
quinnj merged commit 177af30 into main Oct 2, 2026
11 checks passed
quinnj added a commit that referenced this pull request Oct 2, 2026
Local MCP servers using stdin/stdout cannot currently use this package's client: a manually constructed stdio descriptor fails during initialization with `transport_unsupported`. Add the qualified `ModelContextProtocol.prepare_stdio_client(command)` constructor, including a do-block form, and reuse the existing initialization, list/call, handler, and termination APIs.

The client owns one child process and its protocol pipes. It matches concurrent responses by exact request ID, separates stderr, bounds frames and pending work, and applies one deadline to queued writes and response waits. EOF or invalid output fails pending calls and starts process cleanup. Write failures preserve the original failure; complete responses received before EOF remain available.

Notifications retain arrival order. Legacy server requests run in bounded, owned tasks so a handler's nested call can receive another server request before completing. Request handlers may overlap notifications and other request handlers. External `close` waits for all owned tasks under one deadline. A callback calling `close` waits for process and IO shutdown without waiting on other callbacks, avoiding cycles between callbacks that close concurrently. Unfinished callbacks remain owned for a later external close; arbitrary blocked user code still needs cooperative release.

Protocol selection is explicit: `2025-11-25` by default, or `2026-07-28` discovery and request metadata. Automatic version probing/restart/replay, modern subscriptions, and Agentif catalog import are outside this change. Subprocess stdio requires the Julia runtime; the existing static native server remains separate. There are no new dependencies or exports. Existing HTTP behavior and positional client constructors remain covered. `MCPClient` gains one optional field, changing its exact field layout.

Validation on macOS arm64:

- Full Julia 1.10.12 / HTTP 1.11 / OAuth 2 suite: 1,048 assertions passed.
- Full Julia 1.13.1 / HTTP 2.8 / OAuth 4 suite: 1,053 assertions passed, including seven strict native compilation/execution checks with zero verifier errors or warnings.
- Both full suites pass all 446 stdio checks and the 125 argument-serialization checks merged in #15. The new nested-request regression failed before the correction and passes afterward.
- Lifecycle controls cover blocked notifications, active-handler overflow, EOF/malformed output during nested calls, simultaneous handler closes, notification/handler close, retained callbacks, cleanup retry, exact IDs, cancellation, and blocked pipes.
- An independent review found no actionable issues. Its separate three-level nested-request and blocked-notification check passed all nine assertions, including shutdown and recovery.
- Strict documentation, doctests, and the runnable local-child example pass. Local documentation deployment was disabled.

AI-driven research and implementation with Codex, followed by independent review.

Co-authored by Codex
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant