Skip to content

Document audio mode for debugging LiveKit agents - #14

Merged
bcherry merged 3 commits into
mainfrom
bcherry/great-volta-nox5h9
Oct 9, 2026
Merged

bcherry merged 3 commits into
mainfrom
bcherry/great-volta-nox5h9

Conversation

@bcherry

@bcherry bcherry commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

What does this PR do?

Expands the debugging-livekit-agents skill documentation to cover audio mode, which speaks turns into the agent's microphone input for testing transcription, endpointing, and speech-to-speech models. Updates trigger queries and README to reflect that the debugger now supports both text and audio modes.

Changes

  • SKILL.md:

    • Updated description to mention audio mode and new use cases ("it mishears my order number")
    • Added "Audio mode" section explaining when to use it, costs, how to compare transcripts, and limitations
    • Updated "When to use something else" table to distinguish transcription bugs (use audio mode) from interruptions (use simulations)
    • Clarified that text mode is the default but audio mode is available
  • queries.json: Added two trigger eval queries for audio mode use cases (order number transcription, speech-to-speech models)

  • README.md: Updated skill summary to note both text and audio modes

  • building-livekit-agents/SKILL.md: Updated guidance to mention sending turns as text or speech

Checklist

  • Content passes the "freeze forever" test: references --help and start --help instead of specific flags
  • No time-relative phrasing
  • Description is third person, includes user phrases ("it mishears", "speech-to-speech model"), names sibling skills
  • If description changed: trigger eval queries added for audio mode scenarios
  • No new eval misses expected (audio mode is a documented feature, not a new skill)

Eval results

n/a: trigger queries added for audio mode coverage; no description changes to existing queries

https://claude.ai/code/session_01GgJFuYzMp7KtqGhSQYD5Zr

The debugger can now speak each turn into the agent's audio pipeline
(livekit/livekit-cli#1000). Update the skill and description so it is
used for transcription/endpointing bugs and audio-only realtime models,
and add trigger queries for those requests.

Trigger eval (python, 1 run/query): 52/52 acceptable, no misses.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GgJFuYzMp7KtqGhSQYD5Zr
@bcherry
bcherry requested a review from u9g October 6, 2026 21:04
Comment thread skills/debugging-livekit-agents/SKILL.md Outdated
…ription

Keep the original description and add one sentence for speech-to-speech
models and mishearing, per review. Trigger eval (1 run/query): 52/52, no misses.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GgJFuYzMp7KtqGhSQYD5Zr
@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

Comment thread skills/debugging-livekit-agents/SKILL.md Outdated
Comment thread skills/debugging-livekit-agents/SKILL.md Outdated
Comment thread skills/debugging-livekit-agents/SKILL.md Outdated
Comment thread skills/debugging-livekit-agents/SKILL.md Outdated
Per review: the description is now a short trigger rather than a
summary, and the body no longer mentions cost. Trigger eval (1
run/query): 52/52, no misses.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GgJFuYzMp7KtqGhSQYD5Zr
@bcherry
bcherry merged commit 8095b29 into main Oct 9, 2026
4 of 5 checks passed
@bcherry
bcherry deleted the bcherry/great-volta-nox5h9 branch October 9, 2026 19:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants