Skip to content

aura.usage SSE event has inconsistent semantics between orchestration and single agent #113

Description

@Shearerbeard

Problem

The aura.usage SSE event currently has dual semantics:

  • In single-agent mode, it reports the usage mathed out in a way that its attempting to only capture turn by turn conversation context fils
  • In orchestration mode the results seem mostly accurate (verify ground truth with provider - for example Bedrock runs can be verified after in Cloudwatch metrics)

The semantics are inconsistent and we need to follow normal OpenAI style SSE events for usage that ONLY report the turn usage in full. We should add another aura event to help client accurately calculate only the context window additive tokens per turn (basically total - inner react loop tokens) or simply a calculation of the outboud output tokens. This is partially provided by rig already and accurate on rigs end (at least in bedrock - more ground truth needs verified with other providers).

Expected Behavior

  • Standard usage field just reports 1:1 with what we get from our provider for both single and orchestrated
  • some sort of custom SSE field that accurately calculates just the context window payloads (basically returned agent turns). Preferable if we don't have to calculate our own with tiktoken.

Activity

  1. self-assigned this
    on May 12, 2026
  2. removed their assignment
    on Jun 5, 2026
  3. changed the title [-]aura.usage SSE event has inconsistent semantics and no orchestration coverage[/-] [+]aura.usage SSE event has inconsistent semantics between orchestration and single agent[/+] on Jun 24, 2026
  4. self-assigned this
    on Jul 8, 2026
  5. added a commit that references this issue on Jul 27, 2026
    e263b05
  6. added 7 commits that reference this issue on Aug 25, 2026
    00de63d
    d54b69d
    f0cff98
    bbdde0e
    8a9807c
    d527465
    2dab51b
  7. added a commit that references this issue on Aug 27, 2026
    f061320
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions