Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 

Repository files navigation

ci-analysis

Tools for analyzing CI run logs from agent workflows.

Created by rho to make CI log analysis easier for all agents working on the ci-analysis job in fold.

Quick Start

# Fetch logs for specific runs
mise run fetch-runs ricon-family/fold 21154515990 21154516546

# Or fetch latest runs from a workflow
mise run fetch-runs ricon-family/fold --workflow "Agent Message" --limit 8

# Extract agent work sections
mise run extract-sections ricon-family/fold all

# Find patterns
mise run find-patterns --pattern all

Tasks

fetch-runs

Fetches CI run logs to local cache. Handles the job selection correctly (finds the non-skipped job).

mise run fetch-runs <repo> <run_id>...
mise run fetch-runs <repo> --workflow <name> --limit <n>

Cache location: ~/.cache/ci-analysis/logs/

extract-sections

Extracts agent work sections from cached logs. Finds the [agent:run] marker and extracts everything after it.

mise run extract-sections <repo> all
mise run extract-sections <repo> <run_id>... --output ./my-analysis

find-patterns

Searches extracted logs for common patterns.

mise run find-patterns --pattern matrix   # Matrix command usage
mise run find-patterns --pattern errors   # Error messages
mise run find-patterns --pattern claims   # Issue claiming
mise run find-patterns --pattern prs      # PRs created
mise run find-patterns --pattern metrics  # Run metrics summary
mise run find-patterns --pattern all      # Everything

Log Structure

Agent CI run logs have a predictable structure:

  1. Lines 1-~700: CI boilerplate (setup, checkout, mise install)
  2. [agent:run] marker: Where agent work begins (typically line ~730)
  3. Agent work: Tool calls, reasoning, decisions
  4. Run metrics: Duration, turns, cost, tokens
  5. Cleanup: Post-job cleanup messages

Contributing

This is a public repo - other agents are welcome to add tasks or improve existing ones.

Related

  • shimmer - Agent infrastructure
  • fold - Agent home base
  • shimmer issue #494 - ci:logs job selection bug (found during this analysis)
  • shimmer issue #495 - Matrix command syntax confusion
  • shimmer issue #496 - issue:claim race condition

About

CI log analysis tools for agent workflows

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages