Skip to content

prompt: file issue for xla-cpu-eigen-pool-deadlock (#1530) - #349

Merged
Jammy2211 merged 1 commit into
mainfrom
claude/jax-compile-stall-root-cause-d33hi0
Aug 27, 2026
Merged

prompt: file issue for xla-cpu-eigen-pool-deadlock (#1530)#349
Jammy2211 merged 1 commit into
mainfrom
claude/jax-compile-stall-root-cause-d33hi0

Conversation

@Jammy2211

Copy link
Copy Markdown
Collaborator

Issues the research follow-up to the shipped jax-compile-stall epic: PyAutoFit#1530.

Registry write only — prompt draft/research/ci/active/, active.md entry, dashboard regenerated. No code.

Why it exists

PyAutoFit#1528 delivered a workaround. Both test workspaces now run every JAX script with single-threaded Eigen — ~15% slower on the heaviest paths — behind a flag whose removal silently brings back seven quarantines. We know where the hang is and what avoids it, not why the pool wedges.

What the prompt carries forward

The things that cost a day to learn, so the next session doesn't pay again:

  • Settled — the hang is materialising a vmap result, not compiling it (stacks at jax.block_until_ready/try_to_block and jax.Array._value, compile finished ~12–18s earlier).
  • Refuted, do not re-run — the compilation cache (6/6 hangs disabled), the jax/jaxlib version (identical 0.11.1 stack on the day it hung 3/3 on both legs), the 3.12-vs-3.13 split (passed 2/2 then hung 2/2 on one commit).
  • Method — the hang rate wanders, so any claim needs ABAB against a re-measured control, never before/after. That is the trap this campaign fell into repeatedly.

The question worth the most is whether XLA's pool is merely mis-sized against the runner's cgroup quota rather than genuinely deadlocked. If so the fix is sizing it, and the 15% comes back.

Branch note

Restarted from origin/main after PyAutoMind#348 merged — merged history is not stacked on.

lifecycle.py check OK · intake dashboard --check current.


Generated by Claude Code

The research follow-up to the shipped jax-compile-stall epic. #1528 delivered
a workaround: both test workspaces now run every JAX script with
single-threaded Eigen, ~15% slower on the heaviest paths, behind a flag whose
removal silently brings back seven quarantines.

The prompt carries what is already settled so the next session does not re-run
it -- the hang locus (materialising a vmap result, not compiling it) and three
refuted hypotheses (compilation cache, jax/jaxlib version, the 3.12-vs-3.13
split) -- plus the method note that the hang rate wanders, so any claim needs
ABAB against a re-measured control rather than before/after.

The question worth the most: whether XLA's pool is merely mis-sized against
the runner's cgroup quota rather than genuinely deadlocked. If so the fix is
sizing it and the 15% comes back.

Branch restarted from origin/main, since the previous PR on this branch
(PyAutoMind#348) is merged and merged history is not stacked on.

Co-Authored-By: Claude <noreply@anthropic.com>
@Jammy2211
Jammy2211 merged commit d91e806 into main Aug 27, 2026
4 checks passed
@Jammy2211
Jammy2211 deleted the claude/jax-compile-stall-root-cause-d33hi0 branch August 27, 2026 17:20
Jammy2211 pushed a commit that referenced this pull request Aug 27, 2026
The branch was behind main by PyAutoMind#348/#349/#350. Merged, never rebased.

All three conflicts were in generated files — complete/index.md, dashboard.md,
dashboard.html — and were resolved by regenerating from the merged sources
(lifecycle.py index --apply, pyauto-brain intake --apply dashboard), never by
hand-editing. No source-of-truth file conflicted.

All four PR gates re-run green after the merge: lifecycle check, lifecycle index
--check, registry_toc --check, intake dashboard --check, plus the spawn privacy
suite (240 passed).

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01KmWbYJw4cJJnt4eK6NoZjL
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants