Fix eval: set up in current directory, not subdirectory

[jrenaldi79]

Summary

Root cause of 0/28 setup eval failure: init-project.js --name=myapp creates a myapp/ subdirectory inside the temp dir, but the grader checks the temp dir root. All files existed but in the wrong place.

• All three eval prompts now say "IN THE CURRENT DIRECTORY — do not create a subdirectory"
• Added gotcha to CLAUDE.md for future eval work

Test plan

• npx jest --config '{}' tests/scripts/ — 112 tests pass
• bash tests/evals/run-evals.sh --config setup-eval-config.json --dry-run — prompts show directory guidance

https://claude.ai/code/session_01Hbxy31TkbujzukGFSxLcPw

[coderabbitai]

Warning

Rate limit exceeded

@jrenaldi79 has exceeded the limit for the number of commits that can be reviewed per hour. Please wait 0 minutes and 26 seconds before requesting another review.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

ℹ️ Review info

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: c84e035e-df4a-4bfd-b16e-da96e4860f5d

📥 Commits

Reviewing files that changed from the base of the PR and between dfe7b4d and dad3f31.

📒 Files selected for processing (2)

• CLAUDE.md
• tests/evals/setup-eval-config.json

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch claude/fix-eval-subdir

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}