Repository navigation
Proposal: lesson pictures from MCP servers, prepared in the background #777
Closed
neilseller
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I have a working prototype, on a fork, of the teacher preparing the pictures a lesson needs. I'd like to know whether you want this in LearnHarness, and if so whether in core or as a plugin, before I open any feature PR.
Related: #494 and #773 (MCP sources), and the open PRs #394 (question figures) and #349 (MCP client for stdio servers). The prototype builds on both PRs.
Problem
The teacher can draw an SVG or a diagram, but it cannot use the pictures that already exist in good libraries (anatomy, biology, chemistry). Drawn pictures of complex subjects are often wrong or too simple to teach from. The learner has no way to point the teacher at a trusted source.
What the prototype does
ask_user_questioncan carry a picture: an SVG, a Mermaid diagram, or a picture supplied by an MCP server. Over-wide figures are rejected, and the model is told the display width and minimum text size.Design notes:
docs/resource-pipeline.mdon the branch.Branch: https://github.com/neilseller/learnharness/tree/feat/question-figures
Where it stands
v0.5.0plus feat: graded questions can carry a figure (charts, diagrams) the learner reads to answer #394 and feat: add MCP client support for stdio servers (minimal) #349. It does not yet include the 187 commits since, which overlap in places (native SVG figures, diagram instructions, the plugin architecture). A test merge with currentmainconflicts in 31 files.Questions
Separately, #776 makes the test suite run and pass on Windows. It is independent of this proposal.
All reactions