Skip to content
View devYRPauli's full-sized avatar

Block or report devYRPauli

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
devYRPauli/README.md
The model is the easy part. Proving the answer is right is the hard one.

Yash Raj Pandey

AI systems engineer at UF/IFAS

I work on the layer where AI systems quietly go wrong, and I prove it.

Portfolio    Writing    LinkedIn    X    Resume

Most of my side projects start with a bug I could not leave alone.

What I work on

At UF/IFAS I build and run AI systems for scientific research. One constraint shapes everything else: research data stays on infrastructure the university controls.

The model is the easy part. You download it and it answers. The hard part is working out what the question was before any model runs, getting clean text out of documents that resist it, and proving an answer is right before a scientist acts on it. A confident wrong number is worse than an error.

Some of what that has meant:

  • About twenty routing rules, each correct on its own, collided in production. I replaced them with one deterministic arbiter that can be read and tested.
  • A hand-written agent loop grew until one tool failure could stop the whole assistant. I replaced it with a proven framework, and shipped it only after it beat the old one on a held-out set.
  • Every number in an answer traces back to the tool result it came from.
  • An alarming document-quality metric turned out to be a measurement bug, not damaged text. Check the alarm before you act on it.

I also lead a data platform for agricultural research. It brings scattered spreadsheets into one system of record: about 1.5 million research records, used by more than 30 researchers across five labs.

I joined UF/IFAS in March 2025 after my MS at the University of Florida. Two promotions since. I am now the AI Agents Architect.

Projects

Project What it does
Podium Runs delegated coding work with acceptance checks and durable receipts.
Baton The earlier delegation system that led to Podium, with durable jobs, focused briefs, and independent verification.
Looma Turns coding-agent history into resumable project context. Local-first, zero dependencies, and available on PyPI.
willitcall Tests tool calling across local models, quantizations, templates, and inference servers.
mddocs Adds real-time collaboration, comments, suggestions, and an agent API to Markdown files stored in git.
TabFM evaluation Reproduces Google's TabFM across three machines and 13 datasets, including baselines, failure analysis, and upstream fixes.
TurboQuant evaluation Tests KV-cache compression on a 16 GB M1 Pro across MLX and llama.cpp.
Portfolio The text-first Astro site for my work, writing, and project notes.
World Cup 2026 Picks A self-hosted prediction pool with live scoring, group picks, knockout picks, and final results.
Football Hub A live football dashboard for standings, fixtures, and top scorers across seven competitions.
ApplyScore A Chrome extension for comparing a resume with a job posting.

Open source

69 merged pull requests across 30 external projects. Almost none of them are features. Most are the class of bug that returns a plausible wrong answer instead of an error.

Project Stars Merged What I work on there
llama.cpp 125k 3 Kernels. Wrong gradients under in-place aliasing. A routing table that must not be quantized.
RAGFlow 89k 16 Document parsers. Dropped table cells, spliced CSV fields, crashes on valid input.
Mem0 64k 4 Retrieval and vector store correctness.
LiteLLM 57k 3 Billing. People pay these numbers.
Agno 41k 1 A reader that took the user id from the wrong field.
MLX 28k 2 Undefined behavior in shape arithmetic.
CodexBar 20k 8 Pricing tables, quota display, reset-date rollover, cache-token accounting.
txtai 12k 1 Embeddings and retrieval correctness.
pypdf 10k 1 PDF parsing, which sits under most ingestion pipelines.

The other 30 are spread across 21 smaller projects: mlx-lm, turboquant_plus, and a long run through Peter Steinberger's tool ecosystem. One is google-research/tabfm, where prediction crashed on multi-device hosts. I found that during my own evaluation of the model, which is the short version of how most of these start.

Another 39 pull requests are open. When I cannot fix something myself I file the reproduction instead, which is where my 10 upstream issues come from.

See every external merged pull request.

Writing

I mostly work in Python, TypeScript, Rust, SQL, C, C++, and Bash. Outside work, I follow football, play tactical shooters and story-rich RPGs, and listen to lo-fi while I build.

Pinned Loading

  1. looma looma Public

    Local-first project memory that turns coding-agent history into resumable context.

    Python 6 1

  2. tabfm-evaluation tabfm-evaluation Public

    Independent reproduction of Google TabFM across three machines and 13 datasets, with baselines, failure analysis, and upstream fixes.

    Python 6

  3. turboquant-m1pro-evaluation turboquant-m1pro-evaluation Public

    Independent TurboQuant evaluation on a 16 GB M1 Pro across MLX and llama.cpp, with long-context tests and implementation fixes.

    Python 2

  4. mddocs mddocs Public

    Local-first, git-native Markdown collaboration with multiplayer editing, comments, suggestions, and an agent HTTP API.

    TypeScript 1

  5. podium podium Public

    Verified delegation for Claude Code. The runner executes acceptance checks and records a receipt for every job.

    Shell 1

  6. willitcall willitcall Public

    A reproducible compatibility matrix for tool calling across local models, quantizations, templates, and inference servers.

    Rust 1 1