Skip to content
View Yashwanth-Nallapuneni's full-sized avatar

Highlights

  • Pro

Block or report Yashwanth-Nallapuneni

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

   

I build LLM systems that are reliable, measurable, and safe to ship.


👋 About me

🎓  M.S. Computer Science · Columbia University (2026 – 2027)
🏛️  B.Tech CSE · VIT Vellore (9.15 CGPA · ranked 6th in program)
🛠️  Building LLM agents, RAG pipelines and evaluation harnesses
📦  Shipped aiollm-gateway on PyPI
📄  Published at IEEE ICoECIT 2026
💬  Ask me about LangGraph, LLM evals, synthetic data


💼 Experience

AI Research Intern · Jio Institute, Navi Mumbai · Jun 2026 to Jul 2026

  • Built automated LLM experiment pipelines with LangChain, LangGraph and the OpenRouter API, running controlled evaluations on GSM8K and Visual7W
  • Engineered a multi-turn Solver–Prober setup to test whether LLMs stay consistent under adversarial questioning, across different prompting tones
  • Extended multiple-choice evaluation experiments to vision-language models by building visual reasoning benchmarks

Undergraduate Research Assistant · VIT Vellore · Advisor: Prof. Gopichand G · Jul 2025 to May 2026

  • Built LLM-guided data augmentation to reduce bias in AI systems, with checks on semantic fidelity, safety and statistical validity
  • Designed experiments measuring fairness and subgroup performance gaps; contributed to an IEEE-published paper

📄 Publication

LGSA: LLM-Guided Synthetic Augmentation for Mitigating Bias in AI Systems
IEEE ICoECIT 2026 · arXiv:2510.13202
Uses an LLM to generate label-consistent counterfactual samples for underrepresented groups, validated in multiple stages. Narrows subgroup performance gaps without hurting overall accuracy.


🚀 Projects

📚 ragpipe

Production RAG with enforced citations. Answers questions over 40 arXiv papers, and every claim must trace to a retrieved passage, or the system refuses. Hybrid BM25 + dense retrieval, cross-encoder reranking, a LangGraph pipeline, and a RAGAS quality gate on every pull request.

Async rate-limit layer for LLM APIs, published on PyPI as aiollm-gateway. Paces requests under provider limits, retries what's worth retrying, batches prompts, and fails over with a circuit breaker. Zero runtime dependencies.

Scores synthetic tabular data on fidelity, utility, privacy, diversity and calibration, detecting numeric and categorical features automatically. FastAPI backend in Docker, Streamlit front end.

Detects and categorizes LLM hallucinations with heuristic and LLM-based pipelines. Measures prompt–output drift with sentence embeddings, and its taxonomy refines itself as new cases come in.


🛠️ Tech stack

Languages
LLM & AI
Data
Engineering

Also: retrieval-augmented generation, prompt engineering, LLM evaluation, synthetic data.

Pinned Loading

  1. synthetic-data-quality-validator synthetic-data-quality-validator Public

    Python

  2. DocGuardVault-BackEnd DocGuardVault-BackEnd Public

    Forked from HARDIKSHARMA16/DocGuardVault-BackEnd

    JavaScript

  3. AI-Hallucination-Taxonomy AI-Hallucination-Taxonomy Public

    Python

  4. DocGuardVault DocGuardVault Public

    Forked from HARDIKSHARMA16/DocGuardVault

    JavaScript