zhyncs

Follow

🎯

Yineng Zhang zhyncs

🎯

Follow

Just for fun 🌁

1.8k followers · 22 following

Bay Area, CA
05:14 (UTC -07:00)
https://zhyncs.com
@zhyncs42

Sponsors

Achievements

Achievements

Organizations

zhyncs/README.md

Hi there 👋

🔭 Principal AI Researcher at Together AI
💼 Inference Lead for SGLang at LMSYS, working closely with Lianmin Zheng and Ying Sheng to co-lead the project. Responsible for releases, optimization, and roadmap. Led major version development and blog posts, including Llama 3, DeepSeek V3, Large Scale EP, and GB200 NVL72. Co-authored the FlashInfer paper (MLSys 2025 Best Paper). Committer for FlashInfer and LMDeploy. Previously Lead Software Engineer at Baseten, co-authored the DeepSeek V3 and Qwen 3 launch blogs and The Baseten Inference Stack ebook. Earlier at Meituan, led CTR GPU inference and vector retrieval system development.
👀 Check out my talk on SGLang at GPU MODE, CAMEL-AI Hackathon, CUDA Tech Briefing at NVIDIA GTC 2025, AI Engineer World's Fair 2025
🚀 DeepSeek V3 Related: SGLang Day One Support, Latent Space Podcast, The New York Times First Article, Second Article
📫 Contact: [email protected] | Telegram
📄 More: LinkedIn | Homepage
🙌 The best way to contact me is via the SGLang Slack. We're looking for open-source enthusiasts and learners to help grow the SGLang project and community.

Pinned Loading

sgl-project/sglang sgl-project/sglang Public

SGLang is a fast serving framework for large language models and vision language models.

Python 18.1k 3k
flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

FlashInfer: Kernel Library for LLM Serving

Cuda 3.8k 513