bhavnicksm
Follow
Lists (2)
Starred repositories
A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
Simple-to-use scoring function for arbitrarily tokenized texts.
A curated and opinionated list of resources for Chief Technology Officers, with the emphasis on startups
Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and WordPiece tokenization in JavaScript, Python and Rust.
🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library
Best Practices on Recommendation Systems
Efficient Triton Kernels for LLM Training
PyTorch emulation library for Microscaling (MX)-compatible data formats
⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)
The official implementation of Tensor ProducT ATTenTion Transformer (T6)
🤗 smolagents: a barebones library for agents. Agents write python code to call tools and orchestrate other agents.
Things you can do with the token embeddings of an LLM
Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.
⚡ A Fast, Extensible Progress Bar for Python and CLI
Large Concept Models: Language modeling in a sentence representation space
Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception
👻 Ghostty is a fast, feature-rich, and cross-platform terminal emulator that uses platform-native UI and GPU acceleration.
Make websites accessible for AI agents
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.
Minimalistic 4D-parallelism distributed training framework for education purpose
Recipes to scale inference-time compute of open models
