Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

38 Commits
 
 
 
 

Repository files navigation

Homebrew tap for squish

Squish — local LLM inference server for Apple Silicon with block-level paged KV cache, INT3 support, and an OpenAI-compatible API.

Install

brew tap konjoai/squish
brew install squish

Update

brew update
brew upgrade squish

Requirements

  • macOS 13+ on Apple Silicon (M1–M5). The formula refuses to install on Intel because mlx is Apple-Silicon-only.
  • Python 3.12 (installed automatically as a Homebrew dependency).

What you get

After brew install squish, four CLI entry points are on your PATH:

Command Purpose
squish Main CLI (squish run, squish pull, squish serve, …)
squish-server Standalone FastAPI server entry point
squish-convert One-shot model conversion utility
squishd Persistent daemon with UDS IPC

The PyPI distribution is squish-ai; the installed Python module and CLI are both squish.

Issues

Report formula issues here. Report squish bugs at konjoai/squish.

About

Homebrew tap for squish-ai — local LLM inference for Apple Silicon

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages