Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 8 additions & 3 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,11 @@ All notable changes to Throttle will be documented in this file.

## [Unreleased]

## [0.7.0] - 2026-11-10

Stop renting your AI. First release of the loop on PyPI: `pip install "throttle-pro==0.7.0"`.
Includes the security, trust and per-token pricing work below.

### Added
- `throttle report` can price a cheaper model per token, with no GPU:
`--candidate-model` (list price from the bundled table, labelled LIST PRICE)
Expand Down Expand Up @@ -53,9 +58,9 @@ All notable changes to Throttle will be documented in this file.
- Subcommand help says "a cheaper model" or "the candidate model", which can be
closed or open, to match the top-level help.

## [0.7.0] - 2026-11-03
### Loop (first tagged 2026-11-03, never published to PyPI)

Stop renting your AI. Throttle now tests your app's OpenAI and Anthropic calls
Throttle now tests your app's OpenAI and Anthropic calls
against cheaper models on your own traffic, moves the ones that pass after you
approve, and falls back to the API on any error or broken answer. This release
adds that loop and Throttle for GitHub, and removes what the new product does
Expand Down Expand Up @@ -146,7 +151,7 @@ stays local under `~/.throttle/own` (or `$THROTTLE_OWN_DIR`, or `--dir`).
removed commands. The README "70% cheaper" sample output (from mock
endpoints) is gone.

## [0.7.0] - 2026-10-26
### Serving tools (first drafted 2026-10-26, never published to PyPI)

Throttle cuts what your LLM inference costs on your own GPUs: whether a
cheaper model, engine or config still gives good answers on your work
Expand Down
15 changes: 8 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,22 +32,23 @@ MI300X with vLLM, [raw data](validation/hotaisle-mi300x-20261001/)):
## Try it in a minute

```sh
pip install "git+https://github.com/KushagraKanaujia/throttle@64cb03e30b87b1de0e4bcc6bed55d0a54641eb95" # v0.7.0
pip install "throttle-pro==0.7.0"
throttle demo
```

The install is pinned to the full commit of v0.7.0, so what you install
never changes under you. This README can be newer than that commit; each
release moves the pin to itself. The `throttle-pro` package on PyPI is behind and does not
have this loop yet; this README switches to `pip install throttle-pro==0.7.0`
once 0.7.0 is published there.
Pin the version so what you install never changes under you.

`throttle demo` runs the whole loop offline on made-up traffic: capture,
workloads, shadow, eval and report. It needs no API key, no GPU and no
network. It writes `throttle-demo/report.html`. Every number in it is
labelled DEMO, because none of it is a measurement of a real company or a
real model.

Already serving your own model? `throttle check --url http://your-server:8000
--model <name> --total-hourly-price <usd>` measures what it really costs per
1M tokens, with a 95% interval, and refuses to call a change a win inside the
noise. See [Serving your own model](#serving-your-own-model).

## How Throttle is different

- **AI jobs are tracked in pull requests.** Each AI call in your code is a
Expand Down Expand Up @@ -128,7 +129,7 @@ with the date each price was checked and the page it came from. `--prices
FILE` adds or replaces prices; those are labelled ASSUMED. The monthly figure
scales the capture window to 30 days and is refused for a window shorter than
a day. `--embed` also splits each kind into clusters by prompt similarity
(needs `pip install "throttle-pro[embeddings]"`).
(needs `pip install "throttle-pro[embeddings]==0.7.0"`).

### 3. Shadow

Expand Down
23 changes: 11 additions & 12 deletions src/throttle/console/docs/getting-started/installation.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,33 +4,32 @@

Throttle needs **Python 3.11 or newer**. The command is `throttle`.

Install v0.7.0 from `main`, pinned to its full commit SHA so what you install never changes under you. These docs can be newer than that commit; each release moves the pin to itself.
Install v0.7.0 from PyPI. Pin the version so what you install never changes under you.

```bash loop (v0.7.0)
pip install "git+https://github.com/KushagraKanaujia/throttle@64cb03e30b87b1de0e4bcc6bed55d0a54641eb95" # v0.7.0
```bash pip
python3 -m pip install "throttle-pro==0.7.0"
throttle demo
```

That gives you the whole loop (`capture`, `workloads`, `shadow`, `eval`, `report`, `route`, `refresh`, `demo`), `jobs`, `pr-check` and the serving tools.

The PyPI package `throttle-pro` is behind until 0.7.0 is published there. It does not have the loop yet, only the serving commands such as `check`:

```bash pipx
pipx install throttle-pro
pipx install "throttle-pro==0.7.0"
throttle --version
```

```bash pip
python3 -m pip install throttle-pro
throttle --version
That gives you the whole loop (`capture`, `workloads`, `shadow`, `eval`, `report`, `route`, `refresh`, `demo`), `jobs`, `pr-check` and the serving tools such as `check`.

To install straight from the source you can read, use the release tag:

```bash
pip install "git+https://github.com/KushagraKanaujia/throttle@v0.7.0"
```


## Optional extras

| Extra | Install | What it adds |
| --- | --- | --- |
| `embeddings` | `pip install "throttle-pro[embeddings] @ git+https://github.com/KushagraKanaujia/throttle@64cb03e30b87b1de0e4bcc6bed55d0a54641eb95"` | `throttle workloads --embed` (similarity clusters) and the opt-in semantic tier of the caching proxy. |
| `embeddings` | `pip install "throttle-pro[embeddings]==0.7.0"` | `throttle workloads --embed` (similarity clusters) and the opt-in semantic tier of the caching proxy. |

## Check your setup

Expand Down
4 changes: 2 additions & 2 deletions src/throttle/console/docs/getting-started/quickstart.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,10 +5,10 @@
## 1. Install

```bash
pip install "git+https://github.com/KushagraKanaujia/throttle@64cb03e30b87b1de0e4bcc6bed55d0a54641eb95" # v0.7.0
pip install "throttle-pro==0.7.0"
```

This pins v0.7.0 by its full commit SHA. The `throttle-pro` package on PyPI is behind until 0.7.0 is published there, and does not have the loop yet.
This pins v0.7.0. To install from the source tag instead, see Installation.

## 2. Run the demo

Expand Down
8 changes: 5 additions & 3 deletions tests/test_style_and_panels.py
Original file line number Diff line number Diff line change
Expand Up @@ -431,16 +431,18 @@ def readme_section(title: str) -> str:
return text[start:end if end != -1 else None]


def test_readme_install_and_action_are_pinned_to_a_full_sha() -> None:
def test_readme_install_and_action_are_pinned() -> None:
text = (REPO / "README.md").read_text(encoding="utf-8")
assert f'pip install "git+https://github.com/KushagraKanaujia/throttle@{PINNED_SHA}" # v0.7.0' in text
assert 'pip install "throttle-pro==0.7.0"' in text
assert "PyPI is behind" not in text
assert f"uses: KushagraKanaujia/throttle/.github/actions/throttle-pr@{PINNED_SHA} # v0.7.0" in text
assert "Pin the action by its full commit SHA" in text
assert "throttle-pr@main" not in text
assert not re.search(r"pip install git\+https://github\.com/KushagraKanaujia/throttle\s*$", text, re.M)
for doc in ("getting-started/installation.md", "getting-started/quickstart.md"):
body = (REPO / "src/throttle/console/docs" / doc).read_text(encoding="utf-8")
assert PINNED_SHA in body, doc
assert 'throttle-pro==0.7.0' in body, doc
assert "behind until" not in body, doc
assert "own/mvp" not in body and "pipx upgrade" not in body, doc


Expand Down
Loading