From dc953b6bf965827205fe0cbd7f6614a558cd00ba Mon Sep 17 00:00:00 2001 From: Kushagra Kanaujia Date: Tue, 10 Nov 2026 13:54:33 -0800 Subject: [PATCH] Release 0.7.0 to PyPI: install from PyPI, check on the first screen, changelog dated Co-Authored-By: Claude Opus 5.5 --- CHANGELOG.md | 11 ++++++--- README.md | 15 ++++++------ .../docs/getting-started/installation.md | 23 +++++++++---------- .../docs/getting-started/quickstart.md | 4 ++-- tests/test_style_and_panels.py | 8 ++++--- 5 files changed, 34 insertions(+), 27 deletions(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index b20ab50..38c47bf 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -4,6 +4,11 @@ All notable changes to Throttle will be documented in this file. ## [Unreleased] +## [0.7.0] - 2026-11-10 + +Stop renting your AI. First release of the loop on PyPI: `pip install "throttle-pro==0.7.0"`. +Includes the security, trust and per-token pricing work below. + ### Added - `throttle report` can price a cheaper model per token, with no GPU: `--candidate-model` (list price from the bundled table, labelled LIST PRICE) @@ -53,9 +58,9 @@ All notable changes to Throttle will be documented in this file. - Subcommand help says "a cheaper model" or "the candidate model", which can be closed or open, to match the top-level help. -## [0.7.0] - 2026-11-03 +### Loop (first tagged 2026-11-03, never published to PyPI) -Stop renting your AI. Throttle now tests your app's OpenAI and Anthropic calls +Throttle now tests your app's OpenAI and Anthropic calls against cheaper models on your own traffic, moves the ones that pass after you approve, and falls back to the API on any error or broken answer. This release adds that loop and Throttle for GitHub, and removes what the new product does @@ -146,7 +151,7 @@ stays local under `~/.throttle/own` (or `$THROTTLE_OWN_DIR`, or `--dir`). removed commands. The README "70% cheaper" sample output (from mock endpoints) is gone. -## [0.7.0] - 2026-10-26 +### Serving tools (first drafted 2026-10-26, never published to PyPI) Throttle cuts what your LLM inference costs on your own GPUs: whether a cheaper model, engine or config still gives good answers on your work diff --git a/README.md b/README.md index 6b0bdc8..234e596 100644 --- a/README.md +++ b/README.md @@ -32,15 +32,11 @@ MI300X with vLLM, [raw data](validation/hotaisle-mi300x-20261001/)): ## Try it in a minute ```sh -pip install "git+https://github.com/KushagraKanaujia/throttle@64cb03e30b87b1de0e4bcc6bed55d0a54641eb95" # v0.7.0 +pip install "throttle-pro==0.7.0" throttle demo ``` -The install is pinned to the full commit of v0.7.0, so what you install -never changes under you. This README can be newer than that commit; each -release moves the pin to itself. The `throttle-pro` package on PyPI is behind and does not -have this loop yet; this README switches to `pip install throttle-pro==0.7.0` -once 0.7.0 is published there. +Pin the version so what you install never changes under you. `throttle demo` runs the whole loop offline on made-up traffic: capture, workloads, shadow, eval and report. It needs no API key, no GPU and no @@ -48,6 +44,11 @@ network. It writes `throttle-demo/report.html`. Every number in it is labelled DEMO, because none of it is a measurement of a real company or a real model. +Already serving your own model? `throttle check --url http://your-server:8000 +--model --total-hourly-price ` measures what it really costs per +1M tokens, with a 95% interval, and refuses to call a change a win inside the +noise. See [Serving your own model](#serving-your-own-model). + ## How Throttle is different - **AI jobs are tracked in pull requests.** Each AI call in your code is a @@ -128,7 +129,7 @@ with the date each price was checked and the page it came from. `--prices FILE` adds or replaces prices; those are labelled ASSUMED. The monthly figure scales the capture window to 30 days and is refused for a window shorter than a day. `--embed` also splits each kind into clusters by prompt similarity -(needs `pip install "throttle-pro[embeddings]"`). +(needs `pip install "throttle-pro[embeddings]==0.7.0"`). ### 3. Shadow diff --git a/src/throttle/console/docs/getting-started/installation.md b/src/throttle/console/docs/getting-started/installation.md index 0d088bf..1b6dd64 100644 --- a/src/throttle/console/docs/getting-started/installation.md +++ b/src/throttle/console/docs/getting-started/installation.md @@ -4,25 +4,24 @@ Throttle needs **Python 3.11 or newer**. The command is `throttle`. -Install v0.7.0 from `main`, pinned to its full commit SHA so what you install never changes under you. These docs can be newer than that commit; each release moves the pin to itself. +Install v0.7.0 from PyPI. Pin the version so what you install never changes under you. -```bash loop (v0.7.0) -pip install "git+https://github.com/KushagraKanaujia/throttle@64cb03e30b87b1de0e4bcc6bed55d0a54641eb95" # v0.7.0 +```bash pip +python3 -m pip install "throttle-pro==0.7.0" throttle demo ``` -That gives you the whole loop (`capture`, `workloads`, `shadow`, `eval`, `report`, `route`, `refresh`, `demo`), `jobs`, `pr-check` and the serving tools. - -The PyPI package `throttle-pro` is behind until 0.7.0 is published there. It does not have the loop yet, only the serving commands such as `check`: - ```bash pipx -pipx install throttle-pro +pipx install "throttle-pro==0.7.0" throttle --version ``` -```bash pip -python3 -m pip install throttle-pro -throttle --version +That gives you the whole loop (`capture`, `workloads`, `shadow`, `eval`, `report`, `route`, `refresh`, `demo`), `jobs`, `pr-check` and the serving tools such as `check`. + +To install straight from the source you can read, use the release tag: + +```bash +pip install "git+https://github.com/KushagraKanaujia/throttle@v0.7.0" ``` @@ -30,7 +29,7 @@ throttle --version | Extra | Install | What it adds | | --- | --- | --- | -| `embeddings` | `pip install "throttle-pro[embeddings] @ git+https://github.com/KushagraKanaujia/throttle@64cb03e30b87b1de0e4bcc6bed55d0a54641eb95"` | `throttle workloads --embed` (similarity clusters) and the opt-in semantic tier of the caching proxy. | +| `embeddings` | `pip install "throttle-pro[embeddings]==0.7.0"` | `throttle workloads --embed` (similarity clusters) and the opt-in semantic tier of the caching proxy. | ## Check your setup diff --git a/src/throttle/console/docs/getting-started/quickstart.md b/src/throttle/console/docs/getting-started/quickstart.md index f7788cd..c82b356 100644 --- a/src/throttle/console/docs/getting-started/quickstart.md +++ b/src/throttle/console/docs/getting-started/quickstart.md @@ -5,10 +5,10 @@ ## 1. Install ```bash -pip install "git+https://github.com/KushagraKanaujia/throttle@64cb03e30b87b1de0e4bcc6bed55d0a54641eb95" # v0.7.0 +pip install "throttle-pro==0.7.0" ``` -This pins v0.7.0 by its full commit SHA. The `throttle-pro` package on PyPI is behind until 0.7.0 is published there, and does not have the loop yet. +This pins v0.7.0. To install from the source tag instead, see Installation. ## 2. Run the demo diff --git a/tests/test_style_and_panels.py b/tests/test_style_and_panels.py index 4c24e76..e94b4a9 100644 --- a/tests/test_style_and_panels.py +++ b/tests/test_style_and_panels.py @@ -431,16 +431,18 @@ def readme_section(title: str) -> str: return text[start:end if end != -1 else None] -def test_readme_install_and_action_are_pinned_to_a_full_sha() -> None: +def test_readme_install_and_action_are_pinned() -> None: text = (REPO / "README.md").read_text(encoding="utf-8") - assert f'pip install "git+https://github.com/KushagraKanaujia/throttle@{PINNED_SHA}" # v0.7.0' in text + assert 'pip install "throttle-pro==0.7.0"' in text + assert "PyPI is behind" not in text assert f"uses: KushagraKanaujia/throttle/.github/actions/throttle-pr@{PINNED_SHA} # v0.7.0" in text assert "Pin the action by its full commit SHA" in text assert "throttle-pr@main" not in text assert not re.search(r"pip install git\+https://github\.com/KushagraKanaujia/throttle\s*$", text, re.M) for doc in ("getting-started/installation.md", "getting-started/quickstart.md"): body = (REPO / "src/throttle/console/docs" / doc).read_text(encoding="utf-8") - assert PINNED_SHA in body, doc + assert 'throttle-pro==0.7.0' in body, doc + assert "behind until" not in body, doc assert "own/mvp" not in body and "pipx upgrade" not in body, doc