Skip to content
Merged
Show file tree
Hide file tree
Changes from 7 commits
Commits
Show all changes
45 commits
Select commit Hold shift + click to select a range
78f2a4c
Add onboarding guide for InfluxDB v3
trevorbonas May 22, 2026
1e2cff7
Add InfluxDB v2 onboarding guide
trevorbonas May 22, 2026
c03c078
Add schema-design.md for InfluxDB v2
trevorbonas May 26, 2026
db88bf1
Merge branch 'main' of github.com:Bit-Quill/mcp into influxdb-power-s…
trevorbonas May 28, 2026
57535aa
docs(timestream-influxdb-mcp-server): Add InfluxDB v2 and v3 query an…
trevorbonas Jun 3, 2026
1585ddc
docs(timestream-influxdb-mcp-server): Add migration guides and versio…
trevorbonas Jun 10, 2026
be25700
docs(timestream-influxdb-mcp-server): Add dashboard guides for v2 and…
trevorbonas Jun 11, 2026
7e99bdb
Update POWER.md, glossary.md, troubleshooting.md, and troubleshooting.md
trevorbonas Jun 11, 2026
cc40c47
Refine POWER.md, direct users to ingestion files for line protocol
trevorbonas Jun 11, 2026
d4fd993
Populate line-protocol.md
trevorbonas Jun 11, 2026
e15720f
Rename power to kiro_power and populate README.md
trevorbonas Jun 11, 2026
54ecf1a
Fix incorrect links in README.md
trevorbonas Jun 11, 2026
b5551bb
Add more links in getting-started.md
trevorbonas Jun 11, 2026
9dedf6b
Populate troubleshooting guides
trevorbonas Jun 11, 2026
ed3c4ef
Fix InfluxDB v3 max tables, database, and column limits
trevorbonas Jun 11, 2026
852bbd8
Add backlinks to ingestion documents for line protocol
trevorbonas Jun 11, 2026
f876e8c
Cover parameter group casing
trevorbonas Jun 11, 2026
cca2722
Update src/timestream-for-influxdb-mcp-server/README.md
trevorbonas Jun 11, 2026
994ad79
Add more details about MCP setup
trevorbonas Jun 11, 2026
7e21f28
Merge branch 'influxdb-power-schema' of github.com:Bit-Quill/mcp into…
trevorbonas Jun 11, 2026
08f9ce2
Add InfluxDB v2 parameters.md
trevorbonas Jun 12, 2026
0b14914
Add note about read replica deployment in parameters.md
trevorbonas Jun 12, 2026
cd68a89
Change migration guides to describe migrating to a version not from
trevorbonas Jun 12, 2026
f7d62e4
Fix 422 status codes being inaccurate for v3
trevorbonas Jun 15, 2026
a9f905f
Fix broken bold styling in glossary.md
trevorbonas Jun 15, 2026
035b7de
Change wording of turnkey phrase
trevorbonas Jun 15, 2026
ccc9c54
Add more information about overcoming Core limitations
trevorbonas Jun 15, 2026
92a2e89
Document Core vs Enterprise features
trevorbonas Jun 15, 2026
4ab2d56
Fix table rendering for Core vs Enterprise table
trevorbonas Jun 15, 2026
9e9732b
Add header link for Core vs Enterprise section
trevorbonas Jun 15, 2026
4553404
Move mention of v2 422 status code to influxdb-2-vs-3.md
trevorbonas Jun 15, 2026
d52b3a1
Clarify 400 HTTP status code differences
trevorbonas Jun 15, 2026
654b59e
Remove mention of table limit for v2
trevorbonas Jun 15, 2026
79dabe7
Fix incorrect reference to Core table limits
trevorbonas Jun 15, 2026
5cb603b
Specify Enterprise-only parameter options
trevorbonas Jun 15, 2026
11a1023
Use Token authentication in v2 writes
trevorbonas Jun 15, 2026
391b08f
Remove inaccurate description of storage not being updatable
trevorbonas Jun 16, 2026
83c94ed
Remove all references to InfluxDB v2 storage not being updatable
trevorbonas Jun 16, 2026
9f39d19
Link to v2 vs v3 guide for v2 schema guide
trevorbonas Jun 16, 2026
776c42d
Remove mention of v2 in v3 troubleshooting guide
trevorbonas Jun 16, 2026
5aecc05
Recommend Bearer token for v2 HTTP API calls
trevorbonas Jun 17, 2026
f353573
Link to LA to V3 migration plugin
trevorbonas Jun 17, 2026
09ecaf0
Note that SELECT count(*) is expensive
trevorbonas Jun 17, 2026
a52fe97
Remove note that Core does not have a processing engine
trevorbonas Jun 17, 2026
5ebeef1
Refine note for processing engine triggers
trevorbonas Jun 17, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions src/timestream-for-influxdb-mcp-server/power/POWER.md
Original file line number Diff line number Diff line change
Expand Up @@ -49,19 +49,23 @@ This Power enables you to deploy and operate Timestream for InfluxDB instances a
- [ ] `query-guide.md` - Query examples (SQL, InfluxQL)
- [ ] `troubleshooting.md` - Common errors in InfluxDB 3 and how to solve them
- [ ] `migrations.md`
- ALWAYS load when migrating between InfluxDB versions or products (OSS/Core, Enterprise, or InfluxDB Cloud -> Timestream for InfluxDB 3)
- [ ] OSS (Core) -> Timestream for InfluxDB 3
- [ ] Core -> Enterprise
- [ ] InfluxDB Cloud -> Timestream for InfluxDB 3
- [ ] `dashboard-guide.md` - Generate grafana dashboards and visualizations
- SHOULD load when building Grafana dashboards or visualizations

- `influxdb2/`
- [ ] `developer-guide.md` - Contains guide for managing instances/clusters, queries/writes, example workflows
Comment thread
fredjoonpark marked this conversation as resolved.
Outdated
- [ ] `query-guide.md` - Query examples (Flux, InfluxQL)
- [ ] `troubleshooting.md` - Common errors in InfluxDB 2 and how to solve them
- [ ] `migrations`
Comment thread
fredjoonpark marked this conversation as resolved.
Outdated
- ALWAYS load when migrating to or from Timestream for InfluxDB 2 (OSS -> v2, or v2 -> v3)
- [ ] Timestream for InfluxDB (2) -> Timestream for InfluxDB 3
- [ ] OSS -> Timestream for InfluxDB (2)
- [ ] `dashboard-guide.md` - Generate grafana dashboards and visualizations
- SHOULD load when building Grafana dashboards or visualizations


## Available MCP Tools
Expand Down
Original file line number Diff line number Diff line change
@@ -1 +1,129 @@
# InfluxDB 2 vs 3

Covers the differences between **Timestream for InfluxDB** (the InfluxDB 2.x engine) and **Timestream for InfluxDB 3** (the InfluxDB 3 engine). Load this when there is ambiguity about which version a user is on, or when planning a migration between the two.

## At-a-Glance Comparison

| Aspect | V2 (Timestream for InfluxDB) | V3 (Timestream for InfluxDB 3) |
|--------|----|----|
| Underlying engine | InfluxDB OSS 2.x branch (Go) | InfluxDB 3 (Rust) |
| Storage engine | TSM (Time-Structured Merge Tree) + TSI index | Apache Parquet on object storage |
| Query engine | InfluxDB built-in | Apache DataFusion |
| Storage layer | Influx IOPS Included volumes (local, block) | Amazon S3 (object storage) |
| Namespace | Organization → Bucket | Database → Table (no orgs) |
| Query language | Flux (primary), InfluxQL | SQL (primary), InfluxQL — **no Flux** |
| Query/network protocol | HTTP | Apache Arrow Flight SQL (gRPC) + HTTP |
| Default port | 8086 | 8181 |
| Auth prefix | `Token` | `Bearer` |
| Write namespacing | `org` + `bucket` | `db` (database) |
| Cardinality | ~10M series practical limit | Virtually unlimited |
| **Deployment topology** | **Single node** (optionally + standby); **read-replica cluster** for multiple nodes | **Cluster only** (Core = single-node, Enterprise = multi-node) |
| Control-plane create op | `create-db-instance` or `create-db-cluster` | `create-db-cluster` only |
| Max storage | Up to 16 TiB provisioned, **cannot grow after creation** | Elastic via S3 |
| Processing/automation | Tasks (Flux) | Processing engine (embedded Python VM) |
| Extra licensing | Read replicas add a license fee | Enterprise adds a per-node Marketplace license; Core has none |

## Deployment Topology

This is the most commonly misunderstood difference. The two versions have fundamentally different deployment models.

### V2 — single node by default
A Timestream for InfluxDB **instance** (`create-db-instance`) is a **single node**. Availability options change this only slightly:

- **`SINGLE_AZ`** (default) — one node, one Availability Zone.
- **`WITH_MULTIAZ_STANDBY`** — a primary node plus a secondary **standby** in another AZ. The standby is for **failover only**; it does not serve reads or add throughput.

To get more than one serving node, you must create a **read-replica cluster** (`create-db-cluster` with `--deployment-type MULTI_NODE_READ_REPLICAS`). Only then does V2 run multiple nodes. **Without a read-replica cluster, V2 is a single node.**

### V3 — cluster only
Timestream for InfluxDB 3 is **always deployed as a cluster** (`create-db-cluster`). There is no single-instance API for V3. The cluster's topology is determined by the parameter group, not a `--deployment-type` flag (do **not** pass `--deployment-type` for V3):

- **Core** (`InfluxDBV3Core`) — a **single-node** cluster. Ingestion, querying, compaction, and the processing engine all run on one node and share compute. Core has **no dedicated compactor**, so it is best for recent data (typically the last 3–5 days).
- **Enterprise** (`InfluxDBV3Enterprise`) — a **multi-node** cluster, up to 15 nodes: 1–4 writer (ingest) nodes, 0–13 read-only (query) nodes, and 1 compactor node. Nodes can be assigned distinct roles to isolate ingest/query/compaction/processing. All multi-node deployments are spread across multiple AZs for availability.

**Summary:** V2 is single-node unless you build a read-replica cluster; V3 is only ever a cluster (single-node for Core, multi-node for Enterprise).

## Architecture & Storage

**V2** uses the InfluxDB 2.x **TSM** storage engine with a **TSI** (time-series index). Tags are indexed, which is what makes high cardinality expensive — every unique tag-value combination becomes a series key, and large indexes drive memory pressure and slow writes/queries. Practical guidance caps a V2 instance at **~10M series**. Storage is local **Influx IOPS Included** block volumes (up to 16 TiB), and **storage cannot be increased after creation** — capacity must be planned upfront.

**V3** is a ground-up redesign built on open formats:
- **Rust** core for performance.
- **Apache Arrow** for in-memory columnar processing (vectorized execution, predicate/projection pushdown).
- **Apache Parquet** for persisted columnar files.
- **Apache DataFusion** as the query optimizer/engine.
- **Apache Arrow Flight SQL** (gRPC) as the high-performance query protocol.
- **Amazon S3** as the core storage layer — 11 nines (99.999999999%) durability, multi-AZ, and effectively elastic capacity.

V3 also adds two in-memory caches that accelerate common patterns:
- **Last Value Cache (LVC)** — most recent value per field; millisecond "last point" lookups for dashboards.
- **Distinct Value Cache (DVC)** — unique tag/field values per table; fast metadata queries (e.g., listing host or sensor IDs).

## Query Languages

- **V2:** **Flux** is the primary language; **InfluxQL** is also supported, **SQL** is not.
- **V3:** **SQL** is the primary language (via DataFusion); a v1-compatible **InfluxQL** endpoint is provided for legacy apps. **Flux is not supported.**

There is **no automatic Flux-to-SQL conversion**. Migrating from V2 to V3 requires rewriting all Flux queries, tasks, and dashboards into SQL or InfluxQL.

## Data Model & API

- **V2** organizes data as **Organization → Bucket**. Writes specify `org` and `bucket`; data-plane auth uses the `Token` prefix; default port **8086**.
- **V3** organizes data as **Database → Table** (no organizations). Tables are created automatically on first write (a measurement becomes a table). Writes specify `db`; data-plane auth uses the `Bearer` prefix; default port **8181**.

**Backward compatibility:** V3 exposes v1- and v2-compatible write endpoints (including `/api/v2/write`), so existing line-protocol writers and Telegraf configs can keep writing without changes during a migration. Line protocol itself is unchanged across versions.

## Automation / Processing

- **V2** uses **Tasks** — scheduled Flux scripts for downsampling, alerting, and transforms.
- **V3** ships a **processing engine**: an embedded Python virtual machine that runs plugins on scheduled events or WAL-flush events (downsampling, alerting, anomaly detection) with zero-copy access to data. Timestream for InfluxDB 3 provides a curated, security-hardened set of plugins.
- **Gotcha:** on multi-node Enterprise, scheduled triggers run on **every** node and can OOM small instances — target nodes with `node_spec` or scale up.

## Cost & Licensing

- **V2:** billed on instance hours + provisioned storage (per GiB) + data transfer. **Read replicas add a license fee**.
- **V3 Core:** compute + S3 storage only — **no license fee**.
- **V3 Enterprise:** compute + S3 storage **plus** an Enterprise license billed per node-hour via **AWS Marketplace** (InfluxData). The license is separate from AWS compute spend, and **EDP discounts do not apply** to Marketplace charges.

## Choosing / Migration Guidance

- **Choose V3** for high or unpredictable cardinality, SQL/BI integration, large historical retention (cheap S3), or when you need a multi-node solution for high ingest. V3 is also the forward path for workloads leaving Timestream for LiveAnalytics (in maintenance mode).
- **Stay on / choose V2** when you depend on **Flux**, existing v2 tooling/dashboards, or org/bucket semantics, and your cardinality stays well under ~10M series.
- **Migration checklist (V2 → V3):** rewrite Flux → SQL/InfluxQL; map orgs/buckets → databases/tables; switch auth `Token` → `Bearer` and port `8086` → `8181`; re-point writers (or use V3's v2-compatible write endpoint); re-provision as a cluster (Core or Enterprise).
- **No turnkey data migration:** the engines share no storage format, and managed V2 blocks host access (so the OSS `influxd inspect export-lp` disk dump is unavailable). Data must move through the **query API**: extract from V2 as annotated CSV or a DataFrame (V2 cannot emit line protocol from queries), then load into V3 — the InfluxDB 3 Python client's `write_file()` (CSV/JSON/Parquet/…) and `write_dataframe()` are the most capable loaders. Full runbook: `influxdb2/migrations.md`.

## Retrieving tokens

To interact with your deployed Timestream for InfluxDB instance or cluster, creating buckets, executing queries, ingesting data, etc., using the InfluxDB v2 or v3 HTTP APIs, you must retrieve or create an InfluxDB token.

### V2

Once your v2 instance or cluster has been deployed, create a new operator token, using the [Influx v2 CLI](https://docs.influxdata.com/influxdb/v2/tools/influx-cli/?section=influxdb%252Fv2%252Ftools):

```shell
influx config create --config-name CONFIG_NAME1 --host-url "https://yourinstanceid.eu-central-1.timestream-influxdb.amazonaws.com:8086" --org [YOURORG] --username-password [YOURUSERNAME] --active

influx auth create --org [YOURORG] --operator
```

### V3

After you have deployed a Timestream for InfluxDB v3 cluster, a secret in AWS Secrets Manager will be associated with your cluster. The ID of this secret will be returned as part of the `aws timestream-influxdb get-db-cluster` AWS CLI call and is visible in the AWS console.

Given the cluster ID, you can retrieve your token with the following command, replacing `<cluster ID>` with your cluster ID:
```shell
aws secretsmanager \
get-secret-value \
--secret-id READONLY-InfluxDB-auth-parameters-<cluster ID> \
--query SecretString \
--output text | jq -r '.token'
```

## Sources

- [What is Timestream for InfluxDB?](https://docs.aws.amazon.com/timestream/latest/developerguide/timestream-for-influxdb.html)
- [Amazon Timestream for InfluxDB 3](https://docs.aws.amazon.com/timestream/latest/developerguide/influxdb3.html)
- [Features and workflows with Amazon Timestream for InfluxDB 3](https://aws.amazon.com/blogs/database/features-and-workflows-with-amazon-timestream-for-influxdb-3/)
- [Timestream for InfluxDB 3 workload analysis and best practices](https://aws.amazon.com/blogs/database/timestream-for-influxdb-3-workload-analysis-and-best-practices/)
- [InfluxDB v2 HTTP API](https://docs.influxdata.com/influxdb/v2/api/?section=influxdb%252Fv2%252Fapi)
- [InfluxDB v3 HTTP API](https://docs.influxdata.com/influxdb3/enterprise/api/)
Loading
Loading