Skip to content

Commit 1a7ad90

Browse files
committed
Listing write steps for Core and enterprise (#5878)
1 parent d6444ac commit 1a7ad90

File tree

1 file changed

+16
-0
lines changed

1 file changed

+16
-0
lines changed

content/shared/v3-core-get-started/_index.md

+16
Original file line numberDiff line numberDiff line change
@@ -251,6 +251,22 @@ Subsequent requests can add new fields on-the-fly, but can't add new tags.
251251
252252
{{% product-name %}} is optimized for recent data, but accepts writes from any time period. It persists that data in Parquet files for access by third-party systems for longer term historical analysis and queries. If you require longer historical queries with a compactor that optimizes data organization, consider using [InfluxDB 3 Enterprise](/influxdb3/enterprise/get-started/).
253253
254+
#### Data persistence flow
255+
256+
When you write data to InfluxDB 3, your data flows through the following stages:
257+
258+
1. **Write validation**: InfluxDB validates incoming data and rejects invalid points with an HTTP 400 error.
259+
260+
2. **Memory buffer**: Valid data points are initially stored in an in-memory write buffer.
261+
262+
3. **WAL persistence**: Every second (by default), InfluxDB flushes the write buffer to Write-Ahead Log (WAL) files in object storage.
263+
- By default, write requests are acknowledged only after this WAL persistence completes
264+
- With the `no_sync` option, writes are acknowledged before WAL persistence, reducing latency but increasing risk of data loss during system failure
265+
266+
4. **Query availability**: After WAL persistence completes, data moves to the queryable buffer where it becomes available for queries.
267+
268+
5. **Parquet storage**: Every ten minutes (by default), InfluxDB persists data from the queryable buffer to object storage as Parquet files for long-term storage.
269+
254270
The database provides three write API endpoints that respond to HTTP `POST` requests:
255271
256272
#### /api/v3/write_lp endpoint

0 commit comments

Comments
 (0)