Skip to content

Commit d74d51b

Browse files
authored
Merge pull request #2792 from ClickHouse/ks/update_kinesis_virtual_columns
Add _sequence_number as supported Kinesis virtual column
2 parents 24410d1 + 06e6f0f commit d74d51b

File tree

1 file changed

+7
-6
lines changed
  • docs/en/integrations/data-ingestion/clickpipes

1 file changed

+7
-6
lines changed

docs/en/integrations/data-ingestion/clickpipes/kinesis.md

+7-6
Original file line numberDiff line numberDiff line change
@@ -96,12 +96,13 @@ The following ClickHouse data types are currently supported in ClickPipes:
9696

9797
The following virtual columns are supported for Kinesis stream. When creating a new destination table virtual columns can be added by using the `Add Column` button.
9898

99-
| Name | Description | Recommended Data Type |
100-
|--------------|---------------------------------------------------------------|-----------------------|
101-
| _key | Kinesis Partition Key | String |
102-
| _timestamp | Kinesis Approximate Arrival Timestamp (millisecond precision) | DateTime64(3) |
103-
| _stream | Kafka Stream Name | String |
104-
| _raw_message | Full Kinesis Message | String |
99+
| Name | Description | Recommended Data Type |
100+
|------------------|---------------------------------------------------------------|-----------------------|
101+
| _key | Kinesis Partition Key | String |
102+
| _timestamp | Kinesis Approximate Arrival Timestamp (millisecond precision) | DateTime64(3) |
103+
| _stream | Kinesis Stream Name | String |
104+
| _sequence_number | Kinesis Sequence Number | String |
105+
| _raw_message | Full Kinesis Message | String |
105106

106107
The _raw_message field can be used in cases where only full Kinesis JSON record is required (such as using ClickHouse [`JsonExtract*`](https://clickhouse.com/docs/en/sql-reference/functions/json-functions#jsonextract-functions) functions to populate a downstream materialized
107108
view). For such pipes, it may improve ClickPipes performance to delete all the "non-virtual" columns.

0 commit comments

Comments
 (0)