You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/docs-src/core/modules/ROOT/pages/backfill-cli.adoc
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -31,7 +31,7 @@ cd cdc-apache-cassandra
31
31
Result::
32
32
+
33
33
--
34
-
[source,bash]
34
+
[source,console]
35
35
----
36
36
BUILD SUCCESSFUL in 37s
37
37
17 actionable tasks: 15 executed, 2 up-to-date
@@ -175,7 +175,7 @@ Your data topic is now populated with the existing data from the Cassandra table
175
175
.Pulsar consumer subscription output:
176
176
[%collapsible]
177
177
====
178
-
[source,plain]
178
+
[source,console]
179
179
----
180
180
----- got message -----
181
181
2023-04-14T11:47:48,652-0400 [main] INFO org.apache.pulsar.client.impl.schema.AutoConsumeSchema - Configure topic schema \x00\x00\x00\x00\x00\x00\x00\x00 for topic persistent://public/default/data-ks1.table1 : {"key":{"name":"table1","schema":{"type":"record","name":"table1","namespace":"ks1","doc":"Table ks1.table1","fields":[{"name":"id","type":"string"}]},"type":"AVRO","timestamp":0,"properties":{}},"value":{"name":"table1","schema":{"type":"record","name":"table1","namespace":"ks1","doc":"Table ks1.table1","fields":[{"name":"val","type":["null","string"]}]},"type":"AVRO","timestamp":0,"properties":{}}}
@@ -236,7 +236,7 @@ When running the backfill CLI as a Pulsar-admin extension, all `--pulsar-*` para
236
236
The `--dsbulk-log-dir` is only available when running the backfill CLI as a standalone Java application.
237
237
238
238
The `--export-dsbulk-option` parameter passes extra parameters to DSBulk.
239
-
The relevant DSBulk settings configure the CSV connector and can be found https://github.com/datastax/dsbulk/blob/1.10.x/manual/settings.md#connector.csv[here^].
239
+
The relevant DSBulk settings configure the CSV connector and can be found https://github.com/datastax/dsbulk/blob/1.10.x/manual/settings.md#connector.csv[here].
240
240
Shortened option names are not supported.
241
241
242
242
In both the Pulsar-admin extension and the standalone Java application, C* related configurations are exclusively passed as command line arguments.
Copy file name to clipboardExpand all lines: docs/docs-src/core/modules/ROOT/pages/cdcExample.adoc
+9-9Lines changed: 9 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
3
3
Capture schema changes in your C* tables and pass them to Apache Pulsar(R) with DataStax Change Data Capture (CDC). This doc will guide you through installing, configuring, and using CDC with C* or DSE in a VM-based deployment.
4
4
5
-
This installation requires the following. Latest version artifacts are available https://github.com/datastax/cdc-apache-cassandra/releases/latest[here^]. Use image:https://img.shields.io/github/v/release/datastax/cdc-apache-cassandra?color=green&display_name=tag[link="https://github.com/datastax/cdc-apache-cassandra/releases/latest"^] for the latest version.
5
+
This installation requires the following. Latest version artifacts are available https://github.com/datastax/cdc-apache-cassandra/releases/latest[here]. Use image:https://img.shields.io/github/v/release/datastax/cdc-apache-cassandra?color=green&display_name=tag[link="https://github.com/datastax/cdc-apache-cassandra/releases/latest"] for the latest version.
@@ -17,7 +17,7 @@ This installation requires the following. Latest version artifacts are available
17
17
18
18
== Installing and configuring
19
19
20
-
. Download the https://pulsar.apache.org/download/[Pulsar tarball] and set up a Pulsar cluster. This example uses Pulsar https://pulsar.apache.org/docs/en/standalone/[standalone mode], but you can also use our helpful https://github.com/datastax/pulsar-ansible[Ansible Scripts^].
20
+
. Download the https://pulsar.apache.org/download/[Pulsar tarball] and set up a Pulsar cluster. This example uses Pulsar https://pulsar.apache.org/docs/en/standalone/[standalone mode], but you can also use our helpful https://github.com/datastax/pulsar-ansible[Ansible Scripts].
21
21
+
22
22
[source,bash]
23
23
----
@@ -29,7 +29,7 @@ bin/pulsar standalone
29
29
====
30
30
We recommend using the latest CDC agent version (at least version `1.0.4`+) to support C* collection data types.
31
31
====
32
-
. Install C*/DSE with your preferred https://docs.datastax.com/en/install/6.8/install/installWhichOne.html[installation method^].
32
+
. Install C*/DSE with your preferred https://docs.datastax.com/en/install/6.8/install/installWhichOne.html[installation method].
33
33
34
34
. After installing C*/DSE, but before starting the C*/DSE service, set the `Cassandra-env.sh` configuration:
35
35
+
@@ -78,13 +78,13 @@ INFO [main] 2022-04-11 18:47:06,433 Agent.java:92 - CDC agent started
78
78
79
79
== Deploy Pulsar Connector
80
80
81
-
. Deploy the Pulsar Cassandra Source Connector (CSC) for each CDC-enabled C* table. In the below example, we're configuring the source connector with parameters passed in `--source-config`.
81
+
. Deploy the Pulsar Cassandra Source Connector (CSC) for each CDC-enabled C* table. In the below example, we're configuring the source connector with parameters passed in `--source-config`.
82
82
+
83
-
The `outputFormat` source configuration controls the format of messages on the data topic.
83
+
The `outputFormat` source configuration controls the format of messages on the data topic.
84
84
+
85
-
* `key-value-avro` - Default behavior. Key and value are encoded separately in AVRO format.
85
+
* `key-value-avro` - Default behavior. Key and value are encoded separately in AVRO format.
86
86
* `key-value-json` - Key and value are encoded *separately* in JSON format.
87
-
* `json` - Key and value are encoded *together* in a single JSON object. Key field is populated with a JSON string representing key fields.
87
+
* `json` - Key and value are encoded *together* in a single JSON object. Key field is populated with a JSON string representing key fields.
Copy file name to clipboardExpand all lines: docs/docs-src/core/modules/ROOT/pages/faqs.adoc
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -102,7 +102,7 @@ We recommend active monitoring of the disk space of the C* nodes. If the Pulsar
102
102
When the disk space of the `cdc_raw` directory reaches your `cdc_total_space_in_mb` Cassandra setting (less than 4GB by default), writes to CDC-enabled tables will fail with a `CDCWriteException`.
103
103
The following warning message is included in Cassandra logs:
104
104
105
-
[source,language-bash]
105
+
[source,bash]
106
106
----
107
107
WARN [CoreThread-5] 2021-10-29 09:12:52,790 NoSpamLogger.java:98 - Rejecting Mutation containing CDC-enabled table. Free up space in /mnt/data/cdc_raw.
@@ -48,7 +48,7 @@ For `datastax-java-driver.basic.contact-points`, you must provide the fully qual
48
48
49
49
By passing in the Java driver's setting, this option gives you more configuration flexibility because you can specify a different port for each host. For example:
0 commit comments