Skip to content

Commit ae7eee4

Browse files
yanghuaiGityanghuaiGit
committed
add sqlserverCDC Modules and docs
2 parents 84a9cad + 2586664 commit ae7eee4

File tree

137 files changed

+6078
-1825
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

137 files changed

+6078
-1825
lines changed

‎README.md

+2-1
Original file line numberDiff line numberDiff line change
@@ -70,7 +70,7 @@ The following databases are currently supported:
7070
| | FTP | [doc](docs/offline/reader/ftpreader.md) | [doc](docs/offline/writer/ftpwriter.md) |
7171
| | HDFS | [doc](docs/offline/reader/hdfsreader.md) | [doc](docs/offline/writer/hdfswriter.md) |
7272
| | Carbondata | [doc](docs/offline/reader/carbondatareader.md) | [doc](docs/offline/writer/carbondatawriter.md) |
73-
| | Stream | [doc](docs/offline/reader/streamreader.md) | [doc](docs/offline/writer/carbondatawriter.md) |
73+
| | Stream | [doc](docs/offline/reader/streamreader.md) | [doc](docs/offline/writer/streamwriter.md) |
7474
| | Redis | | [doc](docs/offline/writer/rediswriter.md) |
7575
| | Hive | | [doc](docs/offline/writer/hivewriter.md) |
7676
| Stream Synchronization | Kafka | [doc](docs/realTime/reader/kafkareader.md) | [doc](docs/realTime/writer/kafkawriter.md) |
@@ -80,6 +80,7 @@ The following databases are currently supported:
8080
| | MongoDB Oplog | [doc](docs/realTime/reader/mongodboplogreader.md)| |
8181
| | PostgreSQL WAL | [doc](docs/realTime/reader/pgwalreader.md) | |
8282
| | Oracle LogMiner| [doc](docs/realTime/reader/LogMiner.md) | |
83+
| | Sqlserver CDC| [doc](docs/realTime/reader/sqlservercdc.md) | |
8384

8485
# Fundamental
8586
In the underlying implementation, FlinkX relies on Flink, and the data synchronization task will be translated into StreamGraph and executed on Flink. The basic principle is as follows:

‎README_CH.md

+3-2
Original file line numberDiff line numberDiff line change
@@ -80,16 +80,17 @@ FlinkX目前支持下面这些数据库：
8080
| | FTP | [doc](docs/offline/reader/ftpreader.md) | [doc](docs/offline/writer/ftpwriter.md) |
8181
| | HDFS | [doc](docs/offline/reader/hdfsreader.md) | [doc](docs/offline/writer/hdfswriter.md) |
8282
| | Carbondata | [doc](docs/offline/reader/carbondatareader.md) | [doc](docs/offline/writer/carbondatawriter.md) |
83-
| | Stream | [doc](docs/offline/reader/streamreader.md) | [doc](docs/offline/writer/carbondatawriter.md) |
83+
| | Stream | [doc](docs/offline/reader/streamreader.md) | [doc](docs/offline/writer/streamwriter.md) |
8484
| | Redis | | [doc](docs/offline/writer/rediswriter.md) |
8585
| | Hive | | [doc](docs/offline/writer/hivewriter.md) |
8686
| Stream Synchronization | Kafka | [doc](docs/realTime/reader/kafkareader.md) | [doc](docs/realTime/writer/kafkawriter.md) |
8787
| | EMQX | [doc](docs/realTime/reader/emqxreader.md) | [doc](docs/realTime/writer/emqxwriter.md) |
88-
| | RestApi | | [doc](docs/realTime/writer/restapiwriter.md) |
88+
| | RestApi |[doc](docs/realTime/reader/restapireader.md) | [doc](docs/realTime/writer/restapiwriter.md) |
8989
| | MySQL Binlog | [doc](docs/realTime/reader/binlogreader.md) | |
9090
| | MongoDB Oplog | [doc](docs/realTime/reader/mongodboplogreader.md)| |
9191
| | PostgreSQL WAL | [doc](docs/realTime/reader/pgwalreader.md) | |
9292
| | Oracle LogMiner | [doc](docs/realTime/reader/LogMiner.md) | |
93+
| | Sqlserver CDC | [doc](docs/realTime/reader/sqlservercdc.md) | |
9394

9495
# 基本原理
9596
在底层实现上，FlinkX依赖Flink，数据同步任务会被翻译成StreamGraph在Flink上执行，基本原理如下图：

‎docs/images/SqlserverCDC/Sqlserver1.png

31.3 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver10.png

26.9 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver11.png

27 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver12.png

35.6 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver13.png

22.9 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver14.png

47.6 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver2.png

67.4 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver3.png

12.8 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver4.png

11.6 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver5.png

13.3 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver6.png

13.1 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver7.png

31 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver8.png

124 KB
Loading

‎docs/images/SqlserverCDC/Sqlserver9.png

157 KB
Loading

‎docs/offline/reader/sqlserverreader.md

-1
Original file line numberDiff line numberDiff line change
@@ -398,7 +398,6 @@
398398
}
399399
}
400400
}
401-
}
402401
```
403402
<a name="labNO"></a>
404403
#### 4、增量同步指定startLocation

0 commit comments

Comments
 (0)