Skip to content

Latest commit

ย 

History

History
63 lines (48 loc) ยท 1.17 KB

File metadata and controls

63 lines (48 loc) ยท 1.17 KB

Kafka Sink Connector ์šด์˜ ๊ฐ€์ด๋“œ

๐Ÿณ Docker Compose

์‹คํ–‰

docker-compose up -d

์ข…๋ฃŒ ๋ฐ ๋ณผ๋ฅจ ์‚ญ์ œ

docker-compose down -v

๐Ÿ”Œ Kafka Sink Connector ๋“ฑ๋ก ๋ฐ ์‚ญ์ œ

๐Ÿ” ๋“ฑ๋ก - InfluxDB Sink Connector

curl -X POST \
  -H "Content-Type: application/json" \
  --data '@influxdb-sink-config.json' \
  http://localhost:8083/connectors

โŒ ์‚ญ์ œ - InfluxDB Sink Connector

curl -X DELETE http://localhost:8083/connectors/influxdb-sink-connector

โ˜๏ธ ๋“ฑ๋ก - S3 Sink Connector

curl -i -X POST \
  -H "Content-Type: application/json" \
  -H "Accept: application/json" \
  --data @s3-sink-config.json \
  http://localhost:8083/connectors

๐Ÿงช Kafka ๋ฉ”์‹œ์ง€ ํ™•์ธ (Kafka ์ปจํ…Œ์ด๋„ˆ ๋‚ด๋ถ€)

kafka-console-consumer \
  --bootstrap-server kafka:9093 \
  --topic EQUIPMENT \
  --from-beginning

โ˜๏ธ AWS CLI ์„ค์ •

aws configure

๐Ÿ“Œ ๊ธฐํƒ€ ์ฐธ๊ณ 

  • sink-connector๋Š” Kafka Connect์˜ REST API๋ฅผ ํ†ตํ•ด ๋“ฑ๋ก ๋ฐ ์‚ญ์ œํ•ฉ๋‹ˆ๋‹ค.
  • S3 ๋˜๋Š” InfluxDB์™€์˜ ์—ฐ๋™ ์ „, ์ธ์ฆํ‚ค ๋ฐ ์ ‘์† ์„ค์ •์ด ์˜ฌ๋ฐ”๋ฅธ์ง€ ํ™•์ธํ•˜์„ธ์š”.