feat(workers): implement Cloudflare Queue Consumer for ClickHouse sync #1812

koxudaxi · 2026-01-06T08:14:31Z

No description provided.

koxudaxi · 2026-01-06T08:14:42Z

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

feat(workers): implement Cloudflare Queue Consumer for ClickHouse sync #1812 👈 (View in Graphite)
feat(workers): implement outbox processor for ClickHouse sync #1811 : 1 other dependent PR (#1813 )
feat(db): write to outbox on span insertion #1810
feat(db): add spans_outbox table schema #1809
feat(clickhouse): implement ClickHouse client service #1808
feat(docker): add ClickHouse service for local development #1807 : 1 other dependent PR (#1819 )
feat(clickhouse): add clickhouse migrations and migrate tooling #1849
v2

This stack of pull requests is managed by Graphite. Learn more about stacking.

cloudflare-workers-and-pages · 2026-01-06T08:18:13Z

Deploying with Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status	Name	Latest Commit	Updated (UTC)
✅ Deployment successful! View logs	v2-docs	`3fff78c`	Jan 08 2026, 05:47 PM

graphite-app · 2026-01-08T15:14:48Z

cloud/wrangler.jsonc

+  "queues": {
+    "producers": [
+      {
+        "binding": "SPANS_OUTBOX_QUEUE",
+        "queue": "spans-outbox"
+      }
+    ],
+    "consumers": [
+      {
+        "queue": "spans-outbox",
+        "max_batch_size": 100,
+        "max_batch_timeout": 5
+      }
+    ]
+  },


This section causes CI to fail because it doesn't meet Prettier's formatting standards. Run 'npm run format' or 'prettier --write cloud/wrangler.jsonc' to automatically format the file according to the project's style guidelines.

Spotted by Graphite Agent (based on CI logs)

Is this helpful? React 👍 or 👎 to let us know.

This was referenced Jan 6, 2026

feat(workers): implement Cron Trigger for outbox re-enqueue #1813

Merged

feat(workers): implement local polling worker for ClickHouse sync #1814

Closed

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from 508eda7 to 7388a0a Compare January 6, 2026 08:22

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch 2 times, most recently from 0bd5bf4 to bcf092c Compare January 6, 2026 08:22

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from 7388a0a to 7fa58a6 Compare January 6, 2026 08:22

koxudaxi marked this pull request as ready for review January 6, 2026 08:23

koxudaxi requested a review from willbakst as a code owner January 6, 2026 08:23

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from 7fa58a6 to 95377e6 Compare January 6, 2026 08:32

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch 2 times, most recently from 495a3e7 to 9700c2e Compare January 6, 2026 08:36

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from 95377e6 to 7cb0db4 Compare January 6, 2026 08:36

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch from 9700c2e to ab157f5 Compare January 6, 2026 08:41

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from 7cb0db4 to 154ac86 Compare January 6, 2026 08:41

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch from ab157f5 to 7e41a1d Compare January 6, 2026 08:44

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from 154ac86 to 8adf745 Compare January 6, 2026 08:44

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch from 7e41a1d to 464a232 Compare January 6, 2026 08:45

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch 2 times, most recently from 27e1420 to eafad8b Compare January 6, 2026 08:49

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch from 464a232 to d5d28f1 Compare January 6, 2026 08:49

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from eafad8b to e347a9d Compare January 6, 2026 08:54

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch 2 times, most recently from b1b100e to e0908fa Compare January 6, 2026 08:59

koxudaxi force-pushed the graphite-base/1812 branch from aa32baf to 062e939 Compare January 8, 2026 09:06

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from aeb6573 to 825cb3e Compare January 8, 2026 09:06

koxudaxi changed the base branch from graphite-base/1812 to 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync January 8, 2026 09:06

koxudaxi changed the base branch from 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync to graphite-base/1812 January 8, 2026 09:33

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from 825cb3e to e514574 Compare January 8, 2026 09:36

koxudaxi force-pushed the graphite-base/1812 branch from 062e939 to b8e1062 Compare January 8, 2026 09:36

koxudaxi changed the base branch from graphite-base/1812 to 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync January 8, 2026 09:36

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from e514574 to ebe7788 Compare January 8, 2026 10:22

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch from b8e1062 to 804fdfa Compare January 8, 2026 10:22

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from ebe7788 to f87b7ce Compare January 8, 2026 10:25

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch 2 times, most recently from 55fd093 to 86cf1c3 Compare January 8, 2026 10:30

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from f87b7ce to 9656ef1 Compare January 8, 2026 10:30

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch from 86cf1c3 to 50f3052 Compare January 8, 2026 12:00

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch 2 times, most recently from 75e6afb to 699a351 Compare January 8, 2026 12:10

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch from 50f3052 to 3e94ee5 Compare January 8, 2026 12:10

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from 699a351 to ce86d89 Compare January 8, 2026 12:21

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch 2 times, most recently from 198a86b to b8c79c1 Compare January 8, 2026 13:25

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from ce86d89 to 7776f4c Compare January 8, 2026 13:25

koxudaxi mentioned this pull request Jan 8, 2026

chore(test): hard delete api test users #1850

Merged

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from 7776f4c to d50f9b1 Compare January 8, 2026 14:33

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch from b8c79c1 to 0e599c9 Compare January 8, 2026 14:33

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from d50f9b1 to a1ebdf4 Compare January 8, 2026 14:36

koxudaxi force-pushed the 01-06-feat_workers_implement_outbox_processor_for_clickhouse_sync branch from 0e599c9 to 972673c Compare January 8, 2026 14:36

fix(workers): use settings environment helpers

3fff78c

koxudaxi force-pushed the 01-06-feat_workers_implement_cloudflare_queue_consumer_for_clickhouse_sync branch from a1ebdf4 to 3fff78c Compare January 8, 2026 14:55

graphite-app bot reviewed Jan 8, 2026

View reviewed changes

koxudaxi closed this Jan 8, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat(workers): implement Cloudflare Queue Consumer for ClickHouse sync #1812

feat(workers): implement Cloudflare Queue Consumer for ClickHouse sync #1812

Uh oh!

koxudaxi commented Jan 6, 2026 •

edited

Loading

Uh oh!

koxudaxi commented Jan 6, 2026 •

edited

Loading

Uh oh!

cloudflare-workers-and-pages bot commented Jan 6, 2026 •

edited

Loading

Uh oh!

graphite-app bot Jan 8, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

feat(workers): implement Cloudflare Queue Consumer for ClickHouse sync #1812

feat(workers): implement Cloudflare Queue Consumer for ClickHouse sync #1812

Uh oh!

Conversation

koxudaxi commented Jan 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

koxudaxi commented Jan 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cloudflare-workers-and-pages bot commented Jan 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Deploying with Cloudflare Workers

Uh oh!

graphite-app bot Jan 8, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

koxudaxi commented Jan 6, 2026 •

edited

Loading

koxudaxi commented Jan 6, 2026 •

edited

Loading

cloudflare-workers-and-pages bot commented Jan 6, 2026 •

edited

Loading