You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: fern/docs/pages/airdrop/data-extraction.mdx
+3-9Lines changed: 3 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -282,11 +282,9 @@ This lets you simulate a soft timeout and validate that your worker shuts down.
282
282
283
283
## Time-scoped syncs
284
284
285
-
Time-scoped syncs allow users to specify a particular timestamp to control the scope of data extraction. This capability enables more granular control over which data gets synchronized between external systems and DevRev.
285
+
Time-scoped syncs allow users to specify a custom timestamp to control the scope of data extraction. This capability enables more granular control over which data gets synchronized between external systems and DevRev.
286
286
287
-
### Configuration
288
-
289
-
Enable time-scoped syncs by adding the capability to your manifest:
287
+
Enable time-scoped syncs by first adding the capability to your manifest:
290
288
291
289
```yaml
292
290
imports:
@@ -295,17 +293,13 @@ imports:
295
293
- TIME_SCOPED_SYNCS
296
294
```
297
295
298
-
### Implementation
299
-
300
296
Your data extraction implementation must handle two optional parameters from the event's `EventContext`:
301
297
302
298
- **`extract_from`**: Timestamp indicating extraction starting point (applies to both initial and incremental syncs)
303
-
- **`reset_extract_from`**: Boolean flag for incremental syncs that determines extraction behavior
299
+
- **`reset_extract_from`**: Boolean flag for incremental syncs that determines whether data should be reextracted
304
300
305
301
<Info>Both parameters are optional and only provided when users specify time-scoped sync parameters.</Info>
306
302
307
-
#### Extraction logic
308
-
309
303
The extraction logic depends on the sync type and parameter combination:
310
304
311
305
**Initial syncs**: Use `extract_from` as the starting timestamp for data extraction.
0 commit comments