Skip to content

Commit

Permalink
Updated formatting
Browse files Browse the repository at this point in the history
  • Loading branch information
dat-a-man committed Jan 25, 2025
1 parent 31f31a2 commit 58a98c7
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions docs/website/docs/general-usage/incremental-loading.md
Original file line number Diff line number Diff line change
Expand Up @@ -120,7 +120,7 @@ If you use the `merge` write disposition, but do not specify merge or primary ke
The appended data will be inserted from a staging table in one transaction for most destinations in this case.
:::

Example: Dedup sort behavior example
Example: Deduplication with Timestamp based sorting

```py
# Sample data
Expand All @@ -145,13 +145,13 @@ def sample_data():
```
When this resource is executed, the following deduplication rules are applied:

1. For records with different values in the dedup_sort column:
1. For records with different values in the `dedup_sort` column:
- The record with the highest value is kept when using `desc`
- For example, between records with id=1, the one with metadata_modified="2024-01-02" is kept
- For example, between records with id=1, the one with `"metadata_modified"="2024-01-02"` is kept

2. For records with identical values in the dedup_sort column:
- The first occurrence encountered is kept
- For example, between records with id=2 and identical metadata_modified="2024-01-01", the first record (value="C") is kept
- For example, between records with id=2 and identical `"metadata_modified"="2024-01-01"`, the first record (value="C") is kept

#### Delete records
The `hard_delete` column hint can be used to delete records from the destination dataset. The behavior of the delete mechanism depends on the data type of the column marked with the hint:
Expand Down

0 comments on commit 58a98c7

Please sign in to comment.