Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Lucene index scrubbing of missing entries #3008

Closed
jjezra opened this issue Dec 16, 2024 · 0 comments · Fixed by #3009
Closed

Support Lucene index scrubbing of missing entries #3008

jjezra opened this issue Dec 16, 2024 · 0 comments · Fixed by #3009

Comments

@jjezra
Copy link
Contributor

jjezra commented Dec 16, 2024 •
edited
Loading

To validate Lucene index validity, support "Report Only" scrubbing for missing Lucene index entries: iterate all records, validate that their primary keys are represented in the “primary key to Lucene segment” map, and that the Lucene segment exists.
jjezra added a commit to jjezra/fdb-record-layer that referenced this issue Dec 18, 2024
@jjezra
Resolve FoundationDB#3008: Support Lucene index scrubbing
0769dbc 
  To validate Lucene index validity, support "Report Only" scrubbing for:
     Dangling Lucene index entries: Iterate "all entries" (similar toLuceneScanAllEntriesTest), validate that all pointers lead to existing records.
     Missing Lucene index entries: iterate all records, validate that their primary keys are represented in the “primary key to Lucene segment” map, and that the Lucene segment exists
jjezra added a commit to jjezra/fdb-record-layer that referenced this issue Jan 13, 2025
@jjezra
Resolve FoundationDB#3008: Support Lucene index scrubbing
4939826 
  To validate Lucene index validity, support "Report Only" scrubbing for:
     Dangling Lucene index entries: Iterate "all entries" (similar toLuceneScanAllEntriesTest), validate that all pointers lead to existing records.
     Missing Lucene index entries: iterate all records, validate that their primary keys are represented in the “primary key to Lucene segment” map, and that the Lucene segment exists
@jjezra jjezra changed the title Support Lucene index scrubbing Support Lucene index scrubbing of missing entries Jan 15, 2025
jjezra added a commit to jjezra/fdb-record-layer that referenced this issue Jan 24, 2025
@jjezra
Resolve FoundationDB#3008: Support Lucene index scrubbing
80681f1 
  To validate Lucene index validity, support "Report Only" scrubbing for:
     Dangling Lucene index entries: Iterate "all entries" (similar toLuceneScanAllEntriesTest), validate that all pointers lead to existing records.
     Missing Lucene index entries: iterate all records, validate that their primary keys are represented in the “primary key to Lucene segment” map, and that the Lucene segment exists
jjezra added a commit to jjezra/fdb-record-layer that referenced this issue Jan 28, 2025
@jjezra
Resolve FoundationDB#3008: Support Lucene index scrubbing
a72bda0 
  To validate Lucene index validity, support "Report Only" scrubbing for:
     Dangling Lucene index entries: Iterate "all entries" (similar toLuceneScanAllEntriesTest), validate that all pointers lead to existing records.
     Missing Lucene index entries: iterate all records, validate that their primary keys are represented in the “primary key to Lucene segment” map, and that the Lucene segment exists
jjezra added a commit to jjezra/fdb-record-layer that referenced this issue Jan 29, 2025
@jjezra
Resolve FoundationDB#3008: Support Lucene index scrubbing
e966c78 
  To validate Lucene index validity, support "Report Only" scrubbing for:
     Dangling Lucene index entries: Iterate "all entries" (similar toLuceneScanAllEntriesTest), validate that all pointers lead to existing records.
     Missing Lucene index entries: iterate all records, validate that their primary keys are represented in the “primary key to Lucene segment” map, and that the Lucene segment exists
jjezra added a commit to jjezra/fdb-record-layer that referenced this issue Feb 5, 2025
@jjezra
Resolve FoundationDB#3008: Support Lucene index scrubbing
e2c6351 
  To validate Lucene index validity, support "Report Only" scrubbing for:
     Dangling Lucene index entries: Iterate "all entries" (similar toLuceneScanAllEntriesTest), validate that all pointers lead to existing records.
     Missing Lucene index entries: iterate all records, validate that their primary keys are represented in the “primary key to Lucene segment” map, and that the Lucene segment exists
jjezra added a commit to jjezra/fdb-record-layer that referenced this issue Feb 10, 2025
@jjezra
Resolve FoundationDB#3008: Support Lucene index scrubbing
fc72128 
  To validate Lucene index validity, support "Report Only" scrubbing for:
     Dangling Lucene index entries: Iterate "all entries" (similar toLuceneScanAllEntriesTest), validate that all pointers lead to existing records.
     Missing Lucene index entries: iterate all records, validate that their primary keys are represented in the “primary key to Lucene segment” map, and that the Lucene segment exists
jjezra added a commit to jjezra/fdb-record-layer that referenced this issue Feb 11, 2025
@jjezra
Resolve FoundationDB#3008: Support Lucene index scrubbing
b7cdd80 
  To validate Lucene index validity, support "Report Only" scrubbing for:
     Dangling Lucene index entries: Iterate "all entries" (similar toLuceneScanAllEntriesTest), validate that all pointers lead to existing records.
     Missing Lucene index entries: iterate all records, validate that their primary keys are represented in the “primary key to Lucene segment” map, and that the Lucene segment exists
@jjezra jjezra closed this as completed in 5254499 Feb 12, 2025
@ScottDugas ScottDugas mentioned this issue Feb 20, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Support Lucene index scrubbing of missing entries jjezra/fdb-record-layer
1 participant
@jjezra