feat: support prompt caching and apply Anthropic's long-context prompt format#52

Merged

lsorber merged 12 commits intomainfrom feat/ms-document-ids

Dec 3, 2024

+396-322

Commits on Nov 25, 2024

Commits on Nov 26, 2024

feat: Simplify the api and minor improvements.
undo76
committed

Commits on Nov 27, 2024

feat: decouple generation from context retrieval
undo76
committed

Commits on Dec 1, 2024

fix: consecutive chunks wrongly scored as neighbours.
undo76
committed

Commits on Dec 2, 2024

fix: type validation.
undo76
committed