Releases: blevesearch/bleve
Releases · blevesearch/bleve
v2.6.0
What's Changed
- MB-69881: Improved APIs and perf optimizations for vector search by @CascadingRadium in #2270
- MB-27666: Hierarchy Search by @CascadingRadium ; see docs/hierarchy.md
- Remove legacy vendor folder by @CascadingRadium in #2271
- Upgrade several dependencies - roaring/v2, mmap-go etc. by @abhinavdangeti in #2275
- MB-59633: Improve performance of Geospatial Search by @CascadingRadium in #2268
- MB-70388: Add forced docvalues for geopoint fields by @Likith101 in #2278
- MB-70410: Simplify
CoalesceQueuein hierarchical nested search by @CascadingRadium in #2283 - MB-61890 - Introducing config for zap layer by @Thejas-bhat in #2066
- Handle
nilmultiSearchParams properly forMultiSearchby @capemox in #2286 - MB-59633: Disable DocValues Chunking & Compression for Geo Fields by @Likith101 in #2269
- Improved geo spatial search accuracy by @Likith101 in blevesearch/geo#29 & blevesearch/geo#30
- MB-62985: Support for Binary quantized vector indexes @Likith101 ; see docs/vectors.md
- MB-62182: New merge approach that avoids re-training of vector indexes @Thejas-bhat ; see docs/fast_merge.md
- MB-71041: avoid updating
root.boltwith in-memory segment's data by @Thejas-bhat in #2296 - MB-65018 add custom_filter/custom_score query support with context-driven callback hooks by @maneuvertomars in #2289 ; see docs/custom_query.md
- MB-65860: Introducing support for fileIO Callbacks by @Likith101 in #2209
- (perf) pool queryStringLex to reuse bufio.Reader across query parses by @huynhanx03 in #2300
- Fix
nullissue when parsing search request attributes by @CascadingRadium in #2312 - MB-71375: Bolt Wrappers for File Callbacks by @Likith101 in #2309
- Absorb fixes for filtering vector search, update workflows by @abhinavdangeti in #2314
- MB-59670: GPU-Accelerated Vector Search by @CascadingRadium & @capemox ; see docs/vectors.md
- MB-71383: Expose vector field stats in scorch by @capemox in #2316
- Added check for in-memory segment merge by @Likith101 in #2319
- MB-71607: Fixed data corruption in bolt by @Likith101 in #2324
- Fix metrics involving NestedDocuments by @CascadingRadium in #2325
- MB-71216, MB-71650: Implement fast merge over binary index classes by @Thejas-bhat in #2326
- Upgrade to go-faiss@v1.1.0; Fix formatting, typos, etc. in docs/ by @abhinavdangeti in #2328
Introduced new file format - zapx@v17
Milestone: https://github.com/blevesearch/bleve/milestone/29
Full Changelog: v2.5.7...v2.6.0
v2.5.7
What's Changed
- MB-69654: Fix vector field alias validation by @CascadingRadium in #2259
- Used iota for scorch EventKind by @capemox in #2257
- Fix String API for SearchResult by @CascadingRadium in #2262
- MB-55637: Added new error types in scorch by @capemox in #2255
- Add documentation for multi-vector and nested-vector field support by @CascadingRadium in #2261
- Add coverage (goveralls) github action by @abhinavdangeti in #2263
- MB-69641: Add support for retrieval of multi-vector documents by @CascadingRadium in #2258
- MB-69655: Fix vector normalization to handle multi-vectors correctly by @CascadingRadium in #2264
Milestone: https://github.com/blevesearch/bleve/milestone/33
Full Changelog: v2.5.6...v2.5.7
v2.5.6
What's Changed
- (feat) Add prefix and regex filtering for term facets by @ajroetker in #2242
- Minor code optimizations around allocations by @abhinavdangeti in #2247
- MB-60401: Perf optimizations for score fusion during hybrid search by @capemox in #2246
- Minor code fixes around recycling data structures and metric tracking by @CascadingRadium in #2252
Milestone: https://github.com/blevesearch/bleve/milestone/32
Full Changelog: v2.5.5...v2.5.6
v2.5.5
What's Changed
- MB-66396: Index APIs for
TermFrequenciesandCentroidCardinalitiesby @abhinavdangeti in #2207 - Fix BooleanFilter Logic by @CascadingRadium in #2239
- Update docs/vectors.md on new
blevesearch/faissversion to use by @abhinavdangeti in #2240 - Minor Fixes by @CascadingRadium in #2241
Milestone: https://github.com/blevesearch/bleve/milestone/31
Full Changelog: v2.5.4...v2.5.5
v2.5.4
What's Changed
- MB-66576: Replace golang/protobuf with google.golang.org/protobuf by @abhinavdangeti in #2205
- MB-67212: Supporting search_after/search_before for deep pagination over non textual content by @capemox in #2208
- refactor: use slices.Equal to simplify code by @houpo-bob in #2211
- Add pagination documentation by @capemox in #2216
- Fix spelling and grammatical errors using
codespellby @kianmeng in #2219 - MB-65170: Add filter support to BooleanQuery by @CascadingRadium in #2220
- Guidelines for search index creation to support auto complete / suggestions by @maneuvertomars in #2217
- Open-api spec for bleve queries by @abhinavdangeti in #2226
- MB-57888: Support for downtime mitigation upon updates to index mapping by @Likith101 in #2106
- MB-60401: Support RRF for hybrid search by @capemox in #2218
- MB-60401: Adding Relative Score Fusion by @capemox in #2233
- MB-60401: Documentation for Hybrid search's score fusion by @capemox in #2235
New Contributors
- @capemox made their first contribution in #2208
- @maneuvertomars made their first contribution in #2217
Milestone: https://github.com/blevesearch/bleve/milestone/28
Full Changelog: v2.5.3...v2.5.4
v2.5.3
Bug Fixes
- Address a performance regression in
GeoShapequeries introduced inv2.5.1and affectsv2.5.2as well. This is captured in #2210. The fix blevesearch/geo#28 has been included with #2214.
Milestone
v2.5.2
v2.5.1
Bug Fixes
- Fix bolt snapshot when concurrent persister is in use (not ON by default), with #2178
- No partial failures allowed during "pre search" - applicable to synonyms, filtered vector search - #2179
- Ensuring latest snapshot is persisted within bolt to avoid any chance of data loss (in parlance with
num_snapshots_to_keep, rollback support) - #2183, #2186 - Recalculation of bm25 metrics upon every request can cause slowness, fixed with #2180
- Fixes around a tracked "pre search metric",
knnfilter query validation and a bad situation with synonyms if legacy zap versions used, with #2188, #2191, #2192
Improvements
- Upgrade forked version of golang/geo in use for
geopointandgeoshapedata to the latest available - Enhanced geoshape support over:
- point/multipoint, blevesearch/geo#18
- linestring/multilineString, blevesearch/geo#19
- polygon/multipolygon, blevesearch/geo#20
- circle, blevesearch/geo#25
- envelope, blevesearch/geo#21
- Circles can be included within geometry collections with #2195, blevesearch/geo#27
Milestone
v2.5.0
Bug Fixes
- Exact hits to score higher than fuzzy hits, with #2056
- Fix boosting during hybrid search that involves text + nearest neighbor, with #2127
- Addressed bug in IP field handling while highlighting, with #2142
- Graceful error handling within registry, with #2151
http/package (meant for demo purposes) removed from repository to remove vulnerability - CVE-2022-31022, relocated to within https://github.com/blevesearch/bleve-explorer- Geo radius queries will now advertise distances (within sort values) in readable format, with #2137
Improvements
- Vector search requires
faissdynamic library to be built from blevesearch/faiss@352484e which is a modified version of v1.10.0 - Support for BM25 scoring, see: scoring.md
- Support for synonyms' search, see: synonyms.md
- Significant performance improvements in pre-filtered vector search, with #2169 + dependent changes
autofuzziness detection with #2060- Ability to affect ingestion/drain rate by tuning persister workers with #2100
- Additional config in merge policy for improved merger behavior, with #2134
- Geo improvements: footprint reduction for polygons, better validation and graceful error handling, with #2162 + #2158 + #2165
- Upgrade to RoaringBitmap/roaring@v2.4.5, etcd.io/bbolt@v1.4.0
- More metrics
Milestone
v2.4.4
Bug Fixes
- Identified root cause for #1662 to be recycling of TermFieldReaders that was causing illegal/incorrect access of several in-memory structures in certain scenarios. We've gone ahead and disabled this feature with #2117 + #2121 . Will work towards re-enabling in the near future once we've ironed out the several associated wrinkles.
- Introduced a guard rail with blevesearch/zapx#282 while performing vector search queries with pre-filtering to avoid hitting a panic when qualified docs do not hold valid vector fields.
- Fixed an issue while applying
ivf_max_codes_pctin vector search requests involving pre-filtering which can cause reduction in recall - blevesearch/go-faiss#40
Vector search continues to require same version of faiss dynamic library (as with v2.4.3) to be built from blevesearch/faiss@b747c55a which is a modified version of v1.8.0