Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add introducing reciprocal rank fusion for hybrid search blog #3621

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

ryanbogan
Copy link
Member

@ryanbogan ryanbogan commented Feb 4, 2025

Description

Add introducing reciprocal rank fusion for hybrid search blog. Goal for release date is post 2.19 release.

Issues Resolved

#3541

Check List

  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the BSD-3-Clause License.

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kolchfa-aws @ryanbogan Editorial review complete. Nice job on this 😄. Please see my comments and changes and let me know if you have any questions. Thanks!

Cc: @pajuric

### CPU utilization

The following table shows CPU utilization measurements on the coordinator node, comparing hybrid and RRF approaches. The percent difference column indicates the relative change in CPU usage between the two methods.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I went with italics for the name of the column, but you can choose different formatting if you'd like.

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
@kolchfa-aws
Copy link
Collaborator

@pajuric Please edit the meta, and this blog will be ready to publish.

@kolchfa-aws
Copy link
Collaborator

@pajuric This is a 2.19 feature so this blog should be published after 2.19 is released.

@pajuric
Copy link

pajuric commented Feb 7, 2025

Let's tentatively schedule this for 2/11 or 2/12, assuming 2.19 goes out the door on time.

has_science_table: true
categories:
- technical-posts
meta_keywords: OpenSearch hybrid search, reciprocal rank fusion, RRF, search ranking, score normalization, Min-max normalization, L2 normalization, ranking algorithms, data normalization
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please update the meta with the following:

meta_keywords: reciprocal rank fusion, OpenSearch 2.19, neural search plugin, hybrid search, relevance ranking, search normalization, k-nn search, L2 normalization, how reciprocal rank fusion works

meta_description: Learn about reciprocal rank fusion (RRF) using the Neural Search plugin in OpenSearch 2.19. Discover how this new approach to hybrid search merges results from multiple query sources for improved relevance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants