Skip to content

Update Vector Graph RAG with two-stage Jev evaluation - #34

Merged
unikcc merged 1 commit into
OmniJev:mainfrom
zc277584121:docs/vector-graph-rag-two-stage
Oct 9, 2026
Merged

unikcc merged 1 commit into
OmniJev:mainfrom
zc277584121:docs/vector-graph-rag-two-stage

Conversation

@zc277584121

Copy link
Copy Markdown
Contributor

Vector Graph RAG now uses two-stage Jev relation selection and full-passage reranking. Its evaluation covers 1,000 MuSiQue and 1,000 2Wiki queries, reaching 76.78% and 95.35% Recall@5 respectively (86.07% average).

The project reports its strongest retrieval results among the compared baselines. The linked report includes saved results, reproduction scripts, and the quality鈥搇atency comparison.

Evaluation: https://github.com/zilliztech/vector-graph-rag/blob/main/evaluation/jev/two-stage/README.md

I am a contributor to Vector Graph RAG and work on search at Zilliz.

Replaces the earlier 500-query relation-only evaluation entry with the full two-stage evaluation. The entry qualifies the Pareto-frontier claim with the report's reference latency estimates.

Passes the Primary test: this is a direct Jev evaluation with public results and reproduction scripts.

Validation: lint and all 15 count checks passed; git diff --check passed. The evaluation URL is directly accessible.

Signed-off-by: Cheney Zhang <chen.zhang@zilliz.com>
@zc277584121

Copy link
Copy Markdown
Contributor Author

Hi @unikcc, thanks for merging our earlier evaluation entry. This update replaces the 500-query relation-only results with the new two-stage Jev evaluation: 1,000 queries each on MuSiQue and 2Wiki, averaging 86.07% Recall@5. It links the full report and its quality鈥搇atency comparison. Lint, counts, and the new link check passed. Would appreciate your review when convenient!

@unikcc
unikcc merged commit ae17878 into OmniJev:main Oct 9, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants