Skip to content

Report query memory allocation in response body#260

Open
JCRPaquin wants to merge 3 commits into
mainfrom
jcrpaquin/improvement/add-request-memory-reporting
Open

Report query memory allocation in response body#260
JCRPaquin wants to merge 3 commits into
mainfrom
jcrpaquin/improvement/add-request-memory-reporting

Conversation

@JCRPaquin
Copy link
Copy Markdown
Member

@JCRPaquin JCRPaquin commented May 13, 2026

Why?

We've had issues with searchers running out of memory while handling standard traffic. Our current observability around Solr is insufficient to help us track down offending requests without testing individual queries.

By adding memory reporting per-query, we hope to capture long tail queries that can be quite costly, as well as allocate resource units to different query types to better rate-limit incoming load.

What?

Adds per-thread allocation tracking and uses it to report per-query memory allocations. This PR also removes pre-allocation from second-order operators.

@JCRPaquin JCRPaquin requested review from kelockhart and tjacovich May 19, 2026 18:48
Copy link
Copy Markdown

@tjacovich tjacovich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this all looks reasonable. Just a comment on explaining what the commented line is and why it is commented out.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we want to add a comment that describes this line and why it is currently excluded?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants