Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TPC-H] Set split_out=True in groupby-aggregations in Q11, Q13, Q17 and Q18 #1377

Merged
merged 6 commits into from
Feb 13, 2024

Conversation

hendrikmakait
Copy link
Member

Workaround for #1376. In the future, this should be superseded by dask/dask-expr#867.

@hendrikmakait hendrikmakait requested a review from phofl February 13, 2024 11:31
@phofl
Copy link
Contributor

phofl commented Feb 13, 2024

pre-commit is broken and I think you can update query 11 as well

@hendrikmakait hendrikmakait changed the title [TPC-H] Set split_out=True in groupby-aggregations in Q17 and Q18 [TPC-H] Set split_out=True in groupby-aggregations in Q11, Q17 and Q18 Feb 13, 2024
@hendrikmakait hendrikmakait changed the title [TPC-H] Set split_out=True in groupby-aggregations in Q11, Q17 and Q18 [TPC-H] Set split_out=True in groupby-aggregations in Q11, Q13, Q17 and Q18 Feb 13, 2024
@hendrikmakait
Copy link
Member Author

It looks like this causes memory pressure for Q18 at scale 10, but I'm inclined to merge anyways.

@phofl phofl merged commit de7673b into main Feb 13, 2024
13 of 15 checks passed
@phofl
Copy link
Contributor

phofl commented Feb 13, 2024

thx

@phofl phofl deleted the split-out-tpch branch February 13, 2024 13:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants