Skip to content

Default hashAggregationCompositeOutputEnabled to false because CompositeVector is not compatible with shuffle batch resize on the latest OSS Gluten#6

Open
markjin1990 wants to merge 1 commit into
WangGuangxin:add_bolt_backendfrom
markjin1990:disable-hashagg-composite-output
Open

Default hashAggregationCompositeOutputEnabled to false because CompositeVector is not compatible with shuffle batch resize on the latest OSS Gluten#6
markjin1990 wants to merge 1 commit into
WangGuangxin:add_bolt_backendfrom
markjin1990:disable-hashagg-composite-output

Conversation

@markjin1990

@markjin1990 markjin1990 commented Feb 6, 2026

Copy link
Copy Markdown

What changes are proposed in this pull request?

  • Default hashAggregationCompositeOutputEnabled to false.
    • Otherwise, HashAgg in Spark on Bolt might cause coredump on gluten::BoltColumnarBatch::ensureFlattened() when there are multiple aggregation fields.

How was this patch tested?

Local test.

Was this patch authored or co-authored using generative AI tooling?

No

…iteVector is not compatible with shuffle batch resize on the latest OSS Gluten
@github-actions github-actions Bot added the VELOX label Feb 6, 2026

@taiyang-li taiyang-li left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@guhaiyan0221 guhaiyan0221 left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the fix

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants