Skip to content

[GLUTEN-11550][UT][Spark4.x] Remove GlutenSingleLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapWithVectorizedMapSuite#11571

Merged
baibaichen merged 7 commits into
apache:mainfrom
kapilks:fix_glutensinglelevelagg
Feb 26, 2026

Conversation

@kapilks

@kapilks kapilks commented Feb 5, 2026

Copy link
Copy Markdown
Contributor

What changes are proposed in this pull request?

Remove following UTs:
GlutenSingleLevelAggregateHashMapSuite
GlutenTwoLevelAggregateHashMapSuite
GlutenTwoLevelAggregateHashMapWithVectorizedMapSuite

Above suites runs UTs similar to GlutenDataFrameAggregateSuite. Only difference being that wholestage codegen is enabled or not and multi level aggregation map. These are specific to Spark implementation only.
So essentially same as GlutenDataFrameAggregateSuite. So I think these suites would be redundant.

Updated GlutenDataFrameAggregateSuite to add overridden UT for some disables cases.

How was this patch tested?

UTs.

Was this patch authored or co-authored using generative AI tooling?

No

Related issue: #11550

@github-actions github-actions Bot added the CORE works for Gluten Core label Feb 5, 2026
@kapilks kapilks changed the title [VL][Spark4.x] Enable GlutenSingleLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapWithVectorizedMapSuite [Spark4.x] Remove GlutenSingleLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapWithVectorizedMapSuite Feb 7, 2026
@kapilks

kapilks commented Feb 7, 2026

Copy link
Copy Markdown
Contributor Author

@baibaichen Let me know if we still want to retain these suites?

@baibaichen

Copy link
Copy Markdown
Contributor

@baibaichen Let me know if we still want to retain these suites?

LGTM to remove them.

Can we keep a small doc listing the excluded/removed suites (and why), so it’s easier to track and revisit later via AI?

@kapilks kapilks force-pushed the fix_glutensinglelevelagg branch from 97b3c52 to 69f1f04 Compare February 10, 2026 15:43
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@kapilks kapilks changed the title [Spark4.x] Remove GlutenSingleLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapWithVectorizedMapSuite [GLUTEN-11550][Spark4.x] Remove GlutenSingleLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapWithVectorizedMapSuite Feb 10, 2026
@kapilks kapilks changed the title [GLUTEN-11550][Spark4.x] Remove GlutenSingleLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapWithVectorizedMapSuite [GLUTEN-11550][UT][Spark4.x] Remove GlutenSingleLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapSuite, GlutenTwoLevelAggregateHashMapWithVectorizedMapSuite Feb 10, 2026
@kapilks

kapilks commented Feb 11, 2026

Copy link
Copy Markdown
Contributor Author

@baibaichen Please review, added a doc.

@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@baibaichen baibaichen force-pushed the fix_glutensinglelevelagg branch from 96b3e52 to fb28bc8 Compare February 26, 2026 07:15
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@baibaichen baibaichen left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks!

@baibaichen baibaichen merged commit 9c86411 into apache:main Feb 26, 2026
60 checks passed
@kapilks kapilks deleted the fix_glutensinglelevelagg branch February 26, 2026 14:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CORE works for Gluten Core

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants