Skip to content

[GLUTEN-6887][VL] Daily Update Velox Version (2025_09_23)#10788

Merged
zhztheplayer merged 2 commits into
apache:mainfrom
GlutenPerfBot:tagging-2025_09_23
Sep 23, 2025
Merged

[GLUTEN-6887][VL] Daily Update Velox Version (2025_09_23)#10788
zhztheplayer merged 2 commits into
apache:mainfrom
GlutenPerfBot:tagging-2025_09_23

Conversation

@GlutenPerfBot

Copy link
Copy Markdown
Contributor

Upstream Velox's New Commits:

7d7a91fc0 by wecharyu, fix: ArrowArrayStruct contains null data pointer for a buffer with non-zero computed size (14755)
27e909259 by Hongze Zhang, build: Fix TpcdsConnector error "'this' pointer is null" (14878)
426516c09 by James Gill, test(geo): Add tests for different output batch sizes (14924)
5ced240b0 by Vivian Hsu, feat: Pass requestOptions per I/O call (14883)
e9ce22b8f by Abhinav Mukherjee, Replace boost::regex with RE2 regex in url_extract_parameter and fb_url_extract_parameter Presto function in Velox (14681)
785b5863e by Jimmy Lu, fix: Do not overwrite valid promise (14923)
602ffe137 by Chengcheng Jin, feat(hive): Support decimal as partition key type in Hive write and read (12910)
de60e0607 by Ke Wang, feat: Add parallel unit loader in Hive and implement it for DWRF (14716)

Upstream Velox's New Commits:
7d7a91fc0 by wecharyu, fix: ArrowArrayStruct contains null data pointer for a buffer with non-zero computed size (#14755)
27e909259 by Hongze Zhang, build: Fix TpcdsConnector error "'this' pointer is null" (#14878)
426516c09 by James Gill, test(geo): Add tests for different output batch sizes (#14924)
5ced240b0 by Vivian Hsu, feat: Pass requestOptions per I/O call (#14883)
e9ce22b8f by Abhinav Mukherjee, Replace boost::regex with RE2 regex in url_extract_parameter and fb_url_extract_parameter Presto function in Velox (#14681)
785b5863e by Jimmy Lu, fix: Do not overwrite valid promise (#14923)
602ffe137 by Chengcheng Jin, feat(hive): Support decimal as partition key type in Hive write and read (#12910)
de60e0607 by Ke Wang, feat: Add parallel unit loader in Hive and implement it for DWRF (#14716)

Signed-off-by: glutenperfbot <glutenperfbot@glutenproject-internal.com>
@github-actions

Copy link
Copy Markdown

#6887

void* buf,
facebook::velox::filesystems::File::IoStats* stats = nullptr) const override {
facebook::velox::filesystems::File::IoStats* stats = nullptr,
const folly::F14FastMap<std::string, std::string>& fileReadOps = {}) const override {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhztheplayer

Copy link
Copy Markdown
Member

There's a CI error at ColumnPruningSuite:

2025-09-23T15:55:02.3923579Z - SPARK-24696 ColumnPruning rule fails to remove extra Project *** FAILED ***
2025-09-23T15:55:02.3924834Z   java.lang.NullPointerException: Cannot invoke "org.apache.spark.sql.execution.SparkPlan.subqueries()" because "x$7" is null
2025-09-23T15:55:02.3926348Z   at org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanHelper.$anonfun$subqueriesAll$1(AdaptiveSparkPlanHelper.scala:121)
2025-09-23T15:55:02.3928074Z   at org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanHelper.$anonfun$flatMap$1(AdaptiveSparkPlanHelper.scala:75)
2025-09-23T15:55:02.3929842Z   at org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanHelper.$anonfun$flatMap$1$adapted(AdaptiveSparkPlanHelper.scala:75)
2025-09-23T15:55:02.3931434Z   at org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanHelper.foreach(AdaptiveSparkPlanHelper.scala:45)
2025-09-23T15:55:02.3932830Z   at org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanHelper.foreach$(AdaptiveSparkPlanHelper.scala:44)
2025-09-23T15:55:02.3933917Z   at org.apache.gluten.test.FallbackUtil$.foreach(FallbackUtil.scala:31)
2025-09-23T15:55:02.3934998Z   at org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanHelper.flatMap(AdaptiveSparkPlanHelper.scala:75)
2025-09-23T15:55:02.3936371Z   at org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanHelper.flatMap$(AdaptiveSparkPlanHelper.scala:73)
2025-09-23T15:55:02.3937624Z   at org.apache.gluten.test.FallbackUtil$.flatMap(FallbackUtil.scala:31)
2025-09-23T15:55:02.3938765Z   at org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanHelper.subqueriesAll(AdaptiveSparkPlanHelper.scala:121)
2025-09-23T15:55:02.3939706Z   ...

This seems like a flaky test and I suppose it's nothing to do with the Velox version update. May investigate later.

@zhztheplayer zhztheplayer merged commit 67b46c2 into apache:main Sep 23, 2025
53 of 55 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants