Skip to content

[VL] Add Spark randstr function mapping for Velox backend#11607

Merged
yaooqinn merged 1 commit into
apache:mainfrom
yaooqinn:feat/gluten-randstr-mapping
Feb 27, 2026
Merged

[VL] Add Spark randstr function mapping for Velox backend#11607
yaooqinn merged 1 commit into
apache:mainfrom
yaooqinn:feat/gluten-randstr-mapping

Conversation

@yaooqinn

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

Add expression mapping for Spark's randstr function (Spark 4.0+) to enable offloading to Velox native execution engine.

The randstr(length, seed) function generates a random string of specified length using characters from 0-9, a-z, A-Z. The Velox implementation was merged in facebookincubator/velox#16014.

Changes:

  • Add RANDSTR constant to ExpressionNames.scala
  • Add Sig[RandStr](ExpressionNames.RANDSTR) to Spark40Shims and Spark41Shims scalar expression mappings

How was this patch tested?

Existing Gluten UT framework. The Velox side has comprehensive tests in RandStrTest.cpp.

@github-actions github-actions Bot added the CORE works for Gluten Core label Feb 11, 2026
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@yaooqinn yaooqinn force-pushed the feat/gluten-randstr-mapping branch from 4c1a925 to 047892d Compare February 11, 2026 18:01
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@github-actions github-actions Bot added the VELOX label Feb 11, 2026
@yaooqinn yaooqinn force-pushed the feat/gluten-randstr-mapping branch from 047892d to 20f412c Compare February 12, 2026 18:14
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@yaooqinn yaooqinn force-pushed the feat/gluten-randstr-mapping branch from 20f412c to 6416265 Compare February 12, 2026 18:45
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@yaooqinn yaooqinn force-pushed the feat/gluten-randstr-mapping branch from 6416265 to bd97113 Compare February 24, 2026 05:37
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@yaooqinn yaooqinn marked this pull request as draft February 24, 2026 06:26
@yaooqinn yaooqinn force-pushed the feat/gluten-randstr-mapping branch from bd97113 to b41e015 Compare February 24, 2026 06:26
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@yaooqinn yaooqinn marked this pull request as ready for review February 24, 2026 06:34
Add expression mapping for Spark's randstr function (Spark 4.0+) to
enable offloading to Velox native execution.

Changes:
- Add RANDSTR constant to ExpressionNames.scala
- Add Sig[RandStr] to Spark40Shims and Spark41Shims scalar expression
  mappings

The Velox implementation was merged in facebookincubator/velox#16014.
randstr(length, seed) generates a random string of specified length
using characters from 0-9, a-z, A-Z.
@yaooqinn yaooqinn force-pushed the feat/gluten-randstr-mapping branch from b41e015 to 20d4e1f Compare February 27, 2026 12:01
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@yaooqinn yaooqinn merged commit bb021e0 into apache:main Feb 27, 2026
61 checks passed
@yaooqinn yaooqinn deleted the feat/gluten-randstr-mapping branch February 27, 2026 16:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CORE works for Gluten Core VELOX

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants