Skip to content

[VL] Support cudf.allowCpuFallback config for Velox cuDF backend #12451

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
marin-ma merged 5 commits into from
Jul 7, 2026
Merged

[VL] Support cudf.allowCpuFallback config for Velox cuDF backend #12451

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
3163a97
[VL] Support cudf.allowCpuFallback config for Velox cuDF backend
ReemaAlzaid Jul 5, 2026
3800270
Add cuDF CPU fallback config entry
ReemaAlzaid Jul 6, 2026
a7ee775
Merge branch 'main' into cudf-allow-cpu-fallback
ReemaAlzaid Jul 6, 2026
aecfa81
address comments
ReemaAlzaid Jul 6, 2026
d225b51
Merge branch 'cudf-allow-cpu-fallback' of https://github.com/ReemaAlz…
ReemaAlzaid Jul 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions backends-velox/src/main/scala/org/apache/gluten/config/VeloxConfig.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -779,6 +779,12 @@ object VeloxConfig extends ConfigRegistry {
.booleanConf
.createWithDefault(true)

val CUDF_ALLOW_CPU_FALLBACK =
buildStaticConf("spark.gluten.sql.columnar.backend.velox.cudf.allowCpuFallback")
.doc("Allow cuDF to fall back to CPU execution for unsupported operators.")
.booleanConf
.createWithDefault(true)

val CUDF_CONCURRENT_GPU_TASKS =
buildStaticConf("spark.gluten.sql.columnar.backend.velox.cudf.concurrentGpuTasks")
.doc("The number of concurrent GPU tasks to run.")
Expand Down
2 changes: 2 additions & 0 deletions cpp/core/config/GlutenConfig.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -110,6 +110,8 @@ const std::string kCudfEnabled = "spark.gluten.sql.columnar.cudf";
constexpr bool kCudfEnabledDefault = false;
const std::string kDebugCudf = "spark.gluten.sql.debug.cudf";
const std::string kDebugCudfDefault = "false";
const std::string kCudfAllowCpuFallback = "spark.gluten.sql.columnar.backend.velox.cudf.allowCpuFallback";
const std::string kCudfAllowCpuFallbackDefault = "true";

std::unordered_map<std::string, std::string>
parseConfMap(JNIEnv* env, const uint8_t* planData, const int32_t planDataLength);
Expand Down
4 changes: 3 additions & 1 deletion cpp/velox/compute/VeloxBackend.cc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -202,7 +202,9 @@ void VeloxBackend::init(
{velox::cudf_velox::CudfConfig::kCudfMemoryResource,
backendConf_->get(kCudfMemoryResource, kCudfMemoryResourceDefault)},
{velox::cudf_velox::CudfConfig::kCudfMemoryPercent,
backendConf_->get(kCudfMemoryPercent, kCudfMemoryPercentDefault)}};
backendConf_->get(kCudfMemoryPercent, kCudfMemoryPercentDefault)},
{velox::cudf_velox::CudfConfig::kCudfAllowCpuFallback,
backendConf_->get(kCudfAllowCpuFallback, kCudfAllowCpuFallbackDefault)}};
auto& cudfConfig = velox::cudf_velox::CudfConfig::getInstance();
cudfConfig.initialize(std::move(options));
velox::cudf_velox::registerCudf();
Expand Down
1 change: 1 addition & 0 deletions docs/velox-configuration.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ nav_order: 16
| spark.gluten.sql.columnar.backend.velox.cacheEnabled | ⚓ Static | false | Enable Velox cache, default off. It's recommended to enablesoft-affinity as well when enable velox cache. |
| spark.gluten.sql.columnar.backend.velox.cachePrefetchMinPct | ⚓ Static | 0 | Set prefetch cache min pct for velox file scan |
| spark.gluten.sql.columnar.backend.velox.checkUsageLeak | ⚓ Static | true | Enable check memory usage leak. |
| spark.gluten.sql.columnar.backend.velox.cudf.allowCpuFallback | ⚓ Static | true | Allow cuDF to fall back to CPU execution for unsupported operators. |
| spark.gluten.sql.columnar.backend.velox.cudf.batchSize | 🔄 Dynamic | 2147483647 | Cudf input batch size after shuffle reader |
| spark.gluten.sql.columnar.backend.velox.cudf.concurrentGpuTasks | ⚓ Static | 1 | The number of concurrent GPU tasks to run. |
| spark.gluten.sql.columnar.backend.velox.cudf.enableTableScan | ⚓ Static | false | Enable cudf table scan |
Expand Down
Loading