[VishnuVV27]

Tracking issue

Closes #6888

Why are the changes needed?

Dynamic workflows in Flyte can fail or suffer from performance issues when the dynamic closure becomes too large, exceeding gRPC message limits (the "message too large" error). Even if execution succeeds, the Flyte UI becomes sluggish because it has to download and parse these massive blobs. This is primarily caused by the inclusion of all node inputs in the dynamic closure, which is redundant since this data is already persisted in metadata storage.

What changes were proposed in this pull request?

1. Pruning Logic: Added a clearNodeInputs helper in flytepropeller/pkg/controller/nodes/dynamic/dynamic_workflow.go to nullify the Inputs field for nodes in the dynamic closure.
2. Recursive Support: The function specifically handles ArrayNode (Map Tasks) to ensure nested node inputs are also pruned, which are often the largest contributors to payload bloat.
3. Integration: Integrated the pruning step into buildContextualDynamicWorkflow so it triggers just before the closure is cached and sent as an event.

This effectively reduces the "blueprint" size of the dynamic workflow without affecting execution, as nodes continue to read their actual inputs from the defined storage locations.

How was this patch tested?

Added a new test suite TestClearNodeInputs_WithCoreBindings in flytepropeller/pkg/controller/nodes/dynamic/dynamic_workflow_test.go.

• Positive Case: Verified that standard node inputs are set to nil.
• Nested Case: Verified that inputs inside ArrayNode targets are also nullified.
• Verification Command:

  go test -v ./pkg/controller/nodes/dynamic/... -run TestClearNodeInputs_WithCoreBindings

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 57.20%. Comparing base (8f92e1d) to head (d7721f1).

Additional details and impacted files

@@           Coverage Diff           @@
##           master    #6908   +/-   ##
=======================================
  Coverage   57.20%   57.20%           
=======================================
  Files         930      930           
  Lines       58253    58262    +9     
=======================================
+ Hits        33322    33330    +8     
- Misses      21870    21871    +1     
  Partials     3061     3061           

Flag	Coverage Δ
unittests-datacatalog	53.51% <ø> (ø)
unittests-flyteadmin	53.17% <ø> (ø)
unittests-flytecopilot	48.05% <ø> (ø)
unittests-flytectl	64.09% <ø> (ø)
unittests-flyteidl	75.71% <ø> (ø)
unittests-flyteplugins	60.38% <ø> (ø)
unittests-flytepropeller	53.81% <100.00%> (+0.02%)	⬆️
unittests-flytestdlib	64.39% <ø> (-0.03%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.