Skip to content

[ENH]: parallelise long-running processes #82

Description

@fredjaya

Is your feature request related to a problem?

Each sample is processed serially and does not scale well with more samples.

Describe the solution you'd like

  • Samples processed in parallel
  • Resource-intensive steps submitted as a job on Gadi, via ARE
  • Contact NCI helpdesk for suggestions

Describe alternatives you've considered

@mgeaghan experimented with snow and multicoreparam backends but kept erroring when setting up; not a simple implementation.

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions