Multi-GPU in Inference

[Francesca-Ro5]

Hi, I've 4 x RTX 6000 Ada with 48 GB VRAM. It's the code configured for multi-GPU's inference??
Now the inference use only one of those available, and with a file audio of 15 seconds, the VRAM is all allocathed, so i have the OutOfMemory problem.

You can give us the memory requirements?

[tendrillion]

+1

[yuchenli-sony]

+100086