Set "PYTORCH_MPS_HIGH_WATERMARK_RATIO" on Mac App

[BenRoe]

Hello,
i get the following error on a MAC M1 with 16G RAM.

MPS backend out of memory (MPS allocated: 18.10 GB, other allocations: 384.00 KB, max allowed: 18.13 GB). Tried to allocate 54.00 MB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure).

I use the Beta app from the website.
Where shall i add the PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to fix that error?

[mauroao]

same error here on Mac M1 16GB RAM

[mauroao]

Ok, I figured out how to change this:

1. Open Finder, go to Applications;
2. Left click on ComfyUI, choose "show package contents"
3. Navigate to folder: Contents -> Resources -> ComfyUI
4. Look for file "main.py"
5. Left click, open with (choose some text editor, like VSCode, or TextEdit...)
6. Look for some line like "os.environ..."
7. put this new like, save it, close and reopen the app:

os.environ['PYTORCH_MPS_HIGH_WATERMARK_RATIO'] = '0.0'

[shivanraptor]

There are several sections having os.environ...