Skip to content

M1/M2 performance fix: use Apple MPS (metal performance shaders) if available #26

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
sghael wants to merge 2 commits into
base: master
Choose a base branch
from
+6 −2
Open

M1/M2 performance fix: use Apple MPS (metal performance shaders) if available #26

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
d1cdede
use apple mps (metal performance shaders) to move work to M1 GPU when…
sghael Jul 17, 2023
8cc3254
Modify the code to work with PyTorch versions prior to 1.2
sghael Jul 18, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion bigram.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,9 @@
max_iters = 3000
eval_interval = 300
learning_rate = 1e-2
device = 'cuda' if torch.cuda.is_available() else 'cpu'
device = ('cuda' if torch.cuda.is_available()
else 'mps' if hasattr(torch.backends, 'mps') and torch.backends.mps.is_available()
else 'cpu')
eval_iters = 200
# ------------

Expand Down
4 changes: 3 additions & 1 deletion gpt.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,9 @@
max_iters = 5000
eval_interval = 500
learning_rate = 3e-4
device = 'cuda' if torch.cuda.is_available() else 'cpu'
device = ('cuda' if torch.cuda.is_available()
else 'mps' if hasattr(torch.backends, 'mps') and torch.backends.mps.is_available()
else 'cpu')
eval_iters = 200
n_embd = 384
n_head = 6
Expand Down