Skip to content

Commit 0becc72

Browse files
author
Sara Adkins
authored
update README memory requirements (#2342)
1 parent c4ec631 commit 0becc72

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/llama7b_sparse_quantized/README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22

33
This example uses SparseML and Compressed-Tensors to create a 2:4 sparse and quantized Llama2-7b model.
44
The model is calibrated and trained with the ultachat200k dataset.
5-
At least 75GB of GPU memory is required to run this example.
5+
At least 85GB of GPU memory is required to run this example.
66

77
Follow the steps below one by one in a code notebook, or run the full example script
88
as `python examples/llama7b_sparse_quantized/llama7b_sparse_w4a16.py`

0 commit comments

Comments
 (0)