Skip to content

Commit f66c75a

Browse files
author
Your Name
committed
avoid OOM on eval set
1 parent 248b8e9 commit f66c75a

File tree

1 file changed

+6
-3
lines changed

1 file changed

+6
-3
lines changed
Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
target_time: 10hr
2-
batch_rate: 1
2+
batch_rate: 2.00
33

44
warmup_batches: 500
55
# Turn down learning rate
@@ -8,10 +8,13 @@ warmup_batches: 500
88
lr: 1.00*1e-4
99
cosine_factor: 1.2
1010

11-
batch_size: 144
11+
batch_size: 140
1212
micro_batches: 1
1313
precision: amp
1414

15-
checkpoints: 12
15+
# For some reason, time is 21hrs
16+
# instead of 10 although the math
17+
# w/ the batch_rate checks out
18+
checkpoints: 24
1619
diffusion_logs: 200
1720
evals: 120

0 commit comments

Comments
 (0)