Skip to content
This repository was archived by the owner on Sep 24, 2025. It is now read-only.

Commit 51a7023

Browse files
committed
update comments
1 parent 8d77d8f commit 51a7023

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

rollout.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -70,8 +70,9 @@
7070
# TODO: start generating rollouts for the experience buffer
7171

7272
# Send the experience buffer to the train agent.
73+
# We do not block here. We can continue generating rollouts while the experience buffer is being sent.
7374
experience_buffer = torch.tensor([20+i])
74-
experience_buffer_work = torch.distributed.broadcast(group=experience_buffer_group, src=1,tensor=experience_buffer, async_op=True) # don't block, send it off and continue generating rollouts
75+
experience_buffer_work = torch.distributed.broadcast(group=experience_buffer_group, src=1,tensor=experience_buffer, async_op=True)
7576
log.info(f"Sent experience buffer {experience_buffer}")
7677

7778
log.info(f"Completed iteration {i + 1}/{MAX_ITERATIONS}")

0 commit comments

Comments
 (0)