Add distillation support to AMP_PPO and AMPOnPolicyRunner#10

Draft

GiulioRomualdi wants to merge 3 commits intomainfrom

Commits on Apr 22, 2025

Add distillation support to AMP_PPO and AMPOnPolicyRunner
GiulioRomualdi
committed
Refactor distillation handling in AMP_PPO to compute the distillation loss along with the AMP-PPO loss
GiulioRomualdi
committed
Refactor teacher parameter type in AMP_PPO and guard forward passes with torch.no_grad()
GiulioRomualdi
committed