Docker Container for Reproducing

[Kartik14]

Thank you for this outstanding project! I am currently facing some difficulties running the multi-node code and suspect it may be due to an incorrect environment setup. If possible, could you kindly provide a link to the Docker container (maybe on dockerhub?) used for training? I would greatly appreciate your assistance!

[HYZ17]

Hi, thank you for your interest in our work! Our environment is largely the same as the official OpenRLHF version and requires only a few additional packages. You can refer to the official documentation for details on the image.