[Question] sim2real for imitation learning

[YongcanZhou]

https://isaac-sim.github.io/IsaacLab/main/source/overview/imitation-learning/teleop_imitation.html

How can I infer the .pth file trained by imitation learning on a real machine? Can I use ROS to simultaneously view the robot operation and the movement of the real machine in the isaaclab interface? Are there any recommended codes for this? Thank you very much

[RandomOakForest]

Thank you for posting this. Yes, you can infer .pth models from Isaac Lab on a real robot and visualize/synchronize its behavior in Isaac Lab using ROS. The recommended approach is to deploy “Sim-to-Real (S2R)” inference using Robomimic (for imitation learning) and integrate Isaac ROS Bridge for real-time robot visualization and control. I'll move this post to our Discussions section for follow up.