Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 44 additions & 0 deletions Online/community/ros2_robot_arm/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
# ros2_robot_arm

[【开源实习】智能机械臂基于香橙派和 MindSpore 的深度学习 AI 推理功能和机械臂二次开发](https://atomgit.com/mindspore/community/issues/1770)

## 项目简介

本项目基于 OrangePi AI Pro、ROS2 与 YOLO 模型,实现积木识别、分拣和堆叠。

- 视觉推理:YOLO 检测积木位置
- 机械控制:机械臂抓取、分类、堆叠
- 可选模型路线:官方模型直接部署 / MindYOLO 自训练后转换 OM

## 环境要求

| 项目 | 说明 |
|---|---|
| 系统 | Ubuntu(开发板) |
| ROS | ROS2 Humble |
| Python | 3.9+ |
| 硬件 | OrangePi AI Pro、机械臂、USB 摄像头 |

## 总体预览

1. 硬件组装与连线。
2. 下载工程并安装依赖(ROS2、ais_bench、项目依赖)。
3. 模型准备(二选一):
- 方案 A:使用官方模型,放入两个 model 目录。
- 方案 B:在云侧进行 MindYOLO 训练,导出 ONNX 并转换 OM,再部署到开发板。
4. 编译 ROS2 工作空间并加载环境。
5. 首次执行相机校准。
6. 运行单积木抓取,稳定后运行堆叠。

> 详细步骤、截图和完整命令请查看教程 notebook:
>
> [ros2_robot_arm_tutorial.ipynb](./ros2_robot_arm_tutorial.ipynb)

## 相关链接

- Issue: https://atomgit.com/mindspore/community/issues/1770
- MindYOLO 自训练参考: https://gitcode.com/shenyidong2025/mindyolo-cube.git

## 致谢

感谢 MindSpore 社区和昇腾 AI 开发者社区提供的支持。
Binary file added Online/community/ros2_robot_arm/imgs/1.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/1.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/10.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/10.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/11.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/12.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/13.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/14.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/15.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/16.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/17.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/18.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/19.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/2.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/20.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/21.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/22.PNG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/23.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/24.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/3.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/4.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/5.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/6.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/7.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added Online/community/ros2_robot_arm/imgs/8.jpg
Binary file added Online/community/ros2_robot_arm/imgs/9.PNG
Binary file added Online/community/ros2_robot_arm/imgs/image1.png
Binary file added Online/community/ros2_robot_arm/imgs/image10.png
Binary file added Online/community/ros2_robot_arm/imgs/image11.png
Binary file added Online/community/ros2_robot_arm/imgs/image12.png
Binary file added Online/community/ros2_robot_arm/imgs/image13.png
Binary file added Online/community/ros2_robot_arm/imgs/image14.png
Binary file added Online/community/ros2_robot_arm/imgs/image15.png
Binary file added Online/community/ros2_robot_arm/imgs/image16.png
Binary file added Online/community/ros2_robot_arm/imgs/image17.png
Binary file added Online/community/ros2_robot_arm/imgs/image18.png
Binary file added Online/community/ros2_robot_arm/imgs/image19.png
Binary file added Online/community/ros2_robot_arm/imgs/image2.png
Binary file added Online/community/ros2_robot_arm/imgs/image20.png
Binary file added Online/community/ros2_robot_arm/imgs/image21.png
Binary file added Online/community/ros2_robot_arm/imgs/image22.png
Binary file added Online/community/ros2_robot_arm/imgs/image3.png
Binary file added Online/community/ros2_robot_arm/imgs/image4.png
Binary file added Online/community/ros2_robot_arm/imgs/image5.png
Binary file added Online/community/ros2_robot_arm/imgs/image6.png
Binary file added Online/community/ros2_robot_arm/imgs/image7.png
Binary file added Online/community/ros2_robot_arm/imgs/image8.png
Binary file added Online/community/ros2_robot_arm/imgs/image9.png
Binary file added Online/community/ros2_robot_arm/imgs/连线.png
Binary file not shown.
Loading