Skip to content

【开源实习】越南语语种的多模态数据资源在昇腾AI开发板上运行应用 #136

Open
uMemory wants to merge 2 commits into
candle-org:masterfrom
uMemory:feature/search_text_image_pair
Open

【开源实习】越南语语种的多模态数据资源在昇腾AI开发板上运行应用 #136
uMemory wants to merge 2 commits into
candle-org:masterfrom
uMemory:feature/search_text_image_pair

Conversation

@uMemory

@uMemory uMemory commented Apr 10, 2026

Copy link
Copy Markdown

Description: 开源实习任务#2079

This PR implements a Vietnamese image-text semantic search application as part of the OpenDataLab "WanJuan-Silk Road" community task. The goal is to demonstrate multimodal data processing and retrieval on the OrangePi AIpro20T.

Approach: Uses the MindNLP framework with the XLM-RoBERTa model to generate embeddings for Vietnamese text and images, enabling semantic cross-modal retrieval.

Related Issue: Fixes #2079 (Ref: mindspore/community#2079).

Changes:

1.New Module: Online/community/ImageTextPairSearching
2.Core Files: Added mindspore_image_text_pair_searching.ipynb for the interactive search pipeline and a comprehensive README.md for deployment guidance.

Testing & Benchmark:

Environment: Verified on OrangePi AIpro20T with CANN 8.1.RC1, MindSpore 2.5.0, Python 3.9 and MindNLP 0.4.1.
Functionality: Successfully retrieved relevant images using Vietnamese queries with similarity scores verified in the demo output.

Checklist

  • Read and followed the Contributing Guidelines.
  • Self-tested locally to ensure the code runs correctly and achieves expected results (all CI checks expected to pass).
  • Updated documentation if needed.
  • Verified accuracy or performance benchmarks if applicable.

Reviewers

@uMemory uMemory changed the title feature: add vietnamese image-text search case for community 【开源实习】越南语语种的多模态数据资源在昇腾AI开发板上运行应用 Apr 10, 2026
@cui0523

cui0523 commented Apr 21, 2026

Copy link
Copy Markdown
Contributor

代码文件中添加数据集和模型下载的代码实现

@cui0523

cui0523 commented Apr 21, 2026

Copy link
Copy Markdown
Contributor

辛苦代码合入master分支的orange-pi-mindspore/Online/community目录下,项目目录和代码文件命名格式参考代码仓中已有项目的格式;同时目录orange-pi-mindspore/Online/,orange-pi-mindspore/Online/community/下的readme文件对应位置补充该项目的相关版本信息

@cui0523

cui0523 commented Apr 21, 2026

Copy link
Copy Markdown
Contributor

为了代码规范,默认设置已经是PYNATIVE_MODE,所以删除代码中的ms.set_context(mode=ms.PYNATIVE_MODE)部分

@uMemory
uMemory changed the base branch from dev to master April 22, 2026 01:10
@uMemory
uMemory force-pushed the feature/search_text_image_pair branch 2 times, most recently from 50e26ae to 323110e Compare April 22, 2026 01:46
@uMemory
uMemory force-pushed the feature/search_text_image_pair branch from f75dd2b to 838db50 Compare April 22, 2026 02:20
@uMemory

uMemory commented Apr 22, 2026

Copy link
Copy Markdown
Author

已按照要求修改了代码并更新了相关的README.md,调整PR合并至master分支

@cui0523

cui0523 commented Apr 22, 2026

Copy link
Copy Markdown
Contributor

验收通过,可以合入

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants