Skip to content

Commit 2b0f6d7

Browse files
authored
Add Metropolis NIM Workflows as submodule (#237)
* add vision worfklow assets * add metropolis workflows submodule to track main * update top level readme * fix formatting
1 parent a3f956a commit 2b0f6d7

File tree

8 files changed

+70
-0
lines changed

8 files changed

+70
-0
lines changed

.gitmodules

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
[submodule "vision_workflows/metropolis-nim-workflows"]
2+
path = vision_workflows/metropolis-nim-workflows
3+
url = https://github.com/NVIDIA/metropolis-nim-workflows
4+
branch = main

README.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,7 @@ This repository is a starting point for developers looking to integrate with the
1616
* [Knowledge Graph RAG](#knowledge-graph-rag)
1717
* [Agentic Workflows with Llama 3.1](#agentic-workflows-with-llama-31)
1818
* [RAG with Local NIM Deployment and LangChain](#rag-with-local-nim-deployment-and-langchain)
19+
* [Vision NIM Workflows](#vision-nim-workflows)
1920
* [Try it Now!](#try-it-now)
2021
* [RAG](#rag)
2122
* [RAG Notebooks](#rag-notebooks)
@@ -50,6 +51,23 @@ This example implements a GPU-accelerated pipeline for creating and querying kno
5051

5152
For more information, refer to the [Generative AI Example releases](https://github.com/NVIDIA/GenerativeAIExamples/releases/).
5253

54+
### Vision NIM Workflows
55+
A collection of Jupyter notebooks, sample code and reference applications built with Vision NIMs.
56+
57+
To pull the vision NIM workflows, clone this repository recursively:
58+
```
59+
git clone https://github.com/nvidia/GenerativeAIExamples --recurse-submodules
60+
```
61+
62+
The workflows will then be located at [GenerativeAIExamples/vision_workflows](vision_workflows/README.md)
63+
64+
Follow the links below to learn more:
65+
- [Learn how to use VLMs to automatically monitor a video stream for custom events.](nim_workflows/vlm_alerts/README.md)
66+
- [Learn how to search images with natural language using NV-CLIP.](nim_workflows/nvclip_multimodal_search/README.md)
67+
- [Learn how to combine VLMs, LLMs and CV models to build a robust text extraction pipeline.](nim_workflows/vision_text_extraction/README.md)
68+
- [Learn how to use embeddings with NVDINOv2 and a Milvus VectorDB to build a few shot classification model.](nim_workflows/nvdinov2_few_shot/README.md)
69+
70+
5371
## Try it Now!
5472

5573
Experience NVIDIA RAG Pipelines with just a few steps!

vision_workflows/README.md

Lines changed: 47 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,47 @@
1+
# Vision Workflows with NVIDIA NIM
2+
3+
This submodule includes NIM based workflows for vision applications. To get access to this submodule, do one of the following:
4+
5+
1) Clone nvidia/GenerativeAIExamples recursively
6+
```
7+
git clone https://github.com/nvidia/GenerativeAIExamples --recurse-submodules
8+
```
9+
10+
2) If you have already cloned the repository without the ```--recurse-submodules``` flag then you can manually pull the submodule
11+
```
12+
git submodule update --init
13+
```
14+
15+
3) You can also clone the vision workflow repository directly
16+
```
17+
git clone https://github.com/NVIDIA/metropolis-nim-workflows.git
18+
```
19+
20+
Once the submodule is pulled or you have cloned the repository directly you can explore the available vision NIM workflows.
21+
22+
## Available Workflows
23+
24+
### [VLM Alert System](https://github.com/NVIDIA/metropolis-nim-workflows/blob/main/nim_workflows/vlm_alerts/README.md)
25+
<p float="left">
26+
<img src="readme_assets/vlm_alert.gif" alt="" width="800"/>
27+
</p>
28+
29+
### [Structured Text Extraction](https://github.com/NVIDIA/metropolis-nim-workflows/tree/main/nim_workflows/vision_text_extraction)
30+
<p float="left">
31+
<img src="readme_assets/text_extraction.gif" alt="" width="800"/>
32+
</p>
33+
34+
### [NVCLIP Multimodal Search](https://github.com/NVIDIA/metropolis-nim-workflows/tree/main/nim_workflows/nvclip_multimodal_search)
35+
<p float="left">
36+
<img src="readme_assets/nvclip_multimodal.gif" alt="" width="800"/>
37+
</p>
38+
39+
### [NV-DINOv2 Few Shot Classification](https://github.com/NVIDIA/metropolis-nim-workflows/tree/main/nim_workflows/nvdinov2_few_shot)
40+
<p float="left">
41+
<img src="readme_assets/few_shot.gif" alt="" width="800"/>
42+
</p>
43+
44+
45+
To learn more, view [this page](https://github.com/NVIDIA/metropolis-nim-workflows)
46+
47+
4.45 MB
Loading
1.43 MB
Loading
418 KB
Loading
4.4 MB
Loading

0 commit comments

Comments
 (0)