-
-
Notifications
You must be signed in to change notification settings - Fork 9k
Add VideoDB Skills to Individual Skills #301
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 1 commit
Commits
Show all changes
10 commits
Select commit
Hold shift + click to select a range
c26ba60
Add VideoDB Skills to Individual Skills
0xrohitgarg cff0308
videodb skills update: add reference files for videodb skills
0xrohitgarg 179a027
videodb skills update: add reference files for videodb skills
0xrohitgarg 9dfe149
Add videodb in readme's folder structure
0xrohitgarg b8ab34e
docs: harden videodb skill examples
affaan-m b0c2e77
docs: clarify videodb reference guides
affaan-m 2581beb
docs: resolve videodb follow-up review comments
affaan-m db2bf16
docs: resolve videodb review findings
affaan-m 70449a1
docs: tighten videodb listener guidance
affaan-m 192d2b6
docs: align videodb event directory handling
affaan-m File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,109 @@ | ||
| --- | ||
| name: videodb-skills | ||
| description: The only video skill your agent needs — upload any video, connect real-time streams, search inside by what was said or shown, build complex editing workflows with overlays, generate AI media, add subtitles, and get instant streaming links. | ||
| origin: ECC | ||
| --- | ||
|
|
||
| # VideoDB Skills | ||
|
|
||
| The only video skill your agent needs. Upload any video, connect real-time streams, search inside by what was said or shown, build complex editing workflows with overlays, generate AI media, add subtitles, and get instant streaming links — all via the VideoDB Python SDK. | ||
|
|
||
| ## When to Activate | ||
|
|
||
| - Uploading or ingesting videos from YouTube URLs, web URLs, or local files | ||
| - Searching spoken words or visual scenes across video content | ||
| - Generating transcripts or auto-styling subtitles | ||
| - Editing clips — trim, combine, multi-timeline composition | ||
| - Adding overlays — text, images, audio, music | ||
| - Generating AI media — images, video, music, sound effects, voiceovers | ||
| - Transcoding — resolution, codec, bitrate, FPS changes | ||
| - Reframing video for social platforms (vertical, square, etc.) | ||
| - Real-time screen or audio capture with AI transcription | ||
| - Getting playable HLS streaming links for any output | ||
|
|
||
| ## Setup | ||
|
|
||
| ```bash | ||
| # Install the skill | ||
| npx skills add video-db/skills | ||
|
|
||
| # Or setup manually | ||
| pip install "videodb[capture]" python-dotenv | ||
| export VIDEO_DB_API_KEY=sk-xxx | ||
| ``` | ||
|
|
||
| Run `/videodb setup` inside your agent for guided setup ($20 free credits, no credit card). | ||
|
|
||
| ## Core Patterns | ||
|
|
||
| ### Upload and Process | ||
|
|
||
| ```python | ||
| import videodb | ||
|
|
||
| conn = videodb.connect() | ||
| video = conn.upload(url="https://www.youtube.com/watch?v=VIDEO_ID") | ||
|
|
||
| transcript = video.get_transcript() | ||
| for entry in transcript: | ||
| print(f"[{entry['start']:.1f}s] {entry['text']}") | ||
| ``` | ||
|
|
||
| ### Search Across Videos | ||
|
|
||
| ```python | ||
| # Index for semantic search | ||
| video.index_spoken_words() | ||
|
|
||
| # Search by what was said | ||
| results = video.search("product demo") | ||
| for r in results: | ||
| print(f"{r.start:.1f}s - {r.end:.1f}s: {r.text}") | ||
| ``` | ||
|
|
||
| ### Timeline Editing | ||
|
|
||
| ```python | ||
| from videodb import Timeline, VideoAsset, AudioAsset | ||
|
|
||
| timeline = Timeline(conn) | ||
| asset = VideoAsset(asset_id=video.id, start=10, end=30) | ||
| timeline.add_inline(asset) | ||
|
|
||
| stream = timeline.generate_stream() | ||
| print(stream) # Playable HLS link | ||
| ``` | ||
|
|
||
| ### AI Media Generation | ||
|
|
||
| ```python | ||
| audio = conn.generate_audio(text="Upbeat background music", duration=30) | ||
| image = conn.generate_image(prompt="Title card: Welcome to the Demo") | ||
| ``` | ||
|
|
||
| ## Capabilities | ||
|
|
||
| | Capability | What It Does | | ||
| |---|---| | ||
| | Upload | YouTube, URLs, local files | | ||
| | Search | Speech-based and scene-based | | ||
| | Transcripts | Timestamped, multi-language | | ||
| | Edit | Trim, combine, multi-timeline | | ||
| | Subtitles | Auto-generate, custom styling | | ||
| | AI Generate | Images, video, music, SFX, voiceover | | ||
| | Capture | Screen + audio, real-time | | ||
| | Transcode | Resolution, codec, aspect ratio | | ||
| | Stream | HLS playable links | | ||
|
|
||
| ## Best Practices | ||
|
|
||
| - Always verify SDK connection before operations: `conn.get_collection()` | ||
| - Use `video.index_spoken_words()` before searching — indexing is required once per video | ||
| - For scene search, use `video.index_scenes()` — this processes visual frames | ||
| - Timeline edits produce new streams; the original video is never modified | ||
| - AI generation is async — poll status or use callbacks for long operations | ||
| - Store `VIDEO_DB_API_KEY` in `.env`, not hardcoded | ||
|
|
||
| ## Repository | ||
|
|
||
| https://github.com/video-db/skills | ||
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Add required "How It Works" section and align section naming with guidelines.
The coding guidelines require skills to have clear sections for "When to Use", "How It Works", and "Examples". The current file is missing the "How It Works" section and uses slightly different section names.
Current structure:
The "How It Works" section should explain the mechanics of how VideoDB integrates with the agent, the SDK architecture, and the workflow of video processing operations.
📋 Suggested structure improvement
Consider adding a "How It Works" section after "When to Use" that explains:
You can also rename "When to Activate" to "When to Use" and "Core Patterns" to "Examples" to match the guidelines exactly, though "Core Patterns" is also descriptive.
As per coding guidelines: Skills should be formatted as Markdown with clear sections for When to Use, How It Works, and Examples.
🤖 Prompt for AI Agents