Release feluda-0.9.2

What's Changed

• merge main to dev by @aatmanvaidya in #486
• tests and minor changes by @aatmanvaidya in #488
• ci: run tests on PR by @aatmanvaidya in #489
• chore: pre-commit hook to sort imports by @aatmanvaidya in #491
• Added Example Notebook for TSNE plots by @plon-Susk7 in #493
• Integration tests by @aatmanvaidya in #495
• chore: fix formatting of example notebook by @aatmanvaidya in #496
• chore: update elasticsearch version by @aatmanvaidya in #498
• docs: update readme by @aatmanvaidya in #500
• merge dev to main by @aatmanvaidya in #499

Full Changelog: feluda-0.9.1...feluda-0.9.2

Release feluda-0.9.1

What's Changed

• chore: testing ci/cd by @dennyabrain in #476
• moving operators by @aatmanvaidya in #479
• merge dev to main by @aatmanvaidya in #480
• merge main to dev by @aatmanvaidya in #481
• Fix semantic script by @aatmanvaidya in #483
• merge dev to main by @aatmanvaidya in #485

Full Changelog: feluda-0.9.0...feluda-0.9.1

Release feluda-0.9.0

Overview

Feluda is now available as a python package. Work is underway to publish feluda operators as packages now.

With this release, feluda has gotten easier to use for developers and researchers who know python but aren't necessarily well versed with Machine Learning. How easy, you ask?

1. Install Dependencies

pip install feluda 
pip install feluda-image-vec-rep-resnet

2. Use in your code

from feluda import Feluda
from feluda.models.media_factory import ImageFactory

feluda = Feluda(r"config.yaml")
feluda.setup() 

image_obj = ImageFactory.make_from_url("https://tattle-media.s3.amazonaws.com/test-data/tattle-search/text-in-image-test-hindi.png")
operator = feluda.operators.get()["image_vec_rep_resnet"]
image_vec = operator.run(image_obj)
print(len(image_vec))

This modularization makes it possible to integrate feluda into your existing workflows and use feluda to analyze multimodal data. With this modularization, we are also encouraging community to work on their own feluda operators.

Majority of this work was led by @aatmanvaidya and @plon-Susk7.

What's Changed

• Wrote Tests for Queue [RabbitMQ] #320 by @plon-Susk7 in #400
• Added support to extract language from video by @plon-Susk7 in #408
• Added support to the operator detect_text_in_image_tesseract for Tamil and Telugu by @plon-Susk7 in #411
• Recipe for searching similar videos by @plon-Susk7 in #412
• Recipe for searching similar audios by @plon-Susk7 in #417
• Recipe for embedding reduction [Videos] by @plon-Susk7 in #418
• Recipe for creating clusters [Videos] by @plon-Susk7 in #419
• Recipe for classifying videos into predefined category by @plon-Susk7 in #420
• Recipe for processing newspaper and searching text through them. by @plon-Susk7 in #424
• chore: moving image vec operator out of src by @aatmanvaidya in #433
• Initial uv setup for Feluda and image_vec_rep_resnet operator by @plon-Susk7 in #434
• feat: refactor feluda API by @aatmanvaidya in #438
• Added update script to update toml files by @plon-Susk7 in #439
• feat: setup uv and refactor feluda structure by @aatmanvaidya in #442
• Test cases for text_vec_rep_paraphrase_lxml operator #421 by @adoo100 in #446
• Added new workflow for version bump by @plon-Susk7 in #458
• some improvements by @aatmanvaidya in #459
• merge dev to main by @aatmanvaidya in #460

New Contributors

• @plon-Susk7 made their first contribution in #400
• @adoo100 made their first contribution in #446

Full Changelog: v0.8.0...feluda-0.9.0

v0.8.0

v0.8.0 (2024-09-12)

Chore

• chore: updating vid vec rep resenet packages (9f212c2)

• chore: updating audio vec embedding pacakges (a41f996)

• chore: updating audio vec embedding pacakges (6e50e06)

• chore: fix conflict in updating requirements packages (acf1a56)

• chore: updating requirements packages (5390073)

• chore: fix ruff lint warnings (5f73898)

• chore: add error handling to clustering and reduction operations (ba01287)

• chore: hardcode perplexity value for t-SNE (60315b5)

• chore: change operator name to be more verbose

Signed-off-by: Snehil Shah <[email protected]> (45bef72)

• chore: remove obsolete print statement

Signed-off-by: Snehil Shah <[email protected]> (92d02e2)

• chore: remove the file after the operation has ended

Signed-off-by: Snehil Shah <[email protected]> (4a384f5)

• chore: removing docs gatsby website (03f5ac0)

Ci

• ci: fix trivy github action (a5d4df8)

• ci: update dependabot yml file (8a6b007)

Feature

• feat: add config

Signed-off-by: Snehil Shah <[email protected]> (73731ec)

• feat: add dimensionality reduction operator (2caf4a4)

• feat: improve exception handling and logic

Co-authored-by: Chaithanya512 <[email protected]>
Signed-off-by: Snehil Shah <[email protected]> (5756a59)

• feat: add cluster_embeddings operator

Signed-off-by: Snehil Shah <[email protected]> (4e08e35)

• feat: add audio embedding operator using CLAP model (233cfd4)

• feat: add classify_video operator

Signed-off-by: Snehil Shah <[email protected]> (2001dab)

• feat: add vid_vec_rep_clip operator

Signed-off-by: Snehil Shah <[email protected]> (8874ce5)

Fix

• fix: es_vec test (08b3085)

• fix: enable worker support for dimension reductionn (89df059)

• fix: update logic as per clustering spec

Signed-off-by: Snehil Shah <[email protected]> (0bea260)

• fix: correct indentation logic (d208d17)

• fix: correct naming and add dimension reduction requirements (0334a4b)

Refactor

• refactor: migrate CLAP operator to Hugging Face Transformers (9e5195a)

• refactor: align dimension reduction with feluda interface (0acfdb7)

• refactor: change modality to video

Signed-off-by: Snehil Shah <[email protected]> (a1506ba)

Style

• style: prepend newline for clearer output in logs

Signed-off-by: Snehil Shah <[email protected]> (bacafdd)

Test

• test: add payload writer for the worker

Signed-off-by: Snehil Shah <[email protected]> (57803e0)

Unknown

• Merge pull request #381 from tattle-made/development

merge dev to main (48bfc87)

• Merge pull request #380 from aatmanvaidya/update-fel

Update Packages and Fix minor Issues (cf64f4d)

• Merge pull request #379 from Snehil-Shah/worker

worker for clustering media (4abae4d)

• nit: add logs

Signed-off-by: Snehil Shah <[email protected]> (1ba6de1)

• draft: implement initial clustering worker (7129ac3)

• init: add Dockerfile for worker

Signed-off-by: Snehil Shah <[email protected]> (777994b)

• Merge pull request #375 from Snehil-Shah/clustering

[81] - add operator to cluster embeddings (1da1c27)

• Merge pull request #376 from Chaithanya512/dim-reduction-operator

feat: add dimensionality reduction operator (cb76d85)

• Merge pull request #372 from Chaithanya512/audio_vec_emb_clap

feat: audio embedding operator using CLAP model (faa9727)

• Merge pull request #370 from Snehil-Shah/classify-video

[81] - add operator to classify videos using a zero-shot approach (91f604b)

• Merge pull request #369 from Snehil-Shah/vid_vec_rep_clip

[81] - add operator to encode videos into vector embeddings using CLIP-ViT-B-32 (c5f09de)

• Merge pull request #367 from aatmanvaidya/remove-docs

chore: removing docs gatsby website (2b9275a)

v0.7.2

v0.7.2 (2024-05-28)

Fix

• fix: Updated pr-security workflow
  fix: Removed ignored vulnerabilities that were fixed (fe9c26a)

Unknown

• Merge pull request #344 from tattle-made/hotfix

Hotfix (10a277c)

• Merge pull request #343 from duggalsu/update_pr_security_workflow

Update pr security workflow (b26a03c)

v0.7.1

v0.7.1 (2024-05-28)

Fix

• fix: Updated github action versions to latest (44b46ad)

Unknown

• Merge pull request #342 from tattle-made/hotfix

Hotfix (eecc55f)

• Merge pull request #341 from duggalsu/update_scorecard_workflow

Update scorecard workflow (b2e2aa8)

v0.7.0

v0.7.0 (2024-05-28)

Chore

• chore: update Dockerfile (8ca692e)

• chore: removing file size limit from vid_vec_rep_resnet (22b9f2a)

Ci

• ci: prod github action for media worker (d4bb47f)

Unknown

• Merge pull request #339 from tattle-made/development

Merge Dev to Main (a1c22d3)

• Merge pull request #340 from tattle-made/aatmanvaidya-patch-1

chore: update Dockerfile (eb018a8)

• Merge pull request #332 from aatmanvaidya/media-worker-for-es

fix: updating media worker to index videos only (e6a8510)

• Merge pull request #324 from Snehil-Shah/language-detection

feat: add operator to detect language in an audio file (acfa3a0)

• Merge remote-tracking branch 'upstream/main' into media-worker-for-es (157508b)

v0.6.6

v0.6.6 (2024-05-24)

Fix

• fix: Updated vulnerable requests package (4b97299)

Unknown

• Merge pull request #334 from tattle-made/hotfix

Hotfix (b9f921a)

• Merge pull request #333 from duggalsu/fix_dependabot_20240524

Fix dependabot 20240524 (e7704e1)

• Regenerated src/requirements.txt (e25bd43)

v0.6.5

v0.6.5 (2024-05-10)

Chore

• chore: removing store from hash worker config (9f71faa)

Fix

• fix: adding store check in hash worker (73157e1)

Unknown

• Merge pull request #309 from tattle-made/hotfix

Hotfix (f21e2e6)

• Merge pull request #308 from aatmanvaidya/hash-fix

fix: adding store check in hash worker (4af10d9)

• Merge pull request #307 from tattle-made/hotfix

Hotfix (8723337)

• Merge pull request #306 from aatmanvaidya/hash-config-hotfix

chore: removing store from hash worker config (75c4a78)

v0.6.4

v0.6.4 (2024-05-08)

Fix

• fix: Update packages to fix vulnerabilities (d222f9c)

Unknown

• Merge pull request #305 from tattle-made/hotfix

Hotfix (2d1bb77)

• Merge pull request #304 from duggalsu/fix_dependabot_20240507

Fix dependabot issues (97cc70d)