hf-img-caption-0

Initial experiments on using models from Hugging Face to caption images

Grabs a model using HF Transformers and then runs it on the most recent pictures from Google photos account.

To get at your Google Photos, you'll need to create a Google Cloud Project, and Client Secret file. Follow the instructions in https://developers.google.com/photos/library/guides/get-started

but choose "Desktop app" as the Application Type.

Name		Name	Last commit message	Last commit date
Latest commit History 14 Commits
.gitignore		.gitignore
Captioning Google Photos Blip 1.ipynb		Captioning Google Photos Blip 1.ipynb
Captioning Google Photos Blip 2-cpu.ipynb		Captioning Google Photos Blip 2-cpu.ipynb
Hugging first test.ipynb		Hugging first test.ipynb
LICENSE		LICENSE
README.md		README.md
blip2cap-better.ipynb		blip2cap-better.ipynb
blip2cap-flexdevice-compiled.ipynb		blip2cap-flexdevice-compiled.ipynb
blip2cap-flexdevice.ipynb		blip2cap-flexdevice.ipynb
blip2flan.ipynb		blip2flan.ipynb
blip2opt-bfloat.ipynb		blip2opt-bfloat.ipynb
environment.yml		environment.yml
requirements.in		requirements.in
requirements.txt		requirements.txt
vip-llava-7b-prompt-novi.ipynb		vip-llava-7b-prompt-novi.ipynb
vip-llava-7b-viprompt-crash.ipynb		vip-llava-7b-viprompt-crash.ipynb
vip-llava-7b.ipynb		vip-llava-7b.ipynb
vitgpt2cap.ipynb		vitgpt2cap.ipynb

Provide feedback