Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Release Candidate v0.0.2: Qwen2.5 72B support #100

Merged
merged 7 commits into from
Feb 7, 2025
Merged

Release Candidate v0.0.2: Qwen2.5 72B support #100

merged 7 commits into from
Feb 7, 2025

Conversation

tstescoTT
Copy link
Contributor

change log

ppetrovicTT and others added 6 commits February 6, 2025 00:29
@ppetrovicTT @tstescoTT
#75: Check if a token can access a model on HuggingFace
f3ad130 
- Check token format
- Validate token with HuggingFace
- Validate access to a specific model by downloading one file header
@ppetrovicTT @tstescoTT
Workaround for outdated apt-get keyring (#90)
c1acc99
@ppetrovicTT @tstescoTT
Provide a model from your local storage (#91)
4cfb631
@tstescoTT
add CONTAINER_APP_UID Docker ARG for cloud image and dev image with d…
5682496 
…eveloment instructions (#94)

* remove git lfs from tt-metal build

* add CONTAINER_APP_UID Docker ARG for cloud image and dev image with develoment instructions
@tstescoTT
tstesco/qwen25-support (#98)
cbd5468 
* avoid jq dependency when checking HF_TOKEN has repo access

* adding Qwen2.5-72B-Instruct setup

* update example scripts for minimal text request with user input without dependencies

* adding qwen setup support

* increase output tokens for example usage

* add TODO note on tt-metal cache in new impl

* add prompt to example output

* fix prompt generation text without images

* adding default env vars for Qwen2.5 72B

* Tstesco/doc update qwen25 (#99)

* update docs

* add container id

* fix import for non qwen models

* update gchr ref

* update main model impl README.md
@tstescoTT
remove tt-metal-llama3-70b, archive tt-metal-mistral-7b (#97)
5fe54b6
rpavlovicTT
rpavlovicTT approved these changes Feb 6, 2025
View reviewed changes
@tstescoTT
Copy link
Contributor Author

Tested setup and run of Qwen2.5-72B-Instruct on LoudBox.

@tstescoTT tstescoTT merged commit a97b620 into main Feb 7, 2025
1 check passed
@tstescoTT tstescoTT deleted the rc-v0.0.2 branch March 13, 2025 21:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@rpavlovicTT rpavlovicTT rpavlovicTT approved these changes

@ppetrovicTT ppetrovicTT Awaiting requested review from ppetrovicTT

@milank94 milank94 Awaiting requested review from milank94

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@tstescoTT @rpavlovicTT @ppetrovicTT