You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
First, really admire the work on OpenELM! Thank you for making your models and code available.
Question regarding the pre-training checkpoints linked here: how can we convert these checkpoints into the format expected by AutoModelForCausalLM.from_pretrained?
I presume there's a script that was used for conversion of the final model weights into HF format, but I couldn't find it in the repo.
Would very much appreciate any help on this!
Best,
Jason
The text was updated successfully, but these errors were encountered:
jasonkrone
changed the title
How to Load Pre-training Checkpoints using Hugging Face AutoModelForCausalLM ?
How to Load OpenELM Pre-training Checkpoints using Hugging Face AutoModelForCausalLM ?
Aug 8, 2024
As a follow question - Are there any plans to push the model checkpoints to Huggingface hub for ease of access (like the Pythia suite of models)?
It would really help the NLP community!
Thanks in Advance!
Hi there,
First, really admire the work on OpenELM! Thank you for making your models and code available.
Question regarding the pre-training checkpoints linked here: how can we convert these checkpoints into the format expected by
AutoModelForCausalLM.from_pretrained
?I presume there's a script that was used for conversion of the final model weights into HF format, but I couldn't find it in the repo.
Would very much appreciate any help on this!
Best,
Jason
The text was updated successfully, but these errors were encountered: