Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rename Olmo1124 to Olmo2 #10500

Merged
merged 1 commit into from
Nov 25, 2024
Merged

Conversation

2015aroras
Copy link
Contributor

The upcoming OLMo November model has been renamed to OLMo2 in transformers (huggingface/transformers#34864). Accordingly, this PR updates the naming in llama.cpp.

@2015aroras
Copy link
Contributor Author

I locally ran the end-to-end process of converting weights to gguf, quantizing and running, just as in the original implementation PR. Everything seemed fine.

Copy link
Collaborator

@slaren slaren left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will break existing gguf models. Are they being distributed already?

@2015aroras
Copy link
Contributor Author

No, I have not uploaded gguf models yet (and we haven't released model weights publicly yet, so nobody else should have either).

@soupysoap
Copy link

This breaks OLMo-1024-preview on huggingface. I have a gguf posted, but I will delete it once this merges 👍

@github-actions github-actions bot added the python python script changes label Nov 25, 2024
@slaren slaren merged commit 80acb7b into ggerganov:master Nov 25, 2024
55 checks passed
@2015aroras 2015aroras deleted the rename-olmo-nov branch November 25, 2024 18:50
@mseri mseri mentioned this pull request Nov 27, 2024
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
python python script changes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants