Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding new entries #89

Open
ozppupbg opened this issue May 13, 2024 · 3 comments
Open

Adding new entries #89

ozppupbg opened this issue May 13, 2024 · 3 comments

Comments

@ozppupbg
Copy link
Contributor

Hello,

I'm queueing up some updates for new entries and have some questions:

@eugeneyan
Copy link
Owner

first, thank you for offering to contribute!

one PR per entry might be simpler to review and approve.

for those that require registration/notification, lets leave out for now? unless they're llama3 quality it may make the list hard to navigate

@ozppupbg
Copy link
Contributor Author

Ok.

For the licenses I was thinking about adding some columns with symbols or simple checkmarks for various use-cases.
Because, e.g. for synthetic dataset creation it is already very difficult to find a model.
"Requires registration" could be just another part of this information.

The registration models seem to be primarily from China, but I have not checked their benchmarks in detail.

@ozppupbg
Copy link
Contributor Author

I came across a number of additional questions:

  • WizardLM 2 was released in April, but the official weights were removed. However, there are unofficial Huggingface repos with copies of the files. Should I add these?
  • There is stuff like Starling-LM-7B-beta, which is under an open license, but trained of OpenAI outputs, so is "not allowed to compete with OpenAI" - whatever that means...
    What is your take on adding such models?
  • For MoE models it is common to add the number of active parameters in addition to the total parameters.
    Should these be added?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants