- Notifications
You must be signed in to change notification settings - Fork468
Add mistral-common library#1641
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
base:main
Are you sure you want to change the base?
Conversation
Hi@juliendenize , thanks for the PR. In the ecosystem we consider vLLM as a Local App rather than a library. If you go onhttps://huggingface.co/mistralai/Mistral-Small-24B-Base-2501?local-app=vllm for instance, you'll see how to serve the model using vLLM. If you are interested in counting the downloads of model repos based on #(toaddinalphabeticalorder)"mistral-common":{prettyLabel:"mistral-common",repoName:"mistral-common",repoUrl:"https://github.com/mistralai/mistral-common",docsUrl:"https://mistralai.github.io/mistral-common/",countDownloads:`path:"config.json" OR path:"params.json"`,}, (I haven't added a code snippet as I'm unsure how to use mistral common) You'll also have to add |
Regarding the PR itself, we won't merge it in its current form. vLLM is a widely used app that is not specific to mistral-common (seehttps://huggingface.co/models?other=vllm) so we don't want the snippet to include mistral-specific instructions for all of them. |
Btw, vllm snippets are definedhere. It is possible to update the install command to include |
Hi@Wauplin thanks a lot for your detailed feedback and given me the context and the pointers ! much appreciated.
This was indeed also a concern for me when I pushed the original PR, and also why I put Mistral related instruction in comments. So, very cool that your proposed solution avoids that. I updated the PR accordingly. I just have a question regarding how tags works, is the library_name considered as a tag ? meaning would that be True: model.tags.includes("mistral-common")// = True ? Or should I update the PR to check the library_name ? |
Uh oh!
There was an error while loading.Please reload this page.
Hi !
We'd like to addvLLM as a library and track the downloads via two possible formats:
config.json
params.json
The code snippet suggested is through serving.
Edit:
Based on@Wauplin comment we changed the integration to instead add the
mistral-common
library