Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Add mistral-common library#1641

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Open
juliendenize wants to merge2 commits intohuggingface:main
base:main
Choose a base branch
Loading
fromjuliendenize:add_vllm_library

Conversation

juliendenize
Copy link

@juliendenizejuliendenize commentedJul 18, 2025
edited
Loading

Hi !

We'd like to addvLLM as a library and track the downloads via two possible formats:

  • Transformers with theconfig.json
  • Mistral with theparams.json

The code snippet suggested is through serving.

Edit:
Based on@Wauplin comment we changed the integration to instead add themistral-common library

@Wauplin
Copy link
Contributor

Hi@juliendenize , thanks for the PR. In the ecosystem we consider vLLM as a Local App rather than a library. If you go onhttps://huggingface.co/mistralai/Mistral-Small-24B-Base-2501?local-app=vllm for instance, you'll see how to serve the model using vLLM. If you are interested in counting the downloads of model repos based onmistral-common, I would suggest to registermistral-common instead. PR would look like this:

#(toaddinalphabeticalorder)"mistral-common":{prettyLabel:"mistral-common",repoName:"mistral-common",repoUrl:"https://github.com/mistralai/mistral-common",docsUrl:"https://mistralai.github.io/mistral-common/",countDownloads:`path:"config.json" OR path:"params.json"`,},

(I haven't added a code snippet as I'm unsure how to use mistral common)

You'll also have to addlibrary_name: mistral-common in the model card metadata of your models.

@Wauplin
Copy link
Contributor

Regarding the PR itself, we won't merge it in its current form. vLLM is a widely used app that is not specific to mistral-common (seehttps://huggingface.co/models?other=vllm) so we don't want the snippet to include mistral-specific instructions for all of them.

@Wauplin
Copy link
Contributor

Btw, vllm snippets are definedhere. It is possible to update the install command to includepip install -U mistral-common for models withmistral-common tag (e.g.if model.tags.includes("mistral-common") ...)

@juliendenizejuliendenize changed the titleAdd vLLM libraryAdd mistral-common libraryJul 18, 2025
@juliendenize
Copy link
Author

Hi@Wauplin thanks a lot for your detailed feedback and given me the context and the pointers ! much appreciated.

so we don't want the snippet to include mistral-specific instructions for all of them.

This was indeed also a concern for me when I pushed the original PR, and also why I put Mistral related instruction in comments. So, very cool that your proposed solution avoids that.

I updated the PR accordingly.

I just have a question regarding how tags works, is the library_name considered as a tag ? meaning would that be True:

model.tags.includes("mistral-common")// = True ?

Or should I update the PR to check the library_name ?

Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment
Reviewers

@SBrandeisSBrandeisAwaiting requested review from SBrandeisSBrandeis is a code owner

@gary149gary149Awaiting requested review from gary149gary149 is a code owner

@WauplinWauplinAwaiting requested review from WauplinWauplin is a code owner

@julien-cjulien-cAwaiting requested review from julien-cjulien-c is a code owner

@pcuencapcuencaAwaiting requested review from pcuencapcuenca is a code owner

@ngxsonngxsonAwaiting requested review from ngxsonngxson is a code owner

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

2 participants
@juliendenize@Wauplin

[8]ページ先頭

©2009-2025 Movatter.jp