Movatterモバイル変換

[0]ホーム
URL:

Skip to content

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

 Sign up
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Modify to support batch size N#15

Open
quinle wants to merge1 commit intoyxuansu:main
base:main
Choose a base branch
Loading
fromquinle:support_inference_batch_n

Conversation

quinle
Copy link

Hi,
Thank you so much for the great project, it is amazing. This PR is for adding support for OPT inference batch size N.
I'm looking forward to your review ^^

@yxuansu
Copy link
Owner

Hi@quinle -- Thank you for your interest in our work and the great effort! We will take a closer look to your commits, many thanks!

@gmftbyGMFTBY Are you able to review the PR by any chance?

@yxuansu
Copy link
Owner

Hi@quinle -- Thank you again for your interest in our work. We are glad that Huggingface has officially supported contrastive search intransformers.Here, we provide a short tutorial. Intransformers, contrastive search supports batch inference by default.

Hope this resource could help you :-)

Best,

Yixuan

Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

2 participants
@quinle@yxuansu
[8]ページ先頭
©2009-2025 Movatter.jp