Movatterモバイル変換

[0]ホーム
URL:

Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

 Sign up
Appearance settings

[WIP] Use DTensor-based tensor parallel#180

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Open
kwen2501 wants to merge1 commit intogh/kwen2501/1/base
base:gh/kwen2501/1/base
Choose a base branch
Loading
fromgh/kwen2501/1/head

Conversation

@kwen2501
Copy link

@kwen2501kwen2501 commentedJun 12, 2024•
edited
Loading

Stack fromghstack (oldest at bottom):

Status:

  • Switched to DTensor based TP in regular tensor path
  • Result is correct, but there is a perf gap (seems to perform extra colls in the beginning, investigating)
  • TODO: switch to DTensor for quantized path too

kwen2501 added a commit that referenced this pull requestJun 12, 2024
ghstack-source-id:b55b264Pull Requestresolved:#180
@facebook-github-botfacebook-github-bot added the CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. labelJun 12, 2024
@kwen2501kwen2501 changed the titleUse DTensor-based tensor parallel[WIP] Use DTensor-based tensor parallelJun 12, 2024
@meta-cla
Copy link

Hi@kwen2501!

Thank you for your pull request.

Werequire contributors to sign ourContributor License Agreement, and yours needs attention.

You currently have a record in our system, but the CLA is no longer valid, and will need to beresubmitted.

Process

In order for us to review and merge your suggested changes, please sign athttps://code.facebook.com/cla.If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA.

Once the CLA is signed, our tooling will perform checks and validations. Afterwards, thepull request will be tagged withCLA signed. The tagging process may take up to 1 hour after signing. Please give it that time before contacting us about it.

If you have received this in error or have any questions, please contact us atcla@meta.com. Thanks!

Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@kwen2501@facebook-github-bot
[8]ページ先頭
©2009-2025 Movatter.jp