Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Add the ONNX TensorRT execution provider and respective device.#1133

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Open
nemphys wants to merge1 commit intohuggingface:main
base:main
Choose a base branch
Loading
fromnemphys:tensorrt-support

Conversation

nemphys
Copy link
Contributor

ONNX has a TensorRT EP that is available for NodeJS along with the CUDA EP (under linux x64) when installing onnxruntime-node.
This commit makes it possible to use it by specifying 'tensorrt' as the device.

@xenova
Copy link
Collaborator

Hi there! Thanks for the PR. Is there a way to detect when this execution provider is available on a device? Is it only available on linux x64? It doesn't seem to be listed in theREADME:
image

@nemphys
Copy link
ContributorAuthor

Hello, as mentioned above, the tensorrt EP is available only under linux and seems to be included with the cuda EP in the default package distribution.
Indeed, they do not mention it anywhere, but it is there from the first onnxruntime distribution that introduced cuda support.

@xenova
Copy link
Collaborator

Maybe@guschmue can share some more information on why it's not listed 👀

Also,@nemphys if you could provide a link to onnxruntime-node example usage/docs which shows this being used, that would be helpful 👍

Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

2 participants
@nemphys@xenova

[8]ページ先頭

©2009-2025 Movatter.jp