- Notifications
You must be signed in to change notification settings - Fork964
Add the ONNX TensorRT execution provider and respective device.#1133
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
base:main
Are you sure you want to change the base?
Uh oh!
There was an error while loading.Please reload this page.
Conversation
Hi there! Thanks for the PR. Is there a way to detect when this execution provider is available on a device? Is it only available on linux x64? It doesn't seem to be listed in theREADME: |
Hello, as mentioned above, the tensorrt EP is available only under linux and seems to be included with the cuda EP in the default package distribution. |
ONNX has a TensorRT EP that is available for NodeJS along with the CUDA EP (under linux x64) when installing onnxruntime-node.
This commit makes it possible to use it by specifying 'tensorrt' as the device.