Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

feat: Python Runtime Windows Builds on TRT 10#2764

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Merged
gs-olive merged 23 commits intopytorch:release/2.3fromgs-olive:windows_CI_trt_10
Apr 25, 2024

Conversation

@gs-olive
Copy link
Contributor

@gs-olivegs-olive commentedApr 19, 2024
edited
Loading

Description

  • TRT-10 based implementation of Windows builds

Type of change

  • New feature (non-breaking change which adds functionality)

Checklist:

  • [ x ] My code follows the style guidelines of this project (You can use the linters)
  • [ x ] I have performed a self-review of my own code
  • [ x ] I have commented my code, particularly in hard-to-understand areas and hacks
  • [ x ] I have made corresponding changes to the documentation
  • [ x ] I have added tests to verify my fix or my feature
  • [ x ] New and existing unit tests pass locally with my changes
  • [ x ] I have added the relevant labels to my PR in so that relevant reviewers are notified

@gs-olivegs-olive added the WIPWork is in progress, pull request should not be merged yet labelApr 19, 2024
@gs-olivegs-olive self-assigned thisApr 19, 2024
@github-actionsgithub-actionsbot added component: loweringIssues re: The lowering / preprocessing passes component: conversionIssues re: Conversion stage component: coreIssues re: The core compiler component: convertersIssues re: Specific op converters component: build systemIssues re: Build system component: api [Python]Issues re: Python API component: api [C++]Issues re: C++ API component: runtime labelsApr 19, 2024
@gs-olivegs-olive removed the request for review fromzewenli98April 19, 2024 01:34
@HolyWu
Copy link
Contributor

https://github.com/HolyWu/TensorRT/tree/windows_CI_trt_10_fix
Did some cleanup and fixes. Also changed to install torch and trt according to desired_cuda from build matrix, otherwise torch and trt with cuda 12 would be installed in cu118 matrix.

gs-olive reacted with thumbs up emoji

@github-actionsgithub-actionsbot added the component: testsIssues re: Tests labelApr 22, 2024
@gs-olive
Copy link
ContributorAuthor

gs-olive commentedApr 22, 2024
edited
Loading

Thanks very much@HolyWu - I've cherry-picked in the non-C++ changes (the C++ runtime will be ported in a different PR), plus some test modifications, and will see how the CI tests go.

@gs-olivegs-olive changed the base branch fromtrt_10 torelease/2.3April 23, 2024 01:16
HolyWuand others added9 commitsApril 23, 2024 16:35
Add build-test-windows job9.3.0 Upgrade and version fixingAdd bazelisk installationUpdate installation of Torch-TRTBazel install fixPython only for initial Windows buildConda install latest cuda toolkitCUDA Driver UpdateCUDA Driver Update 2Get windows version infoAttempt driver upgrade within systemSwitch installer script to curlSwitch installer script to networkTry testing E2E models on WindowsTry linux testing action for WindowsUpdate Windows build/testUse local version of ymlUse local version of yml 2Use local version of yml 3Use local version of yml 4Remove CONDA_RUN referencesUpdate Python sourceAdd torch-trt install script packingRemove extraneous python referencesReplace pipefail commandReplace pipefail command 2Replace source commandUpdate cat command for PowershellAvoid script overwrite in runnerAvoid script overwrite in runner 2Update path concat to use echofix: Use forked infra repositorySkip things not supported by GitHub-hosted Windows runnerUpgrade setuptools and wheelRework windows testRestore root WORKSPACE to originalAttribute naming fix in YMLEnable one test in WindowsEnable GPU AccessEnable GPU Access Attempt 2Enable GPU Access Attempt 3 - revertSwitch off miniconda setupSpecify Python 3.9 as default for testingSpecify Python 3.9 as default for testing 2Revert py39 changes, make changes to infra fork, re-enable cu121 installationFailing cuda installationFailing cuda installation 2Failing cuda installation 3Differentiate pre-build script during build and testInstall trt bindings + lib manuallySwitch back to pytorch as repo sourceSpecify validation runnerRevert "Specify validation runner"This reverts commit6d664c0.Enable more testsEnable more tests 2Remove Python runtime specificationClean up and enable additional Windows testsUse .bat for driver upgradeUse .bat for driver upgrade 2UTF8 encoding for windows testing
@gs-olivegs-olive removed the WIPWork is in progress, pull request should not be merged yet labelApr 23, 2024
source "${BUILD_ENV_FILE}"

# Install test index version of Torch and Torchvision
${CONDA_RUN} pip install torch torchvision --index-url https://download.pytorch.org/whl/test/${CU_VERSION}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Actually you can restore this line back to${CONDA_RUN} ${PIP_INSTALL_TORCH} torchvision like before. The reason you had to manually specify test index is that, when you were usingtrt_10 as base branch, theset-channel actionset CHANNEL to nightly and hencePIP_INSTALL_TORCH was set to install nightly build. Now you have changed the base branch torelease/2.3, theset-channel actionset CHANNEL to test and hencePIP_INSTALL_TORCH was set to install test build.

gs-olive reacted with thumbs up emoji
python -m pip install -U numpy packaging pyyaml setuptools wheel

# Install Torch from Test Index
python -m pip install torch==2.3.0 --index-url https://download.pytorch.org/whl/test/${CU_VERSION}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

This line can be complete removed for the same reason as above, since theInstall torch dependency step already installed the desired version.

gs-olive reacted with thumbs up emoji
Copy link
Collaborator

@narendasannarendasan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

LGTM

@gs-olivegs-olive merged commit8b9836f intopytorch:release/2.3Apr 25, 2024
@gs-olivegs-olive deleted the windows_CI_trt_10 branchApril 25, 2024 17:34
gs-olive added a commit that referenced this pull requestApr 25, 2024
Co-authored-by: HolyWu <holywu@gmail.com>
gs-olive added a commit that referenced this pull requestApr 25, 2024
Co-authored-by: HolyWu <holywu@gmail.com>
gs-olive added a commit that referenced this pull requestApr 25, 2024
Co-authored-by: HolyWu <holywu@gmail.com>
zewenli98 pushed a commit that referenced this pull requestApr 26, 2024
Co-authored-by: HolyWu <holywu@gmail.com>
gs-olive added a commit that referenced this pull requestApr 26, 2024
Co-authored-by: HolyWu <holywu@gmail.com>
gs-olive added a commit that referenced this pull requestApr 29, 2024
Co-authored-by: HolyWu <holywu@gmail.com>
gs-olive added a commit that referenced this pull requestApr 30, 2024
Co-authored-by: HolyWu <holywu@gmail.com>
narendasan pushed a commit that referenced this pull requestMay 1, 2024
laikhtewari pushed a commit that referenced this pull requestMay 24, 2024
Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment

Reviewers

@narendasannarendasannarendasan approved these changes

+1 more reviewer

@HolyWuHolyWuHolyWu left review comments

Reviewers whose approvals may not affect merge requirements

Assignees

@gs-olivegs-olive

Labels

cla signedcomponent: api [C++]Issues re: C++ APIcomponent: api [Python]Issues re: Python APIcomponent: build systemIssues re: Build systemcomponent: conversionIssues re: Conversion stagecomponent: convertersIssues re: Specific op converterscomponent: coreIssues re: The core compilercomponent: loweringIssues re: The lowering / preprocessing passescomponent: runtimecomponent: testsIssues re: Tests

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@gs-olive@HolyWu@narendasan@facebook-github-bot

[8]ページ先頭

©2009-2025 Movatter.jp