Uh oh!
There was an error while loading.Please reload this page.
- Notifications
You must be signed in to change notification settings - Fork66
Build & release to PyPI via trusted publishing#148
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
Uh oh!
There was an error while loading.Please reload this page.
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
I've reviewed this back-to-front -- sorry. I'm a tad uncertain if we should be going with this though. Overarching thoughts:
- I think that the 'check the package is alright' step could happen via a linting run, e.g. just running
twine check
, which avoids the kerfuffle with uploading artefacts & to Test PyPI - On Test PyPI, I'm unconvinced that we should use it for every commit -- we know that the package works, and there are limited resources on Test PyPI, even if the distribution is small, so I think we ought be conservative in what we upload.
- I'm unsure what's behind
hynek/build-and-inspect-python-package
-- whilst I could go and look it up, it adds a layer of indirection when (to my understanding) this workflow should be replicating the release steps one would run locally -- e.g.python -m build; twine upload
. Making it explicit what's going on I think is useful to observability and just having fewer moving parts in general (I'd have the same objection topypa/gh-action-pypi-publish
, save that it implements the OIDC flow for us).
Sorry again for several comments, but I hope this outlines my position to some extent.
A
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
Uh oh!
There was an error while loading.Please reload this page.
There is no linter that does all the checks that PyPI does.
It's no kerfuffle, this PR adds automation so machines take care of it for us. 🤖 |
hugovk commentedAug 21, 2023 • edited
Loading Uh oh!
There was an error while loading.Please reload this page.
edited
Uh oh!
There was an error while loading.Please reload this page.
Disregard, removed:#148 (comment) |
I find the build and content summaries can be useful. It does lots of extra lint checks beyond Best of all, we don't need to maintain it! We can benefit from@hynek and other contributors maintaining and improving it. We can also re-use it in other repos without duplicating all the extra checks across our repos. (Here's the source:https://github.com/hynek/build-and-inspect-python-package) |
Co-authored-by: Adam Turner <9087854+AA-Turner@users.noreply.github.com>
I removed the TestPyPI upload because we hardcode the version and that would have meant the second and subsequent uploads would fail because youcannot reuse filenames on PyPI. I don't want to expand the scope to propose using something likehatch-vcs orsetuptools_scm in this PR, it's more important to get trusted publishing in place. 👍 |
Uh oh!
There was an error while loading.Please reload this page.
AA-Turner commentedAug 26, 2023 • edited
Loading Uh oh!
There was an error while loading.Please reload this page.
edited
Uh oh!
There was an error while loading.Please reload this page.
Thanks for your patience with my questions--excited to see trusted publishing enabled for A |
Uh oh!
There was an error while loading.Please reload this page.
@hugovk I'm just re-engaging with core development a bit more now that I'm semi-retired. Let me know what you need me to do re: pypi. Thanks. |
Congrats on the semi-retirement!
![]() That's it! |
@hugovk Thanks for the great instructions. It's now completed. ✨ |
Thank you! Let's merge this now, and I can try out a release with#153 next week, after 3.12 is out. |
Success! I merged#153, updated version and changelog in#157 and followed these steps (which I'll update in
The tag/release: The CI build and deploy: The release on PyPI: |
Please see PR#158. |
Great work. Thanks! |
Uh oh!
There was an error while loading.Please reload this page.
We discussed in the last monthly docs meeting to automate PyPI deploys using the new "Trusted Publishing", and the consensus was it's a good idea:
This would make releasing easier, and also open the release process to other core devs with the commit bit.
Here's a PR to set up the workflow, we'll also need to set up trusted publishing on TestPyPI and PyPI.
This workflow does three things:
It is based on@hynek's neathttps://github.com/python-attrs/attrs/blob/main/.github/workflows/pypi-package.yml, which I'm successfully using in my own projects.
1.
For all runs, it builds and lints the PyPI sdist and wheel. This makes sure the non-publishing steps are working smoothly, ahead of uploading. It uses@hynek's excellenthttps://github.com/hynek/build-and-inspect-python-package action, which creates a nice summary, for example:
We can see it creates three handy zips if we want to check what would be uploaded to PyPI, and three handy toggles that show the contents. Try it here:
https://github.com/python/python-docs-theme/actions/runs/5919197594?pr=148
2.
For commits to
main
we publish to TestPyPI. This helps us know the publishing process is nicely oiled to avoid surprises on release day. It uses the packages that were already created in step 1.3.
For published GitHub releases we publish to the real PyPI. Also uses packages created in step 1.
TODO
[n/a] Set up trusted publishing on TestPyPI:Go tohttps://test.pypi.org/manage/project/python-docs-theme/settings/publishing/Add a new publisher like:screenshot
@willingc I see you're the only maintainer forhttps://test.pypi.org/project/python-docs-theme/, please could you set up the above for TestPyPI? It's probably a good opportunity to add some extra owners/maintainers such as@Mariatta, to improve the bus factor.@willingc You're also one of the maintainers forhttps://pypi.org/project/python-docs-theme/, so perhaps you could do PyPI too?