Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

🦃 Use sccache in CI with GHA storage, mac & wasi included#127376

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Draft
gpshead wants to merge7 commits intopython:main
base:main
Choose a base branch
Loading
fromgpshead:explore-sccache-ci

Conversation

gpshead
Copy link
Member

@gpsheadgpshead commentedNov 28, 2024
edited
Loading

https://github.com/mozilla/sccache from Mozilla is a modern ccache replacement that uses cloud storage such as GHA directly.

If successful, this adds ccache to places we didn't have it before (macOS), and uses GHA storage directly instead of the old ccache based flow of storing a bundle into the GHA cache after the run.

Q: is that an accurate description of how the old ccache flow actually worked?

Windows? it can! That'll take a little more plumbing into its build flow but it should just work.

TODO items

  • look at the dumped cache stats across GHA CI runs on commits below, why are many of them so low when they should've just rebuilt the same thing? what inputs does sccache use as a key? is there a unique path or env var mixing things up? they in theory designed this in part for CI usage so...
  • figure out thedebugging story for sccache in CI to understand why it is or isn't caching some stuff.
  • decide which places this is worth enabling vs the older ccache stuff.
  • Q: how do we monitor GHA Cache storage and rate limits for the project?

FFY00 reacted with heart emoji
@gpsheadgpshead added skip news skip issue infraCI, GitHub Actions, buildbots, Dependabot, etc. labelsNov 28, 2024
@gpsheadgpshead changed the title[testing] Explore using sccache instead of ccache in CI🦃 Use sccache in CI with GHA storage, mac & wasi includedNov 28, 2024
@eli-schwartz
Copy link
Contributor

If successful, this adds ccache to places we didn't have it before (macOS), and uses GHA storage directly instead of the old ccache based flow of storing a bundle into the GHA cache after the run.

ccache itself should work fine on macOS already (and Windows!) so configuring that directly should be an option too.

look at the dumped cache stats across GHA CI runs on commits below, why are many of them so low when they should've just rebuilt the same thing? what inputs does sccache use as a key? is there a unique path or env var mixing things up? they in theory designed this in part for CI usage so...

I know that sccache does cache on the full path despite that this is fundamentally a pretty bad idea (and renders it totally useless for scenarios such as speeding up Gentoo compilations) so that may very well be the problem.

gpshead reacted with thumbs up emoji

Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment
Reviewers

@brettcannonbrettcannonAwaiting requested review from brettcannonbrettcannon will be requested when the pull request is marked ready for reviewbrettcannon is a code owner

@ezio-melottiezio-melottiAwaiting requested review from ezio-melottiezio-melotti will be requested when the pull request is marked ready for reviewezio-melotti is a code owner

@hugovkhugovkAwaiting requested review from hugovkhugovk will be requested when the pull request is marked ready for reviewhugovk is a code owner

@AA-TurnerAA-TurnerAwaiting requested review from AA-TurnerAA-Turner will be requested when the pull request is marked ready for reviewAA-Turner is a code owner

Assignees
No one assigned
Labels
infraCI, GitHub Actions, buildbots, Dependabot, etc.skip issueskip news
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

2 participants
@gpshead@eli-schwartz

[8]ページ先頭

©2009-2025 Movatter.jp