Uh oh!
There was an error while loading.Please reload this page.
- Notifications
You must be signed in to change notification settings - Fork33.4k
gh-117151: IO performance improvement, increase io.DEFAULT_BUFFER_SIZE to 128k#118144
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
Uh oh!
There was an error while loading.Please reload this page.
Conversation
ghost commentedApr 22, 2024 • edited by ghost
Loading Uh oh!
There was an error while loading.Please reload this page.
edited by ghost
Uh oh!
There was an error while loading.Please reload this page.
Most changes to Pythonrequire a NEWS entry. Add one using theblurb_it web app or theblurb command-line tool. If this change has little impact on Python users, wait for a maintainer to apply the |
Most changes to Pythonrequire a NEWS entry. Add one using theblurb_it web app or theblurb command-line tool. If this change has little impact on Python users, wait for a maintainer to apply the |
morotti commentedApr 25, 2024
@serhiy-storchaka hello, you were kind to review my first PR for buffering performance (118037), would you be able to review this PR too? |
eendebakpt commentedApr 30, 2024 • edited
Loading Uh oh!
There was an error while loading.Please reload this page.
edited
Uh oh!
There was an error while loading.Please reload this page.
@morotti You still need to write a news entry for the PR. For your other PR this is was not required, but due to the performance impact of this PR I think we should. The most convenient way for this is to click on the The CLA is not yet working, but it worked for the other PR (which was created after this one), so maybe it will resolve itself automatically in a couple of days |
Uh oh!
There was an error while loading.Please reload this page.
eendebakpt commentedApr 30, 2024
Pinging@benjaminp as expert on io. Could you review this PR? Are there other benchmarks (besides the one in the corresponding issue) we can perform to test this PR? |
morotti commentedApr 30, 2024
Thank you for reviewing, The CLA check is green now and I added a news entry. |
morotti commentedMay 17, 2024
@eendebakpt@benjaminp could you review? |
eendebakpt commentedMay 17, 2024
@morotti The PR looks good from my side, but I am no core dev so I cannot approve. Currently many core devs are at pycon US, so I think we should wait a bit more. If in a few weeks there has been no further response, we can post a message to discourse (seehttps://devguide.python.org/getting-started/pull-request-lifecycle/#reviewing). |
bedevere-bot commentedMay 23, 2024
bedevere-bot commentedJun 1, 2024
erlend-aasland commentedJun 1, 2024
Requesting Serhiy's review, since he reviewd the other linked (and merged) PR#118037. |
Misc/NEWS.d/next/Core and Builtins/2024-04-30-14-03-09.gh-issue-117151.yt2H8c.rst OutdatedShow resolvedHide resolved
Uh oh!
There was an error while loading.Please reload this page.
Misc/NEWS.d/next/Core and Builtins/2024-04-30-14-03-09.gh-issue-117151.yt2H8c.rst OutdatedShow resolvedHide resolved
Uh oh!
There was an error while loading.Please reload this page.
Misc/NEWS.d/next/Core and Builtins/2024-04-30-14-03-09.gh-issue-117151.yt2H8c.rst OutdatedShow resolvedHide resolved
Uh oh!
There was an error while loading.Please reload this page.
serhiy-storchaka left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
I was convinced that such a change could be beneficial.
But for the case if it has unexpected effect, please ask onhttps://discuss.python.org/. Update also the C implementation ofopen() which is used by default.
Uh oh!
There was an error while loading.Please reload this page.
Misc/NEWS.d/next/Core and Builtins/2024-04-30-14-03-09.gh-issue-117151.yt2H8c.rst OutdatedShow resolvedHide resolved
Uh oh!
There was an error while loading.Please reload this page.
serhiy-storchaka commentedJun 17, 2024
Please do not use rebase and force-push. It makes reviewing more difficult. |
morotti commentedFeb 10, 2025
alright, I've removed the constants _MAXIMUM_BUFFER_SIZE. build green. I think we're good to merge |
erlend-aasland commentedFeb 10, 2025
Please use |
morotti commentedFeb 11, 2025 • edited
Loading Uh oh!
There was an error while loading.Please reload this page.
edited
Uh oh!
There was an error while loading.Please reload this page.
I've updated the branch to main, anything else you want? |
morotti commentedFeb 17, 2025
@cmaloney@gpshead@erlend-aasland the PR is approved and passing builds. can this be merged? |
Uh oh!
There was an error while loading.Please reload this page.
A Python core developer has requested some changes be made to your pull request before we can consider merging it. If you could please address their requests along with any other requests in other reviews from core developers that would be appreciated. Once you have made the requested changes, please leave a comment on this pull request containing the phrase |
Misc/NEWS.d/next/Library/2024-04-30-14-03-09.gh-issue-117151.yt2H8c.rst OutdatedShow resolvedHide resolved
Uh oh!
There was an error while loading.Please reload this page.
morotti commentedFeb 20, 2025 • edited
Loading Uh oh!
There was an error while loading.Please reload this page.
edited
Uh oh!
There was an error while loading.Please reload this page.
@gpshead I've made the changes, would you be able to review again? |
morotti commentedMar 6, 2025
hello@gpshead@cmaloney@serhiy-storchaka@eendebakpt would you be able to review and unblock the PR? |
gpshead left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others.Learn more.
the change looks good, but this PR was created with the checkbox allowing committers to make direct edits to the PR branch disabled so we can't take care of trivia that may be blocking it ourselves.
can you merge master so that it reruns modern CI?
Uh oh!
There was an error while loading.Please reload this page.
morotti commentedMar 7, 2025
@gpshead merged with master. sorry, I haven't found any checkbox to allow to make direct edits or I would have ticket. I suspect it's because the fork is in my work organization, maybe that comes with extra restrictions. |
b1b4f96 intopython:mainUh oh!
There was an error while loading.Please reload this page.
…ER_SIZE to 128k (pythonGH-118144)Co-authored-by: rmorotti <romain.morotti@man.com>
Uh oh!
There was an error while loading.Please reload this page.
See discussiongh-117151
This patch adjusts the buffer size. That gives 3 to 5 times I/O performance improvement on modern hardware.