➜
This issue trackerhas been migrated toGitHub, and is currentlyread-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.
Created on2016-06-03 18:55 byfried, last changed2022-04-11 14:58 byadmin. This issue is nowclosed.
| Files | ||||
|---|---|---|---|---|
| File name | Uploaded | Description | Edit | |
| buftest.py | fried,2016-06-03 18:55 | test file to generate two random tar files and test extraction time improvements | ||
| copybufsize.patch | fried,2016-06-03 18:56 | patch to expose the copy buffer size | review | |
| Messages (4) | |||
|---|---|---|---|
| msg267134 -(view) | Author: Jason Fried (fried)* | Date: 2016-06-03 18:55 | |
The default of 16k while good for memory usage it is not well suited for all cases. if we increased this to 4MB we saw a pretty large improvement to tar file creation and extraction on linux servers.For a 1gb tar file containing 1024 random files each of 10MB in size.Time Delta for TarFile: 146.3240258693695Time Delta for FastTarFile 4MB copybufsize: 102.76440262794495Time Diff: 43.55962324142456 0.2976928975444698 | |||
| msg268234 -(view) | Author: Łukasz Langa (lukasz.langa)* | Date: 2016-06-11 17:27 | |
New feature -> 3.6. | |||
| msg275546 -(view) | Author: Roundup Robot (python-dev) | Date: 2016-09-10 02:50 | |
New changeset0bac85e355b5 by Łukasz Langa in branch 'default':Issue#27199: TarFile expose copyfileobj bufsize to improve throughputhttps://hg.python.org/cpython/rev/0bac85e355b5 | |||
| msg275547 -(view) | Author: Łukasz Langa (lukasz.langa)* | Date: 2016-09-10 02:51 | |
Thanks for the patch! | |||
| History | |||
|---|---|---|---|
| Date | User | Action | Args |
| 2022-04-11 14:58:31 | admin | set | github: 71386 |
| 2016-09-10 02:51:11 | lukasz.langa | set | status: open -> closed resolution: fixed messages: +msg275547 |
| 2016-09-10 02:50:52 | python-dev | set | nosy: +python-dev messages: +msg275546 |
| 2016-06-20 17:45:06 | lukasz.langa | set | nosy: +lars.gustaebel |
| 2016-06-11 17:27:35 | lukasz.langa | set | assignee:lukasz.langa stage: patch review messages: +msg268234 versions: + Python 3.6, - Python 3.5 |
| 2016-06-03 18:56:02 | fried | set | files: +copybufsize.patch keywords: +patch |
| 2016-06-03 18:55:37 | fried | create | |