Movatterモバイル変換

[0]ホーム
URL:

Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

 Sign up
Appearance settings

zstd: Add bigger default blocks#469

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Merged
klauspost merged 1 commit intomasterfromzstd-bigger-default-blocks
Jan 16, 2022

Conversation

klauspost
Copy link
Owner

@klauspostklauspost commentedJan 16, 2022•
edited
Loading

Keep 64K blocks for fastest, but do max size for others.

Healthy compression increase for streams.

(ignore speed)

BEFORE:github-june-2days-2019.jsonzskp1627395176469898953612717470.49github-june-2days-2019.jsonzskp2627395176461788176318084330.86github-june-2days-2019.jsonzskp3627395176452434069137059161.45github-june-2days-2019.jsonzskp4627395176446805260117009335.18AFTER:github-june-2days-2019.jsonzskp1627395176469876812310316580.00github-june-2days-2019.jsonzskp2627395176461087653813942429.13github-june-2days-2019.jsonzskp3627395176451766285842937139.35github-june-2days-2019.jsonzskp4627395176446461711416580636.09BEFORE:github-ranks-backup.binzskp118626232434540730184646382.27github-ranks-backup.binzskp218626232434183911877415239.54github-ranks-backup.binzskp318626232434097832122201480.69github-ranks-backup.binzskp4186262324338383265812427714.29AFTER:github-ranks-backup.binzskp118626232434540184984601386.01github-ranks-backup.binzskp218626232434179233319886179.68github-ranks-backup.binzskp318626232434096132462488371.39github-ranks-backup.binzskp4186262324338366799812658614.03BEFORE:nyc-taxi-data-10M.csvzskp133256057526414011959706326.73nyc-taxi-data-10M.csvzskp2332560575259174809114125224.53nyc-taxi-data-10M.csvzskp333256057525302896873398893.31nyc-taxi-data-10M.csvzskp4332560575247600060515136920.95AFTER:nyc-taxi-data-10M.csvzskp1332560575264130532410939289.91nyc-taxi-data-10M.csvzskp2332560575258897612614511218.56nyc-taxi-data-10M.csvzskp333256057525293292603466491.49nyc-taxi-data-10M.csvzskp4332560575247494977214366022.08BEFORE:gob-streamzskp119113996162349665703484523.19gob-streamzskp219113996162056697914346419.36gob-streamzskp3191139961617503465912428146.67gob-streamzskp419113996161633646345093535.79AFTER:gob-streamzskp119113996162348916093000607.42gob-streamzskp219113996162039976945981304.73gob-streamzskp3191139961617352652312201149.40gob-streamzskp419113996161621952354911637.11

Keep 64K blocks for fastest, but do max size for others.Healthy compression increase for streams.
@klauspostklauspost merged commit22de983 intomasterJan 16, 2022
@klauspostklauspost deleted the zstd-bigger-default-blocks branchJanuary 16, 2022 13:14
Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

1 participant
@klauspost
[8]ページ先頭
©2009-2025 Movatter.jp