Movatterモバイル変換


[0]ホーム

URL:


Jump to content
WikipediaThe Free Encyclopedia
Search

Append-only

From Wikipedia, the free encyclopedia
Property of computer data storage

Append-only is a property ofcomputer data storage such that new data can be appended to the storage, but where existing data isimmutable.

Access control

[edit]

Manyfile systems'Access Control Lists implement an "append-only" permission:

  • chattr in Linux can be used to set the append-only flag to files and directories. This corresponds to theO_APPEND flag inopen().[1]
  • NTFS ACL has a control for "Create Folders / Append Data", but it does not seem to keep data immutable.[2]

Manycloud storage providers provide the ability to limit access as append-only.[3] This feature is especially important to mitigate the risk ofdata loss forbackup policies in the event that the computer being backed-up becomes infected withransomware capable of deleting or encrypting the computer's backups.[4][5]

Data structures

[edit]

Manydata structures anddatabases implementimmutable objects, effectively making their data structures append-only. Implementing an append-only data structure has many benefits, such as ensuring dataconsistency, improvingperformance,[6] and permittingrollbacks.[7][8]

The prototypical append-only data structure is thelog file. Log-structured data structures found inLog-structured file systems and databases work in a similar way: every change (transaction) that happens to the data is logged by the program, and on retrieval the program must combine the pieces of data found in this log file.[9]Blockchains addcryptography to the logs so that every transaction is verifiable.

Append-only data structures may also be mandated by the hardware or software environment:

  • All objects are immutable inpurely functional programming languages, where every function is pure and global states do not exist.[10]
  • Flash storage cells can only be written to once before erasing. Erasing on a flash drive works on the level of pages which cover many cells at once, so each page is treated as an append-only set of cells until it fills up.[9][11]
  • Hard drives that useshingled magnetic recording cannot be written to randomly because writing on a track would clobber a neighboring, usually later, track. As a result, each "zone" on the drive is append-only.[12][6]

Append-only data structures grow over time, with more and more space dedicated to "stale" data found only in the history and more time wasted on parsing these data. A number of append-only systems implementrewriting (copyinggarbage collection), so that a new structure is created only containing the current version and optionally a few older ones.[7][13]

See also

[edit]

References

[edit]
  1. ^chattr(1) – Linux UserManual – User Commands from Manned.org
  2. ^"powershell - How to give "only append" access to user in windows , for logging purposes".Server Fault.
  3. ^Jim Donovan (September 11, 2018)."Why Use Immutable Storage?".Wasabi.
  4. ^Eugene Kolodenker; William Koch; Gianluca Stringhini; Manuel Egele (April 2017). "PayBreak: Defense Against Cryptographic Ransomware".Proceedings of the 2017 ACM on Asia Conference on Computer and Communications Security. pp. 599–611.doi:10.1145/3052973.3053035.Due to the threat of ransomware targeting the key vault, our implementation stores the harvested key material into an append-only file protected with Administrator privileges.
  5. ^Pont, Jamie; Abu Oun, Osama; Brierley, Calvin; Arief, Budi; Hernandez-Castro, Julio (2019). "A Roadmap for Improving the Impact of Anti-ransomware Research".Secure IT Systems, Proceedings of 24th Nordic Conference, NordSec 2019. Springer International Publishing. pp. 137–154.ISBN 978-3-030-35055-0.
  6. ^abMagic Pocket Hardware Engineering Teams."Extending Magic Pocket Innovation with the first petabyte scale SMR drive deployment".dropbox.tech.
  7. ^ab"Redis Persistence".Redis.
  8. ^"Additional Notes".Borg Deduplicating Archiver 1.1.11 documentation.
  9. ^abReid, Colin; Bernstein, Phil (1 January 2010)."Implementing an Append-Only Interface for Semiconductor Storage"(PDF).IEEE Data Eng. Bull.33:14–20.
  10. ^"Thirteen ways of looking at a turtle".F# for fun and profit. Retrieved2018-11-13.
  11. ^"NVMe Zoned Namespace".ZonedStorage.io. Archived fromthe original on 2020-01-29. Retrieved2020-04-25.The internals of Solid State Drives are such that they implement a log-structured data structure, where data is written sequentially to the media.
  12. ^Jake Edge (March 26, 2014)."Support for shingled magnetic recording devices".LWN.net. RetrievedDecember 14, 2014.
  13. ^Brewer, Eric; Ying, Lawrence; Greenfield, Lawrence; Cypher, Robert; T'so, Theodore (2016)."Disks for Data Centers".Proceedings of USENIX FAST 2016.Because of the write restrictions imposed by SMR, when data is deleted, that deleted capacity can not be reused until the system copies the remaining live data in that SMR zone to another part of the disk, a form of garbage collection (GC).
Retrieved from "https://en.wikipedia.org/w/index.php?title=Append-only&oldid=1274470519"
Category:
Hidden categories:

[8]ページ先頭

©2009-2025 Movatter.jp