Movatterモバイル変換


[0]ホーム

URL:


Jump to content
WikipediaThe Free Encyclopedia
Search

ReFS

From Wikipedia, the free encyclopedia
(Redirected fromRefsutil)
Proprietary file system developed by Microsoft
Not to be confused withReiserFS.

ReFS
Developer(s)Microsoft
Full nameResilient File System
Introduced1 August 2012; 12 years ago (2012-08-01)[1] withWindows Server 2012
Structures
Directory contentsB+ tree[2]
Limits
Max volume size35petabytes[3]
Max file size35petabytes[3]
Features
AttributesYes
Transparent
compression
No
Data deduplicationYes, since v3.2 debuting in 2016 v1709[4]
Copy-on-writeYes
Other
Supported
operating systems
Websitelearn.microsoft.com/en-US/windows-server/storage/refs/refs-overview

Resilient File System (ReFS),[6] codenamed "Protogon",[7] is aMicrosoftproprietaryfile system introduced withWindows Server 2012 with the intent of becoming the "next generation"file system afterNTFS.

ReFS was designed to overcome problems that had become significant over the years since NTFS was conceived, which are related to how data storage requirements have changed. These requirements arose from two major changes in storage systems and usage – the size of storage in use (large or massive arrays of multi-terabyte drives now common), and the need forcontinual reliability. As a result, the file system needs to be self-repairing (to prevent disk checking from being impractically slow or disruptive), along withabstraction or virtualization between physical disks and logical volumes.

The key design advantages of ReFS include automaticintegrity checking anddata scrubbing, elimination of the need for runningchkdsk, protection againstdata degradation, built-in handling ofhard disk drive failure andredundancy, integration ofRAID functionality, a switch tocopy/allocate on write for data andmetadata updates, handling ofvery long paths and filenames, andstorage virtualization and pooling, including almost arbitrarily sizedlogical volumes (unrelated to the physical sizes of the used drives).

Comparison with NTFS

[edit]

Major new features

[edit]

Improved reliability for on-disk structures

[edit]

ReFS usesB+ trees for all on-disk structures, including all metadata and file data.[2][8] Metadata and file data are organized into tables similar to arelational database. The file size, number of files in afolder, total volume size, and number of folders in a volume are limited by 64-bit numbers; as a result, ReFS supports a maximum file size of 35petabytes, and a maximum volume size of 35 petabytes.[3]

Built-in resilience

[edit]

ReFS employs anallocation-on-write update strategy for metadata,[2] which allocates new chunks for every update transaction and uses largeIO batches. All ReFS metadata have 64-bit checksums which are stored independently. The file data can have an optional checksum in a separate "integritystream", in which case the file update strategy also implements allocation-on-write for file data; this is controlled by a new "integrity" attribute applicable to both files and directories. If file data or metadata become corrupt, the file can be deleted without taking the whole volume offline for maintenance, and then be restored from the backup. As a result of built-in resiliency, administrators do not need to periodically run error-checking tools such asCHKDSK when using ReFS.

Compatibility with existing APIs and technologies

[edit]

ReFS supports only a subset of NTFS features, and only supports Win32 APIs that are "widely adopted". It does not require new system APIs, and most file system filters continue to work with ReFS volumes.[2] ReFS supports many existing Windows and NTFS features such asBitLocker encryption,Access Control Lists,USN Journal, change notifications,[9]symbolic links,junction points,mount points,reparse points,volume snapshots,file IDs, andoplock. ReFS seamlessly integrates withStorage Spaces,[2] astorage virtualization layer that allows data mirroring and striping, as well as sharing storage pools between machines.[10] ReFS resiliency features enhance the mirroring feature provided by Storage Spaces and can detect whether any mirrored copies of files become corrupt using adata scrubbing process,[8] which periodically reads all mirror copies and verifies their checksums, then replaces bad copies with good ones.

Microsoft Windows and Windows Server includeReFSUtil, acommand-line utility that can be used to diagnose heavily damaged ReFS volumes, identify remaining files, and copy those files to another volume.[11]

Removed features

[edit]

Some NTFS features are not implemented in ReFS. These includeobject IDs,8.3 filename,NTFS compression,Encrypting File System (EFS),transactional NTFS,extended attributes, anddisk quotas.[7][2][12] Dynamic disks with mirrored or striped volumes are replaced with mirrored or striped storage pools provided by Storage Spaces; however, automated error-correction is only supported on mirrored spaces.Data deduplication was missing in early versions of ReFS.[2] It was implemented in v3.2, debuting in Windows Server v1709.[4]

Support foralternate data streams andhard links was initially not implemented in ReFS. In Windows 8.1 64-bit and Server 2012 R2, the file system reacquired support for alternate data streams, with lengths of up to 128K, and automatic correction of corruption when integrity streams are used on parity spaces.[13] ReFS had initially been unsuitable forMicrosoft SQL Server instance allocation due to the absence of alternate data streams.[14] Hard links were introduced with preview versions of Windows Server 2022 but are not yet available in Windows 11.

Implementations

[edit]

ReFS was initially added toWindows Server 2012 only, with the aim of gradual migration to consumer systems in future versions; this was achieved as ofWindows 8.1.[3] The initial versions removed some NTFS features, such asdisk quotas,alternate data streams, andextended attributes. Some of these were re-implemented in later versions of ReFS.

In early versions (2012–2013), ReFS was similar to or slightly faster than NTFS in most tests,[15] but far slower when full integrity checking was enabled, a result attributed to the relative newness of ReFS.[16][self-published source][17][self-published source]

The ability to create ReFS volumes was removed in Windows 10's 2017 Fall Creators Update for all editions except Enterprise and Pro for Workstations.[5][why?]

Starting with Windows Server 2022 and Windows 11 build 22557, theboot environment natively supports ReFS, allowing the system to be installed and run in a special way on a volume formatted with ReFS v3. If it is a volume formatted with ReFS v1, it cannot be booted with ReFS.[18]

Starting with Windows 11 build 22621.2338, ReFS is re-introduced via aDev Drive feature; allowing fixed storage drives and VHDs to be formatted as ReFS, with special file andMicrosoft Defender policies added during use.

Thecluster size of a ReFS volume is either 4 KB or 64 KB.[19]

History

[edit]

Server 2016

[edit]

At the Storage Developer Conference 2015, a Microsoft developer presented enhancements of ReFS expected to be released withWindows Server 2016 and included in Technical Preview 4, titled "ReFS v2".[20] It highlighted that ReFS now included capabilities for very high speed moving, reordering, and cloning of blocks between files[21] (which can be done for all blocks of a file). This is particularly needed forvirtualization, and is stated to allow fast provisioning, diff merging, and tiering. Other enhancements cover the redo log (for synchronous disk writes),parallelization, efficient tracking of uninitialized sparse data and files, and efficient 4kI/O.[20]

Server 2022

[edit]

Windows Server 2022 (using ReFS version 3.7) supports file-level snapshots.[3]

Windows Insider Preview 22H2 and 23H2 (builds 226** and 25***) support ReFS volume compression usingLZ4 andzstd algorithms.[22]

Versions

[edit]
This articlemay beconfusing or unclear to readers. Please helpclarify the article. There might be a discussion about this onthe talk page.(July 2017) (Learn how and when to remove this message)

ReFS has some different versions, with various degrees of compatibility between operating system versions. Aside from development versions of the filesystem, usually, later operating system versions can mount filesystems created with earlier OS versions (backwards compatibility). Some features may not be compatible with the feature set of the OS. The version, cluster size and other features of the filesystem can be queried with the commandfsutil fsinfo refsinfo volumename.

  • 1.1: The original version, formatted byWindows Server 2012.
  • 1.2: Default version if formatted byWindows 8.1,Windows 10 RTM to v1607, Windows Server 2012 R2, and when specified ReFSv1 on Windows Server 2016. Can use alternate data streams under Windows Server 2012 R2.
  • 2.2: Default version formatted by Windows 10 Preview build 10049 or earlier. Could not be mounted in 10061 and later.
  • 2.0: Default version formatted byWindows Server 2016 TP2 and TP3. Could not be mounted in Windows 10 Build 10130 and later, or Windows Server 2016 TP4 and later.
  • 3.0: Default version formatted by Windows Server 2016 TP4 and TP5.
  • 3.1: Default version formatted by Windows Server 2016 RTM.
  • 3.2: Default version formatted by Windows 10 v1703 and Windows Server Insider Preview build 16237. Can be formatted with Windows 10 Insider Preview 15002 or later (though only became the default somewhere between 15002 and 15019). Supports deduplication in the server version.
  • 3.3: Default version formatted by Windows 10 Enterprise v1709 (ReFS volume creation ability removed from all editions except Enterprise and Pro for Workstations starting with build 16226; read/write ability remains[5]) and Windows Server version 1709 (starting with Windows 10 Enterprise Insider Preview build 16257 and Windows Server Insider Preview build 16257).
  • 3.4: Default version formatted by Windows 10 Pro for Workstations/Enterprise v1803 and newer, also server versions (including the long-time support version Windows Server 2019). For Windows 10 Pro 22H2 build 19045 and previous, ReFS is unavailable.
  • 3.5: Default version formatted byWindows 11 Enterprise Insider Preview (build 19536 or newer); adds support forhard links (only on fresh formatted volume; not supported on volumes upgraded from previous versions).[3]
  • 3.6: Default version formatted by Windows 11 Enterprise Insider Preview (build 21292 or newer) and Windows Server Insider Preview (build 20282 or newer)
  • 3.7: Default version formatted by Windows 11 Enterprise Insider Preview (build 21313 or newer) and Windows Server Insider Preview (build 20303 or newer). Also, the version shipped with the final releases ofWindows Server 2022 andWindows 11. Added file-level snapshot (only available in Server 2022).
  • 3.9: Default version formatted by Windows 11 Enterprise Insider Preview (build 22598 or newer) and Windows Server Insider Preview (build 25099 or newer). Added post process compression withLZ4 andZSTD and transparent decompression.
  • 3.10: Default version formatted by Windows 11 Enterprise Insider Preview and Windows Server Insider Preview (build 25324 or newer).
  • 3.12: Default version formatted by Windows 11 Enterprise Insider Preview (build 26002 or newer).
  • 3.14: Default version formatted by Windows 11 (build 26047 and newer).[23]

Known problems

[edit]
This article needs to beupdated. Please help update this article to reflect recent events or newly available information.(February 2019)

Issues identified or suggested for ReFS, when running on Storage Spaces, include:

  • REFSutil does not work on 3.7 (Windows 2022)
  • Adding thin-provisioned ReFS on top of Storage Spaces (according to a 2012 pre-release article) can fail in a non-graceful manner, in which the volume without warning becomes inaccessible or unmanageable.[24] This can happen, for example, if the physical disks underlying a storage space became too full.Smallnetbuilder comments that, in such cases, recovery could be "prohibitive" as a "breakthrough in theory" is needed to identify storage space layouts and recover them, which is required before any ReFS recovery of file system contents can be started; therefore it recommends using backups as well.[24]
  • Thin-provisioned ReFS on top of Storage Spaces, occasionally if the ReFS partition is extended to the full size of the thin-volume. When later extending the thin-volume size the ReFS partition may fail to extend to the thin-volume size. Once it fails to extend the partition you can never again extend the partition, no matter how large you extend the thin-volume size too. The workaround is to never extend the ReFS partition to the full size of the thin-volume, always leave a few GB at the end of the volume unassigned. The problem still exists in Server 2022. It is thought that during the extension of the partition, it writes values into the partition table that corrupt the table when using the full size of the thin-volume, preventing any further expansions. That data is still intact and the ReFS partition works normally. A solution is to create a new volume and ReFS partition and copy out of the old ReFS and into the new ReFS requiring double storage during the copy before the old volume can be deleted.
  • Thin-provisioned volume formatted with ReFS eventually expands the thin volume to the full size of the ReFS formatted size, nullifying the reason to use a thin volume on Windows 10. The more use the partition sees the quicker the volume is expanded, even if the data is mostly static. Less used drives still expand on Windows 10 but not at the same rate. When using an NTFS formatted volume on top of a thin volume does not experience the same expansion. For example, 4 TB ReFS two-way mirror 99% static data(data logs) 1.11 TB used, data does not change once added, data added once a month, storage spaces used the entire 8 TB of storage(should be around 2.2 TB used in storage spaces). Same storage space different thin volume formatted with ReFS, two-way mirror single data write, but data is used less frequently and added to less frequently 257 GB of data, storage spaces using 7.77 TB. thin volume NTFS partition, used in the same manner as the 257 GB partition, but only using 601 GB. 7-month window.
  • Even when Storage Spaces is not thinly provisioned, ReFS may still be unable to dependably correct all file errors in some situations, because Storage Spaces operates on blocks and not files, and therefore some files may potentially lack necessary blocks or recovery data if part of the storage space is not working correctly. As a result, disk and data addition and removal may be impaired, and redundancy conversion becomes difficult or impossible.[citation needed]
  • TheMicrosoft Store cannot install apps on a ReFS volume.[25][self-published source]

Comparison with other file systems

[edit]

Like ReFS,ZFS,Bcachefs, andBtrfs are designed to integrate data protection, snapshots, and background error correction.

In 2012,Phoronix wrote an analysis[26] of ReFS vs Btrfs. At the time, their features were similar, with both supporting checksums,RAID-like use of multiple disks, and error correction. However, ReFS lackedcopy-on-write snapshots and compression, both found in Btrfs and ZFS.

In 2014, BetaNews wrote a review of ReFS and assessed its readiness for production use.[27] The review concluded that ReFS had at least some advantages over twofile systems then available for file servers runningUnix-like operating systems, ZFS andReiserFS.

ZFS (used inSolaris,illumos,FreeBSD and others) was widely criticized for its comparatively extreme memory requirements of many gigabytes ofRAM for online deduplication. However, online deduplication was not enabled by default in ZFS and was not supported at the time by ReFS (it has since been added), so not enabling ZFS online deduplication yielded a more even comparison between the two file systems as ZFS then has a memory requirement of only a few hundred megabytes.[28]

Reverse engineering and internals

[edit]

As of November 2019[update], Microsoft has not published any specifications for ReFS, nor have any working open-source drivers been made. A third-party open-source project to document ReFS is on GitHub.[29][30]

Paragon Software Group provides a closed-source driver for Windows and Linux.

See also

[edit]

References

[edit]
  1. ^Snover, Jeffrey (1 August 2012)."Windows Server 2012 released to manufacturing!".Windows Server Blog. Microsoft Corporation.Archived from the original on 22 December 2015. Retrieved2 September 2014.
  2. ^abcdefgVerma, Surendra (16 January 2012).Sinofsky, Steven (ed.)."Building the next generation file system for Windows: ReFS".Building Windows 8. Microsoft.MSDN blogs. Archived fromthe original on 31 July 2012. Retrieved20 January 2013.
  3. ^abcdef"Resilient File System (ReFS) overview".Microsoft.Archived from the original on 25 September 2020. Retrieved22 September 2020.
  4. ^abSarkar, Dona (13 July 2017)."Announcing Windows Server Insider Preview Build 16237".Windows Experience Blog.Microsoft.Archived from the original on 23 July 2017. Retrieved20 July 2017.
  5. ^abc"Windows 10 features and functionality removed in Windows 10".docs.microsoft.com. 30 January 2020.Archived from the original on 18 November 2019. Retrieved23 February 2020.Creation ability will be available in the following editions only: Windows 10 Enterprise and Windows 10 Pro for Workstations. Creation ability will be removed from all other editions. All other editions will have Read and Write ability.
  6. ^Lucas, Martin (1 January 2013)."Windows Server 2012: Does ReFS replace NTFS? When should I use it?".Ask Premier Field Engineering (PFE) Platforms.Microsoft.TechNet blogs.Archived from the original on 2 June 2013. Retrieved20 January 2013.
  7. ^abFoley, Mary Jo (16 January 2012)."Microsoft goes public with plans for its new Windows 8 file system".ZDNet.CBS Interactive. Retrieved31 July 2024.
  8. ^abMeyer, David (17 January 2012)."Microsoft takes wraps off new Windows file system".ZDNet.CBS Interactive.Archived from the original on 21 May 2013. Retrieved20 January 2013.
  9. ^"ReadDirectoryChangesW function".MSDN Library. Microsoft. 8 November 2012.Archived from the original on 4 May 2013. Retrieved21 January 2013.
  10. ^Nagar, Rajeev (5 January 2012).Sinofsky, Steven (ed.)."Virtualizing storage for scale, resiliency, and efficiency".Building Windows 8. Microsoft.MSDN blogs. Archived fromthe original on 6 January 2012. Retrieved18 January 2013.
  11. ^"ReFSUtil | Microsoft Docs".Archived from the original on 27 August 2021. Retrieved13 July 2021.
  12. ^Windows Server 2012: Does ReFS replace NTFS? When should I use it?Archived 2 June 2013 at theWayback Machine – Martin Lucas,TechNet
  13. ^"Resilient File System Overview".Microsoft Docs.Microsoft. 29 February 2012. Retrieved24 August 2022.
  14. ^Cherry, Denny (21 August 2012)."SQL Server and Windows Server 2012's ReFS File System | Troubleshooting SQL Server Storage Problems".SQL Server Pro magazine.Penton Media.Archived from the original on 14 July 2018. Retrieved9 May 2020.
  15. ^"ReFS vs NTFS Benchmark – First Ever – Exclusive Technology News".FirstEver.eu. Archived fromthe original on 8 July 2014.
  16. ^"Relative Performance of Parity .vs. Mirror in Storage Spaces".Baris Eris's Blog. 22 October 2012.Archived from the original on 22 June 2014. Retrieved17 June 2014.
  17. ^Eckert, Jason (25 February 2014)."Microsoft ReFS vs Oracle ZFS – Fight!".Archived from the original on 13 January 2017. Retrieved12 January 2017.
  18. ^Windows 11 on ReFS,archived from the original on 10 July 2022, retrieved10 July 2022
  19. ^"Storage at Microsoft: Cluster size recommendations for ReFS and NTFS". 13 January 2017. Retrieved22 August 2022.
  20. ^abJ. R. Tipton."ReFS v2 – Cloning, projecting, and moving data"(PDF). Retrieved20 May 2023.
  21. ^"Block Cloning".Microsoft Docs.Microsoft. 7 January 2021. Retrieved20 May 2023.
  22. ^REFS_COMPRESSION_FORMATS - NTIFS.hWindows SDK Insider PreviewArchived 14 May 2022 at theWayback Machine build 22621
  23. ^https://x.com/PhantomOfEarth/status/1756023763643027568
  24. ^abPakhomova, Elena (8 August 2012)."Data Recovery Tales: When Windows Storage Spaces Go Bad".Archived from the original on 30 July 2016. Retrieved17 June 2014.
  25. ^"What I learned after 30 minutes with ReFS".Ctrl blog. 18 May 2017.Archived from the original on 19 May 2017. Retrieved30 May 2017.
  26. ^"Microsoft's ReFS File-System: Competitor To Btrfs?".phoronix.com.Archived from the original on 8 September 2016. Retrieved14 September 2016.
  27. ^"Windows Storage Spaces and ReFS: Is it time to ditch RAID for good?".BetaNews. 15 January 2014.Archived from the original on 31 January 2014. Retrieved17 June 2014.
  28. ^"How To Size Main Memory for ZFS Deduplication".www.oracle.com. Retrieved24 August 2022.
  29. ^"libyal/libfsrefs".GitHub. 18 October 2019.Archived from the original on 9 February 2019. Retrieved11 November 2019.
  30. ^"ReFS documentation project - PDF document of the ReFS filing system (direct link)".GitHub.Archived from the original on 10 July 2022. Retrieved28 June 2020.

External links

[edit]
Disk and
non-rotating
Optical disc
Flash memory andSSD
host-sidewear leveling
Distributed parallel
NAS
Specialized
Pseudo
Encrypted
Types
Features
Access control
Interfaces
Lists
Layouts
Management
tools
Apps
Shell
Services
File systems
Server
Architecture
Security
Compatibility
API
Games
Discontinued
Games
Apps
Others
Spun off to
Microsoft Store
Retrieved from "https://en.wikipedia.org/w/index.php?title=ReFS&oldid=1280309831"
Categories:
Hidden categories:

[8]ページ先頭

©2009-2025 Movatter.jp