subprocess gained the ability to use close_range() in#84603, however, it's only used as a fallback if procfs is not available, which means that at least on Linux it's almost never used. Its performance benefits are significant (see numbers at the end). I propose to use it by default, with procfs being the second option.

This requires some extra changes because _Py_closerange() was designed to be standalone and tries all available methods, including brute force, and also because it's not required to be async-signal-safe, but we must preserve async-signal-safety of fd closing code on Linux. I'll open a PR with a proposed implementation.

Performance comparison that I did on a test version with the following script (may require you to raise the fd limit in your shell):

import os, subprocess, sys, timeitfrom resource import *soft, hard = getrlimit(RLIMIT_NOFILE)setrlimit(RLIMIT_NOFILE, (hard, hard))num_fds, num_iter = map(int, sys.argv[1:3])for i in range(num_fds):    os.open('/dev/null', os.O_RDONLY)print(timeit.timeit(lambda: subprocess.run('/bin/true'), number=num_iter))

Before:

./python test.py 100 1000.11497399304062128./python test.py 1000 1000.3999998280778527./python test.py 10000 1003.19203062588349

After:

./python test.py 100 1000.07936713611707091./python test.py 1000 1000.09550889488309622./python test.py 10000 1000.288825839292258