3.Configure Python¶
3.1.Build Requirements¶
Features required to build CPython:
AC11 compiler.Optional C11featuresare not required.
Support forIEEE 754floating-point numbers andfloating-point Not-a-Number (NaN).
Support for threads.
On Windows, Microsoft Visual Studio 2017 or later is required.
Changed in version 3.5:On Windows, Visual Studio 2015 or later is required.
Changed in version 3.6:Selected C99 features are now required, like<stdint.h> andstaticinline functions.
Changed in version 3.7:Thread support and OpenSSL 1.0.2 are now required.
Changed in version 3.10:OpenSSL 1.1.1 is now required.
Changed in version 3.11:C11 compiler, IEEE 754 and NaN support are now required.On Windows, Visual Studio 2017 or later is required.
See alsoPEP 7 “Style Guide for C Code” andPEP 11 “CPython platformsupport”.
3.2.Generated files¶
To reduce build dependencies, Python source code contains multiple generatedfiles. Commands to regenerate all generated files:
makeregen-allmakeregen-stdlib-module-namesmakeregen-limited-abimakeregen-configure
TheMakefile.pre.in file documents generated files, their inputs, and tools usedto regenerate them. Search forregen-* make targets.
3.2.1.configure script¶
Themakeregen-configure command regenerates theaclocal.m4 file andtheconfigure script using theTools/build/regen-configure.sh shellscript which uses an Ubuntu container to get the same tools versions and have areproducible output.
The container is optional, the following command can be run locally:
autoreconf-ivf-Werror
The generated files can change depending on the exactautoconf-archive,aclocal andpkg-config versions.
3.3.Configure Options¶
List all./configure script options using:
./configure--help
See also theMisc/SpecialBuilds.txt in the Python source distribution.
3.3.1.General Options¶
- --enable-loadable-sqlite-extensions¶
Support loadable extensions in the
_sqliteextension module (defaultis no) of thesqlite3module.See the
sqlite3.Connection.enable_load_extension()method of thesqlite3module.Added in version 3.6.
- --enable-big-digits=[15|30]¶
Define the size in bits of Python
intdigits: 15 or 30 bits.By default, the digit size is 30.
Define the
PYLONG_BITS_IN_DIGITto15or30.
- --with-suffix=SUFFIX¶
Set the Python executable suffix toSUFFIX.
The default suffix is
.exeon Windows and macOS (python.exeexecutable),.json Emscripten node,.htmlon Emscripten browser,.wasmon WASI, and an empty string on other platforms (pythonexecutable).Changed in version 3.11:The default suffix on WASM platform is one of
.js,.htmlor.wasm.
- --with-tzpath=<listofabsolutepathsseparatedbypathsep>¶
Select the default time zone search path for
zoneinfo.TZPATH.See theCompile-time configuration of thezoneinfomodule.Default:
/usr/share/zoneinfo:/usr/lib/zoneinfo:/usr/share/lib/zoneinfo:/etc/zoneinfo.See
os.pathseppath separator.Added in version 3.9.
- --without-decimal-contextvar¶
Build the
_decimalextension module using a thread-local context ratherthan a coroutine-local context (default), see thedecimalmodule.See
decimal.HAVE_CONTEXTVARand thecontextvarsmodule.Added in version 3.9.
- --with-dbmliborder=<listofbackendnames>¶
Override order to check db backends for the
dbmmoduleA valid value is a colon (
:) separated string with the backend names:ndbm;gdbm;bdb.
- --without-c-locale-coercion¶
Disable C locale coercion to a UTF-8 based locale (enabled by default).
Don’t define the
PY_COERCE_C_LOCALEmacro.See
PYTHONCOERCECLOCALEand thePEP 538.
- --without-freelists¶
Disable all freelists except the empty tuple singleton.
Added in version 3.11.
- --with-platlibdir=DIRNAME¶
Python library directory name (default is
lib).Fedora and SuSE use
lib64on 64-bit platforms.See
sys.platlibdir.Added in version 3.9.
- --with-wheel-pkg-dir=PATH¶
Directory of wheel packages used by the
ensurepipmodule(none by default).Some Linux distribution packaging policies recommend against bundlingdependencies. For example, Fedora installs wheel packages in the
/usr/share/python-wheels/directory and don’t install theensurepip._bundledpackage.Added in version 3.10.
- --with-pkg-config=[check|yes|no]¶
Whether configure should usepkg-config to detect builddependencies.
check(default):pkg-config is optionalyes:pkg-config is mandatoryno: configure does not usepkg-config even when present
Added in version 3.11.
- --enable-pystats¶
Turn on internal statistics gathering.
The statistics will be dumped to a arbitrary (probably unique) file in
/tmp/py_stats/, orC:\temp\py_stats\on Windows. If that directorydoes not exist, results will be printed on stdout.Use
Tools/scripts/summarize_stats.pyto read the stats.Added in version 3.11.
3.3.2.WebAssembly Options¶
- --with-emscripten-target=[browser|node]¶
Set build flavor for
wasm32-emscripten.browser(default): preload minimal stdlib, default MEMFS.node: NODERAWFS and pthread support.
Added in version 3.11.
- --enable-wasm-dynamic-linking¶
Turn on dynamic linking support for WASM.
Dynamic linking enables
dlopen. File size of the executableincreases due to limited dead code elimination and additional features.Added in version 3.11.
- --enable-wasm-pthreads¶
Turn on pthreads support for WASM.
Added in version 3.11.
3.3.3.Install Options¶
- --prefix=PREFIX¶
Install architecture-independent files in PREFIX. On Unix, itdefaults to
/usr/local.This value can be retrieved at runtime using
sys.prefix.As an example, one can use
--prefix="$HOME/.local/"to installa Python in its home directory.
- --exec-prefix=EPREFIX¶
Install architecture-dependent files in EPREFIX, defaults to
--prefix.This value can be retrieved at runtime using
sys.exec_prefix.
3.3.4.Performance options¶
Configuring Python using--enable-optimizations--with-lto (PGO + LTO) isrecommended for best performance. The experimental--enable-bolt flag canalso be used to improve performance.
- --enable-optimizations¶
Enable Profile Guided Optimization (PGO) using
PROFILE_TASK(disabled by default).The C compiler Clang requires
llvm-profdataprogram for PGO. OnmacOS, GCC also requires it: GCC is just an alias to Clang on macOS.Disable also semantic interposition in libpython if
--enable-sharedandGCC is used: add-fno-semantic-interpositionto the compiler and linkerflags.Note
During the build, you may encounter compiler warnings aboutprofile data not being available for some source files.These warnings are harmless, as only a subset of the code is exercisedduring profile data acquisition.To disable these warnings on Clang, manually suppress them by adding
-Wno-profile-instr-unprofiledtoCFLAGS.Added in version 3.6.
Changed in version 3.10:Use
-fno-semantic-interpositionon GCC.
- PROFILE_TASK¶
Environment variable used in the Makefile: Python command line arguments forthe PGO generation task.
Default:
-mtest--pgo--timeout=$(TESTTIMEOUT).Added in version 3.8.
- --with-lto=[full|thin|no|yes]¶
Enable Link Time Optimization (LTO) in any build (disabled by default).
The C compiler Clang requires
llvm-arfor LTO (aron macOS), as wellas an LTO-aware linker (ld.goldorlld).Added in version 3.6.
Added in version 3.11:To use ThinLTO feature, use
--with-lto=thinon Clang.Changed in version 3.12:Use ThinLTO as the default optimization policy on Clang if the compiler accepts the flag.
- --enable-bolt¶
Enable usage of theBOLT post-link binary optimizer (disabled bydefault).
BOLT is part of the LLVM project but is not always included in their binarydistributions. This flag requires that
llvm-boltandmerge-fdataare available.BOLT is still a fairly new project so this flag should be consideredexperimental for now. Because this tool operates on machine code its successis dependent on a combination of the build environment + the otheroptimization configure args + the CPU architecture, and not all combinationsare supported.BOLT versions before LLVM 16 are known to crash BOLT under some scenarios.Use of LLVM 16 or newer for BOLT optimization is strongly encouraged.
The
BOLT_INSTRUMENT_FLAGSandBOLT_APPLY_FLAGSconfigure variables can be defined to override the default set ofarguments forllvm-bolt to instrument and apply BOLT data tobinaries, respectively.Added in version 3.12.
- --with-computed-gotos¶
Enable computed gotos in evaluation loop (enabled by default on supportedcompilers).
- --without-pymalloc¶
Disable the specialized Python memory allocatorpymalloc(enabled by default).
See also
PYTHONMALLOCenvironment variable.
- --without-doc-strings¶
Disable static documentation strings to reduce the memory footprint (enabledby default). Documentation strings defined in Python are not affected.
Don’t define the
WITH_DOC_STRINGSmacro.See the
PyDoc_STRVAR()macro.
- --enable-profiling¶
Enable C-level code profiling with
gprof(disabled by default).
- --with-strict-overflow¶
Add
-fstrict-overflowto the C compiler flags (by default we add-fno-strict-overflowinstead).
3.3.5.Python Debug Build¶
A debug build is Python built with the--with-pydebug configureoption.
Effects of a debug build:
Display all warnings by default: the list of default warning filters is emptyin the
warningsmodule.Add
dtosys.abiflags.Add
sys.gettotalrefcount()function.Add
-Xshowrefcountcommand line option.Add
-dcommand line option andPYTHONDEBUGenvironmentvariable to debug the parser.Add support for the
__lltrace__variable: enable low-level tracing in thebytecode evaluation loop if the variable is defined.Installdebug hooks on memory allocatorsto detect buffer overflow and other memory errors.
Define
Py_DEBUGandPy_REF_DEBUGmacros.Add runtime checks: code surrounded by
#ifdefPy_DEBUGand#endif.Enableassert(...)and_PyObject_ASSERT(...)assertions: don’t settheNDEBUGmacro (see also the--with-assertionsconfigureoption). Main runtime checks:Add sanity checks on the function arguments.
Unicode and int objects are created with their memory filled with a patternto detect usage of uninitialized objects.
Ensure that functions which can clear or replace the current exception arenot called with an exception raised.
Check that deallocator functions don’t change the current exception.
The garbage collector (
gc.collect()function) runs some basic checkson objects consistency.The
Py_SAFE_DOWNCAST()macro checks for integer underflow andoverflow when downcasting from wide types to narrow types.
See also thePython Development Mode and the--with-trace-refs configure option.
Changed in version 3.8:Release builds and debug builds are now ABI compatible: defining thePy_DEBUG macro no longer implies thePy_TRACE_REFS macro (see the--with-trace-refs option), which introduces the only ABIincompatibility.
3.3.6.Debug options¶
- --with-pydebug¶
Build Python in debug mode: define the
Py_DEBUGmacro (disabled by default).
- --with-trace-refs¶
Enable tracing references for debugging purpose (disabled by default).
Effects:
Define the
Py_TRACE_REFSmacro.Add
sys.getobjects()function.Add
PYTHONDUMPREFSenvironment variable.
This build is not ABI compatible with release build (default build) or debugbuild (
Py_DEBUGandPy_REF_DEBUGmacros).Added in version 3.8.
- --with-assertions¶
Build with C assertions enabled (default is no):
assert(...);and_PyObject_ASSERT(...);.If set, the
NDEBUGmacro is not defined in theOPTcompilervariable.See also the
--with-pydebugoption (debug build) which also enables assertions.Added in version 3.6.
- --with-valgrind¶
Enable Valgrind support (default is no).
- --with-dtrace¶
Enable DTrace support (default is no).
SeeInstrumenting CPython with DTrace and SystemTap.
Added in version 3.6.
- --with-address-sanitizer¶
Enable AddressSanitizer memory error detector,
asan(default is no).Added in version 3.6.
- --with-memory-sanitizer¶
Enable MemorySanitizer allocation error detector,
msan(default is no).Added in version 3.6.
- --with-undefined-behavior-sanitizer¶
Enable UndefinedBehaviorSanitizer undefined behaviour detector,
ubsan(default is no).Added in version 3.6.
3.3.7.Linker options¶
- --enable-shared¶
Enable building a shared Python library:
libpython(default is no).
- --without-static-libpython¶
Do not build
libpythonMAJOR.MINOR.aand do not installpython.o(built and enabled by default).Added in version 3.10.
3.3.8.Libraries options¶
- --with-libs='lib1...'¶
Link against additional libraries (default is no).
- --with-system-expat¶
Build the
pyexpatmodule using an installedexpatlibrary(default is no).
- --with-system-libmpdec¶
Build the
_decimalextension module using an installedmpdeclibrary, see thedecimalmodule (default is no).Added in version 3.3.
- --with-readline=editline¶
Use
editlinelibrary for backend of thereadlinemodule.Define the
WITH_EDITLINEmacro.Added in version 3.10.
- --without-readline¶
Don’t build the
readlinemodule (built by default).Don’t define the
HAVE_LIBREADLINEmacro.Added in version 3.10.
- --with-libm=STRING¶
Override
libmmath library toSTRING (default is system-dependent).
- --with-libc=STRING¶
Override
libcC library toSTRING (default is system-dependent).
- --with-openssl=DIR¶
Root of the OpenSSL directory.
Added in version 3.7.
- --with-openssl-rpath=[no|auto|DIR]¶
Set runtime library directory (rpath) for OpenSSL libraries:
no(default): don’t set rpath;auto: auto-detect rpath from--with-opensslandpkg-config;DIR: set an explicit rpath.
Added in version 3.10.
3.3.9.Security Options¶
- --with-hash-algorithm=[fnv|siphash13|siphash24]¶
Select hash algorithm for use in
Python/pyhash.c:siphash13(default);siphash24;fnv.
Added in version 3.4.
Added in version 3.11:
siphash13is added and it is the new default.
- --with-builtin-hashlib-hashes=md5,sha1,sha256,sha512,sha3,blake2¶
Built-in hash modules:
md5;sha1;sha256;sha512;sha3(with shake);blake2.
Added in version 3.9.
- --with-ssl-default-suites=[python|openssl|STRING]¶
Override the OpenSSL default cipher suites string:
python(default): use Python’s preferred selection;openssl: leave OpenSSL’s defaults untouched;STRING: use a custom string
See the
sslmodule.Added in version 3.7.
Changed in version 3.10:The settings
pythonandSTRING also set TLS 1.2 as minimumprotocol version.
3.3.10.macOS Options¶
SeeMac/README.rst.
- --enable-universalsdk¶
- --enable-universalsdk=SDKDIR¶
Create a universal binary build.SDKDIR specifies which macOS SDK shouldbe used to perform the build (default is no).
- --enable-framework¶
- --enable-framework=INSTALLDIR¶
Create a Python.framework rather than a traditional Unix install. OptionalINSTALLDIR specifies the installation path (default is no).
- --with-universal-archs=ARCH¶
Specify the kind of universal binary that should be created. This option isonly valid when
--enable-universalsdkis set.Options:
universal2(x86-64 and arm64);32-bit(PPC and i386);64-bit(PPC64 and x86-64);3-way(i386, PPC and x86-64);intel(i386 and x86-64);intel-32(i386);intel-64(x86-64);all(PPC, i386, PPC64 and x86-64).
Note that values for this configuration item arenot the same as theidentifiers used for universal binary wheels on macOS. See the PythonPackaging User Guide for details on thepackaging platform compatibilitytags used on macOS
- --with-framework-name=FRAMEWORK¶
Specify the name for the python framework on macOS only valid when
--enable-frameworkis set (default:Python).
3.3.11.Cross Compiling Options¶
Cross compiling, also known as cross building, can be used to build Pythonfor another CPU architecture or platform. Cross compiling requires a Pythoninterpreter for the build platform. The version of the build Python must matchthe version of the cross compiled host Python.
- --build=BUILD¶
configure for building on BUILD, usually guessed byconfig.guess.
- --host=HOST¶
cross-compile to build programs to run on HOST (target platform)
- --with-build-python=path/to/python¶
path to build
pythonbinary for cross compilingAdded in version 3.11.
- CONFIG_SITE=file¶
An environment variable that points to a file with configure overrides.
Exampleconfig.site file:
# config.site-aarch64ac_cv_buggy_getaddrinfo=noac_cv_file__dev_ptmx=yesac_cv_file__dev_ptc=no
Cross compiling example:
CONFIG_SITE=config.site-aarch64../configure\--build=x86_64-pc-linux-gnu\--host=aarch64-unknown-linux-gnu\--with-build-python=../x86_64/python
3.4.Python Build System¶
3.4.1.Main files of the build system¶
configure.ac=>configure;Makefile.pre.in=>Makefile(created byconfigure);pyconfig.h(created byconfigure);Modules/Setup: C extensions built by the Makefile usingModule/makesetupshell script;
3.4.2.Main build steps¶
C files (
.c) are built as object files (.o).A static
libpythonlibrary (.a) is created from objects files.python.oand the staticlibpythonlibrary are linked into thefinalpythonprogram.C extensions are built by the Makefile (see
Modules/Setup).
3.4.3.Main Makefile targets¶
make: Build Python with the standard library.makeplatform:: build thepythonprogram, but don’t build thestandard library extension modules.makeprofile-opt: build Python using Profile Guided Optimization (PGO).You can use the configure--enable-optimizationsoption to makethis the default target of themakecommand (makeallor justmake).makebuildbottest: Build Python and run the Python test suite, the sameway than buildbots test Python. SetTESTTIMEOUTvariable (in seconds)to change the test timeout (1200 by default: 20 minutes).makeinstall: Build and install Python.makeregen-all: Regenerate (almost) all generated files;makeregen-stdlib-module-namesandautoconfmust be run separatelyfor the remaining generated files.makeclean: Remove built files.makedistclean: Same thanmakeclean, but remove also files createdby the configure script.
3.4.4.C extensions¶
Some C extensions are built as built-in modules, like thesys module.They are built with thePy_BUILD_CORE_BUILTIN macro defined.Built-in modules have no__file__ attribute:
>>>importsys>>>sys<module 'sys' (built-in)>>>>sys.__file__Traceback (most recent call last): File"<stdin>", line1, in<module>AttributeError:module 'sys' has no attribute '__file__'
Other C extensions are built as dynamic libraries, like the_asyncio module.They are built with thePy_BUILD_CORE_MODULE macro defined.Example on Linux x86-64:
>>>import_asyncio>>>_asyncio<module '_asyncio' from '/usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so'>>>>_asyncio.__file__'/usr/lib64/python3.9/lib-dynload/_asyncio.cpython-39-x86_64-linux-gnu.so'
Modules/Setup is used to generate Makefile targets to build C extensions.At the beginning of the files, C extensions are built as built-in modules.Extensions defined after the*shared* marker are built as dynamic libraries.
ThePyAPI_FUNC(),PyAPI_DATA() andPyMODINIT_FUNC macros ofInclude/exports.h are defineddifferently depending if thePy_BUILD_CORE_MODULE macro is defined:
Use
Py_EXPORTED_SYMBOLif thePy_BUILD_CORE_MODULEis definedUse
Py_IMPORTED_SYMBOLotherwise.
If thePy_BUILD_CORE_BUILTIN macro is used by mistake on a C extensionbuilt as a shared library, itsPyInit_xxx() function is not exported,causing anImportError on import.
3.5.Compiler and linker flags¶
Options set by the./configure script and environment variables and used byMakefile.
3.5.1.Preprocessor flags¶
- CPPFLAGS¶
(Objective) C/C++ preprocessor flags, e.g.
-Iinclude_dirif you haveheaders in a nonstandard directoryinclude_dir.Both
CPPFLAGSandLDFLAGSneed to contain the shell’svalue to be able to build extension modules using thedirectories specified in the environment variables.
- BASECPPFLAGS¶
Added in version 3.4.
- PY_CPPFLAGS¶
Extra preprocessor flags added for building the interpreter object files.
Default:
$(BASECPPFLAGS)-I.-I$(srcdir)/Include$(CONFIGURE_CPPFLAGS)$(CPPFLAGS).Added in version 3.2.
3.5.2.Compiler flags¶
- CC¶
C compiler command.
Example:
gcc-pthread.
- CXX¶
C++ compiler command.
Example:
g++-pthread.
- CFLAGS¶
C compiler flags.
- CFLAGS_NODIST¶
CFLAGS_NODISTis used for building the interpreter and stdlib Cextensions. Use it when a compiler flag shouldnot be part ofCFLAGSonce Python is installed (gh-65320).In particular,
CFLAGSshould not contain:the compiler flag
-I(for setting the search path for include files).The-Iflags are processed from left to right, and any flags inCFLAGSwould take precedence over user- and package-supplied-Iflags.hardening flags such as
-Werrorbecause distributions cannot controlwhether packages installed by users conform to such heightenedstandards.
Added in version 3.5.
- COMPILEALL_OPTS¶
Options passed to the
compileallcommand line when building PYC filesinmakeinstall. Default:-j0.Added in version 3.12.
- EXTRA_CFLAGS¶
Extra C compiler flags.
- CONFIGURE_CFLAGS_NODIST¶
Value of
CFLAGS_NODISTvariable passed to the./configurescript.Added in version 3.5.
- BASECFLAGS¶
Base compiler flags.
- OPT¶
Optimization flags.
- CFLAGS_ALIASING¶
Strict or non-strict aliasing flags used to compile
Python/dtoa.c.Added in version 3.7.
- CCSHARED¶
Compiler flags used to build a shared library.
For example,
-fPICis used on Linux and on BSD.
- CFLAGSFORSHARED¶
Extra C flags added for building the interpreter object files.
Default:
$(CCSHARED)when--enable-sharedis used, or an emptystring otherwise.
- PY_CFLAGS¶
Default:
$(BASECFLAGS)$(OPT)$(CONFIGURE_CFLAGS)$(CFLAGS)$(EXTRA_CFLAGS).
- PY_CFLAGS_NODIST¶
Default:
$(CONFIGURE_CFLAGS_NODIST)$(CFLAGS_NODIST)-I$(srcdir)/Include/internal.Added in version 3.5.
- PY_STDMODULE_CFLAGS¶
C flags used for building the interpreter object files.
Default:
$(PY_CFLAGS)$(PY_CFLAGS_NODIST)$(PY_CPPFLAGS)$(CFLAGSFORSHARED).Added in version 3.7.
- PY_CORE_CFLAGS¶
Default:
$(PY_STDMODULE_CFLAGS)-DPy_BUILD_CORE.Added in version 3.2.
- PY_BUILTIN_MODULE_CFLAGS¶
Compiler flags to build a standard library extension module as a built-inmodule, like the
posixmodule.Default:
$(PY_STDMODULE_CFLAGS)-DPy_BUILD_CORE_BUILTIN.Added in version 3.8.
- PURIFY¶
Purify command. Purify is a memory debugger program.
Default: empty string (not used).
3.5.3.Linker flags¶
- LINKCC¶
Linker command used to build programs like
pythonand_testembed.Default:
$(PURIFY)$(CC).
- CONFIGURE_LDFLAGS¶
Value of
LDFLAGSvariable passed to the./configurescript.Avoid assigning
CFLAGS,LDFLAGS, etc. so users can usethem on the command line to append to these values without stomping thepre-set values.Added in version 3.2.
- LDFLAGS_NODIST¶
LDFLAGS_NODISTis used in the same manner asCFLAGS_NODIST. Use it when a linker flag shouldnot be part ofLDFLAGSonce Python is installed (gh-65320).In particular,
LDFLAGSshould not contain:the compiler flag
-L(for setting the search path for libraries).The-Lflags are processed from left to right, and any flags inLDFLAGSwould take precedence over user- and package-supplied-Lflags.
- CONFIGURE_LDFLAGS_NODIST¶
Value of
LDFLAGS_NODISTvariable passed to the./configurescript.Added in version 3.8.
- LDFLAGS¶
Linker flags, e.g.
-Llib_dirif you have libraries in a nonstandarddirectorylib_dir.Both
CPPFLAGSandLDFLAGSneed to contain the shell’svalue to be able to build extension modules using thedirectories specified in the environment variables.
- LIBS¶
Linker flags to pass libraries to the linker when linking the Pythonexecutable.
Example:
-lrt.
- LDSHARED¶
Command to build a shared library.
Default:
@LDSHARED@$(PY_LDFLAGS).
- BLDSHARED¶
Command to build
libpythonshared library.Default:
@BLDSHARED@$(PY_CORE_LDFLAGS).
- PY_LDFLAGS¶
Default:
$(CONFIGURE_LDFLAGS)$(LDFLAGS).
- PY_LDFLAGS_NODIST¶
Default:
$(CONFIGURE_LDFLAGS_NODIST)$(LDFLAGS_NODIST).Added in version 3.8.
- PY_CORE_LDFLAGS¶
Linker flags used for building the interpreter object files.
Added in version 3.8.