Python Initialization Configuration¶
New in version 3.8.
Structures:
Functions:
The preconfiguration (PyPreConfig type) is stored in_PyRuntime.preconfig and the configuration (PyConfig type) is stored inPyInterpreterState.config.
See alsoInitialization, Finalization, and Threads.
See also
PEP 587 “Python Initialization Configuration”.
PyWideStringList¶
PyWideStringList¶List of
wchar_t*strings.Iflength is non-zero,items must be non-
NULLand all strings must benon-NULL.Methods:
- PyStatus
PyWideStringList_Append(PyWideStringList *list, const wchar_t *item)¶ Appenditem tolist.
Python must be preinitialized to call this function.
- PyStatus
PyWideStringList_Insert(PyWideStringList *list,Py_ssize_t index, const wchar_t *item)¶ Insertitem intolist atindex.
Ifindex is greater than or equal tolist length, appenditem tolist.
index must be greater than or equal to 0.
Python must be preinitialized to call this function.
Structure fields:
- Py_ssize_t
length¶ List length.
- wchar_t**
items¶ List items.
- PyStatus
PyStatus¶
PyStatus¶Structure to store an initialization function status: success, erroror exit.
For an error, it can store the C function name which created the error.
Structure fields:
- int
exitcode¶ Exit code. Argument passed to
exit().
- const char *
err_msg¶ Error message.
- const char *
func¶ Name of the function which created an error, can be
NULL.
Functions to create a status:
Functions to handle a status:
- int
PyStatus_Exception(PyStatus status)¶ Is the status an error or an exit? If true, the exception must behandled; by calling
Py_ExitStatusException()for example.
- int
Note
Internally, Python uses macros which setPyStatus.func,whereas functions to create a status setfunc toNULL.
Example:
PyStatusalloc(void**ptr,size_tsize){*ptr=PyMem_RawMalloc(size);if(*ptr==NULL){returnPyStatus_NoMemory();}returnPyStatus_Ok();}intmain(intargc,char**argv){void*ptr;PyStatusstatus=alloc(&ptr,16);if(PyStatus_Exception(status)){Py_ExitStatusException(status);}PyMem_Free(ptr);return0;}
PyPreConfig¶
PyPreConfig¶Structure used to preinitialize Python:
Set the Python memory allocator
Configure the LC_CTYPE locale
Set the UTF-8 mode
Function to initialize a preconfiguration:
- void
PyPreConfig_InitPythonConfig(PyPreConfig *preconfig)¶ Initialize the preconfiguration withPython Configuration.
- void
PyPreConfig_InitIsolatedConfig(PyPreConfig *preconfig)¶ Initialize the preconfiguration withIsolated Configuration.
Structure fields:
- int
allocator¶ Name of the memory allocator:
PYMEM_ALLOCATOR_NOT_SET(0): don’t change memory allocators(use defaults)PYMEM_ALLOCATOR_DEFAULT(1): default memory allocatorsPYMEM_ALLOCATOR_DEBUG(2): default memory allocators withdebug hooksPYMEM_ALLOCATOR_MALLOC(3): force usage ofmalloc()PYMEM_ALLOCATOR_MALLOC_DEBUG(4): force usage ofmalloc()with debug hooksPYMEM_ALLOCATOR_PYMALLOC(5):Python pymalloc memoryallocatorPYMEM_ALLOCATOR_PYMALLOC_DEBUG(6):Python pymallocmemory allocator with debug hooks
PYMEM_ALLOCATOR_PYMALLOCandPYMEM_ALLOCATOR_PYMALLOC_DEBUGare not supported if Python is configured using--without-pymalloc
- int
configure_locale¶ Set the LC_CTYPE locale to the user preferred locale? If equals to 0, set
coerce_c_localeandcoerce_c_locale_warnto 0.
- int
coerce_c_locale¶ If equals to 2, coerce the C locale; if equals to 1, read the LC_CTYPElocale to decide if it should be coerced.
- int
coerce_c_locale_warn¶ If non-zero, emit a warning if the C locale is coerced.
- int
dev_mode¶
- int
isolated¶
- int
legacy_windows_fs_encoding(Windows only)¶ If non-zero, disable UTF-8 Mode, set the Python filesystem encoding to
mbcs, set the filesystem error handler toreplace.Only available on Windows.
#ifdefMS_WINDOWSmacro can be used forWindows specific code.
- int
parse_argv¶ If non-zero,
Py_PreInitializeFromArgs()andPy_PreInitializeFromBytesArgs()parse theirargvargument thesame way the regular Python parses command line arguments: seeCommand Line Arguments.
- int
use_environment¶
- int
utf8_mode¶ If non-zero, enable the UTF-8 mode.
Preinitialization with PyPreConfig¶
Functions to preinitialize Python:
- PyStatus
Py_PreInitialize(constPyPreConfig *preconfig)¶ Preinitialize Python frompreconfig preconfiguration.
- PyStatus
Py_PreInitializeFromBytesArgs(constPyPreConfig *preconfig, int argc, char * const *argv)¶ Preinitialize Python frompreconfig preconfiguration and command linearguments (bytes strings).
- PyStatus
Py_PreInitializeFromArgs(constPyPreConfig *preconfig, int argc, wchar_t * const * argv)¶ Preinitialize Python frompreconfig preconfiguration and command linearguments (wide strings).
The caller is responsible to handle exceptions (error or exit) usingPyStatus_Exception() andPy_ExitStatusException().
ForPython Configuration(PyPreConfig_InitPythonConfig()), if Python is initialized withcommand line arguments, the command line arguments must also be passed topreinitialize Python, since they have an effect on the pre-configurationlike encodings. For example, the-Xutf8 command line optionenables the UTF-8 Mode.
PyMem_SetAllocator() can be called afterPy_PreInitialize() andbeforePy_InitializeFromConfig() to install a custom memory allocator.It can be called beforePy_PreInitialize() ifPyPreConfig.allocator is set toPYMEM_ALLOCATOR_NOT_SET.
Python memory allocation functions likePyMem_RawMalloc() must not beused before Python preinitialization, whereas calling directlymalloc() andfree() is always safe.Py_DecodeLocale() must not be called beforethe preinitialization.
Example using the preinitialization to enable the UTF-8 Mode:
PyStatusstatus;PyPreConfigpreconfig;PyPreConfig_InitPythonConfig(&preconfig);preconfig.utf8_mode=1;status=Py_PreInitialize(&preconfig);if(PyStatus_Exception(status)){Py_ExitStatusException(status);}/* at this point, Python will speak UTF-8 */Py_Initialize();/* ... use Python API here ... */Py_Finalize();
PyConfig¶
PyConfig¶Structure containing most parameters to configure Python.
Structure methods:
- void
PyConfig_InitPythonConfig(PyConfig *config)¶ Initialize configuration withPython Configuration.
- void
PyConfig_InitIsolatedConfig(PyConfig *config)¶ Initialize configuration withIsolated Configuration.
- PyStatus
PyConfig_SetString(PyConfig *config, wchar_t * const *config_str, const wchar_t *str)¶ Copy the wide character stringstr into
*config_str.Preinitialize Python if needed.
- PyStatus
PyConfig_SetBytesString(PyConfig *config, wchar_t * const *config_str, const char *str)¶ Decodestr using
Py_DecodeLocale()and set the result into*config_str.Preinitialize Python if needed.
- PyStatus
PyConfig_SetArgv(PyConfig *config, int argc, wchar_t * const *argv)¶ Set command line arguments from wide character strings.
Preinitialize Python if needed.
- PyStatus
PyConfig_SetBytesArgv(PyConfig *config, int argc, char * const *argv)¶ Set command line arguments: decode bytes using
Py_DecodeLocale().Preinitialize Python if needed.
- PyStatus
PyConfig_SetWideStringList(PyConfig *config,PyWideStringList *list,Py_ssize_t length, wchar_t **items)¶ Set the list of wide stringslist tolength anditems.
Preinitialize Python if needed.
- PyStatus
PyConfig_Read(PyConfig *config)¶ Read all Python configuration.
Fields which are already initialized are left unchanged.
Preinitialize Python if needed.
Most
PyConfigmethods preinitialize Python if needed. In that case, thePython preinitialization configuration in based on thePyConfig.If configuration fields which are in common withPyPreConfigaretuned, they must be set before calling aPyConfigmethod:Moreover, if
PyConfig_SetArgv()orPyConfig_SetBytesArgv()is used, this method must be called first, before other methods, since thepreinitialization configuration depends on command line arguments (ifparse_argvis non-zero).The caller of these methods is responsible to handle exceptions (error orexit) using
PyStatus_Exception()andPy_ExitStatusException().Structure fields:
- PyWideStringList
argv¶ Command line arguments,
sys.argv. Seeparse_argvto parseargvthesame way the regular Python parses Python command line arguments. Ifargvis empty, an empty string is added to ensurethatsys.argvalways exists and is never empty.
- wchar_t*
base_exec_prefix¶
- wchar_t*
base_executable¶ sys._base_executable:__PYVENV_LAUNCHER__environmentvariable value, or copy ofPyConfig.executable.
- wchar_t*
base_prefix¶
- wchar_t*
platlibdir¶ sys.platlibdir: platform library directory name, set at configure timeby--with-platlibdir, overrideable by thePYTHONPLATLIBDIRenvironment variable.New in version 3.9.
- int
buffered_stdio¶ If equals to 0, enable unbuffered mode, making the stdout and stderrstreams unbuffered.
stdin is always opened in buffered mode.
- int
bytes_warning¶ If equals to 1, issue a warning when comparing
bytesorbytearraywithstr, or comparingbyteswithint. If equal or greater to 2, raise aBytesWarningexception.
- wchar_t*
check_hash_pycs_mode¶ Control the validation behavior of hash-based
.pycfiles (seePEP 552):--check-hash-based-pycscommand line option value.Valid values:
always,neveranddefault.The default value is:
default.
- int
configure_c_stdio¶ If non-zero, configure C standard streams (
stdio,stdout,stdout). For example, set their mode toO_BINARYon Windows.
- int
dev_mode¶ If non-zero, enable thePython Development Mode.
- int
dump_refs¶ If non-zero, dump all objects which are still alive at exit.
Py_TRACE_REFSmacro must be defined in build.
- wchar_t*
exec_prefix¶
- wchar_t*
executable¶
- int
faulthandler¶ If non-zero, call
faulthandler.enable()at startup.
- wchar_t*
filesystem_encoding¶ Filesystem encoding,
sys.getfilesystemencoding().
- wchar_t*
filesystem_errors¶ Filesystem encoding errors,
sys.getfilesystemencodeerrors().
- unsigned long
hash_seed¶
- int
use_hash_seed¶ Randomized hash function seed.
If
use_hash_seedis zero, a seed is chosen randomlyat Pythonstartup, andhash_seedis ignored.
- wchar_t*
home¶ Python home directory.
Initialized from
PYTHONHOMEenvironment variable value bydefault.
- int
import_time¶ If non-zero, profile import time.
- int
inspect¶ Enter interactive mode after executing a script or a command.
- int
install_signal_handlers¶ Install signal handlers?
- int
interactive¶ Interactive mode.
- int
isolated¶ If greater than 0, enable isolated mode:
sys.pathcontains neither the script’s directory (computed fromargv[0]or the current directory) nor the user’s site-packagesdirectory.Python REPL doesn’t import
readlinenor enable default readlineconfiguration on interactive prompts.Set
use_environmentanduser_site_directoryto 0.
- int
legacy_windows_stdio¶ If non-zero, use
io.FileIOinstead ofio.WindowsConsoleIOforsys.stdin,sys.stdoutandsys.stderr.Only available on Windows.
#ifdefMS_WINDOWSmacro can be used forWindows specific code.
- int
malloc_stats¶ If non-zero, dump statistics onPython pymalloc memory allocator at exit.
The option is ignored if Python is built using
--without-pymalloc.
- wchar_t*
pythonpath_env¶ Module search paths as a string separated by
DELIM(os.path.pathsep).Initialized from
PYTHONPATHenvironment variable value bydefault.
- PyWideStringList
module_search_paths¶
- int
module_search_paths_set¶ sys.path. Ifmodule_search_paths_setisequal to 0, themodule_search_pathsis overriddenby the function calculating thePath Configuration.
- int
optimization_level¶ Compilation optimization level:
0: Peephole optimizer (and
__debug__is set toTrue)1: Remove assertions, set
__debug__toFalse2: Strip docstrings
- int
parse_argv¶ If non-zero, parse
argvthe same way the regularPython command line arguments, and strip Python arguments fromargv: seeCommand Line Arguments.
- int
parser_debug¶ If non-zero, turn on parser debugging output (for expert only, dependingon compilation options).
- int
pathconfig_warnings¶ If equal to 0, suppress warnings when calculating thePathConfiguration (Unix only, Windows does not log anywarning). Otherwise, warnings are written into
stderr.
- wchar_t*
prefix¶
- wchar_t*
program_name¶ Program name. Used to initialize
executable, and inearly error messages.
- wchar_t*
pycache_prefix¶ sys.pycache_prefix:.pyccache prefix.If
NULL,sys.pycache_prefixis set toNone.
- int
quiet¶ Quiet mode. For example, don’t display the copyright and version messagesin interactive mode.
- wchar_t*
run_command¶ python3-cCOMMANDargument. Used byPy_RunMain().
- wchar_t*
run_filename¶ python3FILENAMEargument. Used byPy_RunMain().
- wchar_t*
run_module¶ python3-mMODULEargument. Used byPy_RunMain().
- int
show_ref_count¶ Show total reference count at exit?
Set to 1 by
-Xshowrefcountcommand line option.Need a debug build of Python (
Py_REF_DEBUGmacro must be defined).
- int
skip_source_first_line¶ Skip the first line of the source?
- wchar_t*
stdio_encoding¶
- wchar_t*
stdio_errors¶ Encoding and encoding errors of
sys.stdin,sys.stdoutandsys.stderr.
- int
tracemalloc¶ If non-zero, call
tracemalloc.start()at startup.
- int
use_environment¶ If greater than 0, useenvironment variables.
- int
verbose¶ If non-zero, enable verbose mode.
- PyWideStringList
warnoptions¶ sys.warnoptions: options of thewarningsmodule to buildwarnings filters: lowest to highest priority.The
warningsmodule addssys.warnoptionsin the reverseorder: the lastPyConfig.warnoptionsitem becomes the firstitem ofwarnings.filterswhich is checked first (highestpriority).
- int
write_bytecode¶ If non-zero, write
.pycfiles.sys.dont_write_bytecodeis initialized to the inverted value ofwrite_bytecode.
- PyWideStringList
xoptions¶
- int
_use_peg_parser¶ Enable PEG parser? Default: 1.
Set to 0 by
-XoldparserandPYTHONOLDPARSER.See alsoPEP 617.
Deprecated since version 3.9, will be removed in version 3.10.
- void
Ifparse_argv is non-zero,argv arguments are parsed the sameway the regular Python parses command line arguments, and Pythonarguments are stripped fromargv: seeCommand Line Arguments.
Thexoptions options are parsed to set other options: see-Xoption.
Changed in version 3.9:Theshow_alloc_count field has been removed.
Initialization with PyConfig¶
Function to initialize Python:
The caller is responsible to handle exceptions (error or exit) usingPyStatus_Exception() andPy_ExitStatusException().
IfPyImport_FrozenModules(),PyImport_AppendInittab() orPyImport_ExtendInittab() are used, they must be set or called afterPython preinitialization and before the Python initialization. If Python isinitialized multiple times,PyImport_AppendInittab() orPyImport_ExtendInittab() must be called before each Pythoninitialization.
Example setting the program name:
voidinit_python(void){PyStatusstatus;PyConfigconfig;PyConfig_InitPythonConfig(&config);/* Set the program name. Implicitly preinitialize Python. */status=PyConfig_SetString(&config,&config.program_name,L"/path/to/my_program");if(PyStatus_Exception(status)){gotofail;}status=Py_InitializeFromConfig(&config);if(PyStatus_Exception(status)){gotofail;}PyConfig_Clear(&config);return;fail:PyConfig_Clear(&config);Py_ExitStatusException(status);}
More complete example modifying the default configuration, read theconfiguration, and then override some parameters:
PyStatusinit_python(constchar*program_name){PyStatusstatus;PyConfigconfig;PyConfig_InitPythonConfig(&config);/* Set the program name before reading the configuration (decode byte string from the locale encoding). Implicitly preinitialize Python. */status=PyConfig_SetBytesString(&config,&config.program_name,program_name);if(PyStatus_Exception(status)){gotodone;}/* Read all configuration at once */status=PyConfig_Read(&config);if(PyStatus_Exception(status)){gotodone;}/* Append our custom search path to sys.path */status=PyWideStringList_Append(&config.module_search_paths,L"/path/to/more/modules");if(PyStatus_Exception(status)){gotodone;}/* Override executable computed by PyConfig_Read() */status=PyConfig_SetString(&config,&config.executable,L"/path/to/my_executable");if(PyStatus_Exception(status)){gotodone;}status=Py_InitializeFromConfig(&config);done:PyConfig_Clear(&config);returnstatus;}
Isolated Configuration¶
PyPreConfig_InitIsolatedConfig() andPyConfig_InitIsolatedConfig() functions create a configuration toisolate Python from the system. For example, to embed Python into anapplication.
This configuration ignores global configuration variables, environmentvariables, command line arguments (PyConfig.argv is not parsed)and user site directory. The C standard streams (ex:stdout) and theLC_CTYPE locale are left unchanged. Signal handlers are not installed.
Configuration files are still used with this configuration. Set thePath Configuration (“output fields”) to ignore theseconfiguration files and avoid the function computing the default pathconfiguration.
Python Configuration¶
PyPreConfig_InitPythonConfig() andPyConfig_InitPythonConfig()functions create a configuration to build a customized Python which behaves asthe regular Python.
Environments variables and command line arguments are used to configurePython, whereas global configuration variables are ignored.
This function enables C locale coercion (PEP 538) and UTF-8 Mode(PEP 540) depending on the LC_CTYPE locale,PYTHONUTF8 andPYTHONCOERCECLOCALE environment variables.
Example of customized Python always running in isolated mode:
intmain(intargc,char**argv){PyStatusstatus;PyConfigconfig;PyConfig_InitPythonConfig(&config);config.isolated=1;/* Decode command line arguments. Implicitly preinitialize Python (in isolated mode). */status=PyConfig_SetBytesArgv(&config,argc,argv);if(PyStatus_Exception(status)){gotofail;}status=Py_InitializeFromConfig(&config);if(PyStatus_Exception(status)){gotofail;}PyConfig_Clear(&config);returnPy_RunMain();fail:PyConfig_Clear(&config);if(PyStatus_IsExit(status)){returnstatus.exitcode;}/* Display the error message and exit the process with non-zero exit code */Py_ExitStatusException(status);}
Path Configuration¶
PyConfig contains multiple fields for the path configuration:
Path configuration inputs:
current working directory: to get absolute paths
PATHenvironment variable to get the program full path(fromPyConfig.program_name)__PYVENV_LAUNCHER__environment variable(Windows only) Application paths in the registry under“SoftwarePythonPythonCoreX.YPythonPath” of HKEY_CURRENT_USER andHKEY_LOCAL_MACHINE (where X.Y is the Python version).
Path configuration output fields:
If at least one “output field” is not set, Python calculates the pathconfiguration to fill unset fields. Ifmodule_search_paths_set is equal to 0,module_search_paths is overridden andmodule_search_paths_set is set to 1.
It is possible to completely ignore the function calculating the defaultpath configuration by setting explicitly all path configuration outputfields listed above. A string is considered as set even if it is non-empty.module_search_paths is considered as set ifmodule_search_paths_set is set to 1. In this case, pathconfiguration input fields are ignored as well.
Setpathconfig_warnings to 0 to suppress warnings whencalculating the path configuration (Unix only, Windows does not log any warning).
Ifbase_prefix orbase_exec_prefixfields are not set, they inherit their value fromprefixandexec_prefix respectively.
Py_RunMain() andPy_Main() modifysys.path:
If
run_filenameis set and is a directory which contains a__main__.pyscript, prependrun_filenametosys.path.If
isolatedis zero:If
run_moduleis set, prepend the current directorytosys.path. Do nothing if the current directory cannot be read.If
run_filenameis set, prepend the directory of thefilename tosys.path.Otherwise, prepend an empty string to
sys.path.
Ifsite_import is non-zero,sys.path can bemodified by thesite module. Ifuser_site_directory is non-zero and the user’ssite-package directory exists, thesite module appends the user’ssite-package directory tosys.path.
The following configuration files are used by the path configuration:
pyvenv.cfgpython._pth(Windows only)pybuilddir.txt(Unix only)
The__PYVENV_LAUNCHER__ environment variable is used to setPyConfig.base_executable
Py_RunMain()¶
- int
Py_RunMain(void)¶ Execute the command (
PyConfig.run_command), the script(PyConfig.run_filename) or the module(PyConfig.run_module) specified on the command line or in theconfiguration.By default and when if
-ioption is used, run the REPL.Finally, finalizes Python and returns an exit status that can be passed tothe
exit()function.
SeePython Configuration for an example ofcustomized Python always running in isolated mode usingPy_RunMain().
Py_GetArgcArgv()¶
- void
Py_GetArgcArgv(int *argc, wchar_t ***argv)¶ Get the original command line arguments, before Python modified them.
Multi-Phase Initialization Private Provisional API¶
This section is a private provisional API introducing multi-phaseinitialization, the core feature ofPEP 432:
“Core” initialization phase, “bare minimum Python”:
“Main” initialization phase, Python is fully initialized:
Install and configure
importlib;Apply thePath Configuration;
Install signal handlers;
Finish
sysmodule initialization (ex: createsys.stdoutandsys.path);Enable optional features like
faulthandlerandtracemalloc;Import the
sitemodule;etc.
Private provisional API:
PyConfig._init_main: if set to 0,Py_InitializeFromConfig()stops at the “Core” initialization phase.PyConfig._isolated_interpreter: if non-zero,disallow threads, subprocesses and fork.
- PyStatus
_Py_InitializeMain(void)¶ Move to the “Main” initialization phase, finish the Python initialization.
No module is imported during the “Core” phase and theimportlib module isnot configured: thePath Configuration is onlyapplied during the “Main” phase. It may allow to customize Python in Python tooverride or tune thePath Configuration, maybeinstall a customsys.meta_path importer or an import hook, etc.
It may become possible to calculatin thePath Configuration in Python, after the Core phase and before the Main phase,which is one of thePEP 432 motivation.
The “Core” phase is not properly defined: what should be and what shouldnot be available at this phase is not specified yet. The API is markedas private and provisional: the API can be modified or even be removedanytime until a proper public API is designed.
Example running Python code between “Core” and “Main” initializationphases:
voidinit_python(void){PyStatusstatus;PyConfigconfig;PyConfig_InitPythonConfig(&config);config._init_main=0;/* ... customize 'config' configuration ... */status=Py_InitializeFromConfig(&config);PyConfig_Clear(&config);if(PyStatus_Exception(status)){Py_ExitStatusException(status);}/* Use sys.stderr because sys.stdout is only created by _Py_InitializeMain() */intres=PyRun_SimpleString("import sys; ""print('Run Python code before _Py_InitializeMain', ""file=sys.stderr)");if(res<0){exit(1);}/* ... put more configuration code here ... */status=_Py_InitializeMain();if(PyStatus_Exception(status)){Py_ExitStatusException(status);}}