Module Objects¶
- PyTypeObjectPyModule_Type¶
- Part of theStable ABI.
This instance of
PyTypeObject
represents the Python module type. Thisis exposed to Python programs astypes.ModuleType
.
- intPyModule_Check(PyObject*p)¶
Return true ifp is a module object, or a subtype of a module object.This function always succeeds.
- intPyModule_CheckExact(PyObject*p)¶
Return true ifp is a module object, but not a subtype of
PyModule_Type
. This function always succeeds.
- PyObject*PyModule_NewObject(PyObject*name)¶
- Return value: New reference. Part of theStable ABI since version 3.7.
Return a new module object with
module.__name__
set toname.The module’s__name__
,__doc__
,__package__
and__loader__
attributes arefilled in (all but__name__
are set toNone
). The caller isresponsible for setting a__file__
attribute.Return
NULL
with an exception set on error.Added in version 3.3.
Changed in version 3.4:
__package__
and__loader__
are now set toNone
.
- PyObject*PyModule_New(constchar*name)¶
- Return value: New reference. Part of theStable ABI.
Similar to
PyModule_NewObject()
, but the name is a UTF-8 encodedstring instead of a Unicode object.
- PyObject*PyModule_GetDict(PyObject*module)¶
- Return value: Borrowed reference. Part of theStable ABI.
Return the dictionary object that implementsmodule’s namespace; this objectis the same as the
__dict__
attribute of the module object.Ifmodule is not a module object (or a subtype of a module object),SystemError
is raised andNULL
is returned.It is recommended extensions use other
PyModule_*
andPyObject_*
functions rather than directly manipulate a module’s__dict__
.
- PyObject*PyModule_GetNameObject(PyObject*module)¶
- Return value: New reference. Part of theStable ABI since version 3.7.
Returnmodule’s
__name__
value. If the module does notprovide one, or if it is not a string,SystemError
is raised andNULL
is returned.Added in version 3.3.
- constchar*PyModule_GetName(PyObject*module)¶
- Part of theStable ABI.
Similar to
PyModule_GetNameObject()
but return the name encoded to'utf-8'
.
- void*PyModule_GetState(PyObject*module)¶
- Part of theStable ABI.
Return the “state” of the module, that is, a pointer to the block of memoryallocated at module creation time, or
NULL
. SeePyModuleDef.m_size
.
- PyModuleDef*PyModule_GetDef(PyObject*module)¶
- Part of theStable ABI.
Return a pointer to the
PyModuleDef
struct from which the module wascreated, orNULL
if the module wasn’t created from a definition.
- PyObject*PyModule_GetFilenameObject(PyObject*module)¶
- Return value: New reference. Part of theStable ABI.
Return the name of the file from whichmodule was loaded usingmodule’s
__file__
attribute. If this is not defined, or if it is not astring, raiseSystemError
and returnNULL
; otherwise returna reference to a Unicode object.Added in version 3.2.
- constchar*PyModule_GetFilename(PyObject*module)¶
- Part of theStable ABI.
Similar to
PyModule_GetFilenameObject()
but return the filenameencoded to ‘utf-8’.Deprecated since version 3.2:
PyModule_GetFilename()
raisesUnicodeEncodeError
onunencodable filenames, usePyModule_GetFilenameObject()
instead.
Initializing C modules¶
Modules objects are usually created from extension modules (shared librarieswhich export an initialization function), or compiled-in modules(where the initialization function is added usingPyImport_AppendInittab()
).SeeBuilding C and C++ Extensions orExtending Embedded Python for details.
The initialization function can either pass a module definition instancetoPyModule_Create()
, and return the resulting module object,or request “multi-phase initialization” by returning the definition struct itself.
- typePyModuleDef¶
- Part of theStable ABI (including all members).
The module definition struct, which holds all information needed to createa module object. There is usually only one statically initialized variableof this type for each module.
- PyModuleDef_Basem_base¶
Always initialize this member to
PyModuleDef_HEAD_INIT
.
- constchar*m_name¶
Name for the new module.
- constchar*m_doc¶
Docstring for the module; usually a docstring variable created with
PyDoc_STRVAR
is used.
- Py_ssize_tm_size¶
Module state may be kept in a per-module memory area that can beretrieved with
PyModule_GetState()
, rather than in static globals.This makes modules safe for use in multiple sub-interpreters.This memory area is allocated based onm_size on module creation,and freed when the module object is deallocated, after the
m_free
function has been called, if present.Setting
m_size
to-1
means that the module does not supportsub-interpreters, because it has global state.Setting it to a non-negative value means that the module can bere-initialized and specifies the additional amount of memory it requiresfor its state. Non-negative
m_size
is required for multi-phaseinitialization.SeePEP 3121 for more details.
- PyMethodDef*m_methods¶
A pointer to a table of module-level functions, described by
PyMethodDef
values. Can beNULL
if no functions are present.
- PyModuleDef_Slot*m_slots¶
An array of slot definitions for multi-phase initialization, terminated bya
{0,NULL}
entry.When using single-phase initialization,m_slots must beNULL
.
- traverseprocm_traverse¶
A traversal function to call during GC traversal of the module object, or
NULL
if not needed.This function is not called if the module state was requested but is notallocated yet. This is the case immediately after the module is createdand before the module is executed (
Py_mod_exec
function). Moreprecisely, this function is not called ifm_size
is greaterthan 0 and the module state (as returned byPyModule_GetState()
)isNULL
.Changed in version 3.9:No longer called before the module state is allocated.
- inquirym_clear¶
A clear function to call during GC clearing of the module object, or
NULL
if not needed.This function is not called if the module state was requested but is notallocated yet. This is the case immediately after the module is createdand before the module is executed (
Py_mod_exec
function). Moreprecisely, this function is not called ifm_size
is greaterthan 0 and the module state (as returned byPyModule_GetState()
)isNULL
.Like
PyTypeObject.tp_clear
, this function is notalwayscalled before a module is deallocated. For example, when referencecounting is enough to determine that an object is no longer used,the cyclic garbage collector is not involved andm_free
is called directly.Changed in version 3.9:No longer called before the module state is allocated.
- freefuncm_free¶
A function to call during deallocation of the module object, or
NULL
if not needed.This function is not called if the module state was requested but is notallocated yet. This is the case immediately after the module is createdand before the module is executed (
Py_mod_exec
function). Moreprecisely, this function is not called ifm_size
is greaterthan 0 and the module state (as returned byPyModule_GetState()
)isNULL
.Changed in version 3.9:No longer called before the module state is allocated.
- PyModuleDef_Basem_base¶
Single-phase initialization¶
The module initialization function may create and return the module objectdirectly. This is referred to as “single-phase initialization”, and uses oneof the following two module creation functions:
- PyObject*PyModule_Create(PyModuleDef*def)¶
- Return value: New reference.
Create a new module object, given the definition indef. This behaveslike
PyModule_Create2()
withmodule_api_version set toPYTHON_API_VERSION
.
- PyObject*PyModule_Create2(PyModuleDef*def,intmodule_api_version)¶
- Return value: New reference. Part of theStable ABI.
Create a new module object, given the definition indef, assuming theAPI versionmodule_api_version. If that version does not match the versionof the running interpreter, a
RuntimeWarning
is emitted.Return
NULL
with an exception set on error.Note
Most uses of this function should be using
PyModule_Create()
instead; only use this if you are sure you need it.
Before it is returned from in the initialization function, the resulting moduleobject is typically populated using functions likePyModule_AddObjectRef()
.
Multi-phase initialization¶
An alternate way to specify extensions is to request “multi-phase initialization”.Extension modules created this way behave more like Python modules: theinitialization is split between thecreation phase, when the module objectis created, and theexecution phase, when it is populated.The distinction is similar to the__new__()
and__init__()
methodsof classes.
Unlike modules created using single-phase initialization, these modules are notsingletons: if thesys.modules entry is removed and the module is re-imported,a new module object is created, and the old module is subject to normal garbagecollection – as with Python modules.By default, multiple modules created from the same definition should beindependent: changes to one should not affect the others.This means that all state should be specific to the module object (using e.g.usingPyModule_GetState()
), or its contents (such as the module’s__dict__
or individual classes created withPyType_FromSpec()
).
All modules created using multi-phase initialization are expected to supportsub-interpreters. Making sure multiple modulesare independent is typically enough to achieve this.
To request multi-phase initialization, the initialization function(PyInit_modulename) returns aPyModuleDef
instance with non-emptym_slots
. Before it is returned, thePyModuleDef
instance must be initialized with the following function:
- PyObject*PyModuleDef_Init(PyModuleDef*def)¶
- Return value: Borrowed reference. Part of theStable ABI since version 3.5.
Ensures a module definition is a properly initialized Python object thatcorrectly reports its type and reference count.
Returnsdef cast to
PyObject*
, orNULL
if an error occurred.Added in version 3.5.
Them_slots member of the module definition must point to an array ofPyModuleDef_Slot
structures:
- typePyModuleDef_Slot¶
- intslot¶
A slot ID, chosen from the available values explained below.
- void*value¶
Value of the slot, whose meaning depends on the slot ID.
Added in version 3.5.
- intslot¶
Them_slots array must be terminated by a slot with id 0.
The available slot types are:
- Py_mod_create¶
Specifies a function that is called to create the module object itself.Thevalue pointer of this slot must point to a function of the signature:
- PyObject*create_module(PyObject*spec,PyModuleDef*def)¶
The function receives a
ModuleSpec
instance, as defined inPEP 451, and the module definition.It should return a new module object, or set an errorand returnNULL
.This function should be kept minimal. In particular, it should notcall arbitrary Python code, as trying to import the same module again mayresult in an infinite loop.
Multiple
Py_mod_create
slots may not be specified in one moduledefinition.If
Py_mod_create
is not specified, the import machinery will createa normal module object usingPyModule_New()
. The name is taken fromspec, not the definition, to allow extension modules to dynamically adjustto their place in the module hierarchy and be imported under differentnames through symlinks, all while sharing a single module definition.There is no requirement for the returned object to be an instance of
PyModule_Type
. Any type can be used, as long as it supportssetting and getting import-related attributes.However, onlyPyModule_Type
instances may be returned if thePyModuleDef
has non-NULL
m_traverse
,m_clear
,m_free
; non-zerom_size
; or slots other thanPy_mod_create
.- PyObject*create_module(PyObject*spec,PyModuleDef*def)¶
- Py_mod_exec¶
Specifies a function that is called toexecute the module.This is equivalent to executing the code of a Python module: typically,this function adds classes and constants to the module.The signature of the function is:
If multiple
Py_mod_exec
slots are specified, they are processed in theorder they appear in them_slots array.
- Py_mod_multiple_interpreters¶
Specifies one of the following values:
- Py_MOD_MULTIPLE_INTERPRETERS_NOT_SUPPORTED¶
The module does not support being imported in subinterpreters.
- Py_MOD_MULTIPLE_INTERPRETERS_SUPPORTED¶
The module supports being imported in subinterpreters,but only when they share the main interpreter’s GIL.(SeeIsolating Extension Modules.)
- Py_MOD_PER_INTERPRETER_GIL_SUPPORTED¶
The module supports being imported in subinterpreters,even when they have their own GIL.(SeeIsolating Extension Modules.)
This slot determines whether or not importing this modulein a subinterpreter will fail.
Multiple
Py_mod_multiple_interpreters
slots may not be specifiedin one module definition.If
Py_mod_multiple_interpreters
is not specified, the importmachinery defaults toPy_MOD_MULTIPLE_INTERPRETERS_SUPPORTED
.Added in version 3.12.
- Py_MOD_MULTIPLE_INTERPRETERS_NOT_SUPPORTED¶
- Py_mod_gil¶
Specifies one of the following values:
- Py_MOD_GIL_USED¶
The module depends on the presence of the global interpreter lock (GIL),and may access global state without synchronization.
- Py_MOD_GIL_NOT_USED¶
The module is safe to run without an active GIL.
This slot is ignored by Python builds not configured with
--disable-gil
. Otherwise, it determines whether or not importingthis module will cause the GIL to be automatically enabled. SeeFree-threaded CPython for more detail.Multiple
Py_mod_gil
slots may not be specified in one module definition.If
Py_mod_gil
is not specified, the import machinery defaults toPy_MOD_GIL_USED
.Added in version 3.13.
- Py_MOD_GIL_USED¶
SeePEP 489 for more details on multi-phase initialization.
Low-level module creation functions¶
The following functions are called under the hood when using multi-phaseinitialization. They can be used directly, for example when creating moduleobjects dynamically. Note that bothPyModule_FromDefAndSpec
andPyModule_ExecDef
must be called to fully initialize a module.
- PyObject*PyModule_FromDefAndSpec(PyModuleDef*def,PyObject*spec)¶
- Return value: New reference.
Create a new module object, given the definition indef and theModuleSpecspec. This behaves like
PyModule_FromDefAndSpec2()
withmodule_api_version set toPYTHON_API_VERSION
.Added in version 3.5.
- PyObject*PyModule_FromDefAndSpec2(PyModuleDef*def,PyObject*spec,intmodule_api_version)¶
- Return value: New reference. Part of theStable ABI since version 3.7.
Create a new module object, given the definition indef and theModuleSpecspec, assuming the API versionmodule_api_version.If that version does not match the version of the running interpreter,a
RuntimeWarning
is emitted.Return
NULL
with an exception set on error.Note
Most uses of this function should be using
PyModule_FromDefAndSpec()
instead; only use this if you are sure you need it.Added in version 3.5.
- intPyModule_ExecDef(PyObject*module,PyModuleDef*def)¶
- Part of theStable ABI since version 3.7.
Process any execution slots (
Py_mod_exec
) given indef.Added in version 3.5.
- intPyModule_SetDocString(PyObject*module,constchar*docstring)¶
- Part of theStable ABI since version 3.7.
Set the docstring formodule todocstring.This function is called automatically when creating a module from
PyModuleDef
, using eitherPyModule_Create
orPyModule_FromDefAndSpec
.Added in version 3.5.
- intPyModule_AddFunctions(PyObject*module,PyMethodDef*functions)¶
- Part of theStable ABI since version 3.7.
Add the functions from the
NULL
terminatedfunctions array tomodule.Refer to thePyMethodDef
documentation for details on individualentries (due to the lack of a shared module namespace, module level“functions” implemented in C typically receive the module as their firstparameter, making them similar to instance methods on Python classes).This function is called automatically when creating a module fromPyModuleDef
, using eitherPyModule_Create
orPyModule_FromDefAndSpec
.Added in version 3.5.
Support functions¶
The module initialization function (if using single phase initialization) ora function called from a module execution slot (if using multi-phaseinitialization), can use the following functions to help initialize the modulestate:
- intPyModule_AddObjectRef(PyObject*module,constchar*name,PyObject*value)¶
- Part of theStable ABI since version 3.10.
Add an object tomodule asname. This is a convenience function whichcan be used from the module’s initialization function.
On success, return
0
. On error, raise an exception and return-1
.Example usage:
staticintadd_spam(PyObject*module,intvalue){PyObject*obj=PyLong_FromLong(value);if(obj==NULL){return-1;}intres=PyModule_AddObjectRef(module,"spam",obj);Py_DECREF(obj);returnres;}
To be convenient, the function accepts
NULL
value with an exceptionset. In this case, return-1
and just leave the raised exceptionunchanged.The example can also be written without checking explicitly ifobj is
NULL
:staticintadd_spam(PyObject*module,intvalue){PyObject*obj=PyLong_FromLong(value);intres=PyModule_AddObjectRef(module,"spam",obj);Py_XDECREF(obj);returnres;}
Note that
Py_XDECREF()
should be used instead ofPy_DECREF()
inthis case, sinceobj can beNULL
.The number of differentname strings passed to this functionshould be kept small, usually by only using statically allocated stringsasname.For names that aren’t known at compile time, prefer calling
PyUnicode_FromString()
andPyObject_SetAttr()
directly.For more details, seePyUnicode_InternFromString()
, which may beused internally to create a key object.Added in version 3.10.
- intPyModule_Add(PyObject*module,constchar*name,PyObject*value)¶
- Part of theStable ABI since version 3.13.
Similar to
PyModule_AddObjectRef()
, but “steals” a referencetovalue.It can be called with a result of function that returns a new referencewithout bothering to check its result or even saving it to a variable.Example usage:
if(PyModule_Add(module,"spam",PyBytes_FromString(value))<0){gotoerror;}
Added in version 3.13.
- intPyModule_AddObject(PyObject*module,constchar*name,PyObject*value)¶
- Part of theStable ABI.
Similar to
PyModule_AddObjectRef()
, but steals a reference tovalue on success (if it returns0
).The new
PyModule_Add()
orPyModule_AddObjectRef()
functions are recommended, since it iseasy to introduce reference leaks by misusing thePyModule_AddObject()
function.Note
Unlike other functions that steal references,
PyModule_AddObject()
only releases the reference tovalueon success.This means that its return value must be checked, and calling code must
Py_XDECREF()
value manually on error.Example usage:
PyObject*obj=PyBytes_FromString(value);if(PyModule_AddObject(module,"spam",obj)<0){// If 'obj' is not NULL and PyModule_AddObject() failed,// 'obj' strong reference must be deleted with Py_XDECREF().// If 'obj' is NULL, Py_XDECREF() does nothing.Py_XDECREF(obj);gotoerror;}// PyModule_AddObject() stole a reference to obj:// Py_XDECREF(obj) is not needed here.
Deprecated since version 3.13:
PyModule_AddObject()
issoft deprecated.
- intPyModule_AddIntConstant(PyObject*module,constchar*name,longvalue)¶
- Part of theStable ABI.
Add an integer constant tomodule asname. This convenience function can beused from the module’s initialization function.Return
-1
with an exception set on error,0
on success.This is a convenience function that calls
PyLong_FromLong()
andPyModule_AddObjectRef()
; see their documentation for details.
- intPyModule_AddStringConstant(PyObject*module,constchar*name,constchar*value)¶
- Part of theStable ABI.
Add a string constant tomodule asname. This convenience function can beused from the module’s initialization function. The stringvalue must be
NULL
-terminated.Return-1
with an exception set on error,0
on success.This is a convenience function that calls
PyUnicode_InternFromString()
andPyModule_AddObjectRef()
;see their documentation for details.
- PyModule_AddIntMacro(module,macro)¶
Add an int constant tomodule. The name and the value are taken frommacro. For example
PyModule_AddIntMacro(module,AF_INET)
adds the intconstantAF_INET with the value ofAF_INET tomodule.Return-1
with an exception set on error,0
on success.
- PyModule_AddStringMacro(module,macro)¶
Add a string constant tomodule.
- intPyModule_AddType(PyObject*module,PyTypeObject*type)¶
- Part of theStable ABI since version 3.10.
Add a type object tomodule.The type object is finalized by calling internally
PyType_Ready()
.The name of the type object is taken from the last component oftp_name
after dot.Return-1
with an exception set on error,0
on success.Added in version 3.9.
- intPyUnstable_Module_SetGIL(PyObject*module,void*gil)¶
- This isUnstable API. It may change without warning in minor releases.
Indicate thatmodule does or does not support running without the globalinterpreter lock (GIL), using one of the values from
Py_mod_gil
. It must be called duringmodule’s initializationfunction. If this function is not called during module initialization, theimport machinery assumes the module does not support running without theGIL. This function is only available in Python builds configured with--disable-gil
.Return-1
with an exception set on error,0
on success.Added in version 3.13.
Module lookup¶
Single-phase initialization creates singleton modules that can be looked upin the context of the current interpreter. This allows the module object to beretrieved later with only a reference to the module definition.
These functions will not work on modules created using multi-phase initialization,since multiple such modules can be created from a single definition.
- PyObject*PyState_FindModule(PyModuleDef*def)¶
- Return value: Borrowed reference. Part of theStable ABI.
Returns the module object that was created fromdef for the current interpreter.This method requires that the module object has been attached to the interpreter state with
PyState_AddModule()
beforehand. In case the corresponding module object is notfound or has not been attached to the interpreter state yet, it returnsNULL
.
- intPyState_AddModule(PyObject*module,PyModuleDef*def)¶
- Part of theStable ABI since version 3.3.
Attaches the module object passed to the function to the interpreter state. This allowsthe module object to be accessible via
PyState_FindModule()
.Only effective on modules created using single-phase initialization.
Python calls
PyState_AddModule
automatically after importing a module,so it is unnecessary (but harmless) to call it from module initializationcode. An explicit call is needed only if the module’s own init codesubsequently callsPyState_FindModule
.The function is mainly intended for implementing alternative importmechanisms (either by calling it directly, or by referring to itsimplementation for details of the required state updates).The caller must hold the GIL.
Return
-1
with an exception set on error,0
on success.Added in version 3.3.
- intPyState_RemoveModule(PyModuleDef*def)¶
- Part of theStable ABI since version 3.3.
Removes the module object created fromdef from the interpreter state.Return
-1
with an exception set on error,0
on success.The caller must hold the GIL.
Added in version 3.3.