Common Object Structures¶
There are a large number of structures which are used in the definition ofobject types for Python. This section describes these structures and how theyare used.
Base object types and macros¶
All Python objects ultimately share a small number of fields at the beginningof the object’s representation in memory. These are represented by thePyObject andPyVarObject types, which are defined, in turn,by the expansions of some macros also used, whether directly or indirectly, inthe definition of all other Python objects. Additional macros can be foundunderreference counting.
- typePyObject¶
- Part of theLimited API. (Only some members are part of the stable ABI.)
All object types are extensions of this type. This is a type whichcontains the information Python needs to treat a pointer to an object as anobject. In a normal “release” build, it contains only the object’sreference count and a pointer to the corresponding type object.Nothing is actually declared to be a
PyObject, but every pointerto a Python object can be cast to aPyObject*.The members must not be accessed directly; instead use macros such as
Py_REFCNTandPy_TYPE.- Py_ssize_tob_refcnt¶
- Part of theStable ABI.
The object’s reference count, as returned by
Py_REFCNT.Do not use this field directly; instead use functions and macros such asPy_REFCNT,Py_INCREF()andPy_DecRef().The field type may be different from
Py_ssize_t, depending onbuild configuration and platform.
- PyTypeObject*ob_type¶
- Part of theStable ABI.
The object’s type.Do not use this field directly; use
Py_TYPEandPy_SET_TYPE()instead.
- Py_ssize_tob_refcnt¶
- typePyVarObject¶
- Part of theLimited API. (Only some members are part of the stable ABI.)
An extension of
PyObjectthat adds theob_sizefield.This is intended for objects that have some notion oflength.As with
PyObject, the members must not be accessed directly;instead use macros such asPy_SIZE,Py_REFCNTandPy_TYPE.- Py_ssize_tob_size¶
- Part of theStable ABI.
A size field, whose contents should be considered an object’s internalimplementation detail.
Do not use this field directly; use
Py_SIZEinstead.Object creation functions such as
PyObject_NewVar()willgenerally set this field to the requested size (number of items).After creation, arbitrary values can be stored inob_sizeusingPy_SET_SIZE.To get an object’s publicly exposed length, as returned bythe Python function
len(), usePyObject_Length()instead.
- Py_ssize_tob_size¶
- PyObject_HEAD¶
This is a macro used when declaring new types which represent objectswithout a varying length. The PyObject_HEAD macro expands to:
PyObjectob_base;
See documentation of
PyObjectabove.
- PyObject_VAR_HEAD¶
This is a macro used when declaring new types which represent objectswith a length that varies from instance to instance.The PyObject_VAR_HEAD macro expands to:
PyVarObjectob_base;
See documentation of
PyVarObjectabove.
- PyTypeObjectPyBaseObject_Type¶
- Part of theStable ABI.
The base class of all other objects, the same as
objectin Python.
- intPy_Is(PyObject*x,PyObject*y)¶
- Part of theStable ABI since version 3.10.
Test if thex object is they object, the same as
xisyin Python.Added in version 3.10.
- intPy_IsNone(PyObject*x)¶
- Part of theStable ABI since version 3.10.
Test if an object is the
Nonesingleton,the same asxisNonein Python.Added in version 3.10.
- intPy_IsTrue(PyObject*x)¶
- Part of theStable ABI since version 3.10.
Test if an object is the
Truesingleton,the same asxisTruein Python.Added in version 3.10.
- intPy_IsFalse(PyObject*x)¶
- Part of theStable ABI since version 3.10.
Test if an object is the
Falsesingleton,the same asxisFalsein Python.Added in version 3.10.
- PyTypeObject*Py_TYPE(PyObject*o)¶
- Return value: Borrowed reference. Part of theStable ABI since version 3.14.
Get the type of the Python objecto.
The returned reference isborrowed fromo.Do not release it with
Py_DECREF()or similar.
- intPy_IS_TYPE(PyObject*o,PyTypeObject*type)¶
Return non-zero if the objecto type istype. Return zero otherwise.Equivalent to:
Py_TYPE(o)==type.Added in version 3.9.
- voidPy_SET_TYPE(PyObject*o,PyTypeObject*type)¶
Set the type of objecto totype, without any checking or referencecounting.
This is a very low-level operation.Consider instead setting the Python attribute
__class__usingPyObject_SetAttrString()or similar.Note that assigning an incompatible type can lead to undefined behavior.
Iftype is aheap type, the caller must create anew reference to it.Similarly, if the old type ofo is a heap type, the caller must releasea reference to that type.
Added in version 3.9.
- Py_ssize_tPy_SIZE(PyVarObject*o)¶
Get the
ob_sizefield ofo.Changed in version 3.11:
Py_SIZE()is changed to an inline static function.The parameter type is no longerconstPyVarObject*.
- voidPy_SET_SIZE(PyVarObject*o,Py_ssize_tsize)¶
Set the
ob_sizefield ofo tosize.Added in version 3.9.
- PyObject_HEAD_INIT(type)¶
This is a macro which expands to initialization values for a new
PyObjecttype. This macro expands to:_PyObject_EXTRA_INIT1,type,
- PyVarObject_HEAD_INIT(type,size)¶
This is a macro which expands to initialization values for a new
PyVarObjecttype, including theob_sizefield.This macro expands to:_PyObject_EXTRA_INIT1,type,size,
Implementing functions and methods¶
- typePyCFunction¶
- Part of theStable ABI.
Type of the functions used to implement most Python callables in C.Functions of this type take twoPyObject* parameters and returnone such value. If the return value is
NULL, an exception shall havebeen set. If notNULL, the return value is interpreted as the returnvalue of the function as exposed in Python. The function must return a newreference.The function signature is:
PyObject*PyCFunction(PyObject*self,PyObject*args);
- typePyCFunctionWithKeywords¶
- Part of theStable ABI.
Type of the functions used to implement Python callables in Cwith signatureMETH_VARARGS | METH_KEYWORDS.The function signature is:
PyObject*PyCFunctionWithKeywords(PyObject*self,PyObject*args,PyObject*kwargs);
- typePyCFunctionFast¶
- Part of theStable ABI since version 3.13.
Type of the functions used to implement Python callables in Cwith signature
METH_FASTCALL.The function signature is:PyObject*PyCFunctionFast(PyObject*self,PyObject*const*args,Py_ssize_tnargs);
- typePyCFunctionFastWithKeywords¶
- Part of theStable ABI since version 3.13.
Type of the functions used to implement Python callables in Cwith signatureMETH_FASTCALL | METH_KEYWORDS.The function signature is:
PyObject*PyCFunctionFastWithKeywords(PyObject*self,PyObject*const*args,Py_ssize_tnargs,PyObject*kwnames);
- typePyCMethod¶
Type of the functions used to implement Python callables in Cwith signatureMETH_METHOD | METH_FASTCALL | METH_KEYWORDS.The function signature is:
PyObject*PyCMethod(PyObject*self,PyTypeObject*defining_class,PyObject*const*args,Py_ssize_tnargs,PyObject*kwnames)
Added in version 3.9.
- typePyMethodDef¶
- Part of theStable ABI (including all members).
Structure used to describe a method of an extension type. This structure hasfour fields:
- constchar*ml_name¶
Name of the method.
- PyCFunctionml_meth¶
Pointer to the C implementation.
- intml_flags¶
Flags bits indicating how the call should be constructed.
- constchar*ml_doc¶
Points to the contents of the docstring.
- constchar*ml_name¶
Theml_meth is a C function pointer.The functions may be of differenttypes, but they always returnPyObject*. If the function is not ofthePyCFunction, the compiler will require a cast in the method table.Even thoughPyCFunction defines the first parameter asPyObject*, it is common that the method implementation uses thespecific C type of theself object.
Theml_flags field is a bitfield which can includethe following flags.The individual flags indicate either a calling convention or a bindingconvention.
There are these calling conventions:
- METH_VARARGS¶
This is the typical calling convention, where the methods have the type
PyCFunction. The function expects twoPyObject* values.The first one is theself object for methods; for module functions, it isthe module object. The second parameter (often calledargs) is a tupleobject representing all arguments. This parameter is typically processedusingPyArg_ParseTuple()orPyArg_UnpackTuple().
- METH_KEYWORDS¶
Can only be used in certain combinations with other flags:METH_VARARGS | METH_KEYWORDS,METH_FASTCALL | METH_KEYWORDS andMETH_METHOD | METH_FASTCALL | METH_KEYWORDS.
- METH_VARARGS|METH_KEYWORDS
Methods with these flags must be of type
PyCFunctionWithKeywords.The function expects three parameters:self,args,kwargs wherekwargs is a dictionary of all the keyword arguments or possiblyNULLif there are no keyword arguments. The parameters are typically processedusingPyArg_ParseTupleAndKeywords().
- METH_FASTCALL¶
Fast calling convention supporting only positional arguments.The methods have the type
PyCFunctionFast.The first parameter isself, the second parameter is a C arrayofPyObject* values indicating the arguments and the thirdparameter is the number of arguments (the length of the array).Added in version 3.7.
Changed in version 3.10:
METH_FASTCALLis now part of thestable ABI.
- METH_FASTCALL|METH_KEYWORDS
Extension of
METH_FASTCALLsupporting also keyword arguments,with methods of typePyCFunctionFastWithKeywords.Keyword arguments are passed the same way as in thevectorcall protocol:there is an additional fourthPyObject* parameterwhich is a tuple representing the names of the keyword arguments(which are guaranteed to be strings)or possiblyNULLif there are no keywords. The values of the keywordarguments are stored in theargs array, after the positional arguments.Added in version 3.7.
- METH_METHOD¶
Can only be used in the combination with other flags:METH_METHOD | METH_FASTCALL | METH_KEYWORDS.
- METH_METHOD|METH_FASTCALL|METH_KEYWORDS
Extension ofMETH_FASTCALL | METH_KEYWORDSsupporting thedefining class, that is,the class that contains the method in question.The defining class might be a superclass of
Py_TYPE(self).The method needs to be of type
PyCMethod, the same as forMETH_FASTCALL|METH_KEYWORDSwithdefining_classargument added afterself.Added in version 3.9.
- METH_NOARGS¶
Methods without parameters don’t need to check whether arguments are given ifthey are listed with the
METH_NOARGSflag. They need to be of typePyCFunction. The first parameter is typically namedself and willhold a reference to the module or object instance. In all cases the secondparameter will beNULL.The function must have 2 parameters. Since the second parameter is unused,
Py_UNUSEDcan be used to prevent a compiler warning.
- METH_O¶
Methods with a single object argument can be listed with the
METH_Oflag, instead of invokingPyArg_ParseTuple()with a"O"argument.They have the typePyCFunction, with theself parameter, and aPyObject* parameter representing the single argument.
These two constants are not used to indicate the calling convention but thebinding when use with methods of classes. These may not be used for functionsdefined for modules. At most one of these flags may be set for any givenmethod.
- METH_CLASS¶
The method will be passed the type object as the first parameter ratherthan an instance of the type. This is used to createclass methods,similar to what is created when using the
classmethod()built-infunction.
- METH_STATIC¶
The method will be passed
NULLas the first parameter rather than aninstance of the type. This is used to createstatic methods, similar towhat is created when using thestaticmethod()built-in function.
One other constant controls whether a method is loaded in place of anotherdefinition with the same method name.
- METH_COEXIST¶
The method will be loaded in place of existing definitions. WithoutMETH_COEXIST, the default is to skip repeated definitions. Since slotwrappers are loaded before the method table, the existence of asq_contains slot, for example, would generate a wrapped method named
__contains__()and preclude the loading of a correspondingPyCFunction with the same name. With the flag defined, the PyCFunctionwill be loaded in place of the wrapper object and will co-exist with theslot. This is helpful because calls to PyCFunctions are optimized morethan wrapper object calls.
- PyObject*PyCMethod_New(PyMethodDef*ml,PyObject*self,PyObject*module,PyTypeObject*cls)¶
- Return value: New reference. Part of theStable ABI since version 3.9.
Turnml into a Pythoncallable object.The caller must ensure thatml outlives thecallable.Typically,ml is defined as a static variable.
Theself parameter will be passed as theself argumentto the C function in
ml->ml_methwhen invoked.self can beNULL.Thecallable object’s
__module__attributecan be set from the givenmodule argument.module should be a Python string,which will be used as name of the module the function is defined in.If unavailable, it can be set toNoneorNULL.See also
Thecls parameter will be passed as thedefining_classargument to the C function.Must be set if
METH_METHODis set onml->ml_flags.Added in version 3.9.
- PyObject*PyCFunction_NewEx(PyMethodDef*ml,PyObject*self,PyObject*module)¶
- Return value: New reference. Part of theStable ABI.
Equivalent to
PyCMethod_New(ml,self,module,NULL).
- PyObject*PyCFunction_New(PyMethodDef*ml,PyObject*self)¶
- Return value: New reference. Part of theStable ABI since version 3.4.
Equivalent to
PyCMethod_New(ml,self,NULL,NULL).
Accessing attributes of extension types¶
- typePyMemberDef¶
- Part of theStable ABI (including all members).
Structure which describes an attribute of a type which corresponds to a Cstruct member.When defining a class, put a NULL-terminated array of thesestructures in the
tp_membersslot.Its fields are, in order:
- constchar*name¶
Name of the member.A NULL value marks the end of a
PyMemberDef[]array.The string should be static, no copy is made of it.
- inttype¶
The type of the member in the C struct.SeeMember types for the possible values.
- Py_ssize_toffset¶
The offset in bytes that the member is located on the type’s object struct.
- intflags¶
Zero or more of theMember flags, combined using bitwise OR.
- constchar*doc¶
The docstring, or NULL.The string should be static, no copy is made of it.Typically, it is defined using
PyDoc_STR.
By default (when
flagsis0), members allowboth read and write access.Use thePy_READONLYflag for read-only access.Certain types, likePy_T_STRING, implyPy_READONLY.OnlyPy_T_OBJECT_EX(and legacyT_OBJECT) members canbe deleted.For heap-allocated types (created using
PyType_FromSpec()or similar),PyMemberDefmay contain a definition for the special member"__vectorcalloffset__", corresponding totp_vectorcall_offsetin type objects.This member must be defined withPy_T_PYSSIZET, and eitherPy_READONLYorPy_READONLY|Py_RELATIVE_OFFSET. For example:staticPyMemberDefspam_type_members[]={{"__vectorcalloffset__",Py_T_PYSSIZET,offsetof(Spam_object,vectorcall),Py_READONLY},{NULL}/* Sentinel */};
(You may need to
#include<stddef.h>foroffsetof().)The legacy offsets
tp_dictoffsetandtp_weaklistoffsetcan be defined similarly using"__dictoffset__"and"__weaklistoffset__"members, but extensionsare strongly encouraged to usePy_TPFLAGS_MANAGED_DICTandPy_TPFLAGS_MANAGED_WEAKREFinstead.Changed in version 3.12:
PyMemberDefis always available.Previously, it required including"structmember.h".Changed in version 3.14:
Py_RELATIVE_OFFSETis now allowed for"__vectorcalloffset__","__dictoffset__"and"__weaklistoffset__". - constchar*name¶
- PyObject*PyMember_GetOne(constchar*obj_addr,structPyMemberDef*m)¶
- Part of theStable ABI.
Get an attribute belonging to the object at addressobj_addr. Theattribute is described by
PyMemberDefm. ReturnsNULLon error.Changed in version 3.12:
PyMember_GetOneis always available.Previously, it required including"structmember.h".
- intPyMember_SetOne(char*obj_addr,structPyMemberDef*m,PyObject*o)¶
- Part of theStable ABI.
Set an attribute belonging to the object at addressobj_addr to objecto.The attribute to set is described by
PyMemberDefm. Returns0if successful and a negative value on failure.Changed in version 3.12:
PyMember_SetOneis always available.Previously, it required including"structmember.h".
Member flags¶
The following flags can be used withPyMemberDef.flags:
- Py_READONLY¶
Not writable.
- Py_AUDIT_READ¶
Emit an
object.__getattr__audit eventbefore reading.
- Py_RELATIVE_OFFSET¶
Indicates that the
offsetof thisPyMemberDefentry indicates an offset from the subclass-specific data, rather thanfromPyObject.Can only be used as part of
Py_tp_membersslotwhen creating a class using negativebasicsize.It is mandatory in that case.This flag is only used in
PyType_Slot.When settingtp_membersduringclass creation, Python clears it and setsPyMemberDef.offsetto the offset from thePyObjectstruct.
Changed in version 3.10:TheRESTRICTED,READ_RESTRICTED andWRITE_RESTRICTED macros available with#include"structmember.h" are deprecated.READ_RESTRICTED andRESTRICTED are equivalent toPy_AUDIT_READ;WRITE_RESTRICTED does nothing.
Changed in version 3.12:TheREADONLY macro was renamed toPy_READONLY.ThePY_AUDIT_READ macro was renamed with thePy_ prefix.The new names are now always available.Previously, these required#include"structmember.h".The header is still available and it provides the old names.
Member types¶
PyMemberDef.type can be one of the following macros correspondingto various C types.When the member is accessed in Python, it will be converted to theequivalent Python type.When it is set from Python, it will be converted back to the C type.If that is not possible, an exception such asTypeError orValueError is raised.
Unless marked (D), attributes defined this way cannot be deletedusing e.g.del ordelattr().
Macro name | C type | Python type |
|---|---|---|
| char | |
| short | |
| int | |
| long | |
| longlong | |
| unsignedchar | |
| unsignedint | |
| unsignedshort | |
| unsignedlong | |
| unsignedlonglong | |
| ||
| float | |
| double | |
| char(written as 0 or 1) | |
| constchar* (*) |
|
| constchar[] (*) |
|
| char (0-127) |
|
|
|
(*): Zero-terminated, UTF8-encoded C string.With
Py_T_STRINGthe C representation is a pointer;withPy_T_STRING_INPLACEthe string is stored directlyin the structure.(**): String of length 1. Only ASCII is accepted.
(RO): Implies
Py_READONLY.(D): Can be deleted, in which case the pointer is set to
NULL.Reading aNULLpointer raisesAttributeError.
Added in version 3.12:In previous versions, the macros were only available with#include"structmember.h" and were named without thePy_ prefix(e.g. asT_INT).The header is still available and contains the old names, along withthe following deprecated types:
- T_OBJECT¶
Like
Py_T_OBJECT_EX, butNULLis converted toNone.This results in surprising behavior in Python: deleting the attributeeffectively sets it toNone.
- T_NONE¶
Always
None. Must be used withPy_READONLY.
Defining Getters and Setters¶
- typePyGetSetDef¶
- Part of theStable ABI (including all members).
Structure to define property-like access for a type. See also description ofthe
PyTypeObject.tp_getsetslot.- constchar*name¶
attribute name
- constchar*doc¶
optional docstring
- void*closure¶
Optional user data pointer, providing additional data for getter and setter.
- constchar*name¶
- typedefPyObject*(*getter)(PyObject*,void*)¶
- Part of theStable ABI.
The
getfunction takes onePyObject* parameter (theinstance) and a user data pointer (the associatedclosure):It should return a new reference on success or
NULLwith a set exceptionon failure.
- typedefint(*setter)(PyObject*,PyObject*,void*)¶
- Part of theStable ABI.
setfunctions take twoPyObject* parameters (the instance andthe value to be set) and a user data pointer (the associatedclosure):In case the attribute should be deleted the second parameter is
NULL.Should return0on success or-1with a set exception on failure.