C API Stability¶
Unless documented otherwise, Python’s C API is covered by the BackwardsCompatibility Policy,PEP 387.Most changes to it are source-compatible (typically by only adding new API).Changing existing API or removing API is only done after a deprecation periodor to fix serious issues.
CPython’s Application Binary Interface (ABI) is forward- andbackwards-compatible across a minor release (if these are compiled the sameway; seePlatform Considerations below).So, code compiled for Python 3.10.0 will work on 3.10.8 and vice versa,but will need to be compiled separately for 3.9.x and 3.11.x.
There are two tiers of C API with different stability expectations:
Unstable API, may change in minor versions withouta deprecation period. It is marked by the
PyUnstable
prefix in names.Limited API, is compatible across several minor releases.When
Py_LIMITED_API
is defined, only this subset is exposedfromPython.h
.
These are discussed in more detail below.
Names prefixed by an underscore, such as_Py_InternalState
,are private API that can change without notice even in patch releases.If you need to use this API, consider reaching out toCPython developersto discuss adding public API for your use case.
Unstable C API¶
Any API named with thePyUnstable
prefix exposes CPython implementationdetails, and may change in every minor release (e.g. from 3.9 to 3.10) withoutany deprecation warnings.However, it will not change in a bugfix release (e.g. from 3.10.0 to 3.10.1).
It is generally intended for specialized, low-level tools like debuggers.
Projects that use this API are expected to followCPython development and spend extra effort adjusting to changes.
Stable Application Binary Interface¶
For simplicity, this document talks aboutextensions, but the Limited APIand Stable ABI work the same way for all uses of the API – for example,embedding Python.
Limited C API¶
Python 3.2 introduced theLimited API, a subset of Python’s C API.Extensions that only use the Limited API can becompiled once and be loaded on multiple versions of Python.Contents of the Limited API arelisted below.
- Py_LIMITED_API¶
Define this macro before including
Python.h
to opt in to only usethe Limited API, and to select the Limited API version.Define
Py_LIMITED_API
to the value ofPY_VERSION_HEX
corresponding to the lowest Python version your extension supports.The extension will be ABI-compatible with all Python 3 releasesfrom the specified one onward, and can use Limited API introduced up to thatversion.Rather than using the
PY_VERSION_HEX
macro directly, hardcode a minimumminor version (e.g.0x030A0000
for Python 3.10) for stability whencompiling with future Python versions.You can also define
Py_LIMITED_API
to3
. This works the same as0x03020000
(Python 3.2, the version that introduced Limited API).
Stable ABI¶
To enable this, Python provides aStable ABI: a set of symbols that willremain ABI-compatible across Python 3.x versions.
Note
The Stable ABI prevents ABI issues, like linker errors due to missingsymbols or data corruption due to changes in structure layouts or functionsignatures.However, other changes in Python can change thebehavior of extensions.See Python’s Backwards Compatibility Policy (PEP 387) for details.
The Stable ABI contains symbols exposed in theLimited API, but also other ones – for example, functions necessary tosupport older versions of the Limited API.
On Windows, extensions that use the Stable ABI should be linked againstpython3.dll
rather than a version-specific library such aspython39.dll
.
On some platforms, Python will look for and load shared library files namedwith theabi3
tag (e.g.mymodule.abi3.so
).It does not check if such extensions conform to a Stable ABI.The user (or their packaging tools) need to ensure that, for example,extensions built with the 3.10+ Limited API are not installed for lowerversions of Python.
All functions in the Stable ABI are present as functions in Python’s sharedlibrary, not solely as macros. This makes them usable from languages that don’tuse the C preprocessor.
Limited API Scope and Performance¶
The goal for the Limited API is to allow everything that is possible with thefull C API, but possibly with a performance penalty.
For example, whilePyList_GetItem()
is available, its “unsafe” macrovariantPyList_GET_ITEM()
is not.The macro can be faster because it can rely on version-specific implementationdetails of the list object.
WithoutPy_LIMITED_API
defined, some C API functions are inlined orreplaced by macros.DefiningPy_LIMITED_API
disables this inlining, allowing stability asPython’s data structures are improved, but possibly reducing performance.
By leaving out thePy_LIMITED_API
definition, it is possible to compilea Limited API extension with a version-specific ABI. This can improveperformance for that Python version, but will limit compatibility.Compiling withPy_LIMITED_API
will then yield an extension that can bedistributed where a version-specific one is not available – for example,for prereleases of an upcoming Python version.
Limited API Caveats¶
Note that compiling withPy_LIMITED_API
isnot a complete guarantee thatcode conforms to theLimited API or theStable ABI.Py_LIMITED_API
only covers definitions, but an API alsoincludes other issues, such as expected semantics.
One issue thatPy_LIMITED_API
does not guard against is calling a functionwith arguments that are invalid in a lower Python version.For example, consider a function that starts acceptingNULL
for anargument. In Python 3.9,NULL
now selects a default behavior, but inPython 3.8, the argument will be used directly, causing aNULL
dereferenceand crash. A similar argument works for fields of structs.
Another issue is that some struct fields are currently not hidden whenPy_LIMITED_API
is defined, even though they’re part of the Limited API.
For these reasons, we recommend testing an extension withall minor Pythonversions it supports, and preferably to build with thelowest such version.
We also recommend reviewing documentation of all used API to checkif it is explicitly part of the Limited API. Even withPy_LIMITED_API
defined, a few private declarations are exposed for technical reasons (oreven unintentionally, as bugs).
Also note that the Limited API is not necessarily stable: compiling withPy_LIMITED_API
with Python 3.8 means that the extension willrun with Python 3.12, but it will not necessarilycompile with Python 3.12.In particular, parts of the Limited API may be deprecated and removed,provided that the Stable ABI stays stable.
Platform Considerations¶
ABI stability depends not only on Python, but also on the compiler used,lower-level libraries and compiler options. For the purposes oftheStable ABI, these details define a “platform”. Theyusually depend on the OS type and processor architecture
It is the responsibility of each particular distributor of Pythonto ensure that all Python versions on a particular platform are builtin a way that does not break the Stable ABI.This is the case with Windows and macOS releases frompython.org
and manythird-party distributors.
Contents of Limited API¶
Currently, theLimited API includes the following items:
PyByteArrayIter_Type
PyBytesIter_Type
PyBytes_DecodeEscape()
PyBytes_Repr()
PyCFunction_GetFlags()
PyCFunction_GetFunction()
PyCFunction_GetSelf()
PyCFunction_Type
PyCapsule_Type
PyClassMethodDescr_Type
PyDictItems_Type
PyDictIterItem_Type
PyDictIterKey_Type
PyDictIterValue_Type
PyDictKeys_Type
PyDictProxy_Type
PyDictRevIterItem_Type
PyDictRevIterKey_Type
PyDictRevIterValue_Type
PyDictValues_Type
PyEnum_Type
PyErr_Display()
PyErr_ProgramText()
PyExc_ArithmeticError
PyExc_AssertionError
PyExc_AttributeError
PyExc_BaseException
PyExc_BaseExceptionGroup
PyExc_BlockingIOError
PyExc_BrokenPipeError
PyExc_BufferError
PyExc_BytesWarning
PyExc_ChildProcessError
PyExc_ConnectionAbortedError
PyExc_ConnectionError
PyExc_ConnectionRefusedError
PyExc_ConnectionResetError
PyExc_DeprecationWarning
PyExc_EOFError
PyExc_EncodingWarning
PyExc_EnvironmentError
PyExc_Exception
PyExc_FileExistsError
PyExc_FileNotFoundError
PyExc_FloatingPointError
PyExc_FutureWarning
PyExc_GeneratorExit
PyExc_IOError
PyExc_ImportError
PyExc_ImportWarning
PyExc_IndentationError
PyExc_IndexError
PyExc_InterruptedError
PyExc_IsADirectoryError
PyExc_KeyError
PyExc_KeyboardInterrupt
PyExc_LookupError
PyExc_MemoryError
PyExc_ModuleNotFoundError
PyExc_NameError
PyExc_NotADirectoryError
PyExc_NotImplementedError
PyExc_OSError
PyExc_OverflowError
PyExc_PendingDeprecationWarning
PyExc_PermissionError
PyExc_ProcessLookupError
PyExc_RecursionError
PyExc_ReferenceError
PyExc_ResourceWarning
PyExc_RuntimeError
PyExc_RuntimeWarning
PyExc_StopAsyncIteration
PyExc_StopIteration
PyExc_SyntaxError
PyExc_SyntaxWarning
PyExc_SystemError
PyExc_SystemExit
PyExc_TabError
PyExc_TimeoutError
PyExc_TypeError
PyExc_UnboundLocalError
PyExc_UnicodeDecodeError
PyExc_UnicodeEncodeError
PyExc_UnicodeError
PyExc_UnicodeTranslateError
PyExc_UnicodeWarning
PyExc_UserWarning
PyExc_ValueError
PyExc_Warning
PyExc_WindowsError
PyExc_ZeroDivisionError
PyExceptionClass_Name()
PyFilter_Type
PyGILState_STATE
PyGetSetDescr_Type
PyListIter_Type
PyListRevIter_Type
PyLongRangeIter_Type
PyMap_Type
PyMemberDescr_Type
PyMemoryView_Type
PyMethodDescr_Type
PyModuleDef_Base
PyModuleDef_Type
PyOS_InterruptOccurred()
PyOS_mystricmp()
PyOS_mystrnicmp()
PyRangeIter_Type
PyRange_Type
PyReversed_Type
PySequence_In()
PySetIter_Type
PySuper_Type
PyThread_GetInfo()
PyThread_acquire_lock()
PyThread_acquire_lock_timed()
PyThread_allocate_lock()
PyThread_exit_thread()
PyThread_free_lock()
PyThread_get_stacksize()
PyThread_get_thread_ident()
PyThread_get_thread_native_id()
PyThread_init_thread()
PyThread_release_lock()
PyThread_set_stacksize()
PyThread_start_new_thread()
PyTraceBack_Here()
PyTraceBack_Print()
PyTraceBack_Type
PyTupleIter_Type
PyUnicode_Append()
PyUnicode_AppendAndDel()
PyUnicode_AsDecodedObject()
PyUnicode_AsDecodedUnicode()
PyUnicode_AsEncodedObject()
PyUnicode_AsEncodedUnicode()
PyUnicode_Resize()
PyVarObject.ob_base
PyWeakReference
PyWrapperDescr_Type
PyZip_Type
Py_FileSystemDefaultEncodeErrors
Py_FileSystemDefaultEncoding
Py_GetRecursionLimit()
Py_HasFileSystemDefaultEncoding
Py_MakePendingCalls()
Py_SetRecursionLimit()
Py_UTF8Mode
Py_intptr_t
Py_uintptr_t
ssizessizeargfunc
ssizessizeobjargproc
symtable