importlib
— The implementation ofimport
¶
Added in version 3.1.
Source code:Lib/importlib/__init__.py
Introduction¶
The purpose of theimportlib
package is three-fold.
One is to provide theimplementation of theimport
statement (and thus, by extension, the__import__()
function) in Python source code. This provides animplementation ofimport
which is portable to any Pythoninterpreter. This also provides an implementation which is easier tocomprehend than one implemented in a programming language other than Python.
Two, the components to implementimport
are exposed in thispackage, making it easier for users to create their own custom objects (knowngenerically as animporter) to participate in the import process.
Three, the package contains modules exposing additional functionality formanaging aspects of Python packages:
importlib.metadata
presents access to metadata from third-partydistributions.importlib.resources
provides routines for accessing non-code“resources” from Python packages.
See also
- The import statement
The language reference for the
import
statement.- Packages specification
Original specification of packages. Some semantics have changed sincethe writing of this document (e.g. redirecting based on
None
insys.modules
).- The
__import__()
function The
import
statement is syntactic sugar for this function.- The initialization of the sys.path module search path
The initialization of
sys.path
.- PEP 235
Import on Case-Insensitive Platforms
- PEP 263
Defining Python Source Code Encodings
- PEP 302
New Import Hooks
- PEP 328
Imports: Multi-Line and Absolute/Relative
- PEP 366
Main module explicit relative imports
- PEP 420
Implicit namespace packages
- PEP 451
A ModuleSpec Type for the Import System
- PEP 488
Elimination of PYO files
- PEP 489
Multi-phase extension module initialization
- PEP 552
Deterministic pycs
- PEP 3120
Using UTF-8 as the Default Source Encoding
- PEP 3147
PYC Repository Directories
Functions¶
- importlib.__import__(name,globals=None,locals=None,fromlist=(),level=0)¶
An implementation of the built-in
__import__()
function.Note
Programmatic importing of modules should use
import_module()
instead of this function.
- importlib.import_module(name,package=None)¶
Import a module. Thename argument specifies what module toimport in absolute or relative terms(e.g. either
pkg.mod
or..mod
). If the name isspecified in relative terms, then thepackage argument must be set tothe name of the package which is to act as the anchor for resolving thepackage name (e.g.import_module('..mod','pkg.subpkg')
will importpkg.mod
).The
import_module()
function acts as a simplifying wrapper aroundimportlib.__import__()
. This means all semantics of the function arederived fromimportlib.__import__()
. The most important differencebetween these two functions is thatimport_module()
returns thespecified package or module (e.g.pkg.mod
), while__import__()
returns the top-level package or module (e.g.pkg
).If you are dynamically importing a module that was created since theinterpreter began execution (e.g., created a Python source file), you mayneed to call
invalidate_caches()
in order for the new module to benoticed by the import system.Changed in version 3.3:Parent packages are automatically imported.
- importlib.invalidate_caches()¶
Invalidate the internal caches of finders stored at
sys.meta_path
. If a finder implementsinvalidate_caches()
then itwill be called to perform the invalidation. This function should be calledif any modules are created/installed while your program is running toguarantee all finders will notice the new module’s existence.Added in version 3.3.
Changed in version 3.10:Namespace packages created/installed in a different
sys.path
location after the same namespace was already imported are noticed.
- importlib.reload(module)¶
Reload a previously importedmodule. The argument must be a module object,so it must have been successfully imported before. This is useful if youhave edited the module source file using an external editor and want to tryout the new version without leaving the Python interpreter. The return valueis the module object (which can be different if re-importing causes adifferent object to be placed in
sys.modules
).When
reload()
is executed:Python module’s code is recompiled and the module-level code re-executed,defining a new set of objects which are bound to names in the module’sdictionary by reusing theloader which originally loaded themodule. The
init
function of extension modules is not called a secondtime.As with all other objects in Python the old objects are only reclaimedafter their reference counts drop to zero.
The names in the module namespace are updated to point to any new orchanged objects.
Other references to the old objects (such as names external to the module) arenot rebound to refer to the new objects and must be updated in each namespacewhere they occur if that is desired.
There are a number of other caveats:
When a module is reloaded, its dictionary (containing the module’s globalvariables) is retained. Redefinitions of names will override the olddefinitions, so this is generally not a problem. If the new version of amodule does not define a name that was defined by the old version, the olddefinition remains. This feature can be used to the module’s advantage if itmaintains a global table or cache of objects — with a
try
statement it can test for the table’s presence and skip its initialization ifdesired:try:cacheexceptNameError:cache={}
It is generally not very useful to reload built-in or dynamically loadedmodules. Reloading
sys
,__main__
,builtins
and otherkey modules is not recommended. In many cases extension modules are notdesigned to be initialized more than once, and may fail in arbitrary wayswhen reloaded.If a module imports objects from another module using
from
…import
…, callingreload()
for the other module does notredefine the objects imported from it — one way around this is tore-execute thefrom
statement, another is to useimport
and qualified names (module.name) instead.If a module instantiates instances of a class, reloading the module thatdefines the class does not affect the method definitions of the instances —they continue to use the old class definition. The same is true for derivedclasses.
Added in version 3.4.
Changed in version 3.7:
ModuleNotFoundError
is raised when the module being reloaded lacksaModuleSpec
.
importlib.abc
– Abstract base classes related to import¶
Source code:Lib/importlib/abc.py
Theimportlib.abc
module contains all of the core abstract base classesused byimport
. Some subclasses of the core abstract base classesare also provided to help in implementing the core ABCs.
ABC hierarchy:
object+--MetaPathFinder+--PathEntryFinder+--Loader+--ResourceLoader--------++--InspectLoader|+--ExecutionLoader--++--FileLoader+--SourceLoader
- classimportlib.abc.MetaPathFinder¶
An abstract base class representing ameta path finder.
Added in version 3.3.
Changed in version 3.10:No longer a subclass of
Finder
.- find_spec(fullname,path,target=None)¶
An abstract method for finding aspec forthe specified module. If this is a top-level import,path willbe
None
. Otherwise, this is a search for a subpackage ormodule andpath will be the value of__path__
from theparent package. If a spec cannot be found,None
is returned.When passed in,target
is a module object that the finder mayuse to make a more educated guess about what spec to return.importlib.util.spec_from_loader()
may be useful for implementingconcreteMetaPathFinders
.Added in version 3.4.
- invalidate_caches()¶
An optional method which, when called, should invalidate any internalcache used by the finder. Used by
importlib.invalidate_caches()
when invalidating the caches of all finders onsys.meta_path
.Changed in version 3.4:Returns
None
when called instead ofNotImplemented
.
- classimportlib.abc.PathEntryFinder¶
An abstract base class representing apath entry finder. Thoughit bears some similarities to
MetaPathFinder
,PathEntryFinder
is meant for use only within the path-based import subsystem providedbyimportlib.machinery.PathFinder
.Added in version 3.3.
Changed in version 3.10:No longer a subclass of
Finder
.- find_spec(fullname,target=None)¶
An abstract method for finding aspec forthe specified module. The finder will search for the module onlywithin thepath entry to which it is assigned. If a speccannot be found,
None
is returned. When passed in,target
is a module object that the finder may use to make a more educatedguess about what spec to return.importlib.util.spec_from_loader()
may be useful for implementing concretePathEntryFinders
.Added in version 3.4.
- invalidate_caches()¶
An optional method which, when called, should invalidate any internalcache used by the finder. Used by
importlib.machinery.PathFinder.invalidate_caches()
when invalidating the caches of all cached finders.
- classimportlib.abc.Loader¶
An abstract base class for aloader.SeePEP 302 for the exact definition for a loader.
Loaders that wish to support resource reading should implement a
get_resource_reader()
method as specified byimportlib.resources.abc.ResourceReader
.Changed in version 3.7:Introduced the optional
get_resource_reader()
method.- create_module(spec)¶
A method that returns the module object to use whenimporting a module. This method may return
None
,indicating that default module creation semantics should take place.Added in version 3.4.
Changed in version 3.6:This method is no longer optional when
exec_module()
is defined.
- exec_module(module)¶
An abstract method that executes the module in its own namespacewhen a module is imported or reloaded. The module should alreadybe initialized when
exec_module()
is called. When this method exists,create_module()
must be defined.Added in version 3.4.
Changed in version 3.6:
create_module()
must also be defined.
- load_module(fullname)¶
A legacy method for loading a module. If the module cannot beloaded,
ImportError
is raised, otherwise the loaded module isreturned.If the requested module already exists in
sys.modules
, thatmodule should be used and reloaded.Otherwise the loader should create a new module and insert it intosys.modules
before any loading begins, to prevent recursionfrom the import. If the loader inserted a module and the load fails, itmust be removed by the loader fromsys.modules
; modules alreadyinsys.modules
before the loader began execution should be leftalone.The loader should set several attributes on the module(note that some of these attributes can change when a module isreloaded):
module.__cached__
(deprecated)module.__package__
(deprecated)module.__loader__
(deprecated)
When
exec_module()
is available then backwards-compatiblefunctionality is provided.Changed in version 3.4:Raise
ImportError
when called instead ofNotImplementedError
. Functionality provided whenexec_module()
is available.Deprecated since version 3.4, will be removed in version 3.15:The recommended API for loading a module is
exec_module()
(andcreate_module()
). Loaders should implement it instead ofload_module()
. The import machinery takes care of all theother responsibilities ofload_module()
whenexec_module()
is implemented.
- classimportlib.abc.ResourceLoader¶
Superseded by TraversableResources
An abstract base class for aloader which implements the optionalPEP 302 protocol for loading arbitrary resources from the storageback-end.
Deprecated since version 3.7:This ABC is deprecated in favour of supporting resource loadingthrough
importlib.resources.abc.TraversableResources
.- abstractmethodget_data(path)¶
An abstract method to return the bytes for the data located atpath.Loaders that have a file-like storage back-endthat allows storing arbitrary datacan implement this abstract method to give direct accessto the data stored.
OSError
is to be raised if thepath cannotbe found. Thepath is expected to be constructed using a module’s__file__
attribute or an item from a package’s__path__
.Changed in version 3.4:Raises
OSError
instead ofNotImplementedError
.
- classimportlib.abc.InspectLoader¶
An abstract base class for aloader which implements the optionalPEP 302 protocol for loaders that inspect modules.
- get_code(fullname)¶
Return the code object for a module, or
None
if the module does nothave a code object (as would be the case, for example, for a built-inmodule). Raise anImportError
if loader cannot find therequested module.Note
While the method has a default implementation, it is suggested thatit be overridden if possible for performance.
Changed in version 3.4:No longer abstract and a concrete implementation is provided.
- abstractmethodget_source(fullname)¶
An abstract method to return the source of a module. It is returned asa text string usinguniversal newlines, translating allrecognized line separators into
'\n'
characters. ReturnsNone
if no source is available (e.g. a built-in module). RaisesImportError
if the loader cannot find the module specified.Changed in version 3.4:Raises
ImportError
instead ofNotImplementedError
.
- is_package(fullname)¶
An optional method to return a true value if the module is a package, afalse value otherwise.
ImportError
is raised if theloader cannot find the module.Changed in version 3.4:Raises
ImportError
instead ofNotImplementedError
.
- staticsource_to_code(data,path='<string>')¶
Create a code object from Python source.
Thedata argument can be whatever the
compile()
functionsupports (i.e. string or bytes). Thepath argument should bethe “path” to where the source code originated from, which can be anabstract concept (e.g. location in a zip file).With the subsequent code object one can execute it in a module byrunning
exec(code,module.__dict__)
.Added in version 3.4.
Changed in version 3.5:Made the method static.
- exec_module(module)¶
Implementation of
Loader.exec_module()
.Added in version 3.4.
- load_module(fullname)¶
Implementation of
Loader.load_module()
.Deprecated since version 3.4, will be removed in version 3.15:use
exec_module()
instead.
- classimportlib.abc.ExecutionLoader¶
An abstract base class which inherits from
InspectLoader
that,when implemented, helps a module to be executed as a script. The ABCrepresents an optionalPEP 302 protocol.- abstractmethodget_filename(fullname)¶
An abstract method that is to return the value of
__file__
for the specified module. If no path isavailable,ImportError
is raised.If source code is available, then the method should return the path tothe source file, regardless of whether a bytecode was used to load themodule.
Changed in version 3.4:Raises
ImportError
instead ofNotImplementedError
.
- classimportlib.abc.FileLoader(fullname,path)¶
An abstract base class which inherits from
ResourceLoader
andExecutionLoader
, providing concrete implementations ofResourceLoader.get_data()
andExecutionLoader.get_filename()
.Thefullname argument is a fully resolved name of the module the loader isto handle. Thepath argument is the path to the file for the module.
Added in version 3.3.
- name¶
The name of the module the loader can handle.
- path¶
Path to the file of the module.
- load_module(fullname)¶
Calls super’s
load_module()
.Deprecated since version 3.4, will be removed in version 3.15:Use
Loader.exec_module()
instead.
- abstractmethodget_data(path)¶
Readspath as a binary file and returns the bytes from it.
- classimportlib.abc.SourceLoader¶
An abstract base class for implementing source (and optionally bytecode)file loading. The class inherits from both
ResourceLoader
andExecutionLoader
, requiring the implementation of:ExecutionLoader.get_filename()
Should only return the path to the source file; sourcelessloading is not supported.
The abstract methods defined by this class are to add optional bytecodefile support. Not implementing these optional methods (or causing them toraise
NotImplementedError
) causes the loader toonly work with source code. Implementing the methods allows the loader towork with sourceand bytecode files; it does not allow forsourcelessloading where only bytecode is provided. Bytecode files are anoptimization to speed up loading by removing the parsing step of Python’scompiler, and so no bytecode-specific API is exposed.- path_stats(path)¶
Optional abstract method which returns a
dict
containingmetadata about the specified path. Supported dictionary keys are:'mtime'
(mandatory): an integer or floating-point numberrepresenting the modification time of the source code;'size'
(optional): the size in bytes of the source code.
Any other keys in the dictionary are ignored, to allow for futureextensions. If the path cannot be handled,
OSError
is raised.Added in version 3.3.
Changed in version 3.4:Raise
OSError
instead ofNotImplementedError
.
- path_mtime(path)¶
Optional abstract method which returns the modification time for thespecified path.
Deprecated since version 3.3:This method is deprecated in favour of
path_stats()
. You don’thave to implement it, but it is still available for compatibilitypurposes. RaiseOSError
if the path cannot be handled.Changed in version 3.4:Raise
OSError
instead ofNotImplementedError
.
- set_data(path,data)¶
Optional abstract method which writes the specified bytes to a filepath. Any intermediate directories which do not exist are to be createdautomatically.
When writing to the path fails because the path is read-only(
errno.EACCES
/PermissionError
), do not propagate theexception.Changed in version 3.4:No longer raises
NotImplementedError
when called.
- get_code(fullname)¶
Concrete implementation of
InspectLoader.get_code()
.
- exec_module(module)¶
Concrete implementation of
Loader.exec_module()
.Added in version 3.4.
- load_module(fullname)¶
Concrete implementation of
Loader.load_module()
.Deprecated since version 3.4, will be removed in version 3.15:Use
exec_module()
instead.
- get_source(fullname)¶
Concrete implementation of
InspectLoader.get_source()
.
- is_package(fullname)¶
Concrete implementation of
InspectLoader.is_package()
. A moduleis determined to be a package if its file path (as provided byExecutionLoader.get_filename()
) is a file named__init__
when the file extension is removedand the module nameitself does not end in__init__
.
- classimportlib.abc.ResourceReader¶
Superseded by TraversableResources
Anabstract base class to provide the ability to readresources.
From the perspective of this ABC, aresource is a binaryartifact that is shipped within a package. Typically this issomething like a data file that lives next to the
__init__.py
file of the package. The purpose of this class is to help abstractout the accessing of such data files so that it does not matter ifthe package and its data file(s) are stored e.g. in a zip fileversus on the file system.For any of methods of this class, aresource argument isexpected to be apath-like object which representsconceptually just a file name. This means that no subdirectorypaths should be included in theresource argument. This isbecause the location of the package the reader is for, acts as the“directory”. Hence the metaphor for directories and filenames is packages and resources, respectively. This is also whyinstances of this class are expected to directly correlate toa specific package (instead of potentially representing multiplepackages or a module).
Loaders that wish to support resource reading are expected toprovide a method called
get_resource_reader(fullname)
whichreturns an object implementing this ABC’s interface. If the modulespecified by fullname is not a package, this method should returnNone
. An object compatible with this ABC should only bereturned when the specified module is a package.Added in version 3.7.
Deprecated since version 3.12, will be removed in version 3.14:Use
importlib.resources.abc.TraversableResources
instead.- abstractmethodopen_resource(resource)¶
Returns an opened,file-like object for binary readingof theresource.
If the resource cannot be found,
FileNotFoundError
israised.
- abstractmethodresource_path(resource)¶
Returns the file system path to theresource.
If the resource does not concretely exist on the file system,raise
FileNotFoundError
.
- abstractmethodis_resource(name)¶
Returns
True
if the namedname is considered a resource.FileNotFoundError
is raised ifname does not exist.
- abstractmethodcontents()¶
Returns aniterable of strings over the contents ofthe package. Do note that it is not required that all namesreturned by the iterator be actual resources, e.g. it isacceptable to return names for which
is_resource()
wouldbe false.Allowing non-resource names to be returned is to allow forsituations where how a package and its resources are storedare known a priori and the non-resource names would be useful.For instance, returning subdirectory names is allowed so thatwhen it is known that the package and resources are stored onthe file system then those subdirectory names can be useddirectly.
The abstract method returns an iterable of no items.
- classimportlib.abc.Traversable¶
An object with a subset of
pathlib.Path
methods suitable fortraversing directories and opening files.For a representation of the object on the file-system, use
importlib.resources.as_file()
.Added in version 3.9.
Deprecated since version 3.12, will be removed in version 3.14:Use
importlib.resources.abc.Traversable
instead.- name¶
Abstract. The base name of this object without any parent references.
- abstractmethoditerdir()¶
Yield
Traversable
objects inself
.
- abstractmethodis_dir()¶
Return
True
ifself
is a directory.
- abstractmethodis_file()¶
Return
True
ifself
is a file.
- abstractmethodjoinpath(child)¶
Return Traversable child in
self
.
- abstractmethod__truediv__(child)¶
Return
Traversable
child inself
.
- abstractmethodopen(mode='r',*args,**kwargs)¶
mode may be ‘r’ or ‘rb’ to open as text or binary. Return a handlesuitable for reading (same as
pathlib.Path.open
).When opening as text, accepts encoding parameters such as thoseaccepted by
io.TextIOWrapper
.
- read_bytes()¶
Read contents of
self
as bytes.
- read_text(encoding=None)¶
Read contents of
self
as text.
- classimportlib.abc.TraversableResources¶
An abstract base class for resource readers capable of servingthe
importlib.resources.files()
interface. Subclassesimportlib.resources.abc.ResourceReader
and providesconcrete implementations of theimportlib.resources.abc.ResourceReader
’sabstract methods. Therefore, any loader supplyingimportlib.abc.TraversableResources
also supplies ResourceReader.Loaders that wish to support resource reading are expected toimplement this interface.
Added in version 3.9.
Deprecated since version 3.12, will be removed in version 3.14:Use
importlib.resources.abc.TraversableResources
instead.- abstractmethodfiles()¶
Returns a
importlib.resources.abc.Traversable
object for the loadedpackage.
importlib.machinery
– Importers and path hooks¶
Source code:Lib/importlib/machinery.py
This module contains the various objects that helpimport
find and load modules.
- importlib.machinery.SOURCE_SUFFIXES¶
A list of strings representing the recognized file suffixes for sourcemodules.
Added in version 3.3.
- importlib.machinery.DEBUG_BYTECODE_SUFFIXES¶
A list of strings representing the file suffixes for non-optimized bytecodemodules.
Added in version 3.3.
Deprecated since version 3.5:Use
BYTECODE_SUFFIXES
instead.
- importlib.machinery.OPTIMIZED_BYTECODE_SUFFIXES¶
A list of strings representing the file suffixes for optimized bytecodemodules.
Added in version 3.3.
Deprecated since version 3.5:Use
BYTECODE_SUFFIXES
instead.
- importlib.machinery.BYTECODE_SUFFIXES¶
A list of strings representing the recognized file suffixes for bytecodemodules (including the leading dot).
Added in version 3.3.
Changed in version 3.5:The value is no longer dependent on
__debug__
.
- importlib.machinery.EXTENSION_SUFFIXES¶
A list of strings representing the recognized file suffixes forextension modules.
Added in version 3.3.
- importlib.machinery.all_suffixes()¶
Returns a combined list of strings representing all file suffixes formodules recognized by the standard import machinery. This is ahelper for code which simply needs to know if a filesystem pathpotentially refers to a module without needing any details on the kindof module (for example,
inspect.getmodulename()
).Added in version 3.3.
- classimportlib.machinery.BuiltinImporter¶
Animporter for built-in modules. All known built-in modules arelisted in
sys.builtin_module_names
. This class implements theimportlib.abc.MetaPathFinder
andimportlib.abc.InspectLoader
ABCs.Only class methods are defined by this class to alleviate the need forinstantiation.
Changed in version 3.5:As part ofPEP 489, the builtin importer now implements
Loader.create_module()
andLoader.exec_module()
- classimportlib.machinery.FrozenImporter¶
Animporter for frozen modules. This class implements the
importlib.abc.MetaPathFinder
andimportlib.abc.InspectLoader
ABCs.Only class methods are defined by this class to alleviate the need forinstantiation.
Changed in version 3.4:Gained
create_module()
andexec_module()
methods.
- classimportlib.machinery.WindowsRegistryFinder¶
Finder for modules declared in the Windows registry. This classimplements the
importlib.abc.MetaPathFinder
ABC.Only class methods are defined by this class to alleviate the need forinstantiation.
Added in version 3.3.
Deprecated since version 3.6:Use
site
configuration instead. Future versions of Python maynot enable this finder by default.
- classimportlib.machinery.PathFinder¶
AFinder for
sys.path
and package__path__
attributes.This class implements theimportlib.abc.MetaPathFinder
ABC.Only class methods are defined by this class to alleviate the need forinstantiation.
- classmethodfind_spec(fullname,path=None,target=None)¶
Class method that attempts to find aspecfor the module specified byfullname on
sys.path
or, ifdefined, onpath. For each path entry that is searched,sys.path_importer_cache
is checked. If a non-false objectis found then it is used as thepath entry finder to lookfor the module being searched for. If no entry is found insys.path_importer_cache
, thensys.path_hooks
issearched for a finder for the path entry and, if found, is storedinsys.path_importer_cache
along with being queried aboutthe module. If no finder is ever found thenNone
is bothstored in the cache and returned.Added in version 3.4.
Changed in version 3.5:If the current working directory – represented by an empty string –is no longer valid then
None
is returned but no value is cachedinsys.path_importer_cache
.
- classmethodinvalidate_caches()¶
Calls
importlib.abc.PathEntryFinder.invalidate_caches()
on allfinders stored insys.path_importer_cache
that define the method.Otherwise entries insys.path_importer_cache
set toNone
aredeleted.Changed in version 3.7:Entries of
None
insys.path_importer_cache
are deleted.
Changed in version 3.4:Calls objects in
sys.path_hooks
with the current workingdirectory for''
(i.e. the empty string).
- classimportlib.machinery.FileFinder(path,*loader_details)¶
A concrete implementation of
importlib.abc.PathEntryFinder
whichcaches results from the file system.Thepath argument is the directory for which the finder is in charge ofsearching.
Theloader_details argument is a variable number of 2-item tuples eachcontaining a loader and a sequence of file suffixes the loader recognizes.The loaders are expected to be callables which accept two arguments ofthe module’s name and the path to the file found.
The finder will cache the directory contents as necessary, making stat callsfor each module search to verify the cache is not outdated. Because cachestaleness relies upon the granularity of the operating system’s stateinformation of the file system, there is a potential race condition ofsearching for a module, creating a new file, and then searching for themodule the new file represents. If the operations happen fast enough to fitwithin the granularity of stat calls, then the module search will fail. Toprevent this from happening, when you create a module dynamically, make sureto call
importlib.invalidate_caches()
.Added in version 3.3.
- path¶
The path the finder will search in.
- find_spec(fullname,target=None)¶
Attempt to find the spec to handlefullname within
path
.Added in version 3.4.
- invalidate_caches()¶
Clear out the internal cache.
- classmethodpath_hook(*loader_details)¶
A class method which returns a closure for use on
sys.path_hooks
.An instance ofFileFinder
is returned by the closure using thepath argument given to the closure directly andloader_detailsindirectly.If the argument to the closure is not an existing directory,
ImportError
is raised.
- classimportlib.machinery.SourceFileLoader(fullname,path)¶
A concrete implementation of
importlib.abc.SourceLoader
bysubclassingimportlib.abc.FileLoader
and providing some concreteimplementations of other methods.Added in version 3.3.
- name¶
The name of the module that this loader will handle.
- path¶
The path to the source file.
- path_stats(path)¶
Concrete implementation of
importlib.abc.SourceLoader.path_stats()
.
- set_data(path,data)¶
Concrete implementation of
importlib.abc.SourceLoader.set_data()
.
- load_module(name=None)¶
Concrete implementation of
importlib.abc.Loader.load_module()
wherespecifying the name of the module to load is optional.Deprecated since version 3.6, will be removed in version 3.15:Use
importlib.abc.Loader.exec_module()
instead.
- classimportlib.machinery.SourcelessFileLoader(fullname,path)¶
A concrete implementation of
importlib.abc.FileLoader
which canimport bytecode files (i.e. no source code files exist).Please note that direct use of bytecode files (and thus not source codefiles) inhibits your modules from being usable by all Pythonimplementations or new versions of Python which change the bytecodeformat.
Added in version 3.3.
- name¶
The name of the module the loader will handle.
- path¶
The path to the bytecode file.
- get_source(fullname)¶
Returns
None
as bytecode files have no source when this loader isused.
- load_module(name=None)¶
Concrete implementation of
importlib.abc.Loader.load_module()
wherespecifying the name of the module to load is optional.Deprecated since version 3.6, will be removed in version 3.15:Use
importlib.abc.Loader.exec_module()
instead.
- classimportlib.machinery.ExtensionFileLoader(fullname,path)¶
A concrete implementation of
importlib.abc.ExecutionLoader
forextension modules.Thefullname argument specifies the name of the module the loader is tosupport. Thepath argument is the path to the extension module’s file.
Note that, by default, importing an extension module will failin subinterpreters if it doesn’t implement multi-phase init(seePEP 489), even if it would otherwise import successfully.
Added in version 3.3.
Changed in version 3.12:Multi-phase init is now required for use in subinterpreters.
- name¶
Name of the module the loader supports.
- path¶
Path to the extension module.
- create_module(spec)¶
Creates the module object from the given specification in accordancewithPEP 489.
Added in version 3.5.
- exec_module(module)¶
Initializes the given module object in accordance withPEP 489.
Added in version 3.5.
- is_package(fullname)¶
Returns
True
if the file path points to a package’s__init__
module based onEXTENSION_SUFFIXES
.
- get_code(fullname)¶
Returns
None
as extension modules lack a code object.
- get_source(fullname)¶
Returns
None
as extension modules do not have source code.
- classimportlib.machinery.NamespaceLoader(name,path,path_finder)¶
A concrete implementation of
importlib.abc.InspectLoader
fornamespace packages. This is an alias for a private class and is only madepublic for introspecting the__loader__
attribute on namespacepackages:>>>fromimportlib.machineryimportNamespaceLoader>>>importmy_namespace>>>isinstance(my_namespace.__loader__,NamespaceLoader)True>>>importimportlib.abc>>>isinstance(my_namespace.__loader__,importlib.abc.Loader)True
Added in version 3.11.
- classimportlib.machinery.ModuleSpec(name,loader,*,origin=None,loader_state=None,is_package=None)¶
A specification for a module’s import-system-related state. This istypically exposed as the module’s
__spec__
attribute. Manyof these attributes are also available directly on a module: for example,module.__spec__.origin==module.__file__
. Note, however, thatwhile thevalues are usually equivalent, they can differ since there isno synchronization between the two objects. For example, it is possible toupdate the module’s__file__
at runtime and this will not beautomatically reflected in the module’s__spec__.origin
, and vice versa.Added in version 3.4.
- name¶
The module’s fully qualified name (see
module.__name__
).Thefinder should always set this attribute to a non-empty string.
- loader¶
Theloader used to load the module (see
module.__loader__
).Thefinder should always set this attribute.
- origin¶
The location theloader should use to load the module(see
module.__file__
).For example, for modules loaded from a.py
file this is the filename.Thefinder should always set this attribute to a meaningful valuefor theloader to use. In the uncommon case that there is not one(like for namespace packages), it should be set toNone
.
- submodule_search_locations¶
A (possibly empty)sequence of strings enumerating the locationsin which a package’s submodules will be found(see
module.__path__
). Most of the time there will only be asingle directory in this list.Thefinder should set this attribute to a sequence, even an emptyone, to indicateto the import system that the module is a package. It should be set to
None
fornon-package modules. It is set automatically later to a special object fornamespace packages.
- loader_state¶
Thefinder may set this attribute to an object containing additional,module-specific data to use when loading the module. Otherwise it should beset to
None
.
- cached¶
The filename of a compiled version of the module’s code(see
module.__cached__
).Thefinder should always set this attribute but it may beNone
for modules that do not need compiled code stored.
- parent¶
(Read-only) The fully qualified name of the package the module is in (or theempty string for a top-level module).See
module.__package__
.If the module is a package then this is the same asname
.
- classimportlib.machinery.AppleFrameworkLoader(name,path)¶
A specialization of
importlib.machinery.ExtensionFileLoader
thatis able to load extension modules in Framework format.For compatibility with the iOS App Store,all binary modules in an iOS appmust be dynamic libraries, contained in a framework with appropriatemetadata, stored in the
Frameworks
folder of the packaged app. There canbe only a single binary per framework, and there can be no executable binarymaterial outside the Frameworks folder.To accommodate this requirement, when running on iOS, extension modulebinaries arenot packaged as
.so
files onsys.path
, but asindividual standalone frameworks. To discover those frameworks, this loaderis be registered against the.fwork
file extension, with a.fwork
file acting as a placeholder in the original location of the binary onsys.path
. The.fwork
file contains the path of the actual binary intheFrameworks
folder, relative to the app bundle. To allow forresolving a framework-packaged binary back to the original location, theframework is expected to contain a.origin
file that contains thelocation of the.fwork
file, relative to the app bundle.For example, consider the case of an import
fromfoo.barimport_whiz
,where_whiz
is implemented with the binary modulesources/foo/bar/_whiz.abi3.so
, withsources
being the locationregistered onsys.path
, relative to the application bundle. This modulemust be distributed asFrameworks/foo.bar._whiz.framework/foo.bar._whiz
(creating the frameworkname from the full import path of the module), with anInfo.plist
filein the.framework
directory identifying the binary as a framework. Thefoo.bar._whiz
module would be represented in the original location withasources/foo/bar/_whiz.abi3.fwork
marker file, containing the pathFrameworks/foo.bar._whiz/foo.bar._whiz
. The framework would also containFrameworks/foo.bar._whiz.framework/foo.bar._whiz.origin
, containing thepath to the.fwork
file.When a module is loaded with this loader, the
__file__
for the modulewill report as the location of the.fwork
file. This allows code to usethe__file__
of a module as an anchor for file system traveral.However, the spec origin will reference the location of theactual binaryin the.framework
folder.The Xcode project building the app is responsible for converting any
.so
files from wherever they exist in thePYTHONPATH
into frameworks in theFrameworks
folder (including stripping extensions from the module file,the addition of framework metadata, and signing the resulting framework),and creating the.fwork
and.origin
files. This will usually be donewith a build step in the Xcode project; see the iOS documentation fordetails on how to construct this build step.Added in version 3.13.
Availability: iOS.
- name¶
Name of the module the loader supports.
- path¶
Path to the
.fwork
file for the extension module.
importlib.util
– Utility code for importers¶
Source code:Lib/importlib/util.py
This module contains the various objects that help in the construction ofanimporter.
- importlib.util.MAGIC_NUMBER¶
The bytes which represent the bytecode version number. If you need help withloading/writing bytecode then consider
importlib.abc.SourceLoader
.Added in version 3.4.
- importlib.util.cache_from_source(path,debug_override=None,*,optimization=None)¶
Return thePEP 3147/PEP 488 path to the byte-compiled file associatedwith the sourcepath. For example, ifpath is
/foo/bar/baz.py
the returnvalue would be/foo/bar/__pycache__/baz.cpython-32.pyc
for Python 3.2.Thecpython-32
string comes from the current magic tag (seeget_tag()
; ifsys.implementation.cache_tag
is not defined thenNotImplementedError
will be raised).Theoptimization parameter is used to specify the optimization level of thebytecode file. An empty string represents no optimization, so
/foo/bar/baz.py
with anoptimization of''
will result in abytecode path of/foo/bar/__pycache__/baz.cpython-32.pyc
.None
causesthe interpreter’s optimization level to be used. Any other value’s stringrepresentation is used, so/foo/bar/baz.py
with anoptimization of2
will lead to the bytecode path of/foo/bar/__pycache__/baz.cpython-32.opt-2.pyc
. The string representationofoptimization can only be alphanumeric, elseValueError
is raised.Thedebug_override parameter is deprecated and can be used to overridethe system’s value for
__debug__
. ATrue
value is the equivalent ofsettingoptimization to the empty string. AFalse
value is the same assettingoptimization to1
. If bothdebug_override anoptimizationare notNone
thenTypeError
is raised.Added in version 3.4.
Changed in version 3.5:Theoptimization parameter was added and thedebug_override parameterwas deprecated.
Changed in version 3.6:Accepts apath-like object.
- importlib.util.source_from_cache(path)¶
Given thepath to aPEP 3147 file name, return the associated source codefile path. For example, ifpath is
/foo/bar/__pycache__/baz.cpython-32.pyc
the returned path would be/foo/bar/baz.py
.path need not exist, however if it does not conformtoPEP 3147 orPEP 488 format, aValueError
is raised. Ifsys.implementation.cache_tag
is not defined,NotImplementedError
is raised.Added in version 3.4.
Changed in version 3.6:Accepts apath-like object.
- importlib.util.decode_source(source_bytes)¶
Decode the given bytes representing source code and return it as a stringwith universal newlines (as required by
importlib.abc.InspectLoader.get_source()
).Added in version 3.4.
- importlib.util.resolve_name(name,package)¶
Resolve a relative module name to an absolute one.
Ifname has no leading dots, thenname is simply returned. Thisallows for usage such as
importlib.util.resolve_name('sys',__spec__.parent)
without doing acheck to see if thepackage argument is needed.ImportError
is raised ifname is a relative module name butpackage is a false value (e.g.None
or the empty string).ImportError
is also raised if a relative name would escape itscontaining package (e.g. requesting..bacon
from within thespam
package).Added in version 3.3.
Changed in version 3.9:To improve consistency with import statements, raise
ImportError
instead ofValueError
for invalid relativeimport attempts.
- importlib.util.find_spec(name,package=None)¶
Find thespec for a module, optionally relative tothe specifiedpackage name. If the module is in
sys.modules
,thensys.modules[name].__spec__
is returned (unless the spec would beNone
or is not set, in which caseValueError
is raised).Otherwise a search usingsys.meta_path
is done.None
isreturned if no spec is found.Ifname is for a submodule (contains a dot), the parent module isautomatically imported.
name andpackage work the same as for
import_module()
.Added in version 3.4.
Changed in version 3.7:Raises
ModuleNotFoundError
instead ofAttributeError
ifpackage is in fact not a package (i.e. lacks a__path__
attribute).
- importlib.util.module_from_spec(spec)¶
Create a new module based onspec and
spec.loader.create_module
.If
spec.loader.create_module
does not returnNone
, then any pre-existing attributes will not be reset.Also, noAttributeError
will be raised if triggered while accessingspec or setting an attribute on the module.This function is preferred over using
types.ModuleType
to create anew module asspec is used to set as many import-controlled attributes onthe module as possible.Added in version 3.5.
- importlib.util.spec_from_loader(name,loader,*,origin=None,is_package=None)¶
A factory function for creating a
ModuleSpec
instance based on a loader. The parameters have the same meaning as they dofor ModuleSpec. The function uses availableloader APIs, such asInspectLoader.is_package()
, to fill in any missinginformation on the spec.Added in version 3.4.
- importlib.util.spec_from_file_location(name,location,*,loader=None,submodule_search_locations=None)¶
A factory function for creating a
ModuleSpec
instance based on the path to a file. Missing information will be filled inon the spec by making use of loader APIs and by the implication that themodule will be file-based.Added in version 3.4.
Changed in version 3.6:Accepts apath-like object.
- importlib.util.source_hash(source_bytes)¶
Return the hash ofsource_bytes as bytes. A hash-based
.pyc
file embedsthesource_hash()
of the corresponding source file’s contents in itsheader.Added in version 3.7.
- importlib.util._incompatible_extension_module_restrictions(*,disable_check)¶
A context manager that can temporarily skip the compatibility checkfor extension modules. By default the check is enabled and will failwhen a single-phase init module is imported in a subinterpreter.It will also fail for a multi-phase init module that doesn’texplicitly support a per-interpreter GIL, when importedin an interpreter with its own GIL.
Note that this function is meant to accommodate an unusual case;one which is likely to eventually go away. There’s is a pretty goodchance this is not what you were looking for.
You can get the same effect as this function by implementing thebasic interface of multi-phase init (PEP 489) and lying aboutsupport for multiple interpreters (or per-interpreter GIL).
Warning
Using this function to disable the check can lead tounexpected behavior and even crashes. It should only be used duringextension module development.
Added in version 3.12.
- classimportlib.util.LazyLoader(loader)¶
A class which postpones the execution of the loader of a module until themodule has an attribute accessed.
This classonly works with loaders that define
exec_module()
as control over what module typeis used for the module is required. For those same reasons, the loader’screate_module()
method must returnNone
or atype for which its__class__
attribute can be mutated along with notusingslots. Finally, modules which substitute the objectplaced intosys.modules
will not work as there is no way to properlyreplace the module references throughout the interpreter safely;ValueError
is raised if such a substitution is detected.Note
For projects where startup time is critical, this class allows forpotentially minimizing the cost of loading a module if it is never used.For projects where startup time is not essential then use of this class isheavily discouraged due to error messages created during loading beingpostponed and thus occurring out of context.
Added in version 3.5.
Changed in version 3.6:Began calling
create_module()
, removing thecompatibility warning forimportlib.machinery.BuiltinImporter
andimportlib.machinery.ExtensionFileLoader
.- classmethodfactory(loader)¶
A class method which returns a callable that creates a lazy loader. Thisis meant to be used in situations where the loader is passed by classinstead of by instance.
suffixes=importlib.machinery.SOURCE_SUFFIXESloader=importlib.machinery.SourceFileLoaderlazy_loader=importlib.util.LazyLoader.factory(loader)finder=importlib.machinery.FileFinder(path,(lazy_loader,suffixes))
Examples¶
Importing programmatically¶
To programmatically import a module, useimportlib.import_module()
.
importimportlibitertools=importlib.import_module('itertools')
Checking if a module can be imported¶
If you need to find out if a module can be imported without actually doing theimport, then you should useimportlib.util.find_spec()
.
Note that ifname
is a submodule (contains a dot),importlib.util.find_spec()
will import the parent module.
importimportlib.utilimportsys# For illustrative purposes.name='itertools'ifnameinsys.modules:print(f"{name!r} already in sys.modules")elif(spec:=importlib.util.find_spec(name))isnotNone:# If you chose to perform the actual import ...module=importlib.util.module_from_spec(spec)sys.modules[name]=modulespec.loader.exec_module(module)print(f"{name!r} has been imported")else:print(f"can't find the{name!r} module")
Importing a source file directly¶
This recipe should be used with caution: it is an approximation of an importstatement where the file path is specified directly, rather thansys.path
being searched. Alternatives should first be considered first,such as modifyingsys.path
when a proper module is required, or usingrunpy.run_path()
when the global namespace resulting from running a Pythonfile is appropriate.
To import a Python source file directly from a path, use the following recipe:
importimportlib.utilimportsysdefimport_from_path(module_name,file_path):spec=importlib.util.spec_from_file_location(module_name,file_path)module=importlib.util.module_from_spec(spec)sys.modules[module_name]=modulespec.loader.exec_module(module)returnmodule# For illustrative purposes only (use of `json` is arbitrary).importjsonfile_path=json.__file__module_name=json.__name__# Similar outcome as `import json`.json=import_from_path(module_name,file_path)
Implementing lazy imports¶
The example below shows how to implement lazy imports:
>>>importimportlib.util>>>importsys>>>deflazy_import(name):...spec=importlib.util.find_spec(name)...loader=importlib.util.LazyLoader(spec.loader)...spec.loader=loader...module=importlib.util.module_from_spec(spec)...sys.modules[name]=module...loader.exec_module(module)...returnmodule...>>>lazy_typing=lazy_import("typing")>>>#lazy_typing is a real module object,>>>#but it is not loaded in memory yet.>>>lazy_typing.TYPE_CHECKINGFalse
Setting up an importer¶
For deep customizations of import, you typically want to implement animporter. This means managing both thefinder andloaderside of things. For finders there are two flavours to choose from depending onyour needs: ameta path finder or apath entry finder. Theformer is what you would put onsys.meta_path
while the latter is whatyou create using apath entry hook onsys.path_hooks
which workswithsys.path
entries to potentially create a finder. This example willshow you how to register your own importers so that import will use them (forcreating an importer for yourself, read the documentation for the appropriateclasses defined within this package):
importimportlib.machineryimportsys# For illustrative purposes only.SpamMetaPathFinder=importlib.machinery.PathFinderSpamPathEntryFinder=importlib.machinery.FileFinderloader_details=(importlib.machinery.SourceFileLoader,importlib.machinery.SOURCE_SUFFIXES)# Setting up a meta path finder.# Make sure to put the finder in the proper location in the list in terms of# priority.sys.meta_path.append(SpamMetaPathFinder)# Setting up a path entry finder.# Make sure to put the path hook in the proper location in the list in terms# of priority.sys.path_hooks.append(SpamPathEntryFinder.path_hook(loader_details))
Approximatingimportlib.import_module()
¶
Import itself is implemented in Python code, making it possible toexpose most of the import machinery through importlib. The followinghelps illustrate the various APIs that importlib exposes by providing anapproximate implementation ofimportlib.import_module()
:
importimportlib.utilimportsysdefimport_module(name,package=None):"""An approximate implementation of import."""absolute_name=importlib.util.resolve_name(name,package)try:returnsys.modules[absolute_name]exceptKeyError:passpath=Noneif'.'inabsolute_name:parent_name,_,child_name=absolute_name.rpartition('.')parent_module=import_module(parent_name)path=parent_module.__spec__.submodule_search_locationsforfinderinsys.meta_path:spec=finder.find_spec(absolute_name,path)ifspecisnotNone:breakelse:msg=f'No module named{absolute_name!r}'raiseModuleNotFoundError(msg,name=absolute_name)module=importlib.util.module_from_spec(spec)sys.modules[absolute_name]=modulespec.loader.exec_module(module)ifpathisnotNone:setattr(parent_module,child_name,module)returnmodule