Python 3.2 有什麼新功能¶
- 作者:
Raymond Hettinger
This article explains the new features in Python 3.2 as compared to 3.1.Python 3.2 was released on February 20, 2011. Itfocuses on a few highlights and gives a few examples. For full details, see theMisc/NEWSfile.
也參考
PEP 392 - Python 3.2 發佈時程
PEP 384: Defining a Stable ABI¶
In the past, extension modules built for one Python version were oftennot usable with other Python versions. Particularly on Windows, everyfeature release of Python required rebuilding all extension modules thatone wanted to use. This requirement was the result of the free access toPython interpreter internals that extension modules could use.
With Python 3.2, an alternative approach becomes available: extensionmodules which restrict themselves to a limited API (by definingPy_LIMITED_API) cannot use many of the internals, but are constrainedto a set of API functions that are promised to be stable for severalreleases. As a consequence, extension modules built for 3.2 in thatmode will also work with 3.3, 3.4, and so on. Extension modules thatmake use of details of memory structures can still be built, but willneed to be recompiled for every feature release.
也參考
- PEP 384 - 定義一個穩定 ABI
由 Martin von Löwis 撰寫 PEP。
PEP 389: Argparse 命令列剖析模組¶
A new module for command line parsing,argparse
, was introduced toovercome the limitations ofoptparse
which did not provide support forpositional arguments (not just options), subcommands, required options and othercommon patterns of specifying and validating options.
This module has already had widespread success in the community as athird-party module. Being more fully featured than its predecessor, theargparse
module is now the preferred module for command-line processing.The older module is still being kept available because of the substantial amountof legacy code that depends on it.
Here's an annotated example parser showing features like limiting results to aset of choices, specifying ametavar in the help screen, validating that oneor more positional arguments is present, and making a required option:
importargparseparser=argparse.ArgumentParser(description='Manage servers',# main description for helpepilog='Tested on Solaris and Linux')# displayed after helpparser.add_argument('action',# argument namechoices=['deploy','start','stop'],# three allowed valueshelp='action on each target')# help msgparser.add_argument('targets',metavar='HOSTNAME',# var name used in help msgnargs='+',# require one or more targetshelp='url for target machines')# help msg explanationparser.add_argument('-u','--user',# -u or --user optionrequired=True,# make it a required argumenthelp='login as user')
Example of calling the parser on a command string:
>>>cmd='deploy sneezy.example.com sleepy.example.com -u skycaptain'>>>result=parser.parse_args(cmd.split())>>>result.action'deploy'>>>result.targets['sneezy.example.com', 'sleepy.example.com']>>>result.user'skycaptain'
Example of the parser's automatically generated help:
>>>parser.parse_args('-h'.split())usage: manage_cloud.py [-h] -u USER {deploy,start,stop} HOSTNAME [HOSTNAME ...]Manage serverspositional arguments: {deploy,start,stop} action on each target HOSTNAME url for target machinesoptional arguments: -h, --help show this help message and exit -u USER, --user USER login as userTested on Solaris and Linux
An especially niceargparse
feature is the ability to define subparsers,each with their own argument patterns and help displays:
importargparseparser=argparse.ArgumentParser(prog='HELM')subparsers=parser.add_subparsers()parser_l=subparsers.add_parser('launch',help='Launch Control')# first subgroupparser_l.add_argument('-m','--missiles',action='store_true')parser_l.add_argument('-t','--torpedos',action='store_true')parser_m=subparsers.add_parser('move',help='Move Vessel',# second subgroupaliases=('steer','turn'))# equivalent namesparser_m.add_argument('-c','--course',type=int,required=True)parser_m.add_argument('-s','--speed',type=int,default=0)
$./helm.py--help# top level help (launch and move)$./helm.pylaunch--help# help for launch options$./helm.pylaunch--missiles# set missiles=True and torpedos=False$./helm.pysteer--course180--speed5# set movement parameters
也參考
- PEP 389 - 新命令列剖析模組
由 Steven Bethard 撰寫 PEP。
將 optparse 程式碼遷移到 argparse for details on the differences fromoptparse
.
PEP 391: Dictionary Based Configuration for Logging¶
Thelogging
module provided two kinds of configuration, one style withfunction calls for each option or another style driven by an external file savedin aconfigparser
format. Those options did not provide the flexibilityto create configurations from JSON or YAML files, nor did they supportincremental configuration, which is needed for specifying logger options from acommand line.
To support a more flexible style, the module now offerslogging.config.dictConfig()
for specifying logging configuration withplain Python dictionaries. The configuration options include formatters,handlers, filters, and loggers. Here's a working example of a configurationdictionary:
{"version":1,"formatters":{"brief":{"format":"%(levelname)-8s:%(name)-15s:%(message)s"},"full":{"format":"%(asctime)s%(name)-15s%(levelname)-8s%(message)s"}},"handlers":{"console":{"class":"logging.StreamHandler","formatter":"brief","level":"INFO","stream":"ext://sys.stdout"},"console_priority":{"class":"logging.StreamHandler","formatter":"full","level":"ERROR","stream":"ext://sys.stderr"}},"root":{"level":"DEBUG","handlers":["console","console_priority"]}}
If that dictionary is stored in a file calledconf.json
, it can beloaded and called with code like this:
>>>importjson,logging.config>>>withopen('conf.json')asf:...conf=json.load(f)...>>>logging.config.dictConfig(conf)>>>logging.info("Transaction completed normally")INFO : root : Transaction completed normally>>>logging.critical("Abnormal termination")2011-02-17 11:14:36,694 root CRITICAL Abnormal termination
也參考
- PEP 391 - Dictionary Based Configuration for Logging
由 Vinay Sajip 撰寫 PEP。
PEP 3148:concurrent.futures
模組¶
Code for creating and managing concurrency is being collected in a new top-levelnamespace,concurrent. Its first member is afutures package which providesa uniform high-level interface for managing threads and processes.
The design forconcurrent.futures
was inspired by thejava.util.concurrent package. In that model, a running call and its resultare represented by aFuture
object that abstractsfeatures common to threads, processes, and remote procedure calls. That objectsupports status checks (running or done), timeouts, cancellations, addingcallbacks, and access to results or exceptions.
The primary offering of the new module is a pair of executor classes forlaunching and managing calls. The goal of the executors is to make it easier touse existing tools for making parallel calls. They save the effort needed tosetup a pool of resources, launch the calls, create a results queue, addtime-out handling, and limit the total number of threads, processes, or remoteprocedure calls.
Ideally, each application should share a single executor across multiplecomponents so that process and thread limits can be centrally managed. Thissolves the design challenge that arises when each component has its owncompeting strategy for resource management.
Both classes share a common interface with three methods:submit()
for scheduling a callable andreturning aFuture
object;map()
for scheduling many asynchronous callsat a time, andshutdown()
for freeingresources. The class is acontext manager and can be used in awith
statement to assure that resources are automatically releasedwhen currently pending futures are done executing.
A simple of example ofThreadPoolExecutor
is alaunch of four parallel threads for copying files:
importconcurrent.futures,shutilwithconcurrent.futures.ThreadPoolExecutor(max_workers=4)ase:e.submit(shutil.copy,'src1.txt','dest1.txt')e.submit(shutil.copy,'src2.txt','dest2.txt')e.submit(shutil.copy,'src3.txt','dest3.txt')e.submit(shutil.copy,'src3.txt','dest4.txt')
也參考
- PEP 3148 - Futures -- Execute Computations Asynchronously
由 Brian Quinlan 撰寫 PEP。
Code for Threaded Parallel URL reads, anexample using threads to fetch multiple web pages in parallel.
Code for computing prime numbers inparallel, an example demonstratingProcessPoolExecutor
.
PEP 3147: PYC Repository Directories¶
Python's scheme for caching bytecode in.pyc files did not work well inenvironments with multiple Python interpreters. If one interpreter encountereda cached file created by another interpreter, it would recompile the source andoverwrite the cached file, thus losing the benefits of caching.
The issue of "pyc fights" has become more pronounced as it has becomecommonplace for Linux distributions to ship with multiple versions of Python.These conflicts also arise with CPython alternatives such as Unladen Swallow.
To solve this problem, Python's import machinery has been extended to usedistinct filenames for each interpreter. Instead of Python 3.2 and Python 3.3 andUnladen Swallow each competing for a file called "mymodule.pyc", they will nowlook for "mymodule.cpython-32.pyc", "mymodule.cpython-33.pyc", and"mymodule.unladen10.pyc". And to prevent all of these new files fromcluttering source directories, thepyc files are now collected in a"__pycache__" directory stored under the package directory.
Aside from the filenames and target directories, the new scheme has a fewaspects that are visible to the programmer:
Imported modules now have a
__cached__
attribute which storesthe name of the actual file that was imported:>>>importcollections>>>collections.__cached__'c:/py32/lib/__pycache__/collections.cpython-32.pyc'
The tag that is unique to each interpreter is accessible from the
imp
module:>>>importimp>>>imp.get_tag()'cpython-32'
Scripts that try to deduce source filename from the imported file now need tobe smarter. It is no longer sufficient to simply strip the "c" from a ".pyc"filename. Instead, use the new functions in the
imp
module:>>>imp.source_from_cache('c:/py32/lib/__pycache__/collections.cpython-32.pyc')'c:/py32/lib/collections.py'>>>imp.cache_from_source('c:/py32/lib/collections.py')'c:/py32/lib/__pycache__/collections.cpython-32.pyc'
The
py_compile
andcompileall
modules have been updated toreflect the new naming convention and target directory. The command-lineinvocation ofcompileall has new options:-i
forspecifying a list of files and directories to compile and-b
which causesbytecode files to be written to their legacy location rather than__pycache__.The
importlib.abc
module has been updated with newabstract baseclasses for loading bytecode files. The obsoleteABCs,PyLoader
andPyPycLoader
, have been deprecated (instructions on howto stay Python 3.1 compatible are included with the documentation).
也參考
- PEP 3147 - PYC Repository Directories
由 Barry Warsaw 撰寫 PEP。
PEP 3149: ABI Version Tagged .so Files¶
The PYC repository directory allows multiple bytecode cache files to beco-located. This PEP implements a similar mechanism for shared object files bygiving them a common directory and distinct names for each version.
The common directory is "pyshared" and the file names are made distinct byidentifying the Python implementation (such as CPython, PyPy, Jython, etc.), themajor and minor version numbers, and optional build flags (such as "d" fordebug, "m" for pymalloc, "u" for wide-unicode). For an arbitrary package "foo",you may see these files when the distribution package is installed:
/usr/share/pyshared/foo.cpython-32m.so/usr/share/pyshared/foo.cpython-33md.so
In Python itself, the tags are accessible from functions in thesysconfig
module:
>>>importsysconfig>>>sysconfig.get_config_var('SOABI')# find the version tag'cpython-32mu'>>>sysconfig.get_config_var('EXT_SUFFIX')# find the full filename extension'.cpython-32mu.so'
也參考
- PEP 3149 - ABI Version Tagged .so Files
由 Barry Warsaw 撰寫 PEP。
PEP 3333: Python Web Server Gateway Interface v1.0.1¶
This informational PEP clarifies how bytes/text issues are to be handled by theWSGI protocol. The challenge is that string handling in Python 3 is mostconveniently handled with thestr
type even though the HTTP protocolis itself bytes oriented.
The PEP differentiates so-callednative strings that are used forrequest/response headers and metadata versusbyte strings which are used forthe bodies of requests and responses.
Thenative strings are always of typestr
but are restricted to codepoints betweenU+0000 throughU+00FF which are translatable to bytes usingLatin-1 encoding. These strings are used for the keys and values in theenvironment dictionary and for response headers and statuses in thestart_response()
function. They must followRFC 2616 with respect toencoding. That is, they must either beISO-8859-1 characters or useRFC 2047 MIME encoding.
For developers porting WSGI applications from Python 2, here are the salientpoints:
If the app already used strings for headers in Python 2, no change is needed.
If instead, the app encoded output headers or decoded input headers, then theheaders will need to be re-encoded to Latin-1. For example, an output headerencoded in utf-8 was using
h.encode('utf-8')
now needs to convert frombytes to native strings usingh.encode('utf-8').decode('latin-1')
.Values yielded by an application or sent using the
write()
methodmust be byte strings. Thestart_response()
function and environmust use native strings. The two cannot be mixed.
For server implementers writing CGI-to-WSGI pathways or other CGI-styleprotocols, the users must to be able access the environment using native stringseven though the underlying platform may have a different convention. To bridgethis gap, thewsgiref
module has a new function,wsgiref.handlers.read_environ()
for transcoding CGI variables fromos.environ
into native strings and returning a new dictionary.
也參考
- PEP 3333 - Python Web Server Gateway Interface v1.0.1
由 Phillip Eby 撰寫 PEP。
其他語言更動¶
Some smaller changes made to the core Python language are:
String formatting for
format()
andstr.format()
gained newcapabilities for the format character#. Previously, for integers inbinary, octal, or hexadecimal, it caused the output to be prefixed with '0b','0o', or '0x' respectively. Now it can also handle floats, complex, andDecimal, causing the output to always have a decimal point even when no digitsfollow it.>>>format(20,'#o')'0o24'>>>format(12.34,'#5.0f')' 12.'
(Suggested by Mark Dickinson and implemented by Eric Smith inbpo-7094.)
There is also a new
str.format_map()
method that extends thecapabilities of the existingstr.format()
method by accepting arbitrarymapping objects. This new method makes it possible to use stringformatting with any of Python's many dictionary-like objects such asdefaultdict
,Shelf
,ConfigParser
, ordbm
. It is also useful withcustomdict
subclasses that normalize keys before look-up or thatsupply a__missing__()
method for unknown keys:>>>importshelve>>>d=shelve.open('tmp.shl')>>>'The{project_name} status is{status} as of{date}'.format_map(d)'The testing project status is green as of February 15, 2011'>>>classLowerCasedDict(dict):...def__getitem__(self,key):...returndict.__getitem__(self,key.lower())...>>>lcd=LowerCasedDict(part='widgets',quantity=10)>>>'There are{QUANTITY}{Part} in stock'.format_map(lcd)'There are 10 widgets in stock'>>>classPlaceholderDict(dict):...def__missing__(self,key):...return'<{}>'.format(key)...>>>'Hello{name}, welcome to{location}'.format_map(PlaceholderDict())'Hello <name>, welcome to <location>'
(Suggested by Raymond Hettinger and implemented by Eric Smith inbpo-6081.)
The interpreter can now be started with a quiet option,
-q
, to preventthe copyright and version information from being displayed in the interactivemode. The option can be introspected using thesys.flags
attribute:$python-q>>> sys.flagssys.flags(debug=0, division_warning=0, inspect=0, interactive=0,optimize=0, dont_write_bytecode=0, no_user_site=0, no_site=0,ignore_environment=0, verbose=0, bytes_warning=0, quiet=1)
(由 Marcin Wojdyr 在bpo-1772833 中貢獻)。
The
hasattr()
function works by callinggetattr()
and detectingwhether an exception is raised. This technique allows it to detect methodscreated dynamically by__getattr__()
or__getattribute__()
whichwould otherwise be absent from the class dictionary. Formerly,hasattrwould catch any exception, possibly masking genuine errors. Now,hasattrhas been tightened to only catchAttributeError
and let otherexceptions pass through:>>>classA:...@property...deff(self):...return1//0...>>>a=A()>>>hasattr(a,'f')Traceback (most recent call last):...ZeroDivisionError:integer division or modulo by zero
(Discovered by Yury Selivanov and fixed by Benjamin Peterson;bpo-9666.)
The
str()
of a float or complex number is now the same as itsrepr()
. Previously, thestr()
form was shorter but that justcaused confusion and is no longer needed now that the shortest possiblerepr()
is displayed by default:>>>importmath>>>repr(math.pi)'3.141592653589793'>>>str(math.pi)'3.141592653589793'
(Proposed and implemented by Mark Dickinson;bpo-9337.)
memoryview
objects now have arelease()
methodand they also now support the context management protocol. This allows timelyrelease of any resources that were acquired when requesting a buffer from theoriginal object.>>>withmemoryview(b'abcdefgh')asv:...print(v.tolist())[97, 98, 99, 100, 101, 102, 103, 104]
(Added by Antoine Pitrou;bpo-9757.)
Previously it was illegal to delete a name from the local namespace if itoccurs as a free variable in a nested block:
defouter(x):definner():returnxinner()delx
This is now allowed. Remember that the target of an
except
clauseis cleared, so this code which used to work with Python 2.6, raised aSyntaxError
with Python 3.1 and now works again:deff():defprint_error():print(e)try:somethingexceptExceptionase:print_error()# implicit "del e" here
(請見bpo-4617。)
Struct sequence types are now subclasses of tuple.This means that C structures like those returned by
os.stat()
,time.gmtime()
, andsys.version_info
now work like anamed tuple and now work with functions and methods thatexpect a tuple as an argument. This is a big step forward in making the Cstructures as flexible as their pure Python counterparts:>>>importsys>>>isinstance(sys.version_info,tuple)True>>>'Version%d.%d.%d%s(%d)'%sys.version_info'Version 3.2.0 final(0)'
(Suggested by Arfrever Frehtes Taifersar Arahesis and implementedby Benjamin Peterson inbpo-8413.)
Warnings are now easier to control using the
PYTHONWARNINGS
environment variable as an alternative to using-W
at the command line:$exportPYTHONWARNINGS='ignore::RuntimeWarning::,once::UnicodeWarning::'
(Suggested by Barry Warsaw and implemented by Philip Jenvey inbpo-7301.)
A new warning category,
ResourceWarning
, has been added. It isemitted when potential issues with resource consumption or cleanupare detected. It is silenced by default in normal release builds butcan be enabled through the means provided by thewarnings
module, or on the command line.A
ResourceWarning
is issued at interpreter shutdown if thegc.garbage
list isn't empty, and ifgc.DEBUG_UNCOLLECTABLE
isset, all uncollectable objects are printed. This is meant to make theprogrammer aware that their code contains object finalization issues.A
ResourceWarning
is also issued when afile object is destroyedwithout having been explicitly closed. While the deallocator for suchobject ensures it closes the underlying operating system resource(usually, a file descriptor), the delay in deallocating the object couldproduce various issues, especially under Windows. Here is an exampleof enabling the warning from the command line:$python-q-Wdefault>>> f = open("foo", "wb")>>> del f__main__:1: ResourceWarning: unclosed file <_io.BufferedWriter name='foo'>
(Added by Antoine Pitrou and Georg Brandl inbpo-10093 andbpo-477863.)
range
objects now supportindex andcount methods. This is partof an effort to make more objects fully implement thecollections.Sequence
abstract base class. As a result, thelanguage will have a more uniform API. In addition,range
objectsnow support slicing and negative indices, even with values larger thansys.maxsize
. This makesrange more interoperable with lists:>>>range(0,100,2).count(10)1>>>range(0,100,2).index(10)5>>>range(0,100,2)[5]10>>>range(0,100,2)[0:5]range(0, 10, 2)
(由 Daniel Stutzbach 在bpo-9213、Alexander Belopolsky 在bpo-2690、Nick Coghlan 在bpo-10889 中貢獻。)
The
callable()
builtin function from Py2.x was resurrected. It providesa concise, readable alternative to using anabstract base class in anexpression likeisinstance(x,collections.Callable)
:>>>callable(max)True>>>callable(20)False
(請見bpo-10518。)
Python's import mechanism can now load modules installed in directories withnon-ASCII characters in the path name. This solved an aggravating problemwith home directories for users with non-ASCII characters in their usernames.
(Required extensive work by Victor Stinner inbpo-9425.)
New, Improved, and Deprecated Modules¶
Python's standard library has undergone significant maintenance efforts andquality improvements.
The biggest news for Python 3.2 is that theemail
package,mailbox
module, andnntplib
modules now work correctly with the bytes/text modelin Python 3. For the first time, there is correct handling of messages withmixed encodings.
Throughout the standard library, there has been more careful attention toencodings and text versus bytes issues. In particular, interactions with theoperating system are now better able to exchange non-ASCII data using theWindows MBCS encoding, locale-aware encodings, or UTF-8.
Another significant win is the addition of substantially better support forSSL connections and security certificates.
In addition, more classes now implement acontext manager to supportconvenient and reliable resource clean-up using awith
statement.
email¶
The usability of theemail
package in Python 3 has been mostly fixed bythe extensive efforts of R. David Murray. The problem was that emails aretypically read and stored in the form ofbytes
rather thanstr
text, and they may contain multiple encodings within a single email. So, theemail package had to be extended to parse and generate email messages in bytesformat.
New functions
message_from_bytes()
andmessage_from_binary_file()
, and new classesBytesFeedParser
andBytesParser
allow binary message data to be parsed into model objects.Given bytes input to the model,
get_payload()
will by default decode a message body that has aContent-Transfer-Encoding of8bit using the charsetspecified in the MIME headers and return the resulting string.Given bytes input to the model,
Generator
willconvert message bodies that have aContent-Transfer-Encoding of8bit to instead have a7bitContent-Transfer-Encoding.Headers with unencoded non-ASCII bytes are deemed to beRFC 2047-encodedusing theunknown-8bit character set.
A new class
BytesGenerator
produces bytes as output,preserving any unchanged non-ASCII data that was present in the input used tobuild the model, including message bodies with aContent-Transfer-Encoding of8bit.The
smtplib
SMTP
class now accepts a byte stringfor themsg argument to thesendmail()
method,and a new method,send_message()
accepts aMessage
object and can optionally obtain thefrom_addr andto_addrs addresses directly from the object.
(Proposed and implemented by R. David Murray,bpo-4661 andbpo-10321.)
elementtree¶
Thexml.etree.ElementTree
package and itsxml.etree.cElementTree
counterpart have been updated to version 1.3.
Several new and useful functions and methods have been added:
xml.etree.ElementTree.fromstringlist()
which builds an XML documentfrom a sequence of fragmentsxml.etree.ElementTree.register_namespace()
for registering a globalnamespace prefixxml.etree.ElementTree.tostringlist()
for string representationincluding all sublistsxml.etree.ElementTree.Element.extend()
for appending a sequence of zeroor more elementsxml.etree.ElementTree.Element.iterfind()
searches an element andsubelementsxml.etree.ElementTree.Element.itertext()
creates a text iterator overan element and its subelementsxml.etree.ElementTree.TreeBuilder.end()
closes the current elementxml.etree.ElementTree.TreeBuilder.doctype()
handles a doctypedeclaration
有兩個方法已被棄用:
xml.etree.ElementTree.getchildren()
uselist(elem)
instead.xml.etree.ElementTree.getiterator()
useElement.iter
instead.
For details of the update, seeIntroducing ElementTreeon Fredrik Lundh's website.
(由 Florent Xicluna 和 Fredrik Lundh 貢獻,bpo-6472。)
functools¶
The
functools
module includes a new decorator for caching functioncalls.functools.lru_cache()
can save repeated queries to an externalresource whenever the results are expected to be the same.For example, adding a caching decorator to a database query function can savedatabase accesses for popular searches:
>>>importfunctools>>>@functools.lru_cache(maxsize=300)...defget_phone_number(name):...c=conn.cursor()...c.execute('SELECT phonenumber FROM phonelist WHERE name=?',(name,))...returnc.fetchone()[0]
>>>fornameinuser_requests:...get_phone_number(name)# cached lookup
To help with choosing an effective cache size, the wrapped function isinstrumented for tracking cache statistics:
>>>get_phone_number.cache_info()CacheInfo(hits=4805, misses=980, maxsize=300, currsize=300)
If the phonelist table gets updated, the outdated contents of the cache can becleared with:
>>>get_phone_number.cache_clear()
(Contributed by Raymond Hettinger and incorporating design ideas from JimBaker, Miki Tebeka, and Nick Coghlan; seerecipe 498245,recipe 577479,bpo-10586, andbpo-10593.)
The
functools.wraps()
decorator now adds a__wrapped__
attributepointing to the original callable function. This allows wrapped functions tobe introspected. It also copies__annotations__
ifdefined. And now it also gracefully skips over missing attributes such as__doc__
whichmight not be defined for the wrapped callable.In the above example, the cache can be removed by recovering the originalfunction:
>>>get_phone_number=get_phone_number.__wrapped__# uncached function
(By Nick Coghlan and Terrence Cole;bpo-9567,bpo-3445, andbpo-8814.)
To help write classes with rich comparison methods, a new decorator
functools.total_ordering()
will use existing equality and inequalitymethods to fill in the remaining methods.For example, supplying__eq__ and__lt__ will enable
total_ordering()
to fill-in__le__,__gt__ and__ge__:@total_orderingclassStudent:def__eq__(self,other):return((self.lastname.lower(),self.firstname.lower())==(other.lastname.lower(),other.firstname.lower()))def__lt__(self,other):return((self.lastname.lower(),self.firstname.lower())<(other.lastname.lower(),other.firstname.lower()))
With thetotal_ordering decorator, the remaining comparison methodsare filled in automatically.
(由 Raymond Hettinger 貢獻。)
To aid in porting programs from Python 2, the
functools.cmp_to_key()
function converts an old-style comparison function tomodernkey function:>>># locale-aware sort order>>>sorted(iterable,key=cmp_to_key(locale.strcoll))
For sorting examples and a brief sorting tutorial, see theSorting HowTo tutorial.
(由 Raymond Hettinger 貢獻。)
itertools¶
The
itertools
module has a newaccumulate()
functionmodeled on APL'sscan operator and Numpy'saccumulate function:>>>fromitertoolsimportaccumulate>>>list(accumulate([8,2,50]))[8, 10, 60]
>>>prob_dist=[0.1,0.4,0.2,0.3]>>>list(accumulate(prob_dist))# cumulative probability distribution[0.1, 0.5, 0.7, 1.0]
For an example using
accumulate()
, see theexamples forthe random module.(由 Raymond Hettinger 貢獻,並結合了 Mark Dickinson 的設計建議。)
collections¶
The
collections.Counter
class now has two forms of in-placesubtraction, the existing-= operator forsaturating subtraction and the newsubtract()
method for regular subtraction. Theformer is suitable formultisetswhich only have positive counts, and the latter is more suitable for use casesthat allow negative counts:>>>fromcollectionsimportCounter>>>tally=Counter(dogs=5,cats=3)>>>tally-=Counter(dogs=2,cats=8)# saturating subtraction>>>tallyCounter({'dogs': 3})
>>>tally=Counter(dogs=5,cats=3)>>>tally.subtract(dogs=2,cats=8)# regular subtraction>>>tallyCounter({'dogs': 3, 'cats': -5})
(由 Raymond Hettinger 貢獻。)
The
collections.OrderedDict
class has a new methodmove_to_end()
which takes an existing key andmoves it to either the first or last position in the ordered sequence.The default is to move an item to the last position. This is equivalent ofrenewing an entry with
od[k]=od.pop(k)
.A fast move-to-end operation is useful for resequencing entries. For example,an ordered dictionary can be used to track order of access by aging entriesfrom the oldest to the most recently accessed.
>>>fromcollectionsimportOrderedDict>>>d=OrderedDict.fromkeys(['a','b','X','d','e'])>>>list(d)['a', 'b', 'X', 'd', 'e']>>>d.move_to_end('X')>>>list(d)['a', 'b', 'd', 'e', 'X']
(由 Raymond Hettinger 貢獻。)
The
collections.deque
class grew two new methodscount()
andreverse()
thatmake them more substitutable forlist
objects:>>>fromcollectionsimportdeque>>>d=deque('simsalabim')>>>d.count('s')2>>>d.reverse()>>>ddeque(['m', 'i', 'b', 'a', 'l', 'a', 's', 'm', 'i', 's'])
(由 Raymond Hettinger 貢獻。)
threading¶
Thethreading
module has a newBarrier
synchronization class for making multiple threads wait until all of them havereached a common barrier point. Barriers are useful for making sure that a taskwith multiple preconditions does not run until all of the predecessor tasks arecomplete.
Barriers can work with an arbitrary number of threads. This is a generalizationof aRendezvous whichis defined for only two threads.
Implemented as a two-phase cyclic barrier,Barrier
objectsare suitable for use in loops. The separatefilling anddraining phasesassure that all threads get released (drained) before any one of them can loopback and re-enter the barrier. The barrier fully resets after each cycle.
Example of using barriers:
fromthreadingimportBarrier,Threaddefget_votes(site):ballots=conduct_election(site)all_polls_closed.wait()# do not count until all polls are closedtotals=summarize(ballots)publish(site,totals)all_polls_closed=Barrier(len(sites))forsiteinsites:Thread(target=get_votes,args=(site,)).start()
In this example, the barrier enforces a rule that votes cannot be counted at anypolling site until all polls are closed. Notice how a solution with a barrieris similar to one withthreading.Thread.join()
, but the threads stay aliveand continue to do work (summarizing ballots) after the barrier point iscrossed.
If any of the predecessor tasks can hang or be delayed, a barrier can be createdwith an optionaltimeout parameter. Then if the timeout period elapses beforeall the predecessor tasks reach the barrier point, all waiting threads arereleased and aBrokenBarrierError
exception is raised:
defget_votes(site):ballots=conduct_election(site)try:all_polls_closed.wait(timeout=midnight-time.now())exceptBrokenBarrierError:lockbox=seal_ballots(ballots)queue.put(lockbox)else:totals=summarize(ballots)publish(site,totals)
In this example, the barrier enforces a more robust rule. If some electionsites do not finish before midnight, the barrier times-out and the ballots aresealed and deposited in a queue for later handling.
SeeBarrier Synchronization Patternsfor more examples of how barriers can be used in parallel computing. Also, there isa simple but thorough explanation of barriers inThe Little Book of Semaphores,section 3.6.
(在bpo-8777 中由 Kristján Valur Jónsson 貢獻、Jeffrey Yasskin 進行 API 審查。)
datetime 和 time¶
The
datetime
module has a new typetimezone
thatimplements thetzinfo
interface by returning a fixed UTCoffset and timezone name. This makes it easier to create timezone-awaredatetime objects:>>>fromdatetimeimportdatetime,timezone>>>datetime.now(timezone.utc)datetime.datetime(2010, 12, 8, 21, 4, 2, 923754, tzinfo=datetime.timezone.utc)>>>datetime.strptime("01/01/2000 12:00 +0000","%m/%d/%Y %H:%M %z")datetime.datetime(2000, 1, 1, 12, 0, tzinfo=datetime.timezone.utc)
Also,
timedelta
objects can now be multiplied byfloat
and divided byfloat
andint
objects.Andtimedelta
objects can now divide one another.The
datetime.date.strftime()
method is no longer restricted to yearsafter 1900. The new supported year range is from 1000 to 9999 inclusive.Whenever a two-digit year is used in a time tuple, the interpretation has beengoverned by
time.accept2dyear
. The default isTrue
which means thatfor a two-digit year, the century is guessed according to the POSIX rulesgoverning the%y
strptime format.Starting with Py3.2, use of the century guessing heuristic will emit a
DeprecationWarning
. Instead, it is recommended thattime.accept2dyear
be set toFalse
so that large date rangescan be used without guesswork:>>>importtime,warnings>>>warnings.resetwarnings()# remove the default warning filters>>>time.accept2dyear=True# guess whether 11 means 11 or 2011>>>time.asctime((11,1,1,12,34,56,4,1,0))Warning (from warnings module): ...DeprecationWarning: Century info guessed for a 2-digit year.'Fri Jan 1 12:34:56 2011'>>>time.accept2dyear=False# use the full range of allowable dates>>>time.asctime((11,1,1,12,34,56,4,1,0))'Fri Jan 1 12:34:56 11'
Several functions now have significantly expanded date ranges. When
time.accept2dyear
is false, thetime.asctime()
function willaccept any year that fits in a C int, while thetime.mktime()
andtime.strftime()
functions will accept the full range supported by thecorresponding operating system functions.
(由 Alexander Belopolsky 和 Victor Stinner 在bpo-1289118、bpo-5094、bpo-6641、bpo-2706、bpo-1777412、bpo-8013 和bpo-10827 中貢獻。)
math¶
Themath
module has been updated with six new functions inspired by theC99 standard.
Theisfinite()
function provides a reliable and fast way to detectspecial values. It returnsTrue
for regular numbers andFalse
forNan orInfinity:
>>>frommathimportisfinite>>>[isfinite(x)forxin(123,4.56,float('Nan'),float('Inf'))][True, True, False, False]
Theexpm1()
function computese**x-1
for small values ofxwithout incurring the loss of precision that usually accompanies the subtractionof nearly equal quantities:
>>>frommathimportexpm1>>>expm1(0.013671875)# more accurate way to compute e**x-1 for a small x0.013765762467652909
Theerf()
function computes a probability integral orGaussianerror function. Thecomplementary error function,erfc()
, is1-erf(x)
:
>>>frommathimporterf,erfc,sqrt>>>erf(1.0/sqrt(2.0))# portion of normal distribution within 1 standard deviation0.682689492137086>>>erfc(1.0/sqrt(2.0))# portion of normal distribution outside 1 standard deviation0.31731050786291404>>>erf(1.0/sqrt(2.0))+erfc(1.0/sqrt(2.0))1.0
Thegamma()
function is a continuous extension of the factorialfunction. Seehttps://en.wikipedia.org/wiki/Gamma_function for details. Becausethe function is related to factorials, it grows large even for small values ofx, so there is also algamma()
function for computing the naturallogarithm of the gamma function:
>>>frommathimportgamma,lgamma>>>gamma(7.0)# six factorial720.0>>>lgamma(801.0)# log(800 factorial)4551.950730698041
(由 Mark Dickinson 貢獻。)
abc¶
Theabc
module now supportsabstractclassmethod()
andabstractstaticmethod()
.
These tools make it possible to define anabstract base class thatrequires a particularclassmethod()
orstaticmethod()
to beimplemented:
classTemperature(metaclass=abc.ABCMeta):@abc.abstractclassmethoddeffrom_fahrenheit(cls,t):...@abc.abstractclassmethoddeffrom_celsius(cls,t):...
(Patch submitted by Daniel Urban;bpo-5867.)
io¶
Theio.BytesIO
has a new method,getbuffer()
, whichprovides functionality similar tomemoryview()
. It creates an editableview of the data without making a copy. The buffer's random access and supportfor slice notation are well-suited to in-place editing:
>>>REC_LEN,LOC_START,LOC_LEN=34,7,11>>>defchange_location(buffer,record_number,location):...start=record_number*REC_LEN+LOC_START...buffer[start:start+LOC_LEN]=location>>>importio>>>byte_stream=io.BytesIO(...b'G3805 storeroom Main chassis '...b'X7899 shipping Reserve cog '...b'L6988 receiving Primary sprocket'...)>>>buffer=byte_stream.getbuffer()>>>change_location(buffer,1,b'warehouse ')>>>change_location(buffer,0,b'showroom ')>>>print(byte_stream.getvalue())b'G3805 showroom Main chassis 'b'X7899 warehouse Reserve cog 'b'L6988 receiving Primary sprocket'
(由 Antoine Pitrou 在bpo-5506 中貢獻。)
reprlib¶
When writing a__repr__()
method for a custom container, it is easy toforget to handle the case where a member refers back to the container itself.Python's builtin objects such aslist
andset
handleself-reference by displaying "..." in the recursive part of the representationstring.
To help write such__repr__()
methods, thereprlib
module has a newdecorator,recursive_repr()
, for detecting recursive calls to__repr__()
and substituting a placeholder string instead:
>>>classMyList(list):...@recursive_repr()...def__repr__(self):...return'<'+'|'.join(map(repr,self))+'>'...>>>m=MyList('abc')>>>m.append(m)>>>m.append('x')>>>print(m)<'a'|'b'|'c'|...|'x'>
logging¶
In addition to dictionary-based configuration described above, thelogging
package has many other improvements.
The logging documentation has been augmented by abasic tutorial, anadvanced tutorial, and acookbook oflogging recipes. These documents are the fastest way to learn about logging.
Thelogging.basicConfig()
set-up function gained astyle argument tosupport three different types of string formatting. It defaults to "%" fortraditional %-formatting, can be set to "{" for the newstr.format()
style, orcan be set to "$" for the shell-style formatting provided bystring.Template
. The following three configurations are equivalent:
>>>fromloggingimportbasicConfig>>>basicConfig(style='%',format="%(name)s ->%(levelname)s:%(message)s")>>>basicConfig(style='{',format="{name} ->{levelname}{message}")>>>basicConfig(style='$',format="$name -> $levelname: $message")
If no configuration is set-up before a logging event occurs, there is now adefault configuration using aStreamHandler
directed tosys.stderr
for events ofWARNING
level or higher. Formerly, anevent occurring before a configuration was set-up would either raise anexception or silently drop the event depending on the value oflogging.raiseExceptions
. The new default handler is stored inlogging.lastResort
.
The use of filters has been simplified. Instead of creating aFilter
object, the predicate can be any Python callable thatreturnsTrue
orFalse
.
There were a number of other improvements that add flexibility and simplifyconfiguration. See the module documentation for a full listing of changes inPython 3.2.
csv¶
Thecsv
module now supports a new dialect,unix_dialect
,which applies quoting for all fields and a traditional Unix style with'\n'
asthe line terminator. The registered dialect name isunix
.
Thecsv.DictWriter
has a new method,writeheader()
for writing-out an initial row to documentthe field names:
>>>importcsv,sys>>>w=csv.DictWriter(sys.stdout,['name','dept'],dialect='unix')>>>w.writeheader()"name","dept">>>w.writerows([...{'name':'tom','dept':'accounting'},...{'name':'susan','dept':'Salesl'}])"tom","accounting""susan","sales"
(New dialect suggested by Jay Talbot inbpo-5975, and the new methodsuggested by Ed Abraham inbpo-1537721.)
contextlib¶
There is a new and slightly mind-blowing toolContextDecorator
that is helpful for creating acontext manager that does double duty as a function decorator.
As a convenience, this new functionality is used bycontextmanager()
so that no extra effort is needed to supportboth roles.
The basic idea is that both context managers and function decorators can be usedfor pre-action and post-action wrappers. Context managers wrap a group ofstatements using awith
statement, and function decorators wrap agroup of statements enclosed in a function. So, occasionally there is a need towrite a pre-action or post-action wrapper that can be used in either role.
For example, it is sometimes useful to wrap functions or groups of statementswith a logger that can track the time of entry and time of exit. Rather thanwriting both a function decorator and a context manager for the task, thecontextmanager()
provides both capabilities in a singledefinition:
fromcontextlibimportcontextmanagerimportlogginglogging.basicConfig(level=logging.INFO)@contextmanagerdeftrack_entry_and_exit(name):logging.info('Entering:%s',name)yieldlogging.info('Exiting:%s',name)
Formerly, this would have only been usable as a context manager:
withtrack_entry_and_exit('widget loader'):print('Some time consuming activity goes here')load_widget()
Now, it can be used as a decorator as well:
@track_entry_and_exit('widget loader')defactivity():print('Some time consuming activity goes here')load_widget()
Trying to fulfill two roles at once places some limitations on the technique.Context managers normally have the flexibility to return an argument usable byawith
statement, but there is no parallel for function decorators.
In the above example, there is not a clean way for thetrack_entry_and_exitcontext manager to return a logging instance for use in the body of enclosedstatements.
(由 Michael Foord 在bpo-9110 中貢獻。)
decimal and fractions¶
Mark Dickinson crafted an elegant and efficient scheme for assuring thatdifferent numeric datatypes will have the same hash value whenever their actualvalues are equal (bpo-8188):
asserthash(Fraction(3,2))==hash(1.5)== \hash(Decimal("1.5"))==hash(complex(1.5,0))
Some of the hashing details are exposed through a new attribute,sys.hash_info
, which describes the bit width of the hash value, theprime modulus, the hash values forinfinity andnan, and the multiplierused for the imaginary part of a number:
>>>sys.hash_infosys.hash_info(width=64, modulus=2305843009213693951, inf=314159, nan=0, imag=1000003)
An early decision to limit the interoperability of various numeric types hasbeen relaxed. It is still unsupported (and ill-advised) to have implicitmixing in arithmetic expressions such asDecimal('1.1')+float('1.1')
because the latter loses information in the process of constructing the binaryfloat. However, since existing floating-point value can be converted losslesslyto either a decimal or rational representation, it makes sense to add them tothe constructor and to support mixed-type comparisons.
The
decimal.Decimal
constructor now acceptsfloat
objectsdirectly so there in no longer a need to use thefrom_float()
method (bpo-8257).Mixed type comparisons are now fully supported so that
Decimal
objects can be directly compared withfloat
andfractions.Fraction
(bpo-2531 andbpo-8188).
Similar changes were made tofractions.Fraction
so that thefrom_float()
andfrom_decimal()
methods are no longer needed (bpo-8294):
>>>fromdecimalimportDecimal>>>fromfractionsimportFraction>>>Decimal(1.1)Decimal('1.100000000000000088817841970012523233890533447265625')>>>Fraction(1.1)Fraction(2476979795053773, 2251799813685248)
Another useful change for thedecimal
module is that theContext.clamp
attribute is now public. This is useful in creatingcontexts that correspond to the decimal interchange formats specified in IEEE754 (seebpo-8540).
(由 Mark Dickinson 和 Raymond Hettinger 貢獻。)
ftp¶
Theftplib.FTP
class now supports the context management protocol tounconditionally consumesocket.error
exceptions and to close the FTPconnection when done:
>>>fromftplibimportFTP>>>withFTP("ftp1.at.proftpd.org")asftp: ftp.login() ftp.dir()'230 Anonymous login ok, restrictions apply.'dr-xr-xr-x 9 ftp ftp 154 May 6 10:43 .dr-xr-xr-x 9 ftp ftp 154 May 6 10:43 ..dr-xr-xr-x 5 ftp ftp 4096 May 6 10:43 CentOSdr-xr-xr-x 3 ftp ftp 18 Jul 10 2008 Fedora
Other file-like objects such asmmap.mmap
andfileinput.input()
also grew auto-closing context managers:
withfileinput.input(files=('log1.txt','log2.txt'))asf:forlineinf:process(line)
(由 Tarek Ziadé 和 Giampaolo Rodolà 在bpo-4972 中貢獻,由 Georg Brandl 在bpo-8046 和bpo-1286 中貢獻。)
TheFTP_TLS
class now accepts acontext parameter, which is assl.SSLContext
object allowing bundling SSL configuration options,certificates and private keys into a single (potentially long-lived) structure.
(由 Giampaolo Rodolà 貢獻;bpo-8806。)
popen¶
Theos.popen()
andsubprocess.Popen()
functions now supportwith
statements for auto-closing of the file descriptors.
select¶
Theselect
module now exposes a new, constant attribute,PIPE_BUF
, which gives the minimum number of bytes which areguaranteed not to block whenselect.select()
says a pipe is readyfor writing.
>>>importselect>>>select.PIPE_BUF512
(Available on Unix systems. Patch by Sébastien Sablé inbpo-9862)
gzip 和 zipfile¶
gzip.GzipFile
now implements theio.BufferedIOBase
abstract base class (except fortruncate()
). It also has apeek()
method and supports unseekable as well aszero-padded file objects.
Thegzip
module also gains thecompress()
anddecompress()
functions for easier in-memory compression anddecompression. Keep in mind that text needs to be encoded asbytes
before compressing and decompressing:
>>>importgzip>>>s='Three shall be the number thou shalt count, '>>>s+='and the number of the counting shall be three'>>>b=s.encode()# convert to utf-8>>>len(b)89>>>c=gzip.compress(b)>>>len(c)77>>>gzip.decompress(c).decode()[:42]# decompress and convert to text'Three shall be the number thou shalt count'
(由 Anand B. Pillai 在bpo-3488 中貢獻;由 Antoine Pitrou、Nir Aides 和 Brian Curtin 在bpo-9962、bpo-1675951、bpo-7471 和bpo-2846 中貢獻。)
Also, thezipfile.ZipExtFile
class was reworked internally to representfiles stored inside an archive. The new implementation is significantly fasterand can be wrapped in anio.BufferedReader
object for more speedups. Italso solves an issue where interleaved calls toread andreadline gave thewrong results.
(Patch submitted by Nir Aides inbpo-7610.)
tarfile¶
TheTarFile
class can now be used as a context manager. Inaddition, itsadd()
method has a new option,filter,that controls which files are added to the archive and allows the file metadatato be edited.
The newfilter option replaces the older, less flexibleexclude parameterwhich is now deprecated. If specified, the optionalfilter parameter needs tobe akeyword argument. The user-supplied filter function accepts aTarInfo
object and returns an updatedTarInfo
object, or if it wants the file to be excluded, thefunction can returnNone
:
>>>importtarfile,glob>>>defmyfilter(tarinfo):...iftarinfo.isfile():# only save real files...tarinfo.uname='monty'# redact the user name...returntarinfo>>>withtarfile.open(name='myarchive.tar.gz',mode='w:gz')astf:...forfilenameinglob.glob('*.txt'):...tf.add(filename,filter=myfilter)...tf.list()-rw-r--r-- monty/501 902 2011-01-26 17:59:11 annotations.txt-rw-r--r-- monty/501 123 2011-01-26 17:59:11 general_questions.txt-rw-r--r-- monty/501 3514 2011-01-26 17:59:11 prion.txt-rw-r--r-- monty/501 124 2011-01-26 17:59:11 py_todo.txt-rw-r--r-- monty/501 1399 2011-01-26 17:59:11 semaphore_notes.txt
(由 Tarek Ziadé 提議並由 Lars Gustäbel 實作於bpo-6856。)
hashlib¶
Thehashlib
module has two new constant attributes listing the hashingalgorithms guaranteed to be present in all implementations and those availableon the current implementation:
>>>importhashlib>>>hashlib.algorithms_guaranteed{'sha1', 'sha224', 'sha384', 'sha256', 'sha512', 'md5'}>>>hashlib.algorithms_available{'md2', 'SHA256', 'SHA512', 'dsaWithSHA', 'mdc2', 'SHA224', 'MD4', 'sha256','sha512', 'ripemd160', 'SHA1', 'MDC2', 'SHA', 'SHA384', 'MD2','ecdsa-with-SHA1','md4', 'md5', 'sha1', 'DSA-SHA', 'sha224','dsaEncryption', 'DSA', 'RIPEMD160', 'sha', 'MD5', 'sha384'}
(由 Carl Chenet 在bpo-7418 中提議。)
ast¶
Theast
module has a wonderful a general-purpose tool for safelyevaluating expression strings using the Python literalsyntax. Theast.literal_eval()
function serves as a secure alternative tothe builtineval()
function which is easily abused. Python 3.2 addsbytes
andset
literals to the list of supported types:strings, bytes, numbers, tuples, lists, dicts, sets, booleans, andNone
.
>>>fromastimportliteral_eval>>>request="{'req': 3, 'func': 'pow', 'args': (2, 0.5)}">>>literal_eval(request){'args': (2, 0.5), 'req': 3, 'func': 'pow'}>>>request="os.system('do something harmful')">>>literal_eval(request)Traceback (most recent call last):...ValueError:malformed node or string: <_ast.Call object at 0x101739a10>
(由 Benjamin Peterson 和 Georg Brandl 實作。)
os¶
Different operating systems use various encodings for filenames and environmentvariables. Theos
module provides two new functions,fsencode()
andfsdecode()
, for encoding and decodingfilenames:
>>>importos>>>filename='Sehenswürdigkeiten'>>>os.fsencode(filename)b'Sehensw\xc3\xbcrdigkeiten'
Some operating systems allow direct access to encoded bytes in theenvironment. If so, theos.supports_bytes_environ
constant will betrue.
For direct access to encoded environment variables (if available),use the newos.getenvb()
function or useos.environb
which is a bytes version ofos.environ
.
(由 Victor Stinner 貢獻。)
shutil¶
Theshutil.copytree()
function has two new options:
ignore_dangling_symlinks: when
symlinks=False
so that the functioncopies a file pointed to by a symlink, not the symlink itself. This optionwill silence the error raised if the file doesn't exist.copy_function: is a callable that will be used to copy files.
shutil.copy2()
is used by default.
(由 Tarek Ziadé 貢獻。)
In addition, theshutil
module now supportsarchiving operations for zipfiles, uncompressed tarfiles, gzipped tarfiles,and bzipped tarfiles. And there are functions for registering additionalarchiving file formats (such as xz compressed tarfiles or custom formats).
The principal functions aremake_archive()
andunpack_archive()
. By default, both operate on the currentdirectory (which can be set byos.chdir()
) and on any sub-directories.The archive filename needs to be specified with a full pathname. The archivingstep is non-destructive (the original files are left unchanged).
>>>importshutil,pprint>>>os.chdir('mydata')# change to the source directory>>>f=shutil.make_archive('/var/backup/mydata',...'zip')# archive the current directory>>>f# show the name of archive'/var/backup/mydata.zip'>>>os.chdir('tmp')# change to an unpacking>>>shutil.unpack_archive('/var/backup/mydata.zip')# recover the data>>>pprint.pprint(shutil.get_archive_formats())# display known formats[('bztar', "bzip2'ed tar-file"), ('gztar', "gzip'ed tar-file"), ('tar', 'uncompressed tar file'), ('zip', 'ZIP file')]>>>shutil.register_archive_format(# register a new archive format...name='xz',...function=xz.compress,# callable archiving function...extra_args=[('level',8)],# arguments to the function...description='xz compression'...)
(由 Tarek Ziadé 貢獻。)
sqlite3¶
Thesqlite3
module was updated to pysqlite version 2.6.0. It has two new capabilities.
The
sqlite3.Connection.in_transit
attribute is true if there is anactive transaction for uncommitted changes.The
sqlite3.Connection.enable_load_extension()
andsqlite3.Connection.load_extension()
methods allows you to load SQLiteextensions from ".so" files. One well-known extension is the fulltext-searchextension distributed with SQLite.
(由 R. David Murray 和 Shashwat Anand 貢獻;bpo-8845。)
html¶
A newhtml
module was introduced with only a single function,escape()
, which is used for escaping reserved characters from HTMLmarkup:
>>>importhtml>>>html.escape('x > 2 && x < 7')'x > 2 && x < 7'
socket¶
Thesocket
module has two new improvements.
Socket objects now have a
detach()
method which putsthe socket into closed state without actually closing the underlying filedescriptor. The latter can then be reused for other purposes.(Added by Antoine Pitrou;bpo-8524.)socket.create_connection()
now supports the context management protocolto unconditionally consumesocket.error
exceptions and to close thesocket when done.(Contributed by Giampaolo Rodolà;bpo-9794.)
ssl¶
Thessl
module added a number of features to satisfy common requirementsfor secure (encrypted, authenticated) internet connections:
A new class,
SSLContext
, serves as a container for persistentSSL data, such as protocol settings, certificates, private keys, and variousother options. It includes awrap_socket()
for creatingan SSL socket from an SSL context.A new function,
ssl.match_hostname()
, supports server identityverification for higher-level protocols by implementing the rules of HTTPS(fromRFC 2818) which are also suitable for other protocols.The
ssl.wrap_socket()
constructor function now takes aciphersargument. Theciphers string lists the allowed encryption algorithms usingthe format described in theOpenSSL documentation.When linked against recent versions of OpenSSL, the
ssl
module nowsupports the Server Name Indication extension to the TLS protocol, allowingmultiple "virtual hosts" using different certificates on a single IP port.This extension is only supported in client mode, and is activated by passingtheserver_hostname argument tossl.SSLContext.wrap_socket()
.Various options have been added to the
ssl
module, such asOP_NO_SSLv2
which disables the insecure and obsolete SSLv2protocol.The extension now loads all the OpenSSL ciphers and digest algorithms. Ifsome SSL certificates cannot be verified, they are reported as an "unknownalgorithm" error.
The version of OpenSSL being used is now accessible using the moduleattributes
ssl.OPENSSL_VERSION
(a string),ssl.OPENSSL_VERSION_INFO
(a 5-tuple), andssl.OPENSSL_VERSION_NUMBER
(an integer).
(由 Antoine Pitrou 在bpo-8850、bpo-1589、bpo-8322、bpo-5639、bpo-4870、bpo-8484 和bpo-8321 中貢獻。)
nntp¶
Thenntplib
module has a revamped implementation with better bytes andtext semantics as well as more practical APIs. These improvements breakcompatibility with the nntplib version in Python 3.1, which was partlydysfunctional in itself.
Support for secure connections through both implicit (usingnntplib.NNTP_SSL
) and explicit (usingnntplib.NNTP.starttls()
)TLS has also been added.
certificates¶
http.client.HTTPSConnection
,urllib.request.HTTPSHandler
andurllib.request.urlopen()
now take optional arguments to allow forserver certificate checking against a set of Certificate Authorities,as recommended in public uses of HTTPS.
(Added by Antoine Pitrou,bpo-9003.)
imaplib¶
Support for explicit TLS on standard IMAP4 connections has been added throughthe newimaplib.IMAP4.starttls
method.
(由 Lorenzo M. Catucci 和 Antoine Pitrou 於bpo-4471 貢獻。)
http.client¶
There were a number of small API improvements in thehttp.client
module.The old-style HTTP 0.9 simple responses are no longer supported and thestrictparameter is deprecated in all classes.
TheHTTPConnection
andHTTPSConnection
classes now have asource_addressparameter for a (host, port) tuple indicating where the HTTP connection is madefrom.
Support for certificate checking and HTTPS virtual hosts were added toHTTPSConnection
.
Therequest()
method on connection objectsallowed an optionalbody argument so that afile object could be usedto supply the content of the request. Conveniently, thebody argument nowalso accepts aniterable object so long as it includes an explicitContent-Length
header. This extended interface is much more flexible thanbefore.
To establish an HTTPS connection through a proxy server, there is a newset_tunnel()
method that sets the host andport for HTTP Connect tunneling.
To match the behavior ofhttp.server
, the HTTP client library now alsoencodes headers with ISO-8859-1 (Latin-1) encoding. It was already doing thatfor incoming headers, so now the behavior is consistent for both incoming andoutgoing traffic. (See work by Armin Ronacher inbpo-10980.)
unittest¶
The unittest module has a number of improvements supporting test discovery forpackages, easier experimentation at the interactive prompt, new testcasemethods, improved diagnostic messages for test failures, and better methodnames.
The command-line call
python-munittest
can now accept file pathsinstead of module names for running specific tests (bpo-10620). The newtest discovery can find tests within packages, locating any test importablefrom the top-level directory. The top-level directory can be specified withthe-t
option, a pattern for matching files with-p
, and a directory tostart discovery with-s
:$python-munittestdiscover-smy_proj_dir-p_test.py
(由 Michael Foord 貢獻。)
Experimentation at the interactive prompt is now easier because the
unittest.TestCase
class can now be instantiated withoutarguments:>>>fromunittestimportTestCase>>>TestCase().assertEqual(pow(2,3),8)
(由 Michael Foord 貢獻。)
The
unittest
module has two new methods,assertWarns()
andassertWarnsRegex()
to verify that a given warning typeis triggered by the code under test:withself.assertWarns(DeprecationWarning):legacy_function('XYZ')
(由 Antoine Pitrou 於bpo-9754 貢獻。)
Another new method,
assertCountEqual()
is used tocompare two iterables to determine if their element counts are equal (whetherthe same elements are present with the same number of occurrences regardlessof order):deftest_anagram(self):self.assertCountEqual('algorithm','logarithm')
(由 Raymond Hettinger 貢獻。)
A principal feature of the unittest module is an effort to produce meaningfuldiagnostics when a test fails. When possible, the failure is recorded alongwith a diff of the output. This is especially helpful for analyzing log filesof failed test runs. However, since diffs can sometime be voluminous, there isa new
maxDiff
attribute that sets maximum length ofdiffs displayed.In addition, the method names in the module have undergone a number of clean-ups.
For example,
assertRegex()
is the new name forassertRegexpMatches()
which was misnamed because thetest usesre.search()
, notre.match()
. Other methods usingregular expressions are now named using short form "Regex" in preference to"Regexp" -- this matches the names used in other unittest implementations,matches Python's old name for there
module, and it has unambiguouscamel-casing.(由 Raymond Hettinger 貢獻,由 Ezio Melotti 實作。)
To improve consistency, some long-standing method aliases are beingdeprecated in favor of the preferred names:
舊名稱
Preferred Name
assert_()
assertEquals()
assertNotEquals()
assertAlmostEquals()
assertNotAlmostEquals()
Likewise, the
TestCase.fail*
methods deprecated in Python 3.1 are expectedto be removed in Python 3.3.(由 Ezio Melotti 貢獻;bpo-9424。)
The
assertDictContainsSubset()
method was deprecatedbecause it was misimplemented with the arguments in the wrong order. Thiscreated hard-to-debug optical illusions where tests likeTestCase().assertDictContainsSubset({'a':1,'b':2},{'a':1})
would fail.(由 Raymond Hettinger 貢獻。)
random¶
The integer methods in therandom
module now do a better job of producinguniform distributions. Previously, they computed selections withint(n*random())
which had a slight bias whenevern was not a power of two.Now, multiple selections are made from a range up to the next power of two and aselection is kept only when it falls within the range0<=x<n
. Thefunctions and methods affected arerandrange()
,randint()
,choice()
,shuffle()
andsample()
.
(由 Raymond Hettinger 貢獻;bpo-9025。)
poplib¶
POP3_SSL
class now accepts acontext parameter, which is assl.SSLContext
object allowing bundling SSL configuration options,certificates and private keys into a single (potentially long-lived)structure.
(由 Giampaolo Rodolà 貢獻;bpo-8807。)
asyncore¶
asyncore.dispatcher
now provides ahandle_accepted()
methodreturning a(sock,addr)
pair which is called when a connection has actuallybeen established with a new remote endpoint. This is supposed to be used as areplacement for oldhandle_accept()
and avoidsthe user to callaccept()
directly.
(由 Giampaolo Rodolà 貢獻;bpo-6706。)
tempfile¶
Thetempfile
module has a new context manager,TemporaryDirectory
which provides easy deterministiccleanup of temporary directories:
withtempfile.TemporaryDirectory()astmpdirname:print('created temporary dir:',tmpdirname)
(由 Neil Schedulenauer 和 Nick Coghlan 貢獻;bpo-5178。)
inspect¶
The
inspect
module has a new functiongetgeneratorstate()
to easily identify the current state of agenerator-iterator:>>>frominspectimportgetgeneratorstate>>>defgen():...yield'demo'...>>>g=gen()>>>getgeneratorstate(g)'GEN_CREATED'>>>next(g)'demo'>>>getgeneratorstate(g)'GEN_SUSPENDED'>>>next(g,None)>>>getgeneratorstate(g)'GEN_CLOSED'
(由 Rodolfo Eckhardt 和 Nick Coghlan 於bpo-10220 貢獻。)
To support lookups without the possibility of activating a dynamic attribute,the
inspect
module has a new function,getattr_static()
.Unlikehasattr()
, this is a true read-only search, guaranteed not tochange state while it is searching:>>>classA:...@property...deff(self):...print('Running')...return10...>>>a=A()>>>getattr(a,'f')Running10>>>inspect.getattr_static(a,'f')<property object at 0x1022bd788>
(由 Michael Foord 貢獻。)
pydoc¶
Thepydoc
module now provides a much-improved web server interface, aswell as a new command-line option-b
to automatically open a browser windowto display that server:
$pydoc3.2-b
(由 Ron Adam 貢獻;bpo-2001。)
dis¶
Thedis
module gained two new functions for inspecting code,code_info()
andshow_code()
. Both provide detailed codeobject information for the supplied function, method, source code string or codeobject. The former returns a string and the latter prints it:
>>>importdis,random>>>dis.show_code(random.choice)Name: choiceFilename: /Library/Frameworks/Python.framework/Versions/3.2/lib/python3.2/random.pyArgument count: 2Kw-only arguments: 0Number of locals: 3Stack size: 11Flags: OPTIMIZED, NEWLOCALS, NOFREEConstants: 0: 'Choose a random element from a non-empty sequence.' 1: 'Cannot choose from an empty sequence'Names: 0: _randbelow 1: len 2: ValueError 3: IndexErrorVariable names: 0: self 1: seq 2: i
In addition, thedis()
function now accepts string argumentsso that the common idiomdis(compile(s,'','eval'))
can be shortenedtodis(s)
:
>>>dis('3*x+1 if x%2==1 else x//2') 1 0 LOAD_NAME 0 (x) 3 LOAD_CONST 0 (2) 6 BINARY_MODULO 7 LOAD_CONST 1 (1) 10 COMPARE_OP 2 (==) 13 POP_JUMP_IF_FALSE 28 16 LOAD_CONST 2 (3) 19 LOAD_NAME 0 (x) 22 BINARY_MULTIPLY 23 LOAD_CONST 1 (1) 26 BINARY_ADD 27 RETURN_VALUE >> 28 LOAD_NAME 0 (x) 31 LOAD_CONST 0 (2) 34 BINARY_FLOOR_DIVIDE 35 RETURN_VALUE
Taken together, these improvements make it easier to explore how CPython isimplemented and to see for yourself what the language syntax doesunder-the-hood.
(由 Nick Coghlan 在bpo-9147 中貢獻。)
dbm¶
All database modules now support theget()
andsetdefault()
methods.
(由 Ray Allen 在bpo-9523 中建議。)
ctypes¶
A new type,ctypes.c_ssize_t
represents the Cssize_t
datatype.
site¶
Thesite
module has three new functions useful for reporting on thedetails of a given Python installation.
getsitepackages()
lists all global site-packages directories.getuserbase()
reports on the user's base directory where data canbe stored.getusersitepackages()
reveals the user-specific site-packagesdirectory path.
>>>importsite>>>site.getsitepackages()['/Library/Frameworks/Python.framework/Versions/3.2/lib/python3.2/site-packages', '/Library/Frameworks/Python.framework/Versions/3.2/lib/site-python', '/Library/Python/3.2/site-packages']>>>site.getuserbase()'/Users/raymondhettinger/Library/Python/3.2'>>>site.getusersitepackages()'/Users/raymondhettinger/Library/Python/3.2/lib/python/site-packages'
Conveniently, some of site's functionality is accessible directly from thecommand-line:
$python-msite--user-base/Users/raymondhettinger/.local$python-msite--user-site/Users/raymondhettinger/.local/lib/python3.2/site-packages
(由 Tarek Ziadé 在bpo-6693 中貢獻。)
sysconfig¶
The newsysconfig
module makes it straightforward to discoverinstallation paths and configuration variables that vary across platforms andinstallations.
The module offers access simple access functions for platform and versioninformation:
get_platform()
returning values likelinux-i586 ormacosx-10.6-ppc.get_python_version()
returns a Python version stringsuch as "3.2".
It also provides access to the paths and variables corresponding to one ofseven named schemes used bydistutils
. Those includeposix_prefix,posix_home,posix_user,nt,nt_user,os2,os2_home:
get_paths()
makes a dictionary containing installation pathsfor the current installation scheme.get_config_vars()
returns a dictionary of platform specificvariables.
There is also a convenient command-line interface:
C:\Python32>python -m sysconfigPlatform: "win32"Python version: "3.2"Current installation scheme: "nt"Paths: data = "C:\Python32" include = "C:\Python32\Include" platinclude = "C:\Python32\Include" platlib = "C:\Python32\Lib\site-packages" platstdlib = "C:\Python32\Lib" purelib = "C:\Python32\Lib\site-packages" scripts = "C:\Python32\Scripts" stdlib = "C:\Python32\Lib"Variables: BINDIR = "C:\Python32" BINLIBDEST = "C:\Python32\Lib" EXE = ".exe" INCLUDEPY = "C:\Python32\Include" LIBDEST = "C:\Python32\Lib" SO = ".pyd" VERSION = "32" abiflags = "" base = "C:\Python32" exec_prefix = "C:\Python32" platbase = "C:\Python32" prefix = "C:\Python32" projectbase = "C:\Python32" py_version = "3.2" py_version_nodot = "32" py_version_short = "3.2" srcdir = "C:\Python32" userbase = "C:\Documents and Settings\Raymond\Application Data\Python"
(Moved out of Distutils by Tarek Ziadé.)
pdb¶
Thepdb
debugger module gained a number of usability improvements:
pdb.py
now has a-c
option that executes commands as given in a.pdbrc
script file.A
.pdbrc
script file can containcontinue
andnext
commandsthat continue debugging.現在
Pdb
類別建構函式接受nosigint 引數。New commands:
l(list)
,ll(longlist)
andsource
forlisting source code.New commands:
display
andundisplay
for showing or hidingthe value of an expression if it has changed.New command:
interact
for starting an interactive interpreter containingthe global and local names found in the current scope.Breakpoints can be cleared by breakpoint number.
(由 Georg Brandl、Antonio Cuni 和 Ilya Sandler 貢獻。)
configparser¶
Theconfigparser
module was modified to improve usability andpredictability of the default parser and its supported INI syntax. The oldConfigParser
class was removed in favor ofSafeConfigParser
which has in turn been renamed toConfigParser
. Supportfor inline comments is now turned off by default and section or optionduplicates are not allowed in a single configuration source.
Config parsers gained a new API based on the mapping protocol:
>>>parser=ConfigParser()>>>parser.read_string("""...[DEFAULT]...location = upper left...visible = yes...editable = no...color = blue......[main]...title = Main Menu...color = green......[options]...title = Options...""")>>>parser['main']['color']'green'>>>parser['main']['editable']'no'>>>section=parser['options']>>>section['title']'Options'>>>section['title']='Options (editable:%(editable)s)'>>>section['title']'Options (editable: no)'
The new API is implemented on top of the classical API, so custom parsersubclasses should be able to use it without modifications.
The INI file structure accepted by config parsers can now be customized. Userscan specify alternative option/value delimiters and comment prefixes, change thename of theDEFAULT section or switch the interpolation syntax.
There is support for pluggable interpolation including an additional interpolationhandlerExtendedInterpolation
:
>>>parser=ConfigParser(interpolation=ExtendedInterpolation())>>>parser.read_dict({'buildout':{'directory':'/home/ambv/zope9'},...'custom':{'prefix':'/usr/local'}})>>>parser.read_string("""...[buildout]...parts =... zope9... instance...find-links =... ${buildout:directory}/downloads/dist......[zope9]...recipe = plone.recipe.zope9install...location = /opt/zope......[instance]...recipe = plone.recipe.zope9instance...zope9-location = ${zope9:location}...zope-conf = ${custom:prefix}/etc/zope.conf...""")>>>parser['buildout']['find-links']'\n/home/ambv/zope9/downloads/dist'>>>parser['instance']['zope-conf']'/usr/local/etc/zope.conf'>>>instance=parser['instance']>>>instance['zope-conf']'/usr/local/etc/zope.conf'>>>instance['zope9-location']'/opt/zope'
A number of smaller features were also introduced, like support for specifyingencoding in read operations, specifying fallback values for get-functions, orreading directly from dictionaries and strings.
(All changes contributed by Łukasz Langa.)
urllib.parse¶
A number of usability improvements were made for theurllib.parse
module.
Theurlparse()
function now supportsIPv6 addresses as described inRFC 2732:
>>>importurllib.parse>>>urllib.parse.urlparse('http://[dead:beef:cafe:5417:affe:8FA3:deaf:feed]/foo/')ParseResult(scheme='http', netloc='[dead:beef:cafe:5417:affe:8FA3:deaf:feed]', path='/foo/', params='', query='', fragment='')
Theurldefrag()
function now returns anamed tuple:
>>>r=urllib.parse.urldefrag('http://python.org/about/#target')>>>rDefragResult(url='http://python.org/about/', fragment='target')>>>r[0]'http://python.org/about/'>>>r.fragment'target'
And, theurlencode()
function is now much more flexible,accepting either a string or bytes type for thequery argument. If it is astring, then thesafe,encoding, anderror parameters are sent toquote_plus()
for encoding:
>>>urllib.parse.urlencode([...('type','telenovela'),...('name','¿Dónde Está Elisa?')],...encoding='latin-1')'type=telenovela&name=%BFD%F3nde+Est%E1+Elisa%3F'
As detailed inParsing ASCII Encoded Bytes, all theurllib.parse
functions now accept ASCII-encoded byte strings as input, so long as they arenot mixed with regular strings. If ASCII-encoded byte strings are given asparameters, the return types will also be an ASCII-encoded byte strings:
>>>urllib.parse.urlparse(b'http://www.python.org:80/about/')ParseResultBytes(scheme=b'http', netloc=b'www.python.org:80', path=b'/about/', params=b'', query=b'', fragment=b'')
(Work by Nick Coghlan, Dan Mahn, and Senthil Kumaran inbpo-2987,bpo-5468, andbpo-9873.)
mailbox¶
Thanks to a concerted effort by R. David Murray, themailbox
module hasbeen fixed for Python 3.2. The challenge was that mailbox had been originallydesigned with a text interface, but email messages are best represented withbytes
because various parts of a message may have different encodings.
The solution harnessed theemail
package's binary support for parsingarbitrary email messages. In addition, the solution required a number of APIchanges.
As expected, theadd()
method formailbox.Mailbox
objects now accepts binary input.
StringIO
and text file input are deprecated. Also, string inputwill fail early if non-ASCII characters are used. Previously it would fail whenthe email was processed in a later step.
There is also support for binary output. Theget_file()
method now returns a file in the binary mode (where it used to incorrectly setthe file to text-mode). There is also a newget_bytes()
method that returns abytes
representation of a message correspondingto a givenkey.
It is still possible to get non-binary output using the old API'sget_string()
method, but that approachis not very useful. Instead, it is best to extract messages fromaMessage
object or to load them from binary input.
(Contributed by R. David Murray, with efforts from Steffen Daode Nurpmeso and aninitial patch by Victor Stinner inbpo-9124.)
turtledemo¶
The demonstration code for theturtle
module was moved from theDemodirectory to main library. It includes over a dozen sample scripts withlively displays. Being onsys.path
, it can now be run directlyfrom the command-line:
$python-mturtledemo
(Moved from the Demo directory by Alexander Belopolsky inbpo-10199.)
Multi-threading¶
The mechanism for serializing execution of concurrently running Python threads(generally known as theGIL or Global Interpreter Lock) hasbeen rewritten. Among the objectives were more predictable switchingintervals and reduced overhead due to lock contention and the number ofensuing system calls. The notion of a "check interval" to allow threadswitches has been abandoned and replaced by an absolute duration expressed inseconds. This parameter is tunable through
sys.setswitchinterval()
.It currently defaults to 5 milliseconds.Additional details about the implementation can be read from apython-devmailing-list message(however, "priority requests" as exposed in this message have not been keptfor inclusion).
(由 Antoine Pitrou 貢獻。)
Regular and recursive locks now accept an optionaltimeout argument to their
acquire()
method. (Contributed by Antoine Pitrou;bpo-7316.)Similarly,
threading.Semaphore.acquire()
also gained atimeoutargument. (Contributed by Torsten Landschoff;bpo-850728.)Regular and recursive lock acquisitions can now be interrupted by signals onplatforms using Pthreads. This means that Python programs that deadlock whileacquiring locks can be successfully killed by repeatedly sending SIGINT to theprocess (by pressingCtrl+C in most shells).(Contributed by Reid Kleckner;bpo-8844.)
最佳化¶
A number of small performance enhancements have been added:
Python's peephole optimizer now recognizes patterns such
xin{1,2,3}
asbeing a test for membership in a set of constants. The optimizer recasts theset
as afrozenset
and stores the pre-built constant.Now that the speed penalty is gone, it is practical to start writingmembership tests using set-notation. This style is both semantically clearand operationally fast:
extension=name.rpartition('.')[2]ifextensionin{'xml','html','xhtml','css'}:handle(name)
(Patch and additional tests contributed by Dave Malcolm;bpo-6690).
Serializing and unserializing data using the
pickle
module is nowseveral times faster.(由 Alexandre Vassalotti、Antoine Pitrou 和 Unladen Swallow 團隊在bpo-9410 和bpo-3873 中貢獻。)
TheTimsort algorithm used in
list.sort()
andsorted()
now runs faster and uses less memorywhen called with akey function. Previously, every element ofa list was wrapped with a temporary object that remembered the key valueassociated with each element. Now, two arrays of keys and values aresorted in parallel. This saves the memory consumed by the sort wrappers,and it saves time lost to delegating comparisons.(Patch by Daniel Stutzbach inbpo-9915.)
JSON decoding performance is improved and memory consumption is reducedwhenever the same string is repeated for multiple keys. Also, JSON encodingnow uses the C speedups when the
sort_keys
argument is true.(由 Antoine Pitrou 在bpo-7451 中貢獻、由 Raymond Hettinger 和 Antoine Pitrou 在bpo-10314 中貢獻。)
Recursive locks (created with the
threading.RLock()
API) now benefitfrom a C implementation which makes them as fast as regular locks, and between10x and 15x faster than their previous pure Python implementation.(由 Antoine Pitrou 貢獻;bpo-3001。)
The fast-search algorithm in stringlib is now used by the
split()
,rsplit()
,splitlines()
andreplace()
methods onbytes
,bytearray
andstr
objects. Likewise, thealgorithm is also used byrfind()
,rindex()
,rsplit()
andrpartition()
.Integer to string conversions now work two "digits" at a time, reducing thenumber of division and modulo operations.
(bpo-6713 by Gawain Bolton, Mark Dickinson, and Victor Stinner.)
There were several other minor optimizations. Set differencing now runs fasterwhen one operand is much larger than the other (patch by Andress Bennetts inbpo-8685). Thearray.repeat()
method has a faster implementation(bpo-1569291 by Alexander Belopolsky). TheBaseHTTPRequestHandler
has more efficient buffering (bpo-3709 by Andrew Schaaf). Theoperator.attrgetter()
function has been sped-up (bpo-10160 byChristos Georgiou). AndConfigParser
loads multi-line arguments a bitfaster (bpo-7113 by Łukasz Langa).
Unicode¶
Python has been updated toUnicode 6.0.0. The update to the standard addsover 2,000 new characters includingemojisymbols which are important for mobile phones.
In addition, the updated standard has altered the character properties for twoKannada characters (U+0CF1, U+0CF2) and one New Tai Lue numeric character(U+19DA), making the former eligible for use in identifiers while disqualifyingthe latter. For more information, seeUnicode Character Database Changes.
編解碼器¶
Support was added forcp720 Arabic DOS encoding (bpo-1616979).
MBCS encoding no longer ignores the error handler argument. In the defaultstrict mode, it raises anUnicodeDecodeError
when it encounters anundecodable byte sequence and anUnicodeEncodeError
for an unencodablecharacter.
The MBCS codec supports'strict'
and'ignore'
error handlers fordecoding, and'strict'
and'replace'
for encoding.
To emulate Python3.1 MBCS encoding, select the'ignore'
handler for decodingand the'replace'
handler for encoding.
On Mac OS X, Python decodes command line arguments with'utf-8'
rather thanthe locale encoding.
By default,tarfile
uses'utf-8'
encoding on Windows (instead of'mbcs'
) and the'surrogateescape'
error handler on all operatingsystems.
文件¶
The documentation continues to be improved.
A table of quick links has been added to the top of lengthy sections such as內建函式. In the case of
itertools
, the links areaccompanied by tables of cheatsheet-style summaries to provide an overview andmemory jog without having to read all of the docs.In some cases, the pure Python source code can be a helpful adjunct to thedocumentation, so now many modules now feature quick links to the latestversion of the source code. For example, the
functools
moduledocumentation has a quick link at the top labeled:Source codeLib/functools.py.
(Contributed by Raymond Hettinger; seerationale.)
The docs now contain more examples and recipes. In particular,
re
module has an extensive section,Regular Expression Examples. Likewise, theitertools
module continues to be updated with newItertools 應用技巧.The
datetime
module now has an auxiliary implementation in pure Python.No functionality was changed. This just provides an easier-to-read alternateimplementation.(由 Alexander Belopolsky 在bpo-9528 中貢獻。)
The unmaintained
Demo
directory has been removed. Some demos wereintegrated into the documentation, some were moved to theTools/demo
directory, and others were removed altogether.(由 Georg Brandl 在bpo-7962 中貢獻。)
IDLE¶
Code Repository¶
In addition to the existing Subversion code repository athttps://svn.python.orgthere is now aMercurial repository athttps://hg.python.org/.
After the 3.2 release, there are plans to switch to Mercurial as the primaryrepository. This distributed version control system should make it easier formembers of the community to create and share external changesets. SeePEP 385 for details.
To learn to use the new version control system, see theQuick Start or theGuide toMercurial Workflows.
建置和 C API 變更¶
Python 建置程序和 C API 的變更包括:
Theidle,pydoc and2to3 scripts are now installed with aversion-specific suffix on
makealtinstall
(bpo-10679).The C functions that access the Unicode Database now accept and returncharacters from the full Unicode range, even on narrow unicode builds(Py_UNICODE_TOLOWER, Py_UNICODE_ISDECIMAL, and others). A visible differencein Python is that
unicodedata.numeric()
now returns the correct valuefor large code points, andrepr()
may consider more characters asprintable.(Reported by Bupjoe Lee and fixed by Amaury Forgeot D'Arc;bpo-5127.)
Computed gotos are now enabled by default on supported compilers (which aredetected by the configure script). They can still be disabled selectively byspecifying
--without-computed-gotos
.(由 Antoine Pitrou 貢獻;bpo-9203。)
The option
--with-wctype-functions
was removed. The built-in unicodedatabase is now used for all functions.(由 Amaury Forgeot D'Arc 貢獻;bpo-9210。)
Hash values are now values of a new type,
Py_hash_t
, which isdefined to be the same size as a pointer. Previously they were of type long,which on some 64-bit operating systems is still only 32 bits long. As aresult of this fix,set
anddict
can now hold more than2**32
entries on builds with 64-bit pointers (previously, they could growto that size but their performance degraded catastrophically).(由 Raymond Hettinger 建議並由 Benjamin Peterson 實作;bpo-9778。)
A new macro
Py_VA_COPY
copies the state of the variable argumentlist. It is equivalent to C99va_copy but available on all Python platforms(bpo-2443).A new C API function
PySys_SetArgvEx()
allows an embedded interpreterto setsys.argv
without also modifyingsys.path
(bpo-5753).PyEval_CallObject()
is now only available in macro form. Thefunction declaration, which was kept for backwards compatibility reasons, isnow removed -- the macro was introduced in 1997 (bpo-8276).There is a new function
PyLong_AsLongLongAndOverflow()
whichis analogous toPyLong_AsLongAndOverflow()
. They both serve toconvert Pythonint
into a native fixed-width type while providingdetection of cases where the conversion won't fit (bpo-7767).The
PyUnicode_CompareWithASCIIString()
function now returnsnotequal if the Python string isNUL terminated.There is a new function
PyErr_NewExceptionWithDoc()
that islikePyErr_NewException()
but allows a docstring to be specified.This lets C exceptions have the same self-documenting capabilities astheir pure Python counterparts (bpo-7033).When compiled with the
--with-valgrind
option, the pymallocallocator will be automatically disabled when running under Valgrind. Thisgives improved memory leak detection when running under Valgrind, while takingadvantage of pymalloc at other times (bpo-2422).Removed the
O?
format from thePyArg_Parse functions. The format is nolonger used and it had never been documented (bpo-8837).
There were a number of other small changes to the C-API. See theMisc/NEWSfile for a complete list.
Also, there were a number of updates to the Mac OS X build, seeMac/BuildScript/README.txtfor details. For users running a 32/64-bitbuild, there is a known problem with the default Tcl/Tk on Mac OS X 10.6.Accordingly, we recommend installing an updated alternative such asActiveState Tcl/Tk 8.5.9.Seehttps://www.python.org/download/mac/tcltk/ for additional details.
移植至 Python 3.2¶
This section lists previously described changes and other bugfixes that mayrequire changes to your code:
The
configparser
module has a number of clean-ups. The major change isto replace the oldConfigParser
class with long-standing preferredalternativeSafeConfigParser
. In addition there are a number ofsmaller incompatibilities:The interpolation syntax is now validated on
get()
andset()
operations. In the defaultinterpolation scheme, only two tokens with percent signs are valid:%(name)s
and%%
, the latter being an escaped percent sign.The
set()
andadd_section()
methods now verify thatvalues are actual strings. Formerly, unsupported types could be introducedunintentionally.Duplicate sections or options from a single source now raise either
DuplicateSectionError
orDuplicateOptionError
. Formerly, duplicates wouldsilently overwrite a previous entry.Inline comments are now disabled by default so now the; charactercan be safely used in values.
Comments now can be indented. Consequently, for; or# to appear atthe start of a line in multiline values, it has to be interpolated. Thiskeeps comment prefix characters in values from being mistaken as comments.
""
is now a valid value and is no longer automatically converted to anempty string. For empty strings, use"option="
in a line.
The
nntplib
module was reworked extensively, meaning that its APIsare often incompatible with the 3.1 APIs.bytearray
objects can no longer be used as filenames; instead,they should be converted tobytes
.The
array.tostring()
andarray.fromstring()
have been renamed toarray.tobytes()
andarray.frombytes()
for clarity. The old nameshave been deprecated. (Seebpo-8990.)PyArg_Parse*()
functions:"t#" format has been removed: use "s#" or "s*" instead
"w" and "w#" formats has been removed: use "w*" instead
The
PyCObject
type, deprecated in 3.1, has been removed. To wrapopaque C pointers in Python objects, thePyCapsule
API should be usedinstead; the new type has a well-defined interface for passing typing safetyinformation and a less complicated signature for calling a destructor.The
sys.setfilesystemencoding()
function was removed becauseit had a flawed design.The
random.seed()
function and method now salt string seeds with ansha512 hash function. To access the previous version ofseed in order toreproduce Python 3.1 sequences, set theversion argument to1,random.seed(s,version=1)
.The previously deprecated
string.maketrans()
function has been removedin favor of the static methodsbytes.maketrans()
andbytearray.maketrans()
. This change solves the confusion around whichtypes were supported by thestring
module. Now,str
,bytes
, andbytearray
each have their ownmaketrans andtranslate methods with intermediate translation tables of the appropriatetype.(由 Georg Brandl 貢獻;bpo-5675。)
The previously deprecated
contextlib.nested()
function has been removedin favor of a plainwith
statement which can accept multiplecontext managers. The latter technique is faster (because it is built-in),and it does a better job finalizing multiple context managers when one of themraises an exception:withopen('mylog.txt')asinfile,open('a.out','w')asoutfile:forlineininfile:if'<critical>'inline:outfile.write(line)
(由 Georg Brandl 和 Mattias Brändström 貢獻;appspot 問題 53094。)
struct.pack()
now only allows bytes for thes
string pack code.Formerly, it would accept text arguments and implicitly encode them to bytesusing UTF-8. This was problematic because it made assumptions about thecorrect encoding and because a variable-length encoding can fail when writingto fixed length segment of a structure.Code such as
struct.pack('<6sHHBBB','GIF87a',x,y)
should be rewrittenwith to use bytes instead of text,struct.pack('<6sHHBBB',b'GIF87a',x,y)
.(Discovered by David Beazley and fixed by Victor Stinner;bpo-10783.)
The
xml.etree.ElementTree
class now raises anxml.etree.ElementTree.ParseError
when a parse fails. Previously itraised anxml.parsers.expat.ExpatError
.The new, longer
str()
value on floats may break doctests which rely onthe old output format.In
subprocess.Popen
, the default value forclose_fds is nowTrue
under Unix; under Windows, it isTrue
if the three standardstreams are set toNone
,False
otherwise. Previously,close_fdswas alwaysFalse
by default, which produced difficult to solve bugsor race conditions when open file descriptors would leak into the childprocess.Support for legacy HTTP 0.9 has been removed from
urllib.request
andhttp.client
. Such support is still present on the server side(inhttp.server
).(由 Antoine Pitrou 於bpo-10711 貢獻。)
SSL sockets in timeout mode now raise
socket.timeout
when a timeoutoccurs, rather than a genericSSLError
.(由 Antoine Pitrou 於bpo-10272 貢獻。)
The misleading functions
PyEval_AcquireLock()
andPyEval_ReleaseLock()
have been officially deprecated. Thethread-state aware APIs (such asPyEval_SaveThread()
andPyEval_RestoreThread()
) should be used instead.Due to security risks,
asyncore.handle_accept()
has been deprecated, anda new function,asyncore.handle_accepted()
, was added to replace it.(由 Giampaolo Rodola 在bpo-6706 中貢獻。)
Due to the newGIL implementation,
PyEval_InitThreads()
cannot be called beforePy_Initialize()
anymore.