Python 2.7 有什麼新功能¶
- 作者:
A.M. Kuchling (amk at amk.ca)
This article explains the new features in Python 2.7. Python 2.7 was releasedon July 3, 2010.
Numeric handling has been improved in many ways, for bothfloating-point numbers and for theDecimal
class.There are some useful additions to the standard library, such as agreatly enhancedunittest
module, theargparse
modulefor parsing command-line options, convenientOrderedDict
andCounter
classes in thecollections
module,and many other improvements.
Python 2.7 is planned to be the last of the 2.x releases, so we workedon making it a good release for the long term. To help with portingto Python 3, several new features from the Python 3.x series have beenincluded in 2.7.
This article doesn't attempt to provide a complete specification ofthe new features, but instead provides a convenient overview. Forfull details, you should refer to the documentation for Python 2.7 athttps://docs.python.org. If you want to understand the rationale forthe design and implementation, refer to the PEP for a particular newfeature or the issue onhttps://bugs.python.org in which a change wasdiscussed. Whenever possible, "What's New in Python" links to thebug/patch item for each change.
Python 2.x 的未來¶
Python 2.7 is the last major release in the 2.x series, as the Pythonmaintainers have shifted the focus of their new feature development effortsto the Python 3.x series. This means that while Python 2 continues toreceive bug fixes, and to be updated to build correctly on new hardware andversions of supported operated systems, there will be no new full featurereleases for the language or standard library.
However, while there is a large common subset between Python 2.7 and Python3, and many of the changes involved in migrating to that common subset, ordirectly to Python 3, can be safely automated, some other changes (notablythose associated with Unicode handling) may require careful consideration,and preferably robust automated regression test suites, to migrateeffectively.
This means that Python 2.7 will remain in place for a long time, providing astable and supported base platform for production systems that have not yetbeen ported to Python 3. The full expected lifecycle of the Python 2.7series is detailed inPEP 373.
Some key consequences of the long-term significance of 2.7 are:
As noted above, the 2.7 release has a much longer period of maintenancewhen compared to earlier 2.x versions. Python 2.7 is currently expected toremain supported by the core development team (receiving security updatesand other bug fixes) until at least 2020 (10 years after its initialrelease, compared to the more typical support period of 18--24 months).
As the Python 2.7 standard library ages, making effective use of thePython Package Index (either directly or via a redistributor) becomesmore important for Python 2 users. In addition to a wide variety of thirdparty packages for various tasks, the available packages include backportsof new modules and features from the Python 3 standard library that arecompatible with Python 2, as well as various tools and libraries that canmake it easier to migrate to Python 3. ThePython Packaging User Guide provides guidance on downloading andinstalling software from the Python Package Index.
While the preferred approach to enhancing Python 2 is now the publicationof new packages on the Python Package Index, this approach doesn'tnecessarily work in all cases, especially those related to networksecurity. In exceptional cases that cannot be handled adequately bypublishing new or updated packages on PyPI, the Python EnhancementProposal process may be used to make the case for adding new featuresdirectly to the Python 2 standard library. Any such additions, and themaintenance releases where they were added, will be noted in theNew Features Added to Python 2.7 Maintenance Releases section below.
For projects wishing to migrate from Python 2 to Python 3, or for libraryand framework developers wishing to support users on both Python 2 andPython 3, there are a variety of tools and guides available to help decideon a suitable approach and manage some of the technical details involved.The recommended starting point is the如何將 Python 2 的程式碼移植到 Python 3 HOWTO guide.
Changes to the Handling of Deprecation Warnings¶
For Python 2.7, a policy decision was made to silence warnings only ofinterest to developers by default.DeprecationWarning
and itsdescendants are now ignored unless otherwise requested, preventingusers from seeing warnings triggered by an application. This changewas also made in the branch that became Python 3.2. (Discussedon stdlib-sig and carried out inbpo-7319.)
In previous releases,DeprecationWarning
messages wereenabled by default, providing Python developers with a clearindication of where their code may break in a future major versionof Python.
However, there are increasingly many users of Python-basedapplications who are not directly involved in the development ofthose applications.DeprecationWarning
messages areirrelevant to such users, making them worry about an applicationthat's actually working correctly and burdening application developerswith responding to these concerns.
You can re-enable display ofDeprecationWarning
messages byrunning Python with the-Wdefault
(short form:-Wd
) switch, or by setting thePYTHONWARNINGS
environment variable to"default"
(or"d"
) before runningPython. Python code can also re-enable themby callingwarnings.simplefilter('default')
.
Theunittest
module also automatically reenables deprecation warningswhen running tests.
Python 3.1 Features¶
Much as Python 2.6 incorporated features from Python 3.0,version 2.7 incorporates some of the new featuresin Python 3.1. The 2.x series continues to provide toolsfor migrating to the 3.x series.
A partial list of 3.1 features that were backported to 2.7:
The syntax for set literals (
{1,2,3}
is a mutable set).Dictionary and set comprehensions (
{i:i*2foriinrange(3)}
).Multiple context managers in a single
with
statement.A new version of the
io
library, rewritten in C for performance.The ordered-dictionary type described inPEP 372: Adding an Ordered Dictionary to collections.
The new
","
format specifier described inPEP 378: Format Specifier for Thousands Separator.memoryview
物件。A small subset of the
importlib
module,described below.The
repr()
of a floatx
is shorter in many cases: it's nowbased on the shortest decimal string that's guaranteed to round backtox
. As in previous versions of Python, it's guaranteed thatfloat(repr(x))
recoversx
.Float-to-string and string-to-float conversions are correctly rounded.The
round()
function is also now correctly rounded.The
PyCapsule
type, used to provide a C API for extension modules.PyLong_AsLongAndOverflow()
C API 函式。
Other new Python3-mode warnings include:
operator.isCallable()
andoperator.sequenceIncludes()
,which are not supported in 3.x, now trigger warnings.The
-3
switch now automaticallyenables the-Qwarn
switch that causes warningsabout using classic division with integers and long integers.
PEP 372: Adding an Ordered Dictionary to collections¶
Regular Python dictionaries iterate over key/value pairs in arbitrary order.Over the years, a number of authors have written alternative implementationsthat remember the order that the keys were originally inserted. Based onthe experiences from those implementations, 2.7 introduces a newOrderedDict
class in thecollections
module.
TheOrderedDict
API provides the same interface as regulardictionaries but iterates over keys and values in a guaranteed orderdepending on when a key was first inserted:
>>>fromcollectionsimportOrderedDict>>>d=OrderedDict([('first',1),...('second',2),...('third',3)])>>>d.items()[('first', 1), ('second', 2), ('third', 3)]
If a new entry overwrites an existing entry, the original insertionposition is left unchanged:
>>>d['second']=4>>>d.items()[('first', 1), ('second', 4), ('third', 3)]
Deleting an entry and reinserting it will move it to the end:
>>>deld['second']>>>d['second']=5>>>d.items()[('first', 1), ('third', 3), ('second', 5)]
Thepopitem()
method has an optionallastargument that defaults toTrue
. Iflast is true, the most recentlyadded key is returned and removed; if it's false, theoldest key is selected:
>>>od=OrderedDict([(x,0)forxinrange(20)])>>>od.popitem()(19, 0)>>>od.popitem()(18, 0)>>>od.popitem(last=False)(0, 0)>>>od.popitem(last=False)(1, 0)
Comparing two ordered dictionaries checks both the keys and values,and requires that the insertion order was the same:
>>>od1=OrderedDict([('first',1),...('second',2),...('third',3)])>>>od2=OrderedDict([('third',3),...('first',1),...('second',2)])>>>od1==od2False>>># Move 'third' key to the end>>>delod2['third'];od2['third']=3>>>od1==od2True
Comparing anOrderedDict
with a regular dictionaryignores the insertion order and just compares the keys and values.
How does theOrderedDict
work? It maintains adoubly linked list of keys, appending new keys to the list as they're inserted.A secondary dictionary maps keys to their corresponding list node, sodeletion doesn't have to traverse the entire linked list and thereforeremainsO(1).
The standard library now supports use of ordered dictionaries in severalmodules.
The
ConfigParser
module uses them by default, meaning thatconfiguration files can now be read, modified, and then written backin their original order.The
_asdict()
method forcollections.namedtuple()
now returns an ordered dictionary with thevalues appearing in the same order as the underlying tuple indices.The
json
module'sJSONDecoder
classconstructor was extended with anobject_pairs_hook parameter toallowOrderedDict
instances to be built by the decoder.Support was also added for third-party tools likePyYAML.
也參考
- PEP 372 - Adding an ordered dictionary to collections
PEP written by Armin Ronacher and Raymond Hettinger;implemented by Raymond Hettinger.
PEP 378: Format Specifier for Thousands Separator¶
To make program output more readable, it can be useful to addseparators to large numbers, rendering them as18,446,744,073,709,551,616 instead of 18446744073709551616.
The fully general solution for doing this is thelocale
module,which can use different separators ("," in North America, "." inEurope) and different grouping sizes, butlocale
is complicatedto use and unsuitable for multi-threaded applications where differentthreads are producing output for different locales.
Therefore, a simple comma-grouping mechanism has been added to themini-language used by thestr.format()
method. Whenformatting a floating-point number, simply include a comma between thewidth and the precision:
>>>'{:20,.2f}'.format(18446744073709551616.0)'18,446,744,073,709,551,616.00'
When formatting an integer, include the comma after the width:
>>>'{:20,d}'.format(18446744073709551616)'18,446,744,073,709,551,616'
This mechanism is not adaptable at all; commas are always used as theseparator and the grouping is always into three-digit groups. Thecomma-formatting mechanism isn't as general as thelocale
module, but it's easier to use.
也參考
- PEP 378 - Format Specifier for Thousands Separator
由 Raymond Hettinger 撰寫 PEP;由 Eric Smith 實作。
PEP 389: The argparse Module for Parsing Command Lines¶
Theargparse
module for parsing command-line arguments wasadded as a more powerful replacement for theoptparse
module.
This means Python now supports three different modules for parsingcommand-line arguments:getopt
,optparse
, andargparse
. Thegetopt
module closely resembles the Clibrary'sgetopt()
function, so it remains useful if you're writing aPython prototype that will eventually be rewritten in C.optparse
becomes redundant, but there are no plans to remove itbecause there are many scripts still using it, and there's noautomated way to update these scripts. (Making theargparse
API consistent withoptparse
's interface was discussed butrejected as too messy and difficult.)
In short, if you're writing a new script and don't need to worryabout compatibility with earlier versions of Python, useargparse
instead ofoptparse
.
以下是個範例:
importargparseparser=argparse.ArgumentParser(description='Command-line example.')# Add optional switchesparser.add_argument('-v',action='store_true',dest='is_verbose',help='produce verbose output')parser.add_argument('-o',action='store',dest='output',metavar='FILE',help='direct output to FILE instead of stdout')parser.add_argument('-C',action='store',type=int,dest='context',metavar='NUM',default=0,help='display NUM lines of added context')# Allow any number of additional arguments.parser.add_argument(nargs='*',action='store',dest='inputs',help='input filenames (default is stdin)')args=parser.parse_args()printargs.__dict__
Unless you override it,-h
and--help
switchesare automatically added, and produce neatly formatted output:
->./python.exeargparse-example.py--helpusage:argparse-example.py[-h][-v][-oFILE][-CNUM][inputs[inputs...]]Command-lineexample.positionalarguments:inputsinputfilenames(defaultisstdin)optionalarguments:-h,--helpshowthishelpmessageandexit-vproduceverboseoutput-oFILEdirectoutputtoFILEinsteadofstdout-CNUMdisplayNUMlinesofaddedcontext
As withoptparse
, the command-line switches and argumentsare returned as an object with attributes named by thedest parameters:
->./python.exeargparse-example.py-v{'output':None,'is_verbose':True,'context':0,'inputs':[]}->./python.exeargparse-example.py-v-o/tmp/output-C4file1file2{'output':'/tmp/output','is_verbose':True,'context':4,'inputs':['file1','file2']}
argparse
has much fancier validation thanoptparse
; youcan specify an exact number of arguments as an integer, 0 or morearguments by passing'*'
, 1 or more by passing'+'
, or anoptional argument with'?'
. A top-level parser can containsub-parsers to define subcommands that have different sets ofswitches, as insvncommit
,svncheckout
, etc. You canspecify an argument's type asFileType
, which willautomatically open files for you and understands that'-'
meansstandard input or output.
也參考
argparse
文件argparse 模組的文件頁面。
- 將 optparse 程式碼遷移到 argparse
Part of the Python documentation, describing how to convertcode that uses
optparse
.- PEP 389 - argparse - New Command Line Parsing Module
由 Steven Bethard 撰寫 PEP 與實作。
PEP 391: Dictionary-Based Configuration For Logging¶
Thelogging
module is very flexible; applications can definea tree of logging subsystems, and each logger in this tree can filterout certain messages, format them differently, and direct messages toa varying number of handlers.
All this flexibility can require a lot of configuration. You canwrite Python statements to create objects and set their properties,but a complex set-up requires verbose but boring code.logging
also supports afileConfig()
function that parses a file, but the file format doesn't supportconfiguring filters, and it's messier to generate programmatically.
Python 2.7 adds adictConfig()
function thatuses a dictionary to configure logging. There are many ways toproduce a dictionary from different sources: construct one with code;parse a file containing JSON; or use a YAML parsing library if one isinstalled. For more information seeConfiguration functions.
The following example configures two loggers, the root logger and alogger named "network". Messages sent to the root logger will besent to the system log using the syslog protocol, and messagesto the "network" logger will be written to anetwork.log
filethat will be rotated once the log reaches 1MB.
importloggingimportlogging.configconfigdict={'version':1,# Configuration schema in use; must be 1 for now'formatters':{'standard':{'format':('%(asctime)s%(name)-15s ''%(levelname)-8s%(message)s')}},'handlers':{'netlog':{'backupCount':10,'class':'logging.handlers.RotatingFileHandler','filename':'/logs/network.log','formatter':'standard','level':'INFO','maxBytes':1000000},'syslog':{'class':'logging.handlers.SysLogHandler','formatter':'standard','level':'ERROR'}},# Specify all the subordinate loggers'loggers':{'network':{'handlers':['netlog']}},# Specify properties of the root logger'root':{'handlers':['syslog']},}# Set up configurationlogging.config.dictConfig(configdict)# As an example, log two error messageslogger=logging.getLogger('/')logger.error('Database not found')netlogger=logging.getLogger('network')netlogger.error('Connection failed')
Three smaller enhancements to thelogging
module, allimplemented by Vinay Sajip, are:
The
SysLogHandler
class now supportssyslogging over TCP. The constructor has asocktype parametergiving the type of socket to use, eithersocket.SOCK_DGRAM
for UDP orsocket.SOCK_STREAM
for TCP. The defaultprotocol remains UDP.Logger
instances gained agetChild()
method that retrieves a descendant logger using a relative path.For example, once you retrieve a logger by doinglog=getLogger('app')
,callinglog.getChild('network.listen')
is equivalent togetLogger('app.network.listen')
.The
LoggerAdapter
class gained anisEnabledFor()
method that takes alevel and returns whether the underlying logger wouldprocess a message of that level of importance.
也參考
- PEP 391 - Dictionary-Based Configuration For Logging
由 Vinay Sajip 撰寫 PEP 與實作。
PEP 3106: Dictionary Views¶
The dictionary methodskeys()
,values()
, anditems()
are different in Python 3.x. They return an objectcalled aview instead of a fully materialized list.
It's not possible to change the return values ofkeys()
,values()
, anditems()
in Python 2.7 becausetoo much code would break. Instead the 3.x versions were addedunder the new namesviewkeys()
,viewvalues()
,andviewitems()
.
>>>d=dict((i*10,chr(65+i))foriinrange(26))>>>d{0: 'A', 130: 'N', 10: 'B', 140: 'O', 20: ..., 250: 'Z'}>>>d.viewkeys()dict_keys([0, 130, 10, 140, 20, 150, 30, ..., 250])
Views can be iterated over, but the key and item views also behavelike sets. The&
operator performs intersection, and|
performs a union:
>>>d1=dict((i*10,chr(65+i))foriinrange(26))>>>d2=dict((i**.5,i)foriinrange(1000))>>>d1.viewkeys()&d2.viewkeys()set([0.0, 10.0, 20.0, 30.0])>>>d1.viewkeys()|range(0,30)set([0, 1, 130, 3, 4, 5, 6, ..., 120, 250])
The view keeps track of the dictionary and its contents change as thedictionary is modified:
>>>vk=d.viewkeys()>>>vkdict_keys([0, 130, 10, ..., 250])>>>d[260]='&'>>>vkdict_keys([0, 130, 260, 10, ..., 250])
However, note that you can't add or remove keys while you're iteratingover the view:
>>>forkinvk:...d[k*2]=k...Traceback (most recent call last): File"<stdin>", line1, in<module>RuntimeError:dictionary changed size during iteration
You can use the view methods in Python 2.x code, and the 2to3converter will change them to the standardkeys()
,values()
, anditems()
methods.
PEP 3137: The memoryview Object¶
Thememoryview
object provides a view of another object'smemory content that matches thebytes
type's interface.
>>>importstring>>>m=memoryview(string.letters)>>>m<memory at 0x37f850>>>>len(m)# Returns length of underlying object52>>>m[0],m[25],m[26]# Indexing returns one byte('a', 'z', 'A')>>>m2=m[0:26]# Slicing returns another memoryview>>>m2<memory at 0x37f080>
The content of the view can be converted to a string of bytes ora list of integers:
>>>m2.tobytes()'abcdefghijklmnopqrstuvwxyz'>>>m2.tolist()[97, 98, 99, 100, 101, 102, 103, ... 121, 122]>>>
memoryview
objects allow modifying the underlying object ifit's a mutable object.
>>>m2[0]=75Traceback (most recent call last): File"<stdin>", line1, in<module>TypeError:cannot modify read-only memory>>>b=bytearray(string.letters)# Creating a mutable object>>>bbytearray(b'abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ')>>>mb=memoryview(b)>>>mb[0]='*'# Assign to view, changing the bytearray.>>>b[0:5]# The bytearray has been changed.bytearray(b'*bcde')>>>
其他語言更動¶
Some smaller changes made to the core Python language are:
The syntax for set literals has been backported from Python 3.x.Curly brackets are used to surround the contents of the resultingmutable set; set literals aredistinguished from dictionaries by not containing colons and values.
{}
continues to represent an empty dictionary; useset()
for an empty set.>>>{1,2,3,4,5}set([1, 2, 3, 4, 5])>>>set()# empty setset([])>>>{}# empty dict{}
Backported by Alexandre Vassalotti;bpo-2335.
Dictionary and set comprehensions are another feature backported from3.x, generalizing list/generator comprehensions to usethe literal syntax for sets and dictionaries.
>>>{x:x*xforxinrange(6)}{0: 0, 1: 1, 2: 4, 3: 9, 4: 16, 5: 25}>>>{('a'*x)forxinrange(6)}set(['', 'a', 'aa', 'aaa', 'aaaa', 'aaaaa'])
Backported by Alexandre Vassalotti;bpo-2333.
The
with
statement can now use multiple context managersin one statement. Context managers are processed from left to rightand each one is treated as beginning a newwith
statement.This means that:withA()asa,B()asb:...suiteofstatements...
等價於:
withA()asa:withB()asb:...suiteofstatements...
The
contextlib.nested()
function provides a very similarfunction, so it's no longer necessary and has been deprecated.(於https://codereview.appspot.com/53094 提出;由 Georg Brandl 實作。)
Conversions between floating-point numbers and strings arenow correctly rounded on most platforms. These conversions occurin many different places:
str()
onfloats and complex numbers; thefloat
andcomplex
constructors;numeric formatting; serializing anddeserializing floats and complex numbers using themarshal
,pickle
andjson
modules;parsing of float and imaginary literals in Python code;andDecimal
-to-float conversion.Related to this, the
repr()
of a floating-point numberxnow returns a result based on the shortest decimal string that'sguaranteed to round back tox under correct rounding (withround-half-to-even rounding mode). Previously it gave a stringbased on rounding x to 17 decimal digits.The rounding library responsible for this improvement works onWindows and on Unix platforms using the gcc, icc, or suncccompilers. There may be a small number of platforms where correctoperation of this code cannot be guaranteed, so the code is notused on such systems. You can find out which code is being usedby checking
sys.float_repr_style
, which will beshort
if the new code is in use andlegacy
if it isn't.Implemented by Eric Smith and Mark Dickinson, using David Gay's
dtoa.c
library;bpo-7117.Conversions from long integers and regular integers to floatingpoint now round differently, returning the floating-point numberclosest to the number. This doesn't matter for small integers thatcan be converted exactly, but for large numbers that willunavoidably lose precision, Python 2.7 now approximates moreclosely. For example, Python 2.6 computed the following:
>>>n=295147905179352891391>>>float(n)2.9514790517935283e+20>>>n-long(float(n))65535L
Python 2.7's floating-point result is larger, but much closer to thetrue value:
>>>n=295147905179352891391>>>float(n)2.9514790517935289e+20>>>n-long(float(n))-1L
(由 Mark Dickinson 實作;bpo-3166。)
Integer division is also more accurate in its rounding behaviours. (Alsoimplemented by Mark Dickinson;bpo-1811.)
Implicit coercion for complex numbers has been removed; the interpreterwill no longer ever attempt to call a
__coerce__()
method on complexobjects. (Removed by Meador Inge and Mark Dickinson;bpo-5211.)The
str.format()
method now supports automatic numbering of the replacementfields. This makes usingstr.format()
more closely resemble using%s
formatting:>>>'{}:{}:{}'.format(2009,04,'Sunday')'2009:4:Sunday'>>>'{}:{}:{day}'.format(2009,4,day='Sunday')'2009:4:Sunday'
The auto-numbering takes the fields from left to right, so the first
{...}
specifier will use the first argument tostr.format()
, the nextspecifier will use the next argument, and so on. You can't mix auto-numberingand explicit numbering -- either number all of your specifier fields or noneof them -- but you can mix auto-numbering and named fields, as in the secondexample above. (Contributed by Eric Smith;bpo-5237.)Complex numbers now correctly support usage with
format()
,and default to being right-aligned.Specifying a precision or comma-separation applies to both the realand imaginary parts of the number, but a specified field width andalignment is applied to the whole of the resulting1.5+3j
output. (Contributed by Eric Smith;bpo-1588 andbpo-7988.)The 'F' format code now always formats its output using uppercase characters,so it will now produce 'INF' and 'NAN'.(Contributed by Eric Smith;bpo-3382.)
A low-level change: the
object.__format__()
method now triggersaPendingDeprecationWarning
if it's passed a format string,because the__format__()
method forobject
convertsthe object to a string representation and formats that. Previouslythe method silently applied the format string to the stringrepresentation, but that could hide mistakes in Python code. Ifyou're supplying formatting information such as an alignment orprecision, presumably you're expecting the formatting to be appliedin some object-specific way. (Fixed by Eric Smith;bpo-7994.)The
int()
andlong()
types gained abit_length
method that returns the number of bits necessary to representits argument in binary:>>>n=37>>>bin(n)'0b100101'>>>n.bit_length()6>>>n=2**123-1>>>n.bit_length()123>>>(n+1).bit_length()124
(由 Fredrik Johansson 和 Victor Stinner 貢獻;bpo-3439。)
The
import
statement will no longer try an absolute importif a relative import (e.g.from.osimportsep
) fails. Thisfixes a bug, but could possibly break certainimport
statements that were only working by accident. (Fixed by Meador Inge;bpo-7902.)It's now possible for a subclass of the built-in
unicode
typeto override the__unicode__()
method. (Implemented byVictor Stinner;bpo-1583863.)The
bytearray
type'stranslate()
method now acceptsNone
as its first argument. (Fixed by Georg Brandl;bpo-4759.)When using
@classmethod
and@staticmethod
to wrapmethods as class or static methods, the wrapper object nowexposes the wrapped function as their__func__
attribute.(Contributed by Amaury Forgeot d'Arc, after a suggestion byGeorge Sakkis;bpo-5982.)When a restricted set of attributes were set using
__slots__
,deleting an unset attribute would not raiseAttributeError
as you would expect. Fixed by Benjamin Peterson;bpo-7604.)Two new encodings are now supported: "cp720", used primarily forArabic text; and "cp858", a variant of CP 850 that adds the eurosymbol. (CP720 contributed by Alexander Belchenko and AmauryForgeot d'Arc inbpo-1616979; CP858 contributed by Tim Hatch inbpo-8016.)
The
file
object will now set thefilename
attributeon theIOError
exception when trying to open a directoryon POSIX platforms (noted by Jan Kaliszewski;bpo-4764), andnow explicitly checks for and forbids writing to read-only file objectsinstead of trusting the C library to catch and report the error(fixed by Stefan Krah;bpo-5677).The Python tokenizer now translates line endings itself, so the
compile()
built-in function now accepts code using anyline-ending convention. Additionally, it no longer requires that thecode end in a newline.Extra parentheses in function definitions are illegal in Python 3.x,meaning that you get a syntax error from
deff((x)):pass
. InPython3-warning mode, Python 2.7 will now warn about this odd usage.(Noted by James Lingard;bpo-7362.)It's now possible to create weak references to old-style classobjects. New-style classes were always weak-referenceable. (Fixedby Antoine Pitrou;bpo-8268.)
When a module object is garbage-collected, the module's dictionary isnow only cleared if no one else is holding a reference to thedictionary (bpo-7140).
Interpreter Changes¶
A new environment variable,PYTHONWARNINGS
,allows controlling warnings. It should be set to a stringcontaining warning settings, equivalent to thoseused with the-W
switch, separated by commas.(Contributed by Brian Curtin;bpo-7301.)
For example, the following setting will print warnings every timethey occur, but turn warnings from theCookie
module into anerror. (The exact syntax for setting an environment variable variesacross operating systems and shells.)
exportPYTHONWARNINGS=all,error:::Cookie:0
最佳化¶
Several performance enhancements have been added:
A new opcode was added to perform the initial setup for
with
statements, looking up the__enter__()
and__exit__()
methods. (Contributed by Benjamin Peterson.)The garbage collector now performs better for one common usagepattern: when many objects are being allocated without deallocatingany of them. This would previously take quadratictime for garbage collection, but now the number of full garbage collectionsis reduced as the number of objects on the heap grows.The new logic only performs a full garbage collection pass whenthe middle generation has been collected 10 times and when thenumber of survivor objects from the middle generation exceeds 10% ofthe number of objects in the oldest generation. (Suggested by Martinvon Löwis and implemented by Antoine Pitrou;bpo-4074.)
The garbage collector tries to avoid tracking simple containerswhich can't be part of a cycle. In Python 2.7, this is now true fortuples and dicts containing atomic types (such as ints, strings,etc.). Transitively, a dict containing tuples of atomic types won'tbe tracked either. This helps reduce the cost of eachgarbage collection by decreasing the number of objects to beconsidered and traversed by the collector.(Contributed by Antoine Pitrou;bpo-4688.)
Long integers are now stored internally either in base
2**15
or in base2**30
, the base being determined at build time. Previously, theywere always stored in base2**15
. Using base2**30
givessignificant performance improvements on 64-bit machines, butbenchmark results on 32-bit machines have been mixed. Therefore,the default is to use base2**30
on 64-bit machines and base2**15
on 32-bit machines; on Unix, there's a new configure option--enable-big-digits
that can be used to override this default.Apart from the performance improvements this change should beinvisible to end users, with one exception: for testing anddebugging purposes there's a new structseq
sys.long_info
thatprovides information about the internal format, giving the number ofbits per digit and the size in bytes of the C type used to storeeach digit:>>>importsys>>>sys.long_infosys.long_info(bits_per_digit=30, sizeof_digit=4)
(由 Mark Dickinson 貢獻;bpo-4258。)
Another set of changes made long objects a few bytes smaller: 2 bytessmaller on 32-bit systems and 6 bytes on 64-bit.(Contributed by Mark Dickinson;bpo-5260.)
The division algorithm for long integers has been made fasterby tightening the inner loop, doing shifts instead of multiplications,and fixing an unnecessary extra iteration.Various benchmarks show speedups of between 50% and 150% for longinteger divisions and modulo operations.(Contributed by Mark Dickinson;bpo-5512.)Bitwise operations are also significantly faster (initial patch byGregory Smith;bpo-1087418).
The implementation of
%
checks for the left-side operand beinga Python string and special-cases it; this results in a 1--3%performance increase for applications that frequently use%
with strings, such as templating libraries.(Implemented by Collin Winter;bpo-5176.)List comprehensions with an
if
condition are compiled intofaster bytecode. (Patch by Antoine Pitrou, back-ported to 2.7by Jeffrey Yasskin;bpo-4715.)Converting an integer or long integer to a decimal string was madefaster by special-casing base 10 instead of using a generalizedconversion function that supports arbitrary bases.(Patch by Gawain Bolton;bpo-6713.)
The
split()
,replace()
,rindex()
,rpartition()
, andrsplit()
methods of string-like types(strings, Unicode strings, andbytearray
objects) now use afast reverse-search algorithm instead of a character-by-characterscan. This is sometimes faster by a factor of 10. (Added byFlorent Xicluna;bpo-7462 andbpo-7622.)The
pickle
andcPickle
modules now automaticallyintern the strings used for attribute names, reducing memory usageof the objects resulting from unpickling. (Contributed by JakeMcGuire;bpo-5084.)The
cPickle
module now special-cases dictionaries,nearly halving the time required to pickle them.(Contributed by Collin Winter;bpo-5670.)
New and Improved Modules¶
As in every release, Python's standard library received a number ofenhancements and bug fixes. Here's a partial list of the most notablechanges, sorted alphabetically by module name. Consult theMisc/NEWS
file in the source tree for a more complete list ofchanges, or look through the Subversion logs for all the details.
The
bdb
module's base debugging classBdb
gained a feature for skipping modules. The constructornow takes an iterable containing glob-style patterns such asdjango.*
; the debugger will not step into stack framesfrom a module that matches one of these patterns.(Contributed by Maru Newby after a suggestion bySenthil Kumaran;bpo-5142.)The
binascii
module now supports the buffer API, so it can beused withmemoryview
instances and other similar buffer objects.(Backported from 3.x by Florent Xicluna;bpo-7703.)Updated module: the
bsddb
module has been updated from 4.7.2devel9to version 4.8.4 ofthe pybsddb package.The new version features better Python 3.x compatibility, various bug fixes,and adds several new BerkeleyDB flags and methods.(Updated by Jesús Cea Avión;bpo-8156. The pybsddbchangelog can be read athttps://hg.jcea.es/pybsddb/file/tip/ChangeLog.)The
bz2
module'sBZ2File
now supports the contextmanagement protocol, so you can writewithbz2.BZ2File(...)asf:
.(Contributed by Hagen Fürstenau;bpo-3860.)New class: the
Counter
class in thecollections
module is useful for tallying data.Counter
instancesbehave mostly like dictionaries but return zero for missing keys instead ofraising aKeyError
:>>>fromcollectionsimportCounter>>>c=Counter()>>>forletterin'here is a sample of english text':...c[letter]+=1...>>>cCounter({' ': 6, 'e': 5, 's': 3, 'a': 2, 'i': 2, 'h': 2,'l': 2, 't': 2, 'g': 1, 'f': 1, 'm': 1, 'o': 1, 'n': 1,'p': 1, 'r': 1, 'x': 1})>>>c['e']5>>>c['z']0
There are three additional
Counter
methods.most_common()
returns the N most commonelements and their counts.elements()
returns an iterator over the contained elements, repeating eachelement as many times as its count.subtract()
takes an iterable andsubtracts one for each element instead of adding; if the argument isa dictionary or anotherCounter
, the counts aresubtracted.>>>c.most_common(5)[(' ', 6), ('e', 5), ('s', 3), ('a', 2), ('i', 2)]>>>c.elements()-> 'a', 'a', ' ', ' ', ' ', ' ', ' ', ' ', 'e', 'e', 'e', 'e', 'e', 'g', 'f', 'i', 'i', 'h', 'h', 'm', 'l', 'l', 'o', 'n', 'p', 's', 's', 's', 'r', 't', 't', 'x'>>>c['e']5>>>c.subtract('very heavy on the letter e')>>>c['e']# Count is now lower-1
由 Raymond Hettinger 貢獻;bpo-1696199。
New class:
OrderedDict
is described in the earliersectionPEP 372: Adding an Ordered Dictionary to collections.New method: The
deque
data type now has acount()
method that returns the number ofcontained elements equal to the supplied argumentx, and areverse()
method that reverses the elementsof the deque in-place.deque
also exposes its maximumlength as the read-onlymaxlen
attribute.(Both features added by Raymond Hettinger.)The
namedtuple
class now has an optionalrename parameter.Ifrename is true, field names that are invalid because they'vebeen repeated or aren't legal Python identifiers will berenamed to legal names that are derived from the field'sposition within the list of fields:>>>fromcollectionsimportnamedtuple>>>T=namedtuple('T',['field1','$illegal','for','field2'],rename=True)>>>T._fields('field1', '_1', '_2', 'field2')
(Added by Raymond Hettinger;bpo-1818.)
Finally, the
Mapping
abstract base class nowreturnsNotImplemented
if a mapping is compared toanother type that isn't aMapping
.(Fixed by Daniel Stutzbach;bpo-8729.)Constructors for the parsing classes in the
ConfigParser
module nowtake anallow_no_value parameter, defaulting to false; if true,options without values will be allowed. For example:>>>importConfigParser,StringIO>>>sample_config="""...[mysqld]...user = mysql...pid-file = /var/run/mysqld/mysqld.pid...skip-bdb...""">>>config=ConfigParser.RawConfigParser(allow_no_value=True)>>>config.readfp(StringIO.StringIO(sample_config))>>>config.get('mysqld','user')'mysql'>>>printconfig.get('mysqld','skip-bdb')None>>>printconfig.get('mysqld','unknown')Traceback (most recent call last):...NoOptionError:No option 'unknown' in section: 'mysqld'
(由 Mats Kindahl 貢獻;bpo-7005。)
Deprecated function:
contextlib.nested()
, which allowshandling more than one context manager with a singlewith
statement, has been deprecated, because thewith
statementnow supports multiple context managers.The
cookielib
module now ignores cookies that have an invalidversion field, one that doesn't contain an integer value. (Fixed byJohn J. Lee;bpo-3924.)The
copy
module'sdeepcopy()
function will nowcorrectly copy bound instance methods. (Implemented byRobert Collins;bpo-1515.)The
ctypes
module now always convertsNone
to a CNULL
pointer for arguments declared as pointers. (Changed by ThomasHeller;bpo-4606.) The underlyinglibffi library has been updated to version3.0.9, containing various fixes for different platforms. (Updatedby Matthias Klose;bpo-8142.)New method: the
datetime
module'stimedelta
classgained atotal_seconds()
method that returns thenumber of seconds in the duration. (Contributed by Brian Quinlan;bpo-5788.)New method: the
Decimal
class gained afrom_float()
class method that performs an exactconversion of a floating-point number to aDecimal
.This exact conversion strives for theclosest decimal approximation to the floating-point representation's value;the resulting decimal value will therefore still include the inaccuracy,if any.For example,Decimal.from_float(0.1)
returnsDecimal('0.1000000000000000055511151231257827021181583404541015625')
.(Implemented by Raymond Hettinger;bpo-4796.)Comparing instances of
Decimal
with floating-pointnumbers now produces sensible results based on the numeric valuesof the operands. Previously such comparisons would fall back toPython's default rules for comparing objects, which produced arbitraryresults based on their type. Note that you still cannot combineDecimal
and floating point in other operations such as addition,since you should be explicitly choosing how to convert between float andDecimal
. (Fixed by Mark Dickinson;bpo-2531.)The constructor for
Decimal
now acceptsfloating-point numbers (added by Raymond Hettinger;bpo-8257)and non-European Unicode characters such as Arabic-Indic digits(contributed by Mark Dickinson;bpo-6595).Most of the methods of the
Context
class now accept integersas well asDecimal
instances; the only exceptions are thecanonical()
andis_canonical()
methods. (Patch by Juan José Conti;bpo-7633.)When using
Decimal
instances with a string'sformat()
method, the default alignment was previouslyleft-alignment. This has been changed to right-alignment, which ismore sensible for numeric types. (Changed by Mark Dickinson;bpo-6857.)Comparisons involving a signaling NaN value (or
sNAN
) now signalInvalidOperation
instead of silently returning a true orfalse value depending on the comparison operator. Quiet NaN values(orNaN
) are now hashable. (Fixed by Mark Dickinson;bpo-7279.)The
difflib
module now produces output that is morecompatible with moderndiff/patch toolsthrough one small change, using a tab character instead of spaces asa separator in the header giving the filename. (Fixed by AnatolyTechtonik;bpo-7585.)The Distutils
sdist
command now always regenerates theMANIFEST
file, since even if theMANIFEST.in
orsetup.py
files haven't been modified, the user might havecreated some new files that should be included.(Fixed by Tarek Ziadé;bpo-8688.)The
doctest
module'sIGNORE_EXCEPTION_DETAIL
flagwill now ignore the name of the module containing the exceptionbeing tested. (Patch by Lennart Regebro;bpo-7490.)The
email
module'sMessage
class willnow accept a Unicode-valued payload, automatically converting thepayload to the encoding specified byoutput_charset
.(Added by R. David Murray;bpo-1368247.)The
Fraction
class now accepts a single float orDecimal
instance, or two rational numbers, asarguments to its constructor. (Implemented by Mark Dickinson;rationals added inbpo-5812, and float/decimal inbpo-8294.)Ordering comparisons (
<
,<=
,>
,>=
) betweenfractions and complex numbers now raise aTypeError
.This fixes an oversight, making theFraction
match the other numeric types.New class:
FTP_TLS
intheftplib
module provides secure FTPconnections using TLS encapsulation of authentication as well assubsequent control and data transfers.(Contributed by Giampaolo Rodola;bpo-2054.)The
storbinary()
method for binary uploads can now restartuploads thanks to an addedrest parameter (patch by Pablo Mouzo;bpo-6845.)New class decorator:
total_ordering()
in thefunctools
module takes a class that defines an__eq__()
method and one of__lt__()
,__le__()
,__gt__()
, or__ge__()
,and generates the missing comparison methods. Since the__cmp__()
method is being deprecated in Python 3.x,this decorator makes it easier to define ordered classes.(Added by Raymond Hettinger;bpo-5479.)New function:
cmp_to_key()
will take an old-style comparisonfunction that expects two arguments and return a new callable thatcan be used as thekey parameter to functions such assorted()
,min()
andmax()
, etc. The primaryintended use is to help with making code compatible with Python 3.x.(Added by Raymond Hettinger.)New function: the
gc
module'sis_tracked()
returnstrue if a given instance is tracked by the garbage collector, falseotherwise. (Contributed by Antoine Pitrou;bpo-4688.)The
gzip
module'sGzipFile
now supports the contextmanagement protocol, so you can writewithgzip.GzipFile(...)asf:
(contributed by Hagen Fürstenau;bpo-3860), and it now implementstheio.BufferedIOBase
ABC, so you can wrap it withio.BufferedReader
for faster processing(contributed by Nir Aides;bpo-7471).It's also now possible to override the modification timerecorded in a gzipped file by providing an optional timestamp tothe constructor. (Contributed by Jacques Frechet;bpo-4272.)Files in gzip format can be padded with trailing zero bytes; the
gzip
module will now consume these trailing bytes. (Fixed byTadek Pietraszek and Brian Curtin;bpo-2846.)New attribute: the
hashlib
module now has analgorithms
attribute containing a tuple naming the supported algorithms.In Python 2.7,hashlib.algorithms
contains('md5','sha1','sha224','sha256','sha384','sha512')
.(Contributed by Carl Chenet;bpo-7418.)The default
HTTPResponse
class used by thehttplib
module nowsupports buffering, resulting in much faster reading of HTTP responses.(Contributed by Kristján Valur Jónsson;bpo-4879.)The
HTTPConnection
andHTTPSConnection
classesnow support asource_address parameter, a(host,port)
2-tuplegiving the source address that will be used for the connection.(Contributed by Eldon Ziegler;bpo-3972.)The
ihooks
module now supports relative imports. Note thatihooks
is an older module for customizing imports,superseded by theimputil
module added in Python 2.0.(Relative import support added by Neil Schemenauer.)The
imaplib
module now supports IPv6 addresses.(Contributed by Derek Morr;bpo-1655.)New function: the
inspect
module'sgetcallargs()
takes a callable and its positional and keyword arguments,and figures out which of the callable's parameters will receive each argument,returning a dictionary mapping argument names to their values. For example:>>>frominspectimportgetcallargs>>>deff(a,b=1,*pos,**named):...pass...>>>getcallargs(f,1,2,3){'a': 1, 'b': 2, 'pos': (3,), 'named': {}}>>>getcallargs(f,a=2,x=4){'a': 2, 'b': 1, 'pos': (), 'named': {'x': 4}}>>>getcallargs(f)Traceback (most recent call last):...TypeError:f() takes at least 1 argument (0 given)
由 George Sakkis 貢獻;bpo-3135。
Updated module: The
io
library has been upgraded to the version shipped withPython 3.1. For 3.1, the I/O library was entirely rewritten in Cand is 2 to 20 times faster depending on the task being performed. Theoriginal Python version was renamed to the_pyio
module.One minor resulting change: the
io.TextIOBase
class nowhas anerrors
attribute giving the error settingused for encoding and decoding errors (one of'strict'
,'replace'
,'ignore'
).The
io.FileIO
class now raises anOSError
when passedan invalid file descriptor. (Implemented by Benjamin Peterson;bpo-4991.) Thetruncate()
method now preserves thefile position; previously it would change the file position to theend of the new file. (Fixed by Pascal Chambon;bpo-6939.)New function:
itertools.compress(data,selectors)
takes twoiterators. Elements ofdata are returned if the correspondingvalue inselectors is true:itertools.compress('ABCDEF',[1,0,1,0,1,1])=>A,C,E,F
New function:
itertools.combinations_with_replacement(iter,r)
returns all the possibler-length combinations of elements from theiterableiter. Unlikecombinations()
, individual elementscan be repeated in the generated combinations:itertools.combinations_with_replacement('abc',2)=>('a','a'),('a','b'),('a','c'),('b','b'),('b','c'),('c','c')
Note that elements are treated as unique depending on their positionin the input, not their actual values.
The
itertools.count()
function now has astep argument thatallows incrementing by values other than 1.count()
alsonow allows keyword arguments, and using non-integer values such asfloats orDecimal
instances. (Implemented by RaymondHettinger;bpo-5032.)itertools.combinations()
anditertools.product()
previously raisedValueError
for values ofr larger thanthe input iterable. This was deemed a specification error, so theynow return an empty iterator. (Fixed by Raymond Hettinger;bpo-4816.)Updated module: The
json
module was upgraded to version 2.0.9 of thesimplejson package, which includes a C extension that makesencoding and decoding faster.(Contributed by Bob Ippolito;bpo-4136.)To support the new
collections.OrderedDict
type,json.load()
now has an optionalobject_pairs_hook parameter that will be calledwith any object literal that decodes to a list of pairs.(Contributed by Raymond Hettinger;bpo-5381.)The
mailbox
module'sMaildir
class now records thetimestamp on the directories it reads, and only re-reads them if themodification time has subsequently changed. This improvesperformance by avoiding unneeded directory scans. (Fixed byA.M. Kuchling and Antoine Pitrou;bpo-1607951,bpo-6896.)New functions: the
math
module gainederf()
anderfc()
for the error function and the complementary error function,expm1()
which computese**x-1
with more precision thanusingexp()
and subtracting 1,gamma()
for the Gamma function, andlgamma()
for the natural log of the Gamma function.(Contributed by Mark Dickinson and nirinA raseliarison;bpo-3366.)The
multiprocessing
module'sManager*
classescan now be passed a callable that will be called whenevera subprocess is started, along with a set of arguments that will bepassed to the callable.(Contributed by lekma;bpo-5585.)The
Pool
class, which controls a pool of worker processes,now has an optionalmaxtasksperchild parameter. Worker processeswill perform the specified number of tasks and then exit, causing thePool
to start a new worker. This is useful if tasks may leakmemory or other resources, or if some tasks will cause the worker tobecome very large.(Contributed by Charles Cazabon;bpo-6963.)The
nntplib
module now supports IPv6 addresses.(Contributed by Derek Morr;bpo-1664.)New functions: the
os
module wraps the following POSIX systemcalls:getresgid()
andgetresuid()
, which return thereal, effective, and saved GIDs and UIDs;setresgid()
andsetresuid()
, which setreal, effective, and saved GIDs and UIDs to new values;initgroups()
, which initialize the group access listfor the current process. (GID/UID functionscontributed by Travis H.;bpo-6508. Support for initgroups addedby Jean-Paul Calderone;bpo-7333.)The
os.fork()
function now re-initializes the import lock inthe child process; this fixes problems on Solaris whenfork()
is called from a thread. (Fixed by Zsolt Cserna;bpo-7242.)In the
os.path
module, thenormpath()
andabspath()
functions now preserve Unicode; if their input pathis a Unicode string, the return value is also a Unicode string.(normpath()
fixed by Matt Giuca inbpo-5827;abspath()
fixed by Ezio Melotti inbpo-3426.)The
pydoc
module now has help for the various symbols that Pythonuses. You can now dohelp('<<')
orhelp('@')
, for example.(Contributed by David Laban;bpo-4739.)The
re
module'ssplit()
,sub()
, andsubn()
now accept an optionalflags argument, for consistency with theother functions in the module. (Added by Gregory P. Smith.)New function:
run_path()
in therunpy
modulewill execute the code at a providedpath argument.path can bethe path of a Python source file (example.py
), a compiledbytecode file (example.pyc
), a directory(./package/
), or a zip archive (example.zip
). If adirectory or zip path is provided, it will be added to the front ofsys.path
and the module__main__
will be imported. It'sexpected that the directory or zip contains a__main__.py
;if it doesn't, some other__main__.py
might be imported froma location later insys.path
. This makes more of the machineryofrunpy
available to scripts that want to mimic the wayPython's command line processes an explicit path name.(Added by Nick Coghlan;bpo-6816.)New function: in the
shutil
module,make_archive()
takes a filename, archive type (zip or tar-format), and a directorypath, and creates an archive containing the directory's contents.(Added by Tarek Ziadé.)shutil
'scopyfile()
andcopytree()
functions now raise aSpecialFileError
exception whenasked to copy a named pipe. Previously the code would treatnamed pipes like a regular file by opening them for reading, andthis would block indefinitely. (Fixed by Antoine Pitrou;bpo-3002.)The
signal
module no longer re-installs the signal handlerunless this is truly necessary, which fixes a bug that could make itimpossible to catch the EINTR signal robustly. (Fixed byCharles-Francois Natali;bpo-8354.)New functions: in the
site
module, three new functionsreturn various site- and user-specific paths.getsitepackages()
returns a list containing allglobal site-packages directories,getusersitepackages()
returns the path of the user'ssite-packages directory, andgetuserbase()
returns the value of theUSER_BASE
environment variable, giving the path to a directory that can be usedto store data.(Contributed by Tarek Ziadé;bpo-6693.)The
site
module now reports exceptions occurringwhen thesitecustomize
module is imported, and will no longercatch and swallow theKeyboardInterrupt
exception. (Fixed byVictor Stinner;bpo-3137.)The
create_connection()
functiongained asource_address parameter, a(host,port)
2-tuplegiving the source address that will be used for the connection.(Contributed by Eldon Ziegler;bpo-3972.)The
recv_into()
andrecvfrom_into()
methods will now write into objects that support the buffer API, most usefullythebytearray
andmemoryview
objects. (Implemented byAntoine Pitrou;bpo-8104.)The
SocketServer
module'sTCPServer
class nowsupports socket timeouts and disabling the Nagle algorithm.Thedisable_nagle_algorithm
class attributedefaults toFalse
; if overridden to be true,new request connections will have the TCP_NODELAY option set toprevent buffering many small sends into a single TCP packet.Thetimeout
class attribute can holda timeout in seconds that will be applied to the request socket; ifno request is received within that time,handle_timeout()
will be called andhandle_request()
will return.(Contributed by Kristján Valur Jónsson;bpo-6192 andbpo-6267.)Updated module: the
sqlite3
module has been updated toversion 2.6.0 of thepysqlite package. Version 2.6.0 includes a number of bugfixes, and addsthe ability to load SQLite extensions from shared libraries.Call theenable_load_extension(True)
method to enable extensions,and then callload_extension()
to load a particular shared library.(Updated by Gerhard Häring.)The
ssl
module'sSSLSocket
objects now support thebuffer API, which fixed a test suite failure (fix by Antoine Pitrou;bpo-7133) and automatically setOpenSSL'sSSL_MODE_AUTO_RETRY
, which will prevent an errorcode being returned fromrecv()
operations that trigger an SSLrenegotiation (fix by Antoine Pitrou;bpo-8222).The
wrap_socket()
constructor function now takes aciphers argument that's a string listing the encryption algorithmsto be allowed; the format of the string is describedin the OpenSSL documentation.(Added by Antoine Pitrou;bpo-8322.)Another change makes the extension load all of OpenSSL's ciphers anddigest algorithms so that they're all available. Some SSLcertificates couldn't be verified, reporting an "unknown algorithm"error. (Reported by Beda Kosata, and fixed by Antoine Pitrou;bpo-8484.)
The version of OpenSSL being used is now available as the moduleattributes
ssl.OPENSSL_VERSION
(a string),ssl.OPENSSL_VERSION_INFO
(a 5-tuple), andssl.OPENSSL_VERSION_NUMBER
(an integer). (Added by AntoinePitrou;bpo-8321.)The
struct
module will no longer silently ignore overflowerrors when a value is too large for a particular integer formatcode (one ofbBhHiIlLqQ
); it now always raises astruct.error
exception. (Changed by Mark Dickinson;bpo-1523.) Thepack()
function will alsoattempt to use__index__()
to convert and pack non-integersbefore trying the__int__()
method or reporting an error.(Changed by Mark Dickinson;bpo-8300.)New function: the
subprocess
module'scheck_output()
runs a command with a specified set of argumentsand returns the command's output as a string when the command runs withouterror, or raises aCalledProcessError
exception otherwise.>>>subprocess.check_output(['df','-h','.'])'Filesystem Size Used Avail Capacity Mounted on\n/dev/disk0s2 52G 49G 3.0G 94% /\n'>>>subprocess.check_output(['df','-h','/bogus']) ...subprocess.CalledProcessError: Command '['df', '-h', '/bogus']' returned non-zero exit status 1
(由 Gregory P. Smith 所貢獻。)
The
subprocess
module will now retry its internal system callson receiving anEINTR
signal. (Reported by several people; finalpatch by Gregory P. Smith inbpo-1068268.)New function:
is_declared_global()
in thesymtable
modulereturns true for variables that are explicitly declared to be global,false for ones that are implicitly global.(Contributed by Jeremy Hylton.)The
syslog
module will now use the value ofsys.argv[0]
as theidentifier instead of the previous default value of'python'
.(Changed by Sean Reifschneider;bpo-8451.)The
sys.version_info
value is now a named tuple, with attributesnamedmajor
,minor
,micro
,releaselevel
, andserial
. (Contributed by RossLight;bpo-4285.)sys.getwindowsversion()
also returns a named tuple,with attributes namedmajor
,minor
,build
,platform
,service_pack
,service_pack_major
,service_pack_minor
,suite_mask
, andproduct_type
. (Contributed by Brian Curtin;bpo-7766.)The
tarfile
module's default error handling has changed, tono longer suppress fatal errors. The default error level was previously 0,which meant that errors would only result in a message being written to thedebug log, but because the debug log is not activated by default,these errors go unnoticed. The default error level is now 1,which raises an exception if there's an error.(Changed by Lars Gustäbel;bpo-7357.)tarfile
now supports filtering theTarInfo
objects being added to a tar file. When you calladd()
,you may supply an optionalfilter argumentthat's a callable. Thefilter callable will be passed theTarInfo
for every file being added, and can modify and return it.If the callable returnsNone
, the file will be excluded from theresulting archive. This is more powerful than the existingexclude argument, which has therefore been deprecated.(Added by Lars Gustäbel;bpo-6856.)TheTarFile
class also now supports the context management protocol.(Added by Lars Gustäbel;bpo-7232.)The
wait()
method of thethreading.Event
classnow returns the internal flag on exit. This means the method will usuallyreturn true becausewait()
is supposed to block until theinternal flag becomes true. The return value will only be false ifa timeout was provided and the operation timed out.(Contributed by Tim Lesher;bpo-1674032.)The Unicode database provided by the
unicodedata
module isnow used internally to determine which characters are numeric,whitespace, or represent line breaks. The database alsoincludes information from theUnihan.txt
data file (patchby Anders Chrigström and Amaury Forgeot d'Arc;bpo-1571184)and has been updated to version 5.2.0 (updated byFlorent Xicluna;bpo-8024).The
urlparse
module'surlsplit()
now handlesunknown URL schemes in a fashion compliant withRFC 3986: if theURL is of the form"<something>://..."
, the text before the://
is treated as the scheme, even if it's a made-up scheme thatthe module doesn't know about. This change may break code thatworked around the old behaviour. For example, Python 2.6.4 or 2.5will return the following:>>>importurlparse>>>urlparse.urlsplit('invented://host/filename?query')('invented', '', '//host/filename?query', '', '')
Python 2.7 (and Python 2.6.5) will return:
>>>importurlparse>>>urlparse.urlsplit('invented://host/filename?query')('invented', 'host', '/filename?query', '', '')
(Python 2.7 actually produces slightly different output, since itreturns a named tuple instead of a standard tuple.)
The
urlparse
module also supports IPv6 literal addresses as defined byRFC 2732 (contributed by Senthil Kumaran;bpo-2987).>>>urlparse.urlparse('http://[1080::8:800:200C:417A]/foo')ParseResult(scheme='http', netloc='[1080::8:800:200C:417A]', path='/foo', params='', query='', fragment='')
New class: the
WeakSet
class in theweakref
module is a set that only holds weak references to its elements; elementswill be removed once there are no references pointing to them.(Originally implemented in Python 3.x by Raymond Hettinger, and backportedto 2.7 by Michael Foord.)The
xml.etree.ElementTree
library, no longer escapesampersands and angle brackets when outputting an XML processinginstruction (which looks like<?xml-stylesheethref="#style1"?>
)or comment (which looks like<!--comment-->
).(Patch by Neil Muller;bpo-2746.)The XML-RPC client and server, provided by the
xmlrpclib
andSimpleXMLRPCServer
modules, have improved performance bysupporting HTTP/1.1 keep-alive and by optionally using gzip encodingto compress the XML being exchanged. The gzip compression iscontrolled by theencode_threshold
attribute ofSimpleXMLRPCRequestHandler
, which contains a size in bytes;responses larger than this will be compressed.(Contributed by Kristján Valur Jónsson;bpo-6267.)The
zipfile
module'sZipFile
now supports the contextmanagement protocol, so you can writewithzipfile.ZipFile(...)asf:
.(Contributed by Brian Curtin;bpo-5511.)zipfile
now also supports archiving empty directories andextracts them correctly. (Fixed by Kuba Wieczorek;bpo-4710.)Reading files out of an archive is faster, and interleavingread()
andreadline()
now works correctly.(Contributed by Nir Aides;bpo-7610.)The
is_zipfile()
function nowaccepts a file object, in addition to the path names accepted in earlierversions. (Contributed by Gabriel Genellina;bpo-4756.)The
writestr()
method now has an optionalcompress_type parameterthat lets you override the default compression method specified in theZipFile
constructor. (Contributed by Ronald Oussoren;bpo-6003.)
New module: importlib¶
Python 3.1 includes theimportlib
package, a re-implementationof the logic underlying Python'simport
statement.importlib
is useful for implementers of Python interpreters andto users who wish to write new importers that can participate in theimport process. Python 2.7 doesn't contain the completeimportlib
package, but instead has a tiny subset that containsa single function,import_module()
.
import_module(name,package=None)
imports a module.name isa string containing the module or package's name. It's possible to dorelative imports by providing a string that begins with a.
character, such as..utils.errors
. For relative imports, thepackage argument must be provided and is the name of the package thatwill be used as the anchor forthe relative import.import_module()
both inserts the importedmodule intosys.modules
and returns the module object.
以下是一些範例:
>>>fromimportlibimportimport_module>>>anydbm=import_module('anydbm')# Standard absolute import>>>anydbm<module 'anydbm' from '/p/python/Lib/anydbm.py'>>>># Relative import>>>file_util=import_module('..file_util','distutils.command')>>>file_util<module 'distutils.file_util' from '/python/Lib/distutils/file_util.pyc'>
importlib
was implemented by Brett Cannon and introduced inPython 3.1.
New module: sysconfig¶
Thesysconfig
module has been pulled out of the Distutilspackage, becoming a new top-level module in its own right.sysconfig
provides functions for getting information aboutPython's build process: compiler switches, installation paths, theplatform name, and whether Python is running from its sourcedirectory.
Some of the functions in the module are:
get_config_var()
returns variables from Python'sMakefile and thepyconfig.h
file.get_config_vars()
returns a dictionary containingall of the configuration variables.get_path()
returns the configured path fora particular type of module: the standard library,site-specific modules, platform-specific modules, etc.is_python_build()
returns true if you're running abinary from a Python source tree, and false otherwise.
Consult thesysconfig
documentation for more details and fora complete list of functions.
The Distutils package andsysconfig
are now maintained by TarekZiadé, who has also started a Distutils2 package (source repository athttps://hg.python.org/distutils2/) for developing a next-generationversion of Distutils.
ttk: Themed Widgets for Tk¶
Tcl/Tk 8.5 includes a set of themed widgets that re-implement basic Tkwidgets but have a more customizable appearance and can therefore moreclosely resemble the native platform's widgets. This widgetset was originally called Tile, but was renamed to Ttk (for "themed Tk")on being added to Tcl/Tck release 8.5.
To learn more, read thettk
module documentation. You may alsowish to read the Tcl/Tk manual page describing theTtk theme engine, available athttps://www.tcl.tk/man/tcl8.5/TkCmd/ttk_intro.html. Somescreenshots of the Python/Ttk code in use are athttps://code.google.com/archive/p/python-ttk/wikis/Screenshots.wiki.
Thetkinter.ttk
module was written by Guilherme Polo and added inbpo-2983. An alternate version calledTile.py
, written byMartin Franklin and maintained by Kevin Walzer, was proposed forinclusion inbpo-2618, but the authors argued that GuilhermePolo's work was more comprehensive.
Updated module: unittest¶
Theunittest
module was greatly enhanced; manynew features were added. Most of these features were implementedby Michael Foord, unless otherwise noted. The enhanced version ofthe module is downloadable separately for use with Python versions 2.4 to 2.6,packaged as theunittest2
package, fromunittest2.
When used from the command line, the module can automatically discovertests. It's not as fancy aspy.test ornose, but provides asimple way to run tests kept within a set of package directories. For example,the following command will search thetest/
subdirectory forany importable test files namedtest*.py
:
python-munittestdiscover-stest
Consult theunittest
module documentation for more details.(Developed inbpo-6001.)
Themain()
function supports some other new options:
-b
or--buffer
will buffer the standard outputand standard error streams during each test. If the test passes,any resulting output will be discarded; on failure, the bufferedoutput will be displayed.-c
or--catch
will cause the control-C interruptto be handled more gracefully. Instead of interrupting the testprocess immediately, the currently running test will be completedand then the partial results up to the interruption will be reported.If you're impatient, a second press of control-C will cause an immediateinterruption.This control-C handler tries to avoid causing problems when the codebeing tested or the tests being run have defined a signal handler oftheir own, by noticing that a signal handler was already set andcalling it. If this doesn't work for you, there's a
removeHandler()
decorator that can be used to mark tests thatshould have the control-C handling disabled.-f
or--failfast
makestest execution stop immediately when a test fails instead ofcontinuing to execute further tests. (Suggested by Cliff Dyer andimplemented by Michael Foord;bpo-8074.)
The progress messages now show 'x' for expected failuresand 'u' for unexpected successes when run in verbose mode.(Contributed by Benjamin Peterson.)
Test cases can raise theSkipTest
exception to skip atest (bpo-1034053).
The error messages forassertEqual()
,assertTrue()
, andassertFalse()
failures now provide more information. If you set thelongMessage
attribute of yourTestCase
classes totrue, both the standard error message and any additional message youprovide will be printed for failures. (Added by Michael Foord;bpo-5663.)
TheassertRaises()
method nowreturns a context handler when called without providing a callableobject to run. For example, you can write this:
withself.assertRaises(KeyError):{}['foo']
(由 Antoine Pitrou 實作;bpo-4444。)
Module- and class-level setup and teardown fixtures are now supported.Modules can containsetUpModule()
andtearDownModule()
functions. Classes can havesetUpClass()
andtearDownClass()
methods that must be defined as class methods(using@classmethod
or equivalent). These functions andmethods are invoked when the test runner switches to a test case in adifferent module or class.
The methodsaddCleanup()
anddoCleanups()
were added.addCleanup()
lets you add cleanup functions thatwill be called unconditionally (aftersetUp()
ifsetUp()
fails, otherwise aftertearDown()
). This allowsfor much simpler resource allocation and deallocation during tests(bpo-5679).
A number of new methods were added that provide more specializedtests. Many of these methods were written by Google engineersfor use in their test suites; Gregory P. Smith, Michael Foord, andGvR worked on merging them into Python's version ofunittest
.
assertIsNone()
andassertIsNotNone()
take oneexpression and verify that the result is or is notNone
.assertIs()
andassertIsNot()
take two values and check whether the two values evaluate to the same object or not.(Added by Michael Foord;bpo-2578.)assertIsInstance()
andassertNotIsInstance()
check whetherthe resulting object is an instance of a particular class, or ofone of a tuple of classes. (Added by Georg Brandl;bpo-7031.)assertGreater()
,assertGreaterEqual()
,assertLess()
, andassertLessEqual()
comparetwo quantities.assertMultiLineEqual()
compares two strings, and if they'renot equal, displays a helpful comparison that highlights thedifferences in the two strings. This comparison is now used bydefault when Unicode strings are compared withassertEqual()
.assertRegexpMatches()
andassertNotRegexpMatches()
checks whether thefirst argument is a string matching or not matching the regularexpression provided as the second argument (bpo-8038).assertRaisesRegexp()
checkswhether a particular exceptionis raised, and then also checks that the string representation ofthe exception matches the provided regular expression.assertIn()
andassertNotIn()
tests whetherfirst is or is not insecond.assertItemsEqual()
tests whether two provided sequencescontain the same elements.assertSetEqual()
compares whether two sets are equal, andonly reports the differences between the sets in case of error.Similarly,
assertListEqual()
andassertTupleEqual()
compare the specified types and explain any differences without necessarilyprinting their full values; these methods are now used by defaultwhen comparing lists and tuples usingassertEqual()
.More generally,assertSequenceEqual()
compares two sequencesand can optionally check whether both sequences are of aparticular type.assertDictEqual()
compares two dictionaries and reports thedifferences; it's now used by default when you compare two dictionariesusingassertEqual()
.assertDictContainsSubset()
checks whetherall of the key/value pairs infirst are found insecond.assertAlmostEqual()
andassertNotAlmostEqual()
testwhetherfirst andsecond are approximately equal. This methodcan either round their difference to an optionally specified numberofplaces (the default is 7) and compare it to zero, or requirethe difference to be smaller than a supplieddelta value.loadTestsFromName()
properly honors thesuiteClass
attribute oftheTestLoader
. (Fixed by Mark Roddy;bpo-6866.)A new hook lets you extend the
assertEqual()
method to handlenew data types. TheaddTypeEqualityFunc()
method takes a typeobject and a function. The function will be used when both of theobjects being compared are of the specified type. This functionshould compare the two objects and raise an exception if they don'tmatch; it's a good idea for the function to provide additionalinformation about why the two objects aren't matching, much as the newsequence comparison methods do.
unittest.main()
now takes an optionalexit
argument. Iffalse,main()
doesn't callsys.exit()
, allowingmain()
to be used from the interactive interpreter.(Contributed by J. Pablo Fernández;bpo-3379.)
TestResult
has newstartTestRun()
andstopTestRun()
methods that are called immediately beforeand after a test run. (Contributed by Robert Collins;bpo-5728.)
With all these changes, theunittest.py
was becoming awkwardlylarge, so the module was turned into a package and the code split intoseveral files (by Benjamin Peterson). This doesn't affect how themodule is imported or used.
也參考
- https://web.archive.org/web/20210619163128/http://www.voidspace.org.uk/python/articles/unittest2.shtml
Describes the new features, how to use them, and therationale for various design decisions. (By Michael Foord.)
Updated module: ElementTree 1.3¶
The version of the ElementTree library included with Python was updated toversion 1.3. Some of the new features are:
The various parsing functions now take aparser keyword argumentgiving an
XMLParser
instance that willbe used. This makes it possible to override the file's internal encoding:p=ET.XMLParser(encoding='utf-8')t=ET.XML("""<root/>""",parser=p)
Errors in parsing XML now raise a
ParseError
exception, whoseinstances have aposition
attributecontaining a (line,column) tuple giving the location of the problem.ElementTree's code for converting trees to a string has beensignificantly reworked, making it roughly twice as fast in manycases. The
ElementTree.write()
andElement.write()
methods now have amethod parameter that can be"xml" (the default), "html", or "text". HTML mode will output emptyelements as<empty></empty>
instead of<empty/>
, and textmode will skip over elements and only output the text chunks. Ifyou set thetag
attribute of anelement toNone
butleave its children in place, the element will be omitted when thetree is written out, so you don't need to do more extensive rearrangementto remove a single element.Namespace handling has also been improved. All
xmlns:<whatever>
declarations are now output on the root element, not scattered throughoutthe resulting XML. You can set the default namespace for a treeby setting thedefault_namespace
attribute and canregister new prefixes withregister_namespace()
. In XML mode,you can use the true/falsexml_declaration parameter to suppress theXML declaration.New
Element
method:extend()
appends the items from asequence to the element's children. Elements themselves behave likesequences, so it's easy to move children from one element toanother:fromxml.etreeimportElementTreeasETt=ET.XML("""<list> <item>1</item> <item>2</item> <item>3</item></list>""")new=ET.XML('<root/>')new.extend(t)# Outputs <root><item>1</item>...</root>printET.tostring(new)
New
Element
method:iter()
yields the children of theelement as a generator. It's also possible to writeforchildinelem:
to loop over an element's children. The existing methodgetiterator()
is now deprecated, as isgetchildren()
which constructs and returns a list of children.New
Element
method:itertext()
yields all chunks oftext that are descendants of the element. For example:t=ET.XML("""<list> <item>1</item> <item>2</item> <item>3</item></list>""")# Outputs ['\n ', '1', ' ', '2', ' ', '3', '\n']printlist(t.itertext())
Deprecated: using an element as a Boolean (i.e.,
ifelem:
) wouldreturn true if the element had any children, or false if there wereno children. This behaviour is confusing --None
is false, butso is a childless element? -- so it will now trigger aFutureWarning
. In your code, you should be explicit: writelen(elem)!=0
if you're interested in the number of children,orelemisnotNone
.
Fredrik Lundh develops ElementTree and produced the 1.3 version;you can read his article describing 1.3 athttps://web.archive.org/web/20200703234532/http://effbot.org/zone/elementtree-13-intro.htm.Florent Xicluna updated the version included withPython, after discussions on python-dev and inbpo-6472.)
建置和 C API 變更¶
Python 建置程序和 C API 的變更包括:
The latest release of the GNU Debugger, GDB 7, can bescriptedusing Python.When you begin debugging an executable program P, GDB will look fora file named
P-gdb.py
and automatically read it. Dave Malcolmcontributed apython-gdb.py
that adds a number ofcommands useful when debugging Python itself. For example,py-up
andpy-down
go up or down one Python stack frame,which usually corresponds to several C stack frames.py-print
prints the value of a Python variable, andpy-bt
prints thePython stack trace. (Added as a result ofbpo-8032.)If you use the
.gdbinit
file provided with Python,the "pyo" macro in the 2.7 version now works correctly when the thread beingdebugged doesn't hold the GIL; the macro now acquires it before printing.(Contributed by Victor Stinner;bpo-3632.)Py_AddPendingCall()
is now thread-safe, letting anyworker thread submit notifications to the main Python thread. Thisis particularly useful for asynchronous IO operations.(Contributed by Kristján Valur Jónsson;bpo-4293.)New function:
PyCode_NewEmpty()
creates an empty code object;only the filename, function name, and first line number are required.This is useful for extension modules that are attempting toconstruct a more useful traceback stack. Previously suchextensions needed to callPyCode_New()
, which had manymore arguments. (Added by Jeffrey Yasskin.)New function:
PyErr_NewExceptionWithDoc()
creates a newexception class, just as the existingPyErr_NewException()
does,but takes an extrachar*
argument containing the docstring for thenew exception class. (Added by 'lekma' on the Python bug tracker;bpo-7033.)New function:
PyFrame_GetLineNumber()
takes a frame objectand returns the line number that the frame is currently executing.Previously code would need to get the index of the bytecodeinstruction currently executing, and then look up the line numbercorresponding to that address. (Added by Jeffrey Yasskin.)New functions:
PyLong_AsLongAndOverflow()
andPyLong_AsLongLongAndOverflow()
approximates a Python longinteger as a Clong orlonglong.If the number is too large to fit intothe output type, anoverflow flag is set and returned to the caller.(Contributed by Case Van Horsen;bpo-7528 andbpo-7767.)New function: stemming from the rewrite of string-to-float conversion,a new
PyOS_string_to_double()
function was added. The oldPyOS_ascii_strtod()
andPyOS_ascii_atof()
functionsare now deprecated.New function:
PySys_SetArgvEx()
sets the value ofsys.argv
and can optionally updatesys.path
to include thedirectory containing the script named bysys.argv[0]
dependingon the value of anupdatepath parameter.This function was added to close a security hole for applicationsthat embed Python. The old function,
PySys_SetArgv()
, wouldalways updatesys.path
, and sometimes it would add the currentdirectory. This meant that, if you ran an application embeddingPython in a directory controlled by someone else, attackers couldput a Trojan-horse module in the directory (say, a file namedos.py
) that your application would then import and run.If you maintain a C/C++ application that embeds Python, checkwhether you're calling
PySys_SetArgv()
and carefully considerwhether the application should be usingPySys_SetArgvEx()
withupdatepath set to false.Security issue reported asCVE 2008-5983;discussed inbpo-5753, and fixed by Antoine Pitrou.
New macros: the Python header files now define the following macros:
Py_ISALNUM
,Py_ISALPHA
,Py_ISDIGIT
,Py_ISLOWER
,Py_ISSPACE
,Py_ISUPPER
,Py_ISXDIGIT
,Py_TOLOWER
, andPy_TOUPPER
.All of these functions are analogous to the Cstandard macros for classifying characters, but ignore the currentlocale setting, because inseveral places Python needs to analyze characters in alocale-independent way. (Added by Eric Smith;bpo-5793.)Removed function:
PyEval_CallObject()
is now only availableas a macro. A function version was being kept around to preserveABI linking compatibility, but that was in 1997; it can certainly bedeleted by now. (Removed by Antoine Pitrou;bpo-8276.)New format codes: the
PyString_FromFormat()
,PyString_FromFormatV()
, andPyErr_Format()
functions nowaccept%lld
and%llu
format codes for displayingC'slonglong types.(Contributed by Mark Dickinson;bpo-7228.)The complicated interaction between threads and process forking hasbeen changed. Previously, the child process created by
os.fork()
might fail because the child is created with only asingle thread running, the thread performing theos.fork()
.If other threads were holding a lock, such as Python's import lock,when the fork was performed, the lock would still be marked as"held" in the new process. But in the child process nothing wouldever release the lock, since the other threads weren't replicated,and the child process would no longer be able to perform imports.Python 2.7 acquires the import lock before performing an
os.fork()
, and will also clean up any locks created using thethreading
module. C extension modules that have internallocks, or that callfork()
themselves, will not benefitfrom this clean-up.(Fixed by Thomas Wouters;bpo-1590864.)
The
Py_Finalize()
function now calls the internalthreading._shutdown()
function; this prevents some exceptions frombeing raised when an interpreter shuts down.(Patch by Adam Olsen;bpo-1722344.)When using the
PyMemberDef
structure to define attributesof a type, Python will no longer let you try to delete or set aT_STRING_INPLACE
attribute.Global symbols defined by the
ctypes
module are now prefixedwithPy
, or with_ctypes
. (Implemented by ThomasHeller;bpo-3102.)New configure option: the
--with-system-expat
switch allowsbuilding thepyexpat
module to use the system Expat library.(Contributed by Arfrever Frehtes Taifersar Arahesis;bpo-7609.)New configure option: the
--with-valgrind
option will now disable the pymallocallocator, which is difficult for the Valgrind memory-error detectorto analyze correctly.Valgrind will therefore be better at detecting memory leaks andoverruns. (Contributed by James Henstridge;bpo-2422.)New configure option: you can now supply an empty string to
--with-dbmliborder=
in order to disable all of the variousDBM modules. (Added by Arfrever Frehtes Taifersar Arahesis;bpo-6491.)Theconfigure script now checks for floating-point rounding bugson certain 32-bit Intel chips and defines a
X87_DOUBLE_ROUNDING
preprocessor definition. No code currently uses this definition,but it's available if anyone wishes to use it.(Added by Mark Dickinson;bpo-2937.)configure also now sets a
LDCXXSHARED
Makefilevariable for supporting C++ linking. (Contributed by ArfreverFrehtes Taifersar Arahesis;bpo-1222585.)The build process now creates the necessary files for pkg-configsupport. (Contributed by Clinton Roy;bpo-3585.)
The build process now supports Subversion 1.7. (Contributed byArfrever Frehtes Taifersar Arahesis;bpo-6094.)
Capsules¶
Python 3.1 adds a new C datatype,PyCapsule
, for providing aC API to an extension module. A capsule is essentially the holder ofa Cvoid*
pointer, and is made available as a module attribute; forexample, thesocket
module's API is exposed assocket.CAPI
,andunicodedata
exposesucnhash_CAPI
. Other extensionscan import the module, access its dictionary to get the capsuleobject, and then get thevoid*
pointer, which will usually pointto an array of pointers to the module's various API functions.
There is an existing data type already used for this,PyCObject
, but it doesn't provide type safety. Evil codewritten in pure Python could cause a segmentation fault by taking aPyCObject
from module A and somehow substituting it for thePyCObject
in module B. Capsules know their own name,and getting the pointer requires providing the name:
void*vtable;if(!PyCapsule_IsValid(capsule,"mymodule.CAPI"){PyErr_SetString(PyExc_ValueError,"argument type invalid");returnNULL;}vtable=PyCapsule_GetPointer(capsule,"mymodule.CAPI");
You are assured thatvtable
points to whatever you're expecting.If a different capsule was passed in,PyCapsule_IsValid()
woulddetect the mismatched name and return false. Refer toProviding a C API for an Extension Module for more information on using these objects.
Python 2.7 now uses capsules internally to provide variousextension-module APIs, but thePyCObject_AsVoidPtr()
wasmodified to handle capsules, preserving compile-time compatibilitywith thePyCObject
interface. Use ofPyCObject_AsVoidPtr()
will signal aPendingDeprecationWarning
, which is silent by default.
Implemented in Python 3.1 and backported to 2.7 by Larry Hastings;discussed inbpo-5630.
Port-Specific Changes: Windows¶
The
msvcrt
module now contains some constants fromthecrtassem.h
header file:CRT_ASSEMBLY_VERSION
,VC_ASSEMBLY_PUBLICKEYTOKEN
,andLIBRARIES_ASSEMBLY_NAME_PREFIX
.(Contributed by David Cournapeau;bpo-4365.)The
_winreg
module for accessing the registry now implementstheCreateKeyEx()
andDeleteKeyEx()
functions, extended versions of previously supported functions thattake several extra arguments. TheDisableReflectionKey()
,EnableReflectionKey()
, andQueryReflectionKey()
were also tested and documented.(Implemented by Brian Curtin:bpo-7347.)The new
_beginthreadex()
API is used to start threads, andthe native thread-local storage functions are now used.(Contributed by Kristján Valur Jónsson;bpo-3582.)The
os.kill()
function now works on Windows. The signal valuecan be the constantsCTRL_C_EVENT
,CTRL_BREAK_EVENT
, or any integer. The first two constantswill sendControl-C andControl-Break keystroke events tosubprocesses; any other value will use theTerminateProcess()
API. (Contributed by Miki Tebeka;bpo-1220212.)The
os.listdir()
function now correctly failsfor an empty path. (Fixed by Hirokazu Yamamoto;bpo-5913.)The
mimetypes
module will now read the MIME database fromthe Windows registry when initializing.(Patch by Gabriel Genellina;bpo-4969.)
Port-Specific Changes: Mac OS X¶
The path
/Library/Python/2.7/site-packages
is now appended tosys.path
, in order to share added packages between the systeminstallation and a user-installed copy of the same version.(Changed by Ronald Oussoren;bpo-4865.)在 2.7.13 版的變更:As of 2.7.13, this change was removed.
/Library/Python/2.7/site-packages
, the site-packages directoryused by the Apple-supplied system Python 2.7 is no longer appended tosys.path
for user-installed Pythons such as from the python.orginstallers. As of macOS 10.12, Apple changed how the systemsite-packages directory is configured, which could cause installationof pip components, like setuptools, to fail. Packages installed forthe system Python will no longer be shared with user-installedPythons. (bpo-28440)
Port-Specific Changes: FreeBSD¶
FreeBSD 7.1's
SO_SETFIB
constant, used with thesocket()
methodsgetsockopt()
/setsockopt()
to select analternate routing table, is now available in thesocket
module. (Added by Kyle VanderBeek;bpo-8235.)
Other Changes and Fixes¶
Two benchmark scripts,
iobench
andccbench
, wereadded to theTools
directory.iobench
measures thespeed of the built-in file I/O objects returned byopen()
while performing various operations, andccbench
is aconcurrency benchmark that tries to measure computing throughput,thread switching latency, and IO processing bandwidth whenperforming several tasks using a varying number of threads.The
Tools/i18n/msgfmt.py
script now understands pluralforms in.po
files. (Fixed by Martin von Löwis;bpo-5464.)When importing a module from a
.pyc
or.pyo
filewith an existing.py
counterpart, theco_filename
attributes of the resulting code objects are overwritten when theoriginal filename is obsolete. This can happen if the file has beenrenamed, moved, or is accessed through different paths. (Patch byZiga Seilnacht and Jean-Paul Calderone;bpo-1180193.)The
regrtest.py
script now takes a--randseed=
switch that takes an integer that will be used as the random seedfor the-r
option that executes tests in random order.The-r
option also reports the seed that was used(Added by Collin Winter.)Another
regrtest.py
switch is-j
, whichtakes an integer specifying how many tests run in parallel. Thisallows reducing the total runtime on multi-core machines.This option is compatible with several other options, including the-R
switch which is known to produce long runtimes.(Added by Antoine Pitrou,bpo-6152.) This can also be usedwith a new-F
switch that runs selected tests in a loopuntil they fail. (Added by Antoine Pitrou;bpo-7312.)When executed as a script, the
py_compile.py
module nowaccepts'-'
as an argument, which will read standard input forthe list of filenames to be compiled. (Contributed by PiotrOżarowski;bpo-8233.)
移植至 Python 2.7¶
This section lists previously described changes and other bugfixesthat may require changes to your code:
The
range()
function processes its arguments moreconsistently; it will now call__int__()
on non-float,non-integer arguments that are supplied to it. (Fixed by AlexanderBelopolsky;bpo-1533.)The string
format()
method changed the default precision usedfor floating-point and complex numbers from 6 decimalplaces to 12, which matches the precision used bystr()
.(Changed by Eric Smith;bpo-5920.)Because of an optimization for the
with
statement, the specialmethods__enter__()
and__exit__()
must belong to the object'stype, and cannot be directly attached to the object's instance. Thisaffects new-style classes (derived fromobject
) and C extensiontypes. (bpo-6101.)Due to a bug in Python 2.6, theexc_value parameter to
__exit__()
methods was often the string representation of theexception, not an instance. This was fixed in 2.7, soexc_valuewill be an instance as expected. (Fixed by Florent Xicluna;bpo-7853.)When a restricted set of attributes were set using
__slots__
,deleting an unset attribute would not raiseAttributeError
as you would expect. Fixed by Benjamin Peterson;bpo-7604.)
In the standard library:
Operations with
datetime
instances that resulted in a yearfalling outside the supported range didn't always raiseOverflowError
. Such errors are now checked more carefullyand will now raise the exception. (Reported by Mark Leander, patchby Anand B. Pillai and Alexander Belopolsky;bpo-7150.)When using
Decimal
instances with a string'sformat()
method, the default alignment was previouslyleft-alignment. This has been changed to right-alignment, which mightchange the output of your programs.(Changed by Mark Dickinson;bpo-6857.)Comparisons involving a signaling NaN value (or
sNAN
) now signalInvalidOperation
instead of silently returning a true orfalse value depending on the comparison operator. Quiet NaN values(orNaN
) are now hashable. (Fixed by Mark Dickinson;bpo-7279.)The
xml.etree.ElementTree
library no longer escapesampersands and angle brackets when outputting an XML processinginstruction (which looks like<?xml-stylesheethref="#style1"?>
)or comment (which looks like<!--comment-->
).(Patch by Neil Muller;bpo-2746.)The
readline()
method ofStringIO
objects now doesnothing when a negative length is requested, as other file-likeobjects do. (bpo-7348).The
syslog
module will now use the value ofsys.argv[0]
as theidentifier instead of the previous default value of'python'
.(Changed by Sean Reifschneider;bpo-8451.)The
tarfile
module's default error handling has changed, tono longer suppress fatal errors. The default error level was previously 0,which meant that errors would only result in a message being written to thedebug log, but because the debug log is not activated by default,these errors go unnoticed. The default error level is now 1,which raises an exception if there's an error.(Changed by Lars Gustäbel;bpo-7357.)The
urlparse
module'surlsplit()
now handlesunknown URL schemes in a fashion compliant withRFC 3986: if theURL is of the form"<something>://..."
, the text before the://
is treated as the scheme, even if it's a made-up scheme thatthe module doesn't know about. This change may break code thatworked around the old behaviour. For example, Python 2.6.4 or 2.5will return the following:>>>importurlparse>>>urlparse.urlsplit('invented://host/filename?query')('invented', '', '//host/filename?query', '', '')
Python 2.7 (and Python 2.6.5) will return:
>>>importurlparse>>>urlparse.urlsplit('invented://host/filename?query')('invented', 'host', '/filename?query', '', '')
(Python 2.7 actually produces slightly different output, since itreturns a named tuple instead of a standard tuple.)
For C extensions:
C extensions that use integer format codes with the
PyArg_Parse*
family of functions will now raise aTypeError
exceptioninstead of triggering aDeprecationWarning
(bpo-5080).Use the new
PyOS_string_to_double()
function instead of the oldPyOS_ascii_strtod()
andPyOS_ascii_atof()
functions,which are now deprecated.
For applications that embed Python:
The
PySys_SetArgvEx()
function was added, lettingapplications close a security hole when the existingPySys_SetArgv()
function was used. Check whether you'recallingPySys_SetArgv()
and carefully consider whether theapplication should be usingPySys_SetArgvEx()
withupdatepath set to false.
New Features Added to Python 2.7 Maintenance Releases¶
New features may be added to Python 2.7 maintenance releases when thesituation genuinely calls for it. Any such additions must go throughthe Python Enhancement Proposal process, and make a compelling case for whythey can't be adequately addressed by either adding the new feature solely toPython 3, or else by publishing it on the Python Package Index.
In addition to the specific proposals listed below, there is a generalexemption allowing new-3
warnings to be added in any Python 2.7maintenance release.
Two new environment variables for debug mode¶
In debug mode, the[xxxrefs]
statistic is not written by default, thePYTHONSHOWREFCOUNT
environment variable now must also be set.(Contributed by Victor Stinner;bpo-31733.)
When Python is compiled withCOUNT_ALLOC
defined, allocation counts are nolonger dumped by default anymore: thePYTHONSHOWALLOCCOUNT
environmentvariable must now also be set. Moreover, allocation counts are now dumped intostderr, rather than stdout. (Contributed by Victor Stinner;bpo-31692.)
在 2.7.15 版被加入.
PEP 434: IDLE Enhancement Exception for All Branches¶
PEP 434 describes a general exemption for changes made to the IDLEdevelopment environment shipped along with Python. This exemption makes itpossible for the IDLE developers to provide a more consistent userexperience across all supported versions of Python 2 and 3.
For details of any IDLE changes, refer to the NEWS file for the specificrelease.
PEP 466: Network Security Enhancements for Python 2.7¶
PEP 466 describes a number of network security enhancement proposalsthat have been approved for inclusion in Python 2.7 maintenance releases,with the first of those changes appearing in the Python 2.7.7 release.
PEP 466 related features added in Python 2.7.7:
hmac.compare_digest()
was backported from Python 3 to make a timingattack resistant comparison operation available to Python 2 applications.(Contributed by Alex Gaynor;bpo-21306.)OpenSSL 1.0.1g was upgraded in the official Windows installers published onpython.org. (Contributed by Zachary Ware;bpo-21462.)
PEP 466 related features added in Python 2.7.8:
hashlib.pbkdf2_hmac()
was backported from Python 3 to make a hashingalgorithm suitable for secure password storage broadly available to Python2 applications. (Contributed by Alex Gaynor;bpo-21304.)OpenSSL 1.0.1h was upgraded for the official Windows installers published onpython.org. (Contributed by Zachary Ware inbpo-21671 forCVE 2014-0224.)
PEP 466 related features added in Python 2.7.9:
Most of Python 3.4's
ssl
module was backported. This meansssl
now supports Server Name Indication, TLS1.x settings, access to the platformcertificate store, theSSLContext
class, and otherfeatures. (Contributed by Alex Gaynor and David Reid;bpo-21308.)Refer to the "Version added: 2.7.9" notes in the module documentation forspecific details.
os.urandom()
was changed to cache a file descriptor to/dev/urandom
instead of reopening/dev/urandom
on every call. (Contributed by AlexGaynor;bpo-21305.)hashlib.algorithms_guaranteed
andhashlib.algorithms_available
were backported from Python 3 to makeit easier for Python 2 applications to select the strongest available hashalgorithm. (Contributed by Alex Gaynor inbpo-21307)
PEP 477: Backport ensurepip (PEP 453) to Python 2.7¶
PEP 477 approves the inclusion of thePEP 453 ensurepip module and theimproved documentation that was enabled by it in the Python 2.7 maintenancereleases, appearing first in the Python 2.7.9 release.
Bootstrapping pip By Default¶
The newensurepip
module (defined inPEP 453) provides a standardcross-platform mechanism to bootstrap the pip installer into Pythoninstallations. The version ofpip
included with Python 2.7.9 ispip
1.5.6, and future 2.7.x maintenance releases will update the bundled version tothe latest version ofpip
that is available at the time of creating therelease candidate.
By default, the commandspip
,pipX
andpipX.Y
will be installed onall platforms (where X.Y stands for the version of the Python installation),along with thepip
Python package and its dependencies.
For CPythonsource builds on POSIX systems,themakeinstall
andmakealtinstall
commands do not bootstrappip
by default. This behaviour can be controlled through configure options, andoverridden through Makefile options.
On Windows and Mac OS X, the CPython installers now default to installingpip
along with CPython itself (users may opt out of installing itduring the installation process). Window users will need to opt in to theautomaticPATH
modifications to havepip
available from the commandline by default, otherwise it can still be accessed through the Pythonlauncher for Windows aspy-mpip
.
Asdiscussed in the PEP,platform packagers may choose not to installthese commands by default, as long as, when invoked, they provide clear andsimple directions on how to install them on that platform (usually usingthe system package manager).
文件更動¶
As part of this change, the安裝 Python 模組 and發布 Python 模組 sections of the documentation have beencompletely redesigned as short getting started and FAQ documents. Mostpackaging documentation has now been moved out to the Python PackagingAuthority maintainedPython Packaging User Guide and the documentation of the individualprojects.
However, as this migration is currently still incomplete, the legacyversions of those guides remaining available as用 setuptools 建置 C 與 C++ 擴充套件and用 setuptools 建置 C 與 C++ 擴充套件.
也參考
- PEP 453 -- Explicit bootstrapping of pip in Python installations
PEP written by Donald Stufft and Nick Coghlan, implemented byDonald Stufft, Nick Coghlan, Martin von Löwis and Ned Deily.
PEP 476: Enabling certificate verification by default for stdlib http clients¶
PEP 476 updatedhttplib
and modules which use it, such asurllib2
andxmlrpclib
, to nowverify that the serverpresents a certificate which is signed by a Certificate Authority in theplatform trust store and whose hostname matches the hostname being requestedby default, significantly improving security for many applications. Thischange was made in the Python 2.7.9 release.
For applications which require the old previous behavior, they can pass analternate context:
importurllib2importssl# This disables all verificationcontext=ssl._create_unverified_context()# This allows using a specific certificate for the host, which doesn't need# to be in the trust storecontext=ssl.create_default_context(cafile="/path/to/file.crt")urllib2.urlopen("https://invalid-cert",context=context)
PEP 493: HTTPS verification migration tools for Python 2.7¶
PEP 493 provides additional migration tools to support a more incrementalinfrastructure upgrade process for environments containing applications andservices relying on the historically permissive processing of servercertificates when establishing client HTTPS connections. These additions weremade in the Python 2.7.12 release.
These tools are intended for use in cases where affected applications andservices can't be modified to explicitly pass a more permissive SSL contextwhen establishing the connection.
For applications and services which can't be modified at all, the newPYTHONHTTPSVERIFY
environment variable may be set to0
to revert anentire Python process back to the default permissive behaviour of Python 2.7.8and earlier.
For cases where the connection establishment code can't be modified, but theoverall application can be, the newssl._https_verify_certificates()
function can be used to adjust the default behaviour at runtime.
Newmakeregen-all
build target¶
To simplify cross-compilation, and to ensure that CPython can reliably becompiled without requiring an existing version of Python to already beavailable, the autotools-based build system no longer attempts to implicitlyrecompile generated files based on file modification times.
Instead, a newmakeregen-all
command has been added to force regenerationof these files when desired (e.g. after an initial version of Python hasalready been built based on the pregenerated versions).
More selective regeneration targets are also defined - seeMakefile.pre.in for details.
(由 Victor Stinner 於bpo-23404 中貢獻。)
在 2.7.14 版被加入.
Removal ofmaketouch
build target¶
Themaketouch
build target previously used to request implicit regenerationof generated files by updating their modification times has been removed.
It has been replaced by the newmakeregen-all
target.
(由 Victor Stinner 於bpo-23404 中貢獻。)
在 2.7.14 版的變更.
致謝¶
The author would like to thank the following people for offeringsuggestions, corrections and assistance with various drafts of thisarticle: Nick Coghlan, Philip Jenvey, Ryan Lovett, R. David Murray,Hugh Secker-Walker.