Movatterモバイル変換

E.57. Release 9.6

• Allow synchronous replication to support multiple simultaneous synchronous standby servers, not just one (Masahiko Sawada, Beena Emerson, Michael Paquier, Fujii Masao, Kyotaro Horiguchi)

  The number of standby servers that must acknowledge a commit before it is considered complete is now configurable as part of thesynchronous_standby_names parameter.

• Add new settingremote_apply for configuration parametersynchronous_commit (Thomas Munro)

  In this mode, the master waits for the transaction to beapplied on the standby server, not just written to disk. That means that you can count on a transaction started on the standby to see all commits previously acknowledged by the master.

• Add a feature to the replication protocol, and a corresponding option topg_create_physical_replication_slot(), to allow reservingWAL immediately when creating a replication slot (Gurjeet Singh, Michael Paquier)

  This allows the creation of a replication slot to guarantee that all theWAL needed for a base backup will be available.

• Add a--slot option topg_basebackup (Peter Eisentraut)

  This letspg_basebackup use a replication slot defined forWAL streaming. After the base backup completes, selecting the same slot for regular streaming replication allows seamless startup of the new standby server.

• Extendpg_start_backup() andpg_stop_backup() to support non-exclusive backups (Magnus Hagander)

• Allow functions that return sets of tuples to return simpleNULLs (Andrew Gierth, Tom Lane)

  In the context ofSELECT FROM function(...), a function that returned a set of composite values was previously not allowed to return a plainNULL value as part of the set. Now that is allowed and interpreted as a row ofNULLs. This avoids corner-case errors with, for example, unnesting an array of composite values.

• Fully support array subscripts and field selections in the target column list of anINSERT with multipleVALUES rows (Tom Lane)

  Previously, such cases failed if the same target column was mentioned more than once, e.g.,INSERT INTO tab (x[1], x[2]) VALUES (...).

• When appropriate, postpone evaluation ofSELECT output expressions until after anORDER BY sort (Konstantin Knizhnik)

  This change ensures that volatile or expensive functions in the output list are executed in the order suggested byORDER BY, and that they are not evaluated more times than required when there is aLIMIT clause. Previously, these properties held if the ordering was performed by an index scan or pre-merge-join sort, but not if it was performed by a top-level sort.

• Widen counters recording the number of tuples processed to 64 bits (Andreas Scherbaum)

  This change allows command tags, e.g.,SELECT, to correctly report tuple counts larger than 4 billion. This also applies to PL/pgSQL'sGET DIAGNOSTICS ... ROW_COUNT command.

• Avoid doing encoding conversions by converting through theMULE_INTERNAL encoding (Tom Lane)

  Previously, many conversions for Cyrillic and Central European single-byte encodings were done by converting to a relatedMULE_INTERNAL coding scheme and then to the destination encoding. Aside from being inefficient, this meant that when the conversion encountered an untranslatable character, the error message would confusingly complain about failure to convert to or fromMULE_INTERNAL, rather than the user-visible encoding.

• Consider performing joins of foreign tables remotely only when the tables will be accessed under the same role ID (Shigeru Hanada, Ashutosh Bapat, Etsuro Fujita)

  Previously, the foreign join pushdown infrastructure left the question of security entirely up to individual foreign data wrappers, but that made it too easy for anFDW to inadvertently create subtle security holes. So, make it the core code's job to determine which role ID will access each table, and do not attempt join pushdown unless the role is the same for all relevant relations.

• AllowCOPY to copy the output of anINSERT/UPDATE/DELETE ...RETURNING query (Marko Tiikkaja)

  Previously, an intermediateCTE had to be written to get this result.

• IntroduceALTERobject DEPENDS ON EXTENSION (Abhijit Menon-Sen)

  This command allows a database object to be marked as depending on an extension, so that it will be dropped automatically if the extension is dropped (without needingCASCADE). However, the object is not part of the extension, and thus will be dumped separately bypg_dump.

• MakeALTERobject SET SCHEMA do nothing when the object is already in the requested schema, rather than throwing an error as it historically has for most object types (Marti Raudsepp)

• Add options toALTER OPERATOR to allow changing the selectivity functions associated with an existing operator (Yury Zhuravlev)

• Add anIF NOT EXISTS option toALTER TABLE ADD COLUMN (Fabrízio de Royes Mello)

• Reduce the lock strength needed byALTER TABLE when setting fillfactor and autovacuum-related relation options (Fabrízio de Royes Mello, Simon Riggs)

• IntroduceCREATE ACCESS METHOD to allow extensions to create index access methods (Alexander Korotkov, Petr Jelínek)

• Add aCASCADE option toCREATE EXTENSION to automatically create any extensions the requested one depends on (Petr Jelínek)

• MakeCREATE TABLE ... LIKE include anOID column if any source table has one (Bruce Momjian)

• If aCHECK constraint is declaredNOT VALID in a table creation command, automatically mark it as valid (Amit Langote, Amul Sul)

  This is safe because the table has no existing rows. This matches the longstanding behavior ofFOREIGN KEY constraints.

• FixDROP OPERATOR to clearpg_operator.oprcom andpg_operator.oprnegate links to the dropped operator (Roma Sokolov)

  Formerly such links were left as-is, which could pose a problem in the somewhat unlikely event that the dropped operator'sOID was reused for another operator.

• Do not show the same subplan twice inEXPLAIN output (Tom Lane)

  In certain cases, typically involving SubPlan nodes in index conditions,EXPLAIN would print data for the same subplan twice.

• Disallow creation of indexes on system columns, except forOID columns (David Rowley)

  Such indexes were never considered supported, and would very possibly misbehave since the system might change the system-column fields of a tuple without updating indexes. However, previously there were no error checks to prevent them from being created.

• Use the privilege system to manage access to sensitive functions (Stephen Frost)

  Formerly, many security-sensitive functions contained hard-wired checks that would throw an error if they were called by a non-superuser. This forced the use of superuser roles for some relatively pedestrian tasks. The hard-wired error checks are now gone in favor of makinginitdb revoke the default publicEXECUTE privilege on these functions. This allows installations to choose to grant usage of such functions to trusted roles that do not need all superuser privileges.

• Create somebuilt-in roles that can be used to grant access to what were previously superuser-only functions (Stephen Frost)

  Currently the only such role ispg_signal_backend, but more are expected to be added in future.

• Improvefull-text search to support searching for phrases, that is, lexemes appearing adjacent to each other in a specific order, or with a specified distance between them (Teodor Sigaev, Oleg Bartunov, Dmitry Ivanov)

  A phrase-search query can be specified intsquery input using the new operators<-> and<N>. The former means that the lexemes before and after it must appear adjacent to each other in that order. The latter means they must be exactlyN lexemes apart.

• Allow omitting one or both boundaries in an array slice specifier, e.g.,array_col[3:] (Yury Zhuravlev)

  Omitted boundaries are taken as the upper or lower limit of the corresponding array subscript. This allows simpler specification for many common use-cases.

• Be more careful about out-of-range dates and timestamps (Vitaly Burovoy)

  This change prevents unexpected out-of-range errors fortimestamp with time zone values very close to the implementation limits. Previously, the“same” value might be accepted or not depending on thetimezone setting, meaning that a dump and reload could fail on a value that had been accepted when presented. Now the limits are enforced according to the equivalentUTC time, not local time, so as to be independent oftimezone.

  Also,PostgreSQL is now more careful to detect overflow in operations that compute new date or timestamp values, such asdate+integer.

• For geometric data types, make sureinfinity andNaN component values are treated consistently during input and output (Tom Lane)

  Such values will now always print the same as they would in a simplefloat8 column, and be accepted the same way on input. Previously the behavior was platform-dependent.

• Upgrade theispell dictionary type to handle modernHunspell files and support more languages (Artur Zakirov)

• Implement look-behind constraints inregular expressions (Tom Lane)

  A look-behind constraint is like a lookahead constraint in that it consumes no text; but it checks for existence (or nonexistence) of a match ending at the current point in the string, rather than one starting at the current point. Similar features exist in many other regular-expression engines.

• In regular expressions, if an apparent three-digit octal escape\nnn would exceed 377 (255 decimal), assume it is a two-digit octal escape instead (Tom Lane)

  This makes the behavior match currentTcl releases.

• Add transaction ID operatorsxid<>xid andxid<>int4, for consistency with the corresponding equality operators (Michael Paquier)

• Addjsonb_insert() function to insert a new element into ajsonb array, or a not-previously-existing key into ajsonb object (Dmitry Dolgov)

• Improve the accuracy of theln(),log(),exp(), andpow() functions for typenumeric (Dean Rasheed)

• Add ascale(numeric) function to extract the display scale of anumeric value (Marko Tiikkaja)

• Add trigonometric functions that work in degrees (Dean Rasheed)

  For example,sind() measures its argument in degrees, whereassin() measures in radians. These functions go to some lengths to deliver exact results for values where an exact result can be expected, for instancesind(30) = 0.5.

• Ensure that trigonometric functions handleinfinity andNaN inputs per thePOSIX standard (Dean Rasheed)

  ThePOSIX standard says that these functions should returnNaN forNaN input, and should throw an error for out-of-range inputs includinginfinity. Previously our behavior varied across platforms.

• Maketo_timestamp(float8) convert floatinfinity to timestampinfinity (Vitaly Burovoy)

  Formerly it just failed on an infinite input.

• Add new functions fortsvector data (Stas Kelvich)

  The new functions arets_delete(),ts_filter(),unnest(),tsvector_to_array(),array_to_tsvector(), and a variant ofsetweight() that sets the weight only for specified lexeme(s).

• Allowts_stat() andtsvector_update_trigger() to operate on values that are of types binary-compatible with the expected argument type, not just exactly that type; for example allowcitext wheretext is expected (Teodor Sigaev)

• Add variadic functionsnum_nulls() andnum_nonnulls() that count the number of their arguments that are null or non-null (Marko Tiikkaja)

  An example usage isCHECK(num_nonnulls(a,b,c) = 1) which asserts that exactly one of a,b,c is notNULL. These functions can also be used to count the number of null or nonnull elements in an array.

• Add functionparse_ident() to split a qualified, possibly quotedSQL identifier into its parts (Pavel Stehule)

• Into_number(), interpret aV format code as dividing by 10 to the power of the number of digits followingV (Bruce Momjian)

  This makes it operate in an inverse fashion toto_char().

• Make theto_reg*() functions accept typetext notcstring (Petr Korobeinikov)

  This avoids the need to write an explicit cast in most cases where the argument is not a simple literal constant.

• Addpg_size_bytes() function to convert human-readable size strings to numbers (Pavel Stehule, Vitaly Burovoy, Dean Rasheed)

  This function converts strings like those produced bypg_size_pretty() into bytes. An example usage isSELECT oid::regclass FROM pg_class WHERE pg_total_relation_size(oid) > pg_size_bytes('10 GB').

• Inpg_size_pretty(), format negative numbers similarly to positive ones (Adrian Vondendriesch)

  Previously, negative numbers were never abbreviated, just printed in bytes.

• Add an optionalmissing_ok argument to thecurrent_setting() function (David Christensen)

  This allows avoiding an error for an unrecognized parameter name, instead returning aNULL.

• Change various catalog-inspection functions to returnNULL for invalid input (Michael Paquier)

  pg_get_viewdef() now returnsNULL if given an invalid viewOID, and several similar functions likewise returnNULL for bad input. Previously, such cases usually led to“cache lookup failed” errors, which are not meant to occur in user-facing cases.

• Fixpg_replication_origin_xact_reset() to not have any arguments (Fujii Masao)

  The documentation said that it has no arguments, and the C code did not expect any arguments, but the entry inpg_proc mistakenly specified two arguments.

• InPL/pgSQL, detect mismatchedCONTINUE andEXIT statements while compiling a function, rather than at execution time (Jim Nasby)

• ExtendPL/Python's error-reporting and message-reporting functions to allow specifying additional message fields besides the primary error message (Pavel Stehule)

• Allow PL/Python functions to call themselves recursively viaSPI, and fix the behavior when multiple set-returning PL/Python functions are called within one query (Alexey Grishchenko, Tom Lane)

• Fix session-lifespan memory leaks in PL/Python (Heikki Linnakangas, Haribabu Kommi, Tom Lane)

• ModernizePL/Tcl to use Tcl's“object”APIs instead of simple strings (Jim Nasby, Karl Lehenbauer)

  This can improve performance substantially in some cases. Note thatPL/Tcl now requires Tcl 8.4 or later.

• InPL/Tcl, make database-reported errors return additional information in Tcl'serrorCode global variable (Jim Nasby, Tom Lane)

  This feature follows the Tcl convention for returning auxiliary data about an error.

• FixPL/Tcl to perform encoding conversion between the database encoding andUTF-8, which is what Tcl expects (Tom Lane)

  Previously, strings were passed through without conversion, leading to misbehavior with non-ASCII characters when the database encoding was notUTF-8.

• Add a nonlocalized version of theseverity field in error and notice messages (Tom Lane)

  This change allows client code to determine severity of an error or notice without having to worry about localized variants of the severity strings.

• Introduce a feature inlibpq whereby theCONTEXT field of messages can be suppressed, either always or only for non-error messages (Pavel Stehule)

  The default behavior ofPQerrorMessage() is now to printCONTEXT only for errors. The new functionPQsetErrorContextVisibility() can be used to adjust this.

• Add support inlibpq for regenerating an error message with a different verbosity level (Alex Shulgin)

  This is done with the new functionPQresultVerboseErrorMessage(). This supportspsql's new\errverbose feature, and may be useful for other clients as well.

• Improvelibpq'sPQhost() function to return useful data for default Unix-socket connections (Tom Lane)

  Previously it would returnNULL if no explicit host specification had been given; now it returns the default socket directory path.

• Fixecpg's lexer to handle line breaks within comments starting on preprocessor directive lines (Michael Meskes)

• Add a--strict-names option topg_dump andpg_restore (Pavel Stehule)

  This option causes the program to complain if there is no match for a-t or-n option, rather than silently doing nothing.

• Inpg_dump, dump locally-made changes of privilege assignments for system objects (Stephen Frost)

  While it has always been possible for a superuser to change the privilege assignments for built-in or extension-created objects, such changes were formerly lost in a dump and reload. Now,pg_dump recognizes and dumps such changes. (This works only when dumping from a 9.6 or later server, however.)

• Allowpg_dump to dump non-extension-owned objects that are within an extension-owned schema (Martín Marqués)

  Previously such objects were ignored because they were mistakenly assumed to belong to the extension owning their schema.

• Inpg_dump output, include the table name in object tags for object types that are only uniquely named per-table (for example, triggers) (Peter Eisentraut)

• Improve error reporting duringinitdb's post-bootstrap phase (Tom Lane)

  Previously, an error here led to reporting the entire input file as the“failing query”; now just the current query is reported. To get the desired behavior, queries ininitdb's input files must be separated by blank lines.

• Speed upinitdb by using just one standalone-backend session for all the post-bootstrap steps (Tom Lane)

• Improvepg_rewind so that it can work when the target timeline changes (Alexander Korotkov)

  This allows, for example, rewinding a promoted standby back to some state of the old master's timeline.

• Remove obsoleteheap_formtuple/heap_modifytuple/heap_deformtuple functions (Peter Geoghegan)

• Add macros to makeAllocSetContextCreate() calls simpler and safer (Tom Lane)

  Writing out the individual sizing parameters for a memory context is now deprecated in favor of using one of the new macrosALLOCSET_DEFAULT_SIZES,ALLOCSET_SMALL_SIZES, orALLOCSET_START_SMALL_SIZES. Existing code continues to work, however.

• Unconditionally usestatic inline functions in header files (Andres Freund)

  This may result in warnings and/or wasted code space with very old compilers, but the notational improvement seems worth it.

• ImproveTAP testing infrastructure (Michael Paquier, Craig Ringer, Álvaro Herrera, Stephen Frost)

  Notably, it is now possible to test recovery scenarios using this infrastructure.

• Maketrace_lwlocks identify individual locks by name (Robert Haas)

• Improvepsql's tab-completion code infrastructure (Thomas Munro, Michael Paquier)

  Tab-completion rules are now considerably easier to write, and more compact.

• Nail thepg_shseclabel system catalog into cache, so that it is available for access during connection authentication (Adam Brightwell)

  The core code does not use this catalog for authentication, but extensions might wish to consult it.

• Restructureindex access methodAPI to hide most of it at theC level (Alexander Korotkov, Andrew Gierth)

  This change modernizes the indexAM API to look more like the designs we have adopted for foreign data wrappers and tablesample handlers. This simplifies theC code and makes it much more practical to define index access methods in installable extensions. A consequence is that most of the columns of thepg_am system catalog have disappeared. Newinspection functions have been added to allow SQL queries to determine index AM properties that used to be discoverable frompg_am.

• Addpg_init_privs system catalog to hold original privileges ofinitdb-created and extension-created objects (Stephen Frost)

  This infrastructure allowspg_dump to dump changes that an installation may have made in privileges attached to system objects. Formerly, such changes would be lost in a dump and reload, but now they are preserved.

• Change the way that extensions allocate customLWLocks (Amit Kapila, Robert Haas)

  TheRequestAddinLWLocks() function is removed, and replaced byRequestNamedLWLockTranche(). This allows better identification of customLWLocks, and is less error-prone.

• Improve the isolation tester to allow multiple sessions to wait concurrently, allowing testing of deadlock scenarios (Robert Haas)

• Introduce extensible node types (KaiGai Kohei)

  This change allowsFDWs or custom scan providers to store data in a plan tree in a more convenient format than was previously possible.

• Make the planner deal with post-scan/join query steps by generating and comparingPaths, replacing a lot of ad-hoc logic (Tom Lane)

  This change provides only marginal user-visible improvements today, but it enables future work on a lot of upper-planner improvements that were impractical to tackle using the old code structure.

• Support partial aggregation (David Rowley, Simon Riggs)

  This change allows the computation of an aggregate function to be split into separate parts, for example so that parallel worker processes can cooperate on computing an aggregate. In future it might allow aggregation across local and remote data to occur partially on the remote end.

• Add a generic command progress reporting facility (Vinayak Pokale, Rahila Syed, Amit Langote, Robert Haas)

• Separate outpsql'sflex lexer to make it usable by other client programs (Tom Lane, Kyotaro Horiguchi)

  This eliminates code duplication for programs that need to be able to parse SQL commands well enough to identify command boundaries. Doing that in full generality is more painful than one could wish, and up to now onlypsql has really gotten it right among our supported client programs.

  A new source-code subdirectorysrc/fe_utils/ has been created to hold this and other code that is shared across our client programs. Formerly such sharing was accomplished by symbolic linking or copying source files at build time, which was ugly and required duplicate compilation.

• IntroduceWaitEventSetAPI to allow efficient waiting for event sets that usually do not change from one wait to the next (Andres Freund, Amit Kapila)

• Add a generic interface for writingWAL records (Alexander Korotkov, Petr Jelínek, Markus Nullmeier)

  This change allows extensions to writeWAL records for changes to pages using a standard layout. The problem of needing to replayWAL without access to the extension is solved by having generic replay code. This allows extensions to implement, for example, index access methods and haveWAL support for them.

• Support genericWAL messages for logical decoding (Petr Jelínek, Andres Freund)

  This feature allows extensions to insert data into theWAL stream that can be read by logical-decoding plugins, but is not connected to physical data restoration.

• Allow SP-GiST operator classes to store an arbitrary“traversal value” while descending the index (Alexander Lebedev, Teodor Sigaev)

  This is somewhat like the“reconstructed value”, but it could be any arbitrary chunk of data, not necessarily of the same data type as the indexed column.

• Introduce aLOG_SERVER_ONLY message level forereport() (David Steele)

  This level acts likeLOG except that the message is never sent to the client. It is meant for use in auditing and similar applications.

• Provide aMakefile target to build all generated headers (Michael Paquier, Tom Lane)

  submake-generated-headers can now be invoked to ensure that generated backend header files are up-to-date. This is useful in subdirectories that might be built“standalone”.

• Support OpenSSL 1.1.0 (Andreas Karlsson, Heikki Linnakangas)

• Add configuration parameterauto_explain.sample_rate to allowcontrib/auto_explain to capture just a configurable fraction of all queries (Craig Ringer, Julien Rouhaud)

  This allows reduction of overhead for heavy query traffic, while still getting useful information on average.

• Addcontrib/bloom module that implements an index access method based on Bloom filtering (Teodor Sigaev, Alexander Korotkov)

  This is primarily a proof-of-concept for non-core index access methods, but it could be useful in its own right for queries that search many columns.

• Incontrib/cube, introduce distance operators for cubes, and support kNN-style searches in GiST indexes on cube columns (Stas Kelvich)

• Makecontrib/hstore'shstore_to_jsonb_loose() andhstore_to_json_loose() functions agree on what is a number (Tom Lane)

  Previously,hstore_to_jsonb_loose() would convert numeric-looking strings toJSON numbers, rather than strings, even if they did not exactly match theJSON syntax specification for numbers. This was inconsistent withhstore_to_json_loose(), so tighten the test to match theJSON syntax.

• Add selectivity estimation functions forcontrib/intarray operators to improve plans for queries using those operators (Yury Zhuravlev, Alexander Korotkov)

• Makecontrib/pageinspect'sheap_page_items() function show the raw data in each tuple, and add new functionstuple_data_split() andheap_page_item_attrs() for inspection of individual tuple fields (Nikolay Shaplov)

• Add an optionalS2K iteration count parameter tocontrib/pgcrypto'spgp_sym_encrypt() function (Jeff Janes)

• Add support for“word similarity” tocontrib/pg_trgm (Alexander Korotkov, Artur Zakirov)

  These functions and operators measure the similarity between one string and the most similar single word of another string.

• Add configuration parameterpg_trgm.similarity_threshold forcontrib/pg_trgm's similarity threshold (Artur Zakirov)

  This threshold has always been configurable, but formerly it was controlled by special-purpose functionsset_limit() andshow_limit(). Those are now deprecated.

• Improvecontrib/pg_trgm's GIN operator class to speed up index searches in which both common and rare keys appear (Jeff Janes)

• Improve performance of similarity searches incontrib/pg_trgm GIN indexes (Christophe Fornaroli)

• Addcontrib/pg_visibility module to allow examining table visibility maps (Robert Haas)

• Addssl_extension_info() function tocontrib/sslinfo, to print information aboutSSL extensions present in theX509 certificate used for the current connection (Dmitry Voronin)