Movatterモバイル変換

[0]ホーム
URL:

Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

 Sign up
Appearance settings

Commit73c986a

Browse files
committed
Keep track of transaction commit timestamps
Transactions can now set their commit timestamp directly as they commit,or an external transaction commit timestamp can be fed from an outsidesystem using the new function TransactionTreeSetCommitTsData(). Thisdata is crash-safe, and truncated at Xid freeze point, same as pg_clog.This module is disabled by default because it causes a performance hit,but can be enabled in postgresql.conf requiring only a server restart.A new test in src/test/modules is included.Catalog version bumped due to the new subdirectory within PGDATA and acouple of new SQL functions.Authors: Álvaro Herrera and Petr JelínekReviewed to varying degrees by Michael Paquier, Andres Freund, RobertHaas, Amit Kapila, Fujii Masao, Jaime Casanova, Simon Riggs, StevenSinger, Peter Eisentraut
1 parent6597ec9 commit73c986a

File tree

43 files changed

+1458
-28
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

43 files changed

+1458
-28
lines changed

‎contrib/pg_upgrade/pg_upgrade.c

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -430,6 +430,13 @@ copy_clog_xlog_xid(void)
430430
"\"%s/pg_resetxlog\" -f -e %u \"%s\"",
431431
new_cluster.bindir,old_cluster.controldata.chkpnt_nxtepoch,
432432
new_cluster.pgdata);
433+
/* must reset commit timestamp limits also */
434+
exec_prog(UTILITY_LOG_FILE,NULL, true,
435+
"\"%s/pg_resetxlog\" -f -c %u,%u \"%s\"",
436+
new_cluster.bindir,
437+
old_cluster.controldata.chkpnt_nxtxid,
438+
old_cluster.controldata.chkpnt_nxtxid,
439+
new_cluster.pgdata);
433440
check_ok();
434441

435442
/*

‎contrib/pg_xlogdump/rmgrdesc.c

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,7 @@
1010

1111
#include"access/brin_xlog.h"
1212
#include"access/clog.h"
13+
#include"access/commit_ts.h"
1314
#include"access/gin.h"
1415
#include"access/gist_private.h"
1516
#include"access/hash.h"

‎doc/src/sgml/config.sgml

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2673,6 +2673,20 @@ include_dir 'conf.d'
26732673
</listitem>
26742674
</varlistentry>
26752675

2676+
<varlistentry id="guc-track-commit-timestamp" xreflabel="track_commit_timestamp">
2677+
<term><varname>track_commit_timestamp</varname> (<type>bool</type>)</term>
2678+
<indexterm>
2679+
<primary><varname>track_commit_timestamp</> configuration parameter</primary>
2680+
</indexterm>
2681+
<listitem>
2682+
<para>
2683+
Record commit time of transactions. This parameter
2684+
can only be set in <filename>postgresql.conf</> file or on the server
2685+
command line. The default value is <literal>off</literal>.
2686+
</para>
2687+
</listitem>
2688+
</varlistentry>
2689+
26762690
</variablelist>
26772691
</sect2>
26782692

‎doc/src/sgml/func.sgml

Lines changed: 39 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15938,6 +15938,45 @@ SELECT collation for ('foo' COLLATE "de_DE");
1593815938
For example <literal>10:20:10,14,15</literal> means
1593915939
<literal>xmin=10, xmax=20, xip_list=10, 14, 15</literal>.
1594015940
</para>
15941+
15942+
<para>
15943+
The functions shown in <xref linkend="functions-commit-timestamp">
15944+
provide information about transactions that have been already committed.
15945+
These functions mainly provide information about when the transactions
15946+
were committed. They only provide useful data when
15947+
<xref linkend="guc-track-commit-timestamp"> configuration option is enabled
15948+
and only for transactions that were committed after it was enabled.
15949+
</para>
15950+
15951+
<table id="functions-commit-timestamp">
15952+
<title>Committed transaction information</title>
15953+
<tgroup cols="3">
15954+
<thead>
15955+
<row><entry>Name</entry> <entry>Return Type</entry> <entry>Description</entry></row>
15956+
</thead>
15957+
15958+
<tbody>
15959+
<row>
15960+
<entry>
15961+
<indexterm><primary>pg_xact_commit_timestamp</primary></indexterm>
15962+
<literal><function>pg_xact_commit_timestamp(<parameter>xid</parameter>)</function></literal>
15963+
</entry>
15964+
<entry><type>timestamp with time zone</type></entry>
15965+
<entry>get commit timestamp of a transaction</entry>
15966+
</row>
15967+
15968+
<row>
15969+
<entry>
15970+
<indexterm><primary>pg_last_committed_xact</primary></indexterm>
15971+
<literal><function>pg_last_committed_xact()</function></literal>
15972+
</entry>
15973+
<entry><parameter>xid</> <type>xid</>, <parameter>timestamp</> <type>timestamp with time zone</></entry>
15974+
<entry>get transaction ID and commit timestamp of latest committed transaction</entry>
15975+
</row>
15976+
</tbody>
15977+
</tgroup>
15978+
</table>
15979+
1594115980
</sect1>
1594215981

1594315982
<sect1 id="functions-admin">

‎doc/src/sgml/ref/pg_resetxlog.sgml

Lines changed: 18 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,7 @@ PostgreSQL documentation
2222
<refsynopsisdiv>
2323
<cmdsynopsis>
2424
<command>pg_resetxlog</command>
25+
<arg choice="opt"><option>-c</option> <replaceable class="parameter">xid</replaceable>,<replaceable class="parameter">xid</replaceable></arg>
2526
<arg choice="opt"><option>-f</option></arg>
2627
<arg choice="opt"><option>-n</option></arg>
2728
<arg choice="opt"><option>-o</option> <replaceable class="parameter">oid</replaceable></arg>
@@ -79,9 +80,12 @@ PostgreSQL documentation
7980
<para>
8081
The <option>-o</>, <option>-x</>, <option>-e</>,
8182
<option>-m</>, <option>-O</>,
83+
<option>-c</>
8284
and <option>-l</>
8385
options allow the next OID, next transaction ID, next transaction ID's
84-
epoch, next and oldest multitransaction ID, next multitransaction offset, and WAL
86+
epoch, next and oldest multitransaction ID, next multitransaction offset,
87+
oldest and newest transaction IDs for which the commit time can be retrieved,
88+
and WAL
8589
starting address values to be set manually. These are only needed when
8690
<command>pg_resetxlog</command> is unable to determine appropriate values
8791
by reading <filename>pg_control</>. Safe values can be determined as
@@ -128,6 +132,19 @@ PostgreSQL documentation
128132
</para>
129133
</listitem>
130134

135+
<listitem>
136+
<para>
137+
A safe value for the oldest transaction ID for which the commit time can
138+
be retrieved (first part of <option>-c</>) can be determined by looking
139+
for the numerically smallest file name in the directory
140+
<filename>pg_committs</> under the data directory. Conversely, a safe
141+
value for the newest transaction ID for which the commit time can be
142+
retrieved (second part of <option>-c</>) can be determined by looking for
143+
the numerically greatest file name in the same directory. As above, the
144+
file names are in hexadecimal.
145+
</para>
146+
</listitem>
147+
131148
<listitem>
132149
<para>
133150
The WAL starting address (<option>-l</>) should be

‎doc/src/sgml/storage.sgml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -66,6 +66,11 @@ Item
6666
<structname>pg_database</></entry>
6767
</row>
6868

69+
<row>
70+
<entry><filename>pg_commit_ts</></entry>
71+
<entry>Subdirectory containing transaction commit timestamp data</entry>
72+
</row>
73+
6974
<row>
7075
<entry><filename>pg_clog</></entry>
7176
<entry>Subdirectory containing transaction commit status data</entry>

‎src/backend/access/rmgrdesc/Makefile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ subdir = src/backend/access/rmgrdesc
88
top_builddir = ../../../..
99
include$(top_builddir)/src/Makefile.global
1010

11-
OBJS = brindesc.o clogdesc.o dbasedesc.o gindesc.o gistdesc.o\
11+
OBJS = brindesc.o clogdesc.ocommittsdesc.odbasedesc.o gindesc.o gistdesc.o\
1212
hashdesc.o heapdesc.o\
1313
mxactdesc.o nbtdesc.o relmapdesc.o seqdesc.o smgrdesc.o spgdesc.o\
1414
standbydesc.o tblspcdesc.o xactdesc.o xlogdesc.o
Lines changed: 82 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,82 @@
1+
/*-------------------------------------------------------------------------
2+
*
3+
* committsdesc.c
4+
* rmgr descriptor routines for access/transam/commit_ts.c
5+
*
6+
* Portions Copyright (c) 1996-2014, PostgreSQL Global Development Group
7+
* Portions Copyright (c) 1994, Regents of the University of California
8+
*
9+
*
10+
* IDENTIFICATION
11+
* src/backend/access/rmgrdesc/committsdesc.c
12+
*
13+
*-------------------------------------------------------------------------
14+
*/
15+
#include"postgres.h"
16+
17+
#include"access/commit_ts.h"
18+
#include"utils/timestamp.h"
19+
20+
21+
void
22+
commit_ts_desc(StringInfobuf,XLogReaderState*record)
23+
{
24+
char*rec=XLogRecGetData(record);
25+
uint8info=XLogRecGetInfo(record)& ~XLR_INFO_MASK;
26+
27+
if (info==COMMIT_TS_ZEROPAGE)
28+
{
29+
intpageno;
30+
31+
memcpy(&pageno,rec,sizeof(int));
32+
appendStringInfo(buf,"%d",pageno);
33+
}
34+
elseif (info==COMMIT_TS_TRUNCATE)
35+
{
36+
intpageno;
37+
38+
memcpy(&pageno,rec,sizeof(int));
39+
appendStringInfo(buf,"%d",pageno);
40+
}
41+
elseif (info==COMMIT_TS_SETTS)
42+
{
43+
xl_commit_ts_set*xlrec= (xl_commit_ts_set*)rec;
44+
intnsubxids;
45+
46+
appendStringInfo(buf,"set %s/%d for: %u",
47+
timestamptz_to_str(xlrec->timestamp),
48+
xlrec->nodeid,
49+
xlrec->mainxid);
50+
nsubxids= ((XLogRecGetDataLen(record)-SizeOfCommitTsSet) /
51+
sizeof(TransactionId));
52+
if (nsubxids>0)
53+
{
54+
inti;
55+
TransactionId*subxids;
56+
57+
subxids=palloc(sizeof(TransactionId)*nsubxids);
58+
memcpy(subxids,
59+
XLogRecGetData(record)+SizeOfCommitTsSet,
60+
sizeof(TransactionId)*nsubxids);
61+
for (i=0;i<nsubxids;i++)
62+
appendStringInfo(buf,", %u",subxids[i]);
63+
pfree(subxids);
64+
}
65+
}
66+
}
67+
68+
constchar*
69+
commit_ts_identify(uint8info)
70+
{
71+
switch (info)
72+
{
73+
caseCOMMIT_TS_ZEROPAGE:
74+
return"ZEROPAGE";
75+
caseCOMMIT_TS_TRUNCATE:
76+
return"TRUNCATE";
77+
caseCOMMIT_TS_SETTS:
78+
return"SETTS";
79+
default:
80+
returnNULL;
81+
}
82+
}

‎src/backend/access/rmgrdesc/xlogdesc.c

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -45,6 +45,7 @@ xlog_desc(StringInfo buf, XLogReaderState *record)
4545
appendStringInfo(buf,"redo %X/%X; "
4646
"tli %u; prev tli %u; fpw %s; xid %u/%u; oid %u; multi %u; offset %u; "
4747
"oldest xid %u in DB %u; oldest multi %u in DB %u; "
48+
"oldest/newest commit timestamp xid: %u/%u; "
4849
"oldest running xid %u; %s",
4950
(uint32) (checkpoint->redo >>32), (uint32)checkpoint->redo,
5051
checkpoint->ThisTimeLineID,
@@ -58,6 +59,8 @@ xlog_desc(StringInfo buf, XLogReaderState *record)
5859
checkpoint->oldestXidDB,
5960
checkpoint->oldestMulti,
6061
checkpoint->oldestMultiDB,
62+
checkpoint->oldestCommitTs,
63+
checkpoint->newestCommitTs,
6164
checkpoint->oldestActiveXid,
6265
(info==XLOG_CHECKPOINT_SHUTDOWN) ?"shutdown" :"online");
6366
}

‎src/backend/access/transam/Makefile

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -12,8 +12,9 @@ subdir = src/backend/access/transam
1212
top_builddir = ../../../..
1313
include$(top_builddir)/src/Makefile.global
1414

15-
OBJS = clog.o transam.o varsup.o xact.o rmgr.o slru.o subtrans.o multixact.o\
16-
timeline.o twophase.o twophase_rmgr.o xlog.o xlogarchive.o xlogfuncs.o\
15+
OBJS = clog.o commit_ts.o multixact.o rmgr.o slru.o subtrans.o\
16+
timeline.o transam.o twophase.o twophase_rmgr.o varsup.o\
17+
xact.o xlog.o xlogarchive.o xlogfuncs.o\
1718
xloginsert.o xlogreader.o xlogutils.o
1819

1920
include$(top_srcdir)/src/backend/common.mk

‎src/backend/access/transam/README

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -840,7 +840,7 @@ parent transaction to complete.
840840

841841
Not all transactional behaviour is emulated, for example we do not insert
842842
a transaction entry into the lock table, nor do we maintain the transaction
843-
stack in memory. Clogandmultixact entries are made normally.
843+
stack in memory. Clog, multixactandcommit_ts entries are made normally.
844844
Subtrans is maintained during recovery but the details of the transaction
845845
tree are ignored and all subtransactions reference the top-level TransactionId
846846
directly. Since commit is atomic this provides correct lock wait behaviour

0 commit comments

Comments
 (0)
[8]ページ先頭
©2009-2025 Movatter.jp