Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Commita273d39

Browse files
committed
Add ideas for concurrent pg_dump and pg_restore:
< * pg_dump> * pg_dump / pg_restore> o Allow pg_dump to utilize multiple CPUs and I/O channels by dumping> multiple objects simultaneously>> The difficulty with this is getting multiple dump processes to> produce a single dump output file.>http://archives.postgresql.org/pgsql-hackers/2008-02/msg00205.php>> o Allow pg_restore to utilize multiple CPUs and I/O channels by> restoring multiple objects simultaneously>> This might require a pg_restore flag to indicate how many> simultaneous operations should be performed. Only pg_dump's> -Fc format has the necessary dependency information.>> o To better utilize resources, restore data, primary keys, and> indexes for a single table before restoring the next table>> Hopefully this will allow the CPU-I/O load to be more uniform> for simultaneous restores. The idea is to start data restores> for several objects, and once the first object is done, to move> on to its primary keys and indexes. Over time, simultaneous> data loads and index builds will be running.>> o To better utilize resources, allow pg_restore to check foreign> keys simultaneously, where possible> o Allow pg_restore to create all indexes of a table> concurrently, via a single heap scan>> This requires a pg_dump -Fc file because that format contains> the required dependency information.>http://archives.postgresql.org/pgsql-general/2007-05/msg01274.php>> o Allow pg_restore to load different parts of the COPY data> simultaneously< single heap scan, and have a restore of a pg_dump somehow use it> single heap scan, and have pg_restore use it<http://archives.postgresql.org/pgsql-general/2007-05/msg01274.php
1 parentb5aae11 commita273d39

File tree

2 files changed

+70
-9
lines changed

2 files changed

+70
-9
lines changed

‎doc/TODO

Lines changed: 37 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
PostgreSQL TODO List
22
====================
33
Current maintainer:Bruce Momjian (bruce@momjian.us)
4-
Last updated:Mon Mar 316:26:04 EST 2008
4+
Last updated:Mon Mar 320:33:10 EST 2008
55

66
The most recent version of this document can be viewed at
77
http://www.postgresql.org/docs/faqs.TODO.html.
@@ -819,7 +819,7 @@ Clients
819819
http://archives.postgresql.org/pgsql-hackers/2006-12/msg00255.php
820820

821821

822-
* pg_dump
822+
* pg_dump / pg_restore
823823
o %Add dumping of comments on index columns and composite type columns
824824
o %Add full object name to the tag field. eg. for operators we need
825825
'=(integer, integer)', instead of just '='.
@@ -838,6 +838,40 @@ Clients
838838
COMMENT ON CURRENT DATABASE.
839839
o Remove unnecessary function pointer abstractions in pg_dump source
840840
code
841+
o Allow pg_dump to utilize multiple CPUs and I/O channels by dumping
842+
multiple objects simultaneously
843+
844+
The difficulty with this is getting multiple dump processes to
845+
produce a single dump output file.
846+
http://archives.postgresql.org/pgsql-hackers/2008-02/msg00205.php
847+
848+
o Allow pg_restore to utilize multiple CPUs and I/O channels by
849+
restoring multiple objects simultaneously
850+
851+
This might require a pg_restore flag to indicate how many
852+
simultaneous operations should be performed. Only pg_dump's
853+
-Fc format has the necessary dependency information.
854+
855+
o To better utilize resources, restore data, primary keys, and
856+
indexes for a single table before restoring the next table
857+
858+
Hopefully this will allow the CPU-I/O load to be more uniform
859+
for simultaneous restores. The idea is to start data restores
860+
for several objects, and once the first object is done, to move
861+
on to its primary keys and indexes. Over time, simultaneous
862+
data loads and index builds will be running.
863+
864+
o To better utilize resources, allow pg_restore to check foreign
865+
keys simultaneously, where possible
866+
o Allow pg_restore to create all indexes of a table
867+
concurrently, via a single heap scan
868+
869+
This requires a pg_dump -Fc file because that format contains
870+
the required dependency information.
871+
http://archives.postgresql.org/pgsql-general/2007-05/msg01274.php
872+
873+
o Allow pg_restore to load different parts of the COPY data
874+
simultaneously
841875

842876

843877
* ecpg
@@ -967,9 +1001,8 @@ Indexes
9671001
downtime.
9681002

9691003
* Allow multiple indexes to be created concurrently, ideally via a
970-
single heap scan, and havea restore of a pg_dump somehow use it
1004+
single heap scan, and havepg_restore use it
9711005

972-
http://archives.postgresql.org/pgsql-general/2007-05/msg01274.php
9731006

9741007

9751008
* Inheritance

‎doc/src/FAQ/TODO.html

Lines changed: 33 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
<bodybgcolor="#FFFFFF"text="#000000"link="#FF0000"vlink="#A00000"alink="#0000FF">
99
<h1><aname="section_1">PostgreSQL TODO List</a></h1>
1010
<p>Current maintainer: Bruce Momjian (<ahref="mailto:bruce@momjian.us">bruce@momjian.us</a>)<br/>
11-
Last updated: Mon Mar 316:26:04 EST 2008
11+
Last updated: Mon Mar 320:33:10 EST 2008
1212
</p>
1313
<p>The most recent version of this document can be viewed at<br/>
1414
<ahref="http://www.postgresql.org/docs/faqs.TODO.html">http://www.postgresql.org/docs/faqs.TODO.html</a>.
@@ -727,7 +727,7 @@ <h1><a name="section_8">Clients</a></h1>
727727
<p><ahref="http://archives.postgresql.org/pgsql-hackers/2006-12/msg00255.php">http://archives.postgresql.org/pgsql-hackers/2006-12/msg00255.php</a>
728728
</p>
729729
</li></ul>
730-
</li><li>pg_dump
730+
</li><li>pg_dump / pg_restore
731731
<ul>
732732
<li>%Add dumping of comments on index columns and composite type columns
733733
</li><li>%Add full object name to the tag field. eg. for operators we need
@@ -747,6 +747,36 @@ <h1><a name="section_8">Clients</a></h1>
747747
COMMENT ON CURRENT DATABASE.
748748
</li><li>Remove unnecessary function pointer abstractions in pg_dump source
749749
code
750+
</li><li>Allow pg_dump to utilize multiple CPUs and I/O channels by dumping
751+
multiple objects simultaneously
752+
<p> The difficulty with this is getting multiple dump processes to
753+
produce a single dump output file.
754+
<ahref="http://archives.postgresql.org/pgsql-hackers/2008-02/msg00205.php">http://archives.postgresql.org/pgsql-hackers/2008-02/msg00205.php</a>
755+
</p>
756+
</li><li>Allow pg_restore to utilize multiple CPUs and I/O channels by
757+
restoring multiple objects simultaneously
758+
<p> This might require a pg_restore flag to indicate how many
759+
simultaneous operations should be performed. Only pg_dump's
760+
-Fc format has the necessary dependency information.
761+
</p>
762+
</li><li>To better utilize resources, restore data, primary keys, and
763+
indexes for a single table before restoring the next table
764+
<p> Hopefully this will allow the CPU-I/O load to be more uniform
765+
for simultaneous restores. The idea is to start data restores
766+
for several objects, and once the first object is done, to move
767+
on to its primary keys and indexes. Over time, simultaneous
768+
data loads and index builds will be running.
769+
</p>
770+
</li><li>To better utilize resources, allow pg_restore to check foreign
771+
keys simultaneously, where possible
772+
</li><li>Allow pg_restore to create all indexes of a table
773+
concurrently, via a single heap scan
774+
<p> This requires a pg_dump -Fc file because that format contains
775+
the required dependency information.
776+
<ahref="http://archives.postgresql.org/pgsql-general/2007-05/msg01274.php">http://archives.postgresql.org/pgsql-general/2007-05/msg01274.php</a>
777+
</p>
778+
</li><li>Allow pg_restore to load different parts of the COPY data
779+
simultaneously
750780
</li></ul>
751781
</li><li>ecpg
752782
<ul>
@@ -860,9 +890,7 @@ <h1><a name="section_10">Indexes</a></h1>
860890
downtime.
861891
</p>
862892
</li><li>Allow multiple indexes to be created concurrently, ideally via a
863-
single heap scan, and have a restore of a pg_dump somehow use it
864-
<p><ahref="http://archives.postgresql.org/pgsql-general/2007-05/msg01274.php">http://archives.postgresql.org/pgsql-general/2007-05/msg01274.php</a>
865-
</p>
893+
single heap scan, and have pg_restore use it
866894
</li><li>Inheritance
867895
<ul>
868896
<li>Allow inherited tables to inherit indexes, UNIQUE constraints,

0 commit comments

Comments
 (0)

[8]ページ先頭

©2009-2025 Movatter.jp