Documentation Home
MySQL 8.0 Reference Manual
Related Documentation Download this Manual
PDF (US Ltr) - 43.3Mb
PDF (A4) - 43.4Mb
Man Pages (TGZ) - 297.2Kb
Man Pages (Zip) - 402.4Kb
Info (Gzip) - 4.3Mb
Info (Zip) - 4.3Mb
Excerpts from this Manual

MySQL 8.0 Reference Manual  / ...  / Replication  / Replication Notes and Tips  / Replication Features and Issues  /  Replication and max_allowed_packet

19.5.1.20 Replication and max_allowed_packet

max_allowed_packet sets an upper limit on the size of any single message between the MySQL server and clients, including replicas. If you are replicating large column values (such as might be found inTEXT orBLOB columns) andmax_allowed_packet is too small on the source, the source fails with an error, and the replica shuts down the replication I/O (receiver) thread. Ifmax_allowed_packet is too small on the replica, this also causes the replica to stop the I/O thread.

Row-based replication sends all columns and column values for updated rows from the source to the replica, including values of columns that were not actually changed by the update. This means that, when you are replicating large column values using row-based replication, you must take care to setmax_allowed_packet large enough to accommodate the largest row in any table to be replicated, even if you are replicating updates only, or you are inserting only relatively small values.

On a multi-threaded replica (withreplica_parallel_workers > 0 orslave_parallel_workers > 0), ensure that the system variablereplica_pending_jobs_size_max orslave_pending_jobs_size_max is set to a value equal to or greater than the setting for themax_allowed_packet system variable on the source. The default setting forreplica_pending_jobs_size_max orslave_pending_jobs_size_max, 128M, is twice the default setting formax_allowed_packet, which is 64M.max_allowed_packet limits the packet size that the source can send, but the addition of an event header can produce a binary log event exceeding this size. Also, in row-based replication, a single event can be significantly larger than themax_allowed_packet size, because the value ofmax_allowed_packet only limits each column of the table.

The replica actually accepts packets up to the limit set by itsreplica_max_allowed_packet orslave_max_allowed_packet setting, which default to the maximum setting of 1GB, to prevent a replication failure due to a large packet. However, the value ofreplica_pending_jobs_size_max orslave_pending_jobs_size_max controls the memory that is made available on the replica to hold incoming packets. The specified memory is shared among all the replica worker queues.

The value ofreplica_pending_jobs_size_max orslave_pending_jobs_size_max is a soft limit, and if an unusually large event (consisting of one or multiple packets) exceeds this size, the transaction is held until all the replica workers have empty queues, and then processed. All subsequent transactions are held until the large transaction has been completed. So although unusual events larger thanreplica_pending_jobs_size_max orslave_pending_jobs_size_max can be processed, the delay to clear the queues of all the replica workers and the wait to queue subsequent transactions can cause lag on the replica and decreased concurrency of the replica workers.replica_pending_jobs_size_max orslave_pending_jobs_size_max should therefore be set high enough to accommodate most expected event sizes.