Matrix defined using smaller matrices called blocks
Inmathematics, ablock matrix or apartitioned matrix is amatrix that is interpreted as having been broken into sections calledblocks orsubmatrices.[1][2]
Intuitively, a matrix interpreted as a block matrix can be visualized as the original matrix with a collection of horizontal and vertical lines, which break it up, orpartition it, into a collection of smaller matrices.[3][2] For example, the 3×4 matrix presented below is divided by horizontal and vertical lines into four blocks: the top-left 2×3 block, the top-right 2×1 block, the bottom-left 1×3 block, and the bottom-right 1×1 block.
Any matrix may be interpreted as a block matrix in one or more ways, with each interpretation defined by how its rows and columns are partitioned.
This notion can be made more precise for an by matrix by partitioning into a collection, and then partitioning into a collection. The original matrix is then considered as the "total" of these groups, in the sense that the entry of the original matrix corresponds in a1-to-1 way with someoffset entry of some, where and.[4]
The horizontal and vertical lines have no special mathematical meaning,[6][7] but are a common way to visualize a partition.[6][7] By this partition, is partitioned into four 2×2 blocks, as
Let. Apartitioning of is a representation of in the form
where are contiguous submatrices,, and.[9] The elements of the partition are calledblocks.[9]
By this definition, the blocks in any one column must all have the same number of columns.[9] Similarly, the blocks in any one row must have the same number of rows.[9]
A special form of matrixtranspose can also be defined for block matrices, where individual blocks are reordered but not transposed. Let be a block matrix with blocks, the block transpose of is the block matrix with blocks.[11] As with the conventional trace operator, the block transpose is alinear mapping such that.[10] However, in general the property does not hold unless the blocks of and commute.
It is possible to use a block partitioned matrix product that involves only algebra on submatrices of the factors. The partitioning of the factors is not arbitrary, however, and requires "conformable partitions"[12] between two matrices and such that all submatrix products that will be used are defined.[13]
Two matrices and are said to be partitioned conformally for the product, when and are partitioned into submatrices and if the multiplication is carried out treating the submatrices as if they are scalars, but keeping the order, and when all products and sums of submatrices involved are defined.
— Arak M. Mathai and Hans J. Haubold,Linear Algebra: A Course for Physicists and Engineers[14]
Let be the matrix defined in§ Transpose, and let be the matrix defined in§ Addition. Then the matrix product
can be performed blockwise, yielding as an matrix. The matrices in the resulting matrix are calculated by multiplying:[6]
Or, using theEinstein notation that implicitly sums over repeated indices:
If a matrix is partitioned into four blocks, it can beinverted blockwise as follows:
whereA andD are square blocks of arbitrary size, andB andC areconformable with them for partitioning. Furthermore,A and the Schur complement ofA inP:P/A =D −CA−1B must be invertible.[15]
By the symmetry between a matrix and its inverse in the block inversion formula, if a matrixP and its inverseP−1 are partitioned conformally:
then the inverse of any principal submatrix can be computed from the corresponding blocks ofP−1:
This relationship follows from recognizing thatE−1 =A −BD−1C (the Schur complement), and applying the same block inversion formula with the roles ofP andP−1 reversed.[17][18]
The formula for the determinant of a-matrix above continues to hold, under appropriate further assumptions, for a matrix composed of four submatrices with and square. The easiest such formula, which can be proven using either theLeibniz formula or a factorization involving theSchur complement, is[16]
Using this formula, we can derive thatcharacteristic polynomials of and are same and equal to the product of characteristic polynomials of and. Furthermore, If or isdiagonalizable, then and are diagonalizable too. The converse is false; simply check.
If the blocks are square matrices of thesame size further formulas hold. For example, if andcommute (i.e.,), then[20]Similar statements hold when,, or. Namely, if, thenNote the change in order of and (we have instead of). Similarly, if, then should be replaced with (i.e. we get) and if, then we should have. Note for the last two results, you have to use commutativity of the underlying ring, but not for the first two.
This formula has been generalized to matrices composed of more than blocks, again under appropriate commutativity conditions among the individual blocks.[21]
For and, the following formula holds (even if and do not commute)[16]
Ablock diagonal matrix is a block matrix that is asquare matrix such that the main-diagonal blocks are square matrices and all off-diagonal blocks are zero matrices.[16] That is, a block diagonal matrixA has the form
whereAk is a square matrix for allk = 1, ...,n. In other words, matrixA is thedirect sum ofA1, ...,An.[16] It can also be indicated asA1 ⊕ A2 ⊕ ... ⊕ An[10] or diag(A1,A2, ...,An)[10] (the latter being the same formalism used for adiagonal matrix). Any square matrix can trivially be considered a block diagonal matrix with only one block.
A block diagonal matrix is invertibleif and only if each of its main-diagonal blocks are invertible, and in this case its inverse is another block diagonal matrix given by[24]
Ablock tridiagonal matrix is another special block matrix, which is just like the block diagonal matrix asquare matrix, having square matrices (blocks) in the lower diagonal,main diagonal and upper diagonal, with all other blocks being zero matrices. It is essentially atridiagonal matrix but has submatrices in places of scalars. A block tridiagonal matrix has the form
where, and are square sub-matrices of the lower, main and upper diagonal respectively.[26][27]
Block tridiagonal matrices are often encountered in numerical solutions of engineering problems (e.g.,computational fluid dynamics). Optimized numerical methods forLU factorization are available[28] and hence efficient solution algorithms for equation systems with a block tridiagonal matrix as coefficient matrix. TheThomas algorithm, used for efficient solution of equation systems involving atridiagonal matrix can also be applied using matrix operations to block tridiagonal matrices (see alsoBlock LU decomposition).
An matrix isupper block triangular (orblock upper triangular[29]) if there are positive integers such that andwhere the matrix is for all.[25][29]Similarly, islower block triangular ifwhere is for all.[25]
Ablock Toeplitz matrix is another special block matrix, which contains blocks that are repeated down the diagonals of the matrix, as aToeplitz matrix has elements repeated down the diagonal.
^Eves, Howard (1980).Elementary Matrix Theory (reprint ed.). New York: Dover. p. 37.ISBN0-486-63946-0. Retrieved24 April 2013.We shall find that it is sometimes convenient to subdivide a matrix into rectangular blocks of elements. This leads us to consider so-calledpartitioned, orblock,matrices.
^abDobrushkin, Vladimir."Partition Matrices".Linear Algebra with Mathematica. Retrieved2024-03-24.
^Anton, Howard (1994).Elementary Linear Algebra (7th ed.). New York: John Wiley. p. 30.ISBN0-471-58742-7.A matrix can be subdivided orpartitioned into smaller matrices by inserting horizontal and vertical rules between selected rows and columns.
^Macedo, H.D.; Oliveira, J.N. (2013). "Typing linear algebra: A biproduct-oriented approach".Science of Computer Programming.78 (11):2160–2191.arXiv:1312.4818.doi:10.1016/j.scico.2012.07.012.
^abcJohnston, Nathaniel (2021).Introduction to linear and matrix algebra. Cham, Switzerland: Springer Nature. pp. 30, 425.ISBN978-3-030-52811-9.
^abJohnston, Nathaniel (2021).Advanced linear and matrix algebra. Cham, Switzerland: Springer Nature. p. 298.ISBN978-3-030-52814-0.
^abcdefghijklmStewart, Gilbert W. (1998).Matrix algorithms. 1: Basic decompositions. Philadelphia, PA: Soc. for Industrial and Applied Mathematics. pp. 18–20.ISBN978-0-89871-414-2.
^abcdeGentle, James E. (2007).Matrix Algebra: Theory, Computations, and Applications in Statistics. Springer Texts in Statistics. New York, NY: Springer New York Springer e-books. pp. 47, 487.ISBN978-0-387-70873-7.
^Anton, Howard (1994).Elementary Linear Algebra (7th ed.). New York: John Wiley. p. 36.ISBN0-471-58742-7....provided the sizes of the submatrices of A and B are such that the indicated operations can be performed.
^Mathai, Arakaparampil M.; Haubold, Hans J. (2017).Linear Algebra: a course for physicists and engineers. De Gruyter textbook. Berlin Boston: De Gruyter. p. 162.ISBN978-3-11-056259-0.
^Bernstein, Dennis (2005).Matrix Mathematics. Princeton University Press. p. 44.ISBN0-691-11802-7.
^abcdefghAbadir, Karim M.; Magnus, Jan R. (2005).Matrix Algebra. Cambridge University Press. pp. 97, 100, 106, 111, 114, 118.ISBN9781139443647.
^Prince, Simon J. D. (2012).Computer vision: models, learning, and inference. New York: Cambridge university press. p. 531.ISBN978-1-107-01179-3.
^abcdeBernstein, Dennis S. (2009).Matrix mathematics: theory, facts, and formulas (2 ed.). Princeton, NJ: Princeton University Press. pp. 168, 298.ISBN978-0-691-14039-1.
^Horn, Roger A.; Johnson, Charles R. (2017).Matrix analysis (Second edition, corrected reprint ed.). New York, NY: Cambridge University Press. p. 36.ISBN978-0-521-83940-2.
^Datta, Biswa Nath (2010).Numerical linear algebra and applications (2 ed.). Philadelphia, Pa: SIAM. p. 168.ISBN978-0-89871-685-6.
^abStewart, Gilbert W. (2001).Matrix algorithms. 2: Eigensystems. Philadelphia, Pa: Soc. for Industrial and Applied Mathematics. p. 5.ISBN978-0-89871-503-3.