This article includes a list ofgeneral references, butit lacks sufficient correspondinginline citations. Please help toimprove this article byintroducing more precise citations.(December 2021) (Learn how and when to remove this message) |
Inmathematics, and more specifically inlinear algebra, alinear map (also called alinear mapping,linear transformation,vector space homomorphism, or in some contextslinear function) is amapping between twovector spaces that preserves the operations ofvector addition andscalar multiplication. The same names and the same definition are also used for the more general case ofmodules over aring; seeModule homomorphism.
If a linear map is abijection then it is called alinear isomorphism. In the case where, a linear map is called alinear endomorphism. Sometimes the termlinear operator refers to this case,[1] but the term "linear operator" can have different meanings for different conventions: for example, it can be used to emphasize that and arereal vector spaces (not necessarily with),[citation needed] or it can be used to emphasize that is afunction space, which is a common convention infunctional analysis.[2] Sometimes the termlinear function has the same meaning aslinear map, while inanalysis it does not.
A linear map from to always maps the origin of to the origin of. Moreover, it mapslinear subspaces in onto linear subspaces in (possibly of a lowerdimension);[3] for example, it maps aplane through theorigin in to either a plane through the origin in, aline through the origin in, or just the origin in. Linear maps can often be represented asmatrices, and simple examples includerotation and reflection linear transformations.
In the language ofcategory theory, linear maps are themorphisms of vector spaces, and they form a categoryequivalent tothe one of matrices.
Definition and first consequences
editLet and be vector spaces over the samefield . Afunction is said to be alinear map if for any two vectors and any scalar the following two conditions are satisfied:
- Additivity / operation of addition
- Homogeneity of degree 1 / operation of scalar multiplication
Thus, a linear map is said to beoperation preserving. In other words, it does not matter whether the linear map is applied before (the right hand sides of the above examples) or after (the left hand sides of the examples) the operations of addition and scalar multiplication.
Bythe associativity of the addition operation denoted as +, for any vectors and scalars the following equality holds:[4][5] Thus a linear map is one which preserveslinear combinations.
Denoting the zero elements of the vector spaces and by and respectively, it follows that Let and in the equation for homogeneity of degree 1:
A linear map with viewed as a one-dimensional vector space over itself is called alinear functional.[6]
These statements generalize to any left-module over a ring without modification, and to any right-module upon reversing of the scalar multiplication.
Examples
edit- A prototypical example that gives linear maps their name is a function , of which thegraph is a line through the origin.[7]
- More generally, anyhomothety centered in the origin of a vector space is a linear map (herec is a scalar).
- The zero map between two vector spaces (over the samefield) is linear.
- Theidentity map on any module is a linear operator.
- For real numbers, the map is not linear.
- For real numbers, the map is not linear (but is anaffine transformation).
- If is a real matrix, then defines a linear map from to by sending acolumn vector to the column vector . Conversely, any linear map betweenfinite-dimensional vector spaces can be represented in this manner; see the§ Matrices, below.
- If is anisometry between realnormed spaces such that then is a linear map. This result is not necessarily true for complex normed space.[8]
- Differentiation defines a linear map from the space of all differentiable functions to the space of all functions. It also defines alinear operator on the space of allsmooth functions (a linear operator is alinear endomorphism, that is, a linear map with the samedomain andcodomain). Indeed,
- A definiteintegral over someintervalI is a linear map from the space of all real-valued integrable functions onI to . Indeed,
- An indefiniteintegral (orantiderivative) with a fixed integration starting point defines a linear map from the space of all real-valued integrable functions on to the space of all real-valued, differentiable functions on . Without a fixed starting point, the antiderivative maps to thequotient space of the differentiable functions by the linear space of constant functions.
- If and are finite-dimensional vector spaces over a fieldF, of respective dimensionsm andn, then the function that maps linear maps ton ×m matrices in the way described in§ Matrices (below) is a linear map, and even alinear isomorphism.
- Theexpected value of arandom variable (which is in fact a function, and as such an element of a vector space) is linear, as for random variables and we have and , but thevariance of a random variable is not linear.
- The function with is a linear map. This function scales the component of a vector by the factor .
- The function is additive: It does not matter whether vectors are first added and then mapped or whether they are mapped and finally added:
- The function is homogeneous: It does not matter whether a vector is first scaled and then mapped or first mapped and then scaled:
Linear extensions
editOften, a linear map is constructed by defining it on a subset of a vector space and thenextending by linearity to thelinear span of the domain. Suppose and are vector spaces and is afunction defined on some subset Then alinear extension of to if it exists, is a linear map defined on thatextends [note 1] (meaning that for all ) and takes its values from the codomain of [9] When the subset is a vector subspace of then a ( -valued) linear extension of to all of is guaranteed to exist if (and only if) is a linear map.[9] In particular, if has a linear extension to then it has a linear extension to all of
The map can be extended to a linear map if and only if whenever is an integer, are scalars, and are vectors such that then necessarily [10] If a linear extension of exists then the linear extension is unique and holds for all and as above.[10] If is linearly independent then every function into any vector space has a linear extension to a (linear) map (the converse is also true).
For example, if and then the assignment and can be linearly extended from the linearly independent set of vectors to a linear map on The unique linear extension is the map that sends to
Every (scalar-valued)linear functional defined on avector subspace of a real or complex vector space has a linear extension to all of Indeed, theHahn–Banach dominated extension theorem even guarantees that when this linear functional is dominated by some givenseminorm (meaning that holds for all in the domain of ) then there exists a linear extension to that is also dominated by
Matrices
editIf and arefinite-dimensional vector spaces and abasis is defined for each vector space, then every linear map from to can be represented by amatrix.[11] This is useful because it allows concrete calculations. Matrices yield examples of linear maps: if is a real matrix, then describes a linear map (seeEuclidean space).
Let be a basis for . Then every vector is uniquely determined by the coefficients in the field :
If is a linear map,
which implies that the functionf is entirely determined by the vectors . Now let be a basis for . Then we can represent each vector as
Thus, the function is entirely determined by the values of . If we put these values into an matrix , then we can conveniently use it to compute the vector output of for any vector in . To get , every column of is a vector corresponding to as defined above. To define it more clearly, for some column that corresponds to the mapping , where is the matrix of . In other words, every column has a corresponding vector whose coordinates are the elements of column . A single linear map may be represented by many matrices. This is because the values of the elements of a matrix depend on the bases chosen.
The matrices of a linear transformation can be represented visually:
- Matrix for relative to :
- Matrix for relative to :
- Transition matrix from to :
- Transition matrix from to :
Such that starting in the bottom left corner and looking for the bottom right corner , one would left-multiply—that is, . The equivalent method would be the "longer" method going clockwise from the same point such that is left-multiplied with , or .
Examples in two dimensions
editIn two-dimensional spaceR2 linear maps are described by 2 × 2matrices. These are some examples:
- rotation
- by 90 degrees counterclockwise:
- by an angleθ counterclockwise:
- reflection
- through thex axis:
- through they axis:
- through a line making an angleθ with the origin:
- scaling by 2 in all directions:
- horizontal shear mapping:
- skew of they axis by an angleθ:
- squeeze mapping:
- projection onto they axis:
If a linear map is only composed of rotation, reflection, and/or uniform scaling, then the linear map is aconformal linear transformation.
Vector space of linear maps
editThe composition of linear maps is linear: if and are linear, then so is theircomposition . It follows from this that theclass of all vector spaces over a given fieldK, together withK-linear maps asmorphisms, forms acategory.
Theinverse of a linear map, when defined, is again a linear map.
If and are linear, then so is theirpointwise sum , which is defined by .
If is linear and is an element of the ground field , then the map , defined by , is also linear.
Thus the set of linear maps from to itself forms a vector space over ,[12] sometimes denoted .[13] Furthermore, in the case that , this vector space, denoted , is anassociative algebra undercomposition of maps, since the composition of two linear maps is again a linear map, and the composition of maps is always associative. This case is discussed in more detail below.
Given again the finite-dimensional case, if bases have been chosen, then the composition of linear maps corresponds to thematrix multiplication, the addition of linear maps corresponds to thematrix addition, and the multiplication of linear maps with scalars corresponds to the multiplication of matrices with scalars.
Endomorphisms and automorphisms
editA linear transformation is anendomorphism of ; the set of all such endomorphisms together with addition, composition and scalar multiplication as defined above forms anassociative algebra with identity element over the field (and in particular aring). The multiplicative identity element of this algebra is theidentity map .
An endomorphism of that is also anisomorphism is called anautomorphism of . The composition of two automorphisms is again an automorphism, and the set of all automorphisms of forms agroup, theautomorphism group of which is denoted by or . Since the automorphisms are precisely thoseendomorphisms which possess inverses under composition, is the group ofunits in the ring .
If has finite dimension , then isisomorphic to theassociative algebra of all matrices with entries in . The automorphism group of isisomorphic to thegeneral linear group of all invertible matrices with entries in .
Kernel, image and the rank–nullity theorem
editIf is linear, we define thekernel and theimage orrange of by
is asubspace of and is a subspace of . The followingdimension formula is known as therank–nullity theorem:[14]
The number is also called therank of and written as , or sometimes, ;[15][16] the number is called thenullity of and written as or .[15][16] If and are finite-dimensional, bases have been chosen and is represented by the matrix , then the rank and nullity of are equal to the rank and nullity of the matrix , respectively.
Cokernel
editA subtler invariant of a linear transformation is thecokernel, which is defined as
This is thedual notion to the kernel: just as the kernel is asubspace of thedomain, the co-kernel is aquotient space of thetarget. Formally, one has theexact sequence
These can be interpreted thus: given a linear equationf(v) =w to solve,
- the kernel is the space ofsolutions to thehomogeneous equationf(v) = 0, and its dimension is the number ofdegrees of freedom in the space of solutions, if it is not empty;
- the co-kernel is the space ofconstraints that the solutions must satisfy, and its dimension is the maximal number of independent constraints.
The dimension of the co-kernel and the dimension of the image (the rank) add up to the dimension of the target space. For finite dimensions, this means that the dimension of the quotient spaceW/f(V) is the dimension of the target space minus the dimension of the image.
As a simple example, consider the mapf:R2 →R2, given byf(x,y) = (0,y). Then for an equationf(x,y) = (a,b) to have a solution, we must havea = 0 (one constraint), and in that case the solution space is (x,b) or equivalently stated, (0,b) + (x, 0), (one degree of freedom). The kernel may be expressed as the subspace (x, 0) <V: the value ofx is the freedom in a solution – while the cokernel may be expressed via the mapW →R, : given a vector (a,b), the value ofa is theobstruction to there being a solution.
An example illustrating the infinite-dimensional case is afforded by the mapf:R∞ →R∞, withb1 = 0 andbn + 1 =an forn > 0. Its image consists of all sequences with first element 0, and thus its cokernel consists of the classes of sequences with identical first element. Thus, whereas its kernel has dimension 0 (it maps only the zero sequence to the zero sequence), its co-kernel has dimension 1. Since the domain and the target space are the same, the rank and the dimension of the kernel add up to the samesum as the rank and the dimension of the co-kernel ( ), but in the infinite-dimensional case it cannot be inferred that the kernel and the co-kernel of anendomorphism have the same dimension (0 ≠ 1). The reverse situation obtains for the maph:R∞ →R∞, withcn =an + 1. Its image is the entire target space, and hence its co-kernel has dimension 0, but since it maps all sequences in which only the first element is non-zero to the zero sequence, its kernel has dimension 1.
Index
editFor a linear operator with finite-dimensional kernel and co-kernel, one may defineindex as: namely the degrees of freedom minus the number of constraints.
For a transformation between finite-dimensional vector spaces, this is just the difference dim(V) − dim(W), by rank–nullity. This gives an indication of how many solutions or how many constraints one has: if mapping from a larger space to a smaller one, the map may be onto, and thus will have degrees of freedom even without constraints. Conversely, if mapping from a smaller space to a larger one, the map cannot be onto, and thus one will have constraints even without degrees of freedom.
The index of an operator is precisely theEuler characteristic of the 2-term complex 0 →V →W → 0. Inoperator theory, the index ofFredholm operators is an object of study, with a major result being theAtiyah–Singer index theorem.[17]
Algebraic classifications of linear transformations
editNo classification of linear maps could be exhaustive. The following incomplete list enumerates some important classifications that do not require any additional structure on the vector space.
LetV andW denote vector spaces over a fieldF and letT:V →W be a linear map.
Monomorphism
editT is said to beinjective or amonomorphism if any of the following equivalent conditions are true:
- T isone-to-one as a map ofsets.
- kerT = {0V}
- dim(kerT) = 0
- T ismonic or left-cancellable, which is to say, for any vector spaceU and any pair of linear mapsR:U →V andS:U →V, the equationTR =TS impliesR =S.
- T isleft-invertible, which is to say there exists a linear mapS:W →V such thatST is theidentity map onV.
Epimorphism
editT is said to besurjective or anepimorphism if any of the following equivalent conditions are true:
- T isonto as a map of sets.
- cokerT = {0W}
- T isepic or right-cancellable, which is to say, for any vector spaceU and any pair of linear mapsR:W →U andS:W →U, the equationRT =ST impliesR =S.
- T isright-invertible, which is to say there exists a linear mapS:W →V such thatTS is theidentity map onW.
Isomorphism
editT is said to be anisomorphism if it is both left- and right-invertible. This is equivalent toT being both one-to-one and onto (abijection of sets) or also toT being both epic and monic, and so being abimorphism.
IfT:V →V is an endomorphism, then:
- If, for some positive integern, then-th iterate ofT,Tn, is identically zero, thenT is said to benilpotent.
- IfT2 =T, thenT is said to beidempotent
- IfT =kI, wherek is some scalar, thenT is said to be a scaling transformation or scalar multiplication map; seescalar matrix.
Change of basis
editGiven a linear map which is anendomorphism whose matrix isA, in the basisB of the space it transforms vector coordinates [u] as [v] =A[u]. As vectors change with the inverse ofB (vectors coordinates arecontravariant) its inverse transformation is [v] =B[v'].
Substituting this in the first expression hence
Therefore, the matrix in the new basis isA′ =B−1AB, beingB the matrix of the given basis.
Therefore, linear maps are said to be 1-co- 1-contra-variant objects, or type (1, 1)tensors.
Continuity
editAlinear transformation betweentopological vector spaces, for examplenormed spaces, may becontinuous. If its domain and codomain are the same, it will then be acontinuous linear operator. A linear operator on a normed linear space is continuous if and only if it isbounded, for example, when the domain is finite-dimensional.[18] An infinite-dimensional domain may havediscontinuous linear operators.
An example of an unbounded, hence discontinuous, linear transformation is differentiation on the space of smooth functions equipped with the supremum norm (a function with small values can have a derivative with large values, while the derivative of 0 is 0). For a specific example,sin(nx)/n converges to 0, but its derivativecos(nx) does not, so differentiation is not continuous at 0 (and by a variation of this argument, it is not continuous anywhere).
Applications
editA specific application of linear maps is forgeometric transformations, such as those performed incomputer graphics, where the translation, rotation and scaling of 2D or 3D objects is performed by the use of atransformation matrix. Linear mappings also are used as a mechanism for describing change: for example in calculus correspond to derivatives; or in relativity, used as a device to keep track of the local transformations of reference frames.
Another application of these transformations is incompiler optimizations of nested-loop code, and inparallelizing compiler techniques.
See also
edit- Additive map – Z-module homomorphism
- Antilinear map – Conjugate homogeneous additive map
- Bent function – Special type of Boolean function
- Bounded operator – Linear transformation between topological vector spaces
- Cauchy's functional equation – Functional equation
- Continuous linear operator
- Linear functional – Linear map from a vector space to its field of scalarsPages displaying short descriptions of redirect targets
- Linear isometry – Distance-preserving mathematical transformationPages displaying short descriptions of redirect targets
- Category of matrices
- Quasilinearization
Notes
edit- ^"Linear transformations ofV intoV are often calledlinear operators onV."Rudin 1976, p. 207
- ^LetV andW be two real vector spaces. A mapping a fromV intoW Is called a 'linear mapping' or 'linear transformation' or 'linear operator' [...] fromV intoW, if
for all ,
for all and all realλ.Bronshtein & Semendyayev 2004, p. 316 - ^Rudin 1991, p. 14
Here are some properties of linear mappings whose proofs are so easy that we omit them; it is assumed that and :- IfA is a subspace (or aconvex set, or abalanced set) the same is true of
- IfB is a subspace (or a convex set, or a balanced set) the same is true of
- In particular, the set: is a subspace ofX, called thenull space of .
- ^Rudin 1991, p. 14. Suppose now thatX andY are vector spacesover the same scalar field. A mapping is said to belinear if for all and all scalars and . Note that one often writes , rather than , when is linear.
- ^Rudin 1976, p. 206. A mappingA of a vector spaceX into a vector spaceY is said to be alinear transformation if: for all and all scalarsc. Note that one often writes instead of ifA is linear.
- ^Rudin 1991, p. 14. Linear mappings ofX onto its scalar field are calledlinear functionals.
- ^"terminology - What does 'linear' mean in Linear Algebra?".Mathematics Stack Exchange. Retrieved2021-02-17.
- ^Wilansky 2013, pp. 21–26.
- ^abKubrusly 2001, p. 57.
- ^abSchechter 1996, pp. 277–280.
- ^Rudin 1976, p. 210Suppose and are bases of vector spacesX andY, respectively. Then every determines a set of numbers such that It is convenient to represent these numbers in a rectangular array ofm rows andn columns, called anmbynmatrix: Observe that the coordinates of the vector (with respect to the basis ) appear in thejth column of . The vectors are therefore sometimes called thecolumn vectors of . With this terminology, therange ofAis spanned by the column vectors of .
- ^Axler (2015) p. 52, § 3.3
- ^Tu (2011), p. 19, § 3.1
- ^Horn & Johnson 2013, 0.2.3 Vector spaces associated with a matrix or linear transformation, p. 6
- ^abKatznelson & Katznelson (2008) p. 52, § 2.5.1
- ^abHalmos (1974) p. 90, § 50
- ^Nistor, Victor (2001) [1994],"Index theory",Encyclopedia of Mathematics,EMS Press: "The main question in index theory is to provide index formulas for classes of Fredholm operators ... Index theory has become a subject on its own only after M. F. Atiyah and I. Singer published their index theorems"
- ^Rudin 1991, p. 151.18 TheoremLet be a linear functional on a topological vector spaceX. Assume for some . Then each of the following four properties implies the other three:
- is continuous
- The null space is closed.
- is not dense inX.
- is bounded in some neighbourhoodV of 0.
Bibliography
edit- Axler, Sheldon Jay (2015).Linear Algebra Done Right (3rd ed.).Springer.ISBN 978-3-319-11079-0.
- Bronshtein, I. N.; Semendyayev, K. A. (2004).Handbook of Mathematics (4th ed.). New York: Springer-Verlag.ISBN 3-540-43491-7.
- Halmos, Paul Richard (1974) [1958].Finite-Dimensional Vector Spaces (2nd ed.).Springer.ISBN 0-387-90093-4.
- Horn, Roger A.; Johnson, Charles R. (2013).Matrix Analysis (Second ed.).Cambridge University Press.ISBN 978-0-521-83940-2.
- Katznelson, Yitzhak; Katznelson, Yonatan R. (2008).A (Terse) Introduction to Linear Algebra.American Mathematical Society.ISBN 978-0-8218-4419-9.
- Kubrusly, Carlos (2001).Elements of operator theory. Boston: Birkhäuser.ISBN 978-1-4757-3328-0.OCLC 754555941.
- Lang, Serge (1987),Linear Algebra (Third ed.), New York:Springer-Verlag,ISBN 0-387-96412-6
- Rudin, Walter (1973).Functional Analysis. International Series in Pure and Applied Mathematics. Vol. 25 (First ed.). New York, NY:McGraw-Hill Science/Engineering/Math.ISBN 9780070542259.
- Rudin, Walter (1976).Principles of Mathematical Analysis. Walter Rudin Student Series in Advanced Mathematics (3rd ed.). New York: McGraw–Hill.ISBN 978-0-07-054235-8.
- Rudin, Walter (1991).Functional Analysis. International Series in Pure and Applied Mathematics. Vol. 8 (Second ed.). New York, NY:McGraw-Hill Science/Engineering/Math.ISBN 978-0-07-054236-5.OCLC 21163277.
- Schaefer, Helmut H.; Wolff, Manfred P. (1999).Topological Vector Spaces.GTM. Vol. 8 (Second ed.). New York, NY: Springer New York Imprint Springer.ISBN 978-1-4612-7155-0.OCLC 840278135.
- Schechter, Eric (1996).Handbook of Analysis and Its Foundations. San Diego, CA: Academic Press.ISBN 978-0-12-622760-4.OCLC 175294365.
- Swartz, Charles (1992).An introduction to Functional Analysis. New York: M. Dekker.ISBN 978-0-8247-8643-4.OCLC 24909067.
- Tu, Loring W. (2011).An Introduction to Manifolds (2nd ed.).Springer.ISBN 978-0-8218-4419-9.
- Wilansky, Albert (2013).Modern Methods in Topological Vector Spaces. Mineola, New York: Dover Publications, Inc.ISBN 978-0-486-49353-4.OCLC 849801114.