We are now ready to define vector spaces. The idea is to observe that sets of column vectors, or row vectors, or more generally matrices of a given size, all come equipped with a notion of addition and scalar multiplication and all obey the same collection of simple algebraic rules, for example, that addition is commutative, that scalar multiplication distributes over vector addition, and so on. We will define a vector space as any set with operations of addition and scalar multiplication obeying similar rules to those satisfied by column vectors. The power of doing this is that it lets us apply our theory in seemingly entirely different contexts.
Let be a field. An -vector space is a set with
a special element called the zero vector
an operation + called addition
a way to multiply elements of by elements of , called scalar multiplication
such that for all in and all in ,
there exists such that
You sometimes see the phrase “vector space over ”, which means the same thing as -vector space.
The elements of vector spaces can be anything at all. They don’t have to look like column or row vectors. Here are some examples of vector spaces.
is a real vector space, is a complex vector space, and if is any field then , the set of all height column vectors with entries from is an -vector space.
, the set of all matrices with real entries, is a real vector space with the zero vector being the all-zeroes matrix. Similarly for any other field.
with the only possible operations is an -vector space, for any field , the zero vector space.
Let be the set of all functions . Define to be the function given by and, for a real number and a function , define by . Then is a real vector space with the zero vector being the constant function taking the value 0.
If is a matrix, the set of all solutions of is a vector space. This is the nullspace we met in Definition 3.6.5.
The set of all real solutions to the differential equation is a vector space, with the definitions of addition and scalar multiplication as in above.
The set of all polynomials in one variable x is a -vector space, as is the set of all polynomials in of degree at most .
The set of magic matrices, those whose row sums and column sums are all equal, is a vector space with the usual matrix addition and scalar multiplication.