On-Line Geometric Modeling Notes

Vector Spaces


These notes give the definition of a vector space and several of the concepts related to these spaces. Examples are drawn from the vector space of vectors in tex2html_wrap_inline260.

For a postscript version of these notes look here.

Definition of a Vector Space

A nonempty set tex2html_wrap_inline262 of elements tex2html_wrap_inline264 is called a vector space if in tex2html_wrap_inline266 there are two algebraic operations (called addition and scalar multiplication), so that the following properties hold.


Addition associates with every pair of vectors tex2html_wrap_inline268 and tex2html_wrap_inline270 a unique vector tex2html_wrap_inline272 which is called the sum of tex2html_wrap_inline274 and tex2html_wrap_inline276 and is written tex2html_wrap_inline278. In the case of the space of 2-dimensional vectors, the summation is componentwise (i.e. if tex2html_wrap_inline280 and tex2html_wrap_inline282, then tex2html_wrap_inline284), which can be best illustrated by the ``parallelogram illustration'' below:

tex2html_wrap354

Addition satisfies the following :


Scalar Multiplication associates with every vector tex2html_wrap_inline320 and every scalar c, another unique vector (usually written tex2html_wrap_inline324),

tex2html_wrap364

For scalar multiplication the following properties hold:

Examples of Vector Spaces

Examples of vector space abound in mathematics. The most obvious examples are the usual vectors in tex2html_wrap_inline368, from which we have drawn our illustrations in the sections above. But we frequently utilize several other vectors spaces: The 3-d space of vectors, the vector space of all polynomials of a fixed degree, and vector spaces of tex2html_wrap_inline370 matrices. We briefly discuss these below.


  The Vector Space of 3-Dimensional Vectors

The vectors in tex2html_wrap_inline372 also form a vector space, where in this case the vector operations of addition and scalar multiplication are done componentwise. That is tex2html_wrap_inline374 and tex2html_wrap_inline376 are vectors, then addition is
displaymath78
and, if c is a scalar, scalar multiplication is given by
displaymath80

The axioms are easily verified (for example the additive identity of tex2html_wrap_inline380 is just tex2html_wrap_inline382, and the zero vector is just tex2html_wrap_inline384. Here the axioms just state what we always have been taught about these sets of vectors.


  Vector Spaces of Polynomials

The set of quadratic polynomials of the form
displaymath84
also form a vector space. We add two of polynomials by adding their respective coefficients. That is, if tex2html_wrap_inline386 and tex2html_wrap_inline388, then
displaymath86
and multiplication is done by multiplying the scalar by each coefficient. That is, if s is a scalar, then
displaymath88

The axioms are again easily verified by performing the operations individually on like terms.


A simple extension of the above is to consider the set of polynomials of degree less than or equal to n. It is easily seen that these also form a vector space.


  Vector Spaces of Matrices

The set of tex2html_wrap_inline394 Matrices form a vector space. Two matrices can be added componentwise, and a matrix can be multiplied by a scalar. All axioms are easily verified.

Linear Independence and Bases

Given a vector space tex2html_wrap_inline396, the concept of a basis for the vector space is fundamental for much of the work that we will do in computer graphics. This section discusses several topics relating to linear combinations of vectors, linear independence and bases.

Linear Combinations

Let tex2html_wrap_inline398 be any vectors in a vector space tex2html_wrap_inline400 and let tex2html_wrap_inline402 be any set of scalars. Then an expression of the form
displaymath94
is called a linear combination of the vectors.

This element is clearly a member of the vector space tex2html_wrap_inline404 (just repeatedly apply the summation and scalar multiplication axioms).

The set S that contains all possible linear combinations of tex2html_wrap_inline408 is called the span of tex2html_wrap_inline410. We frequently say that S is spanned (or generated) by those n vectors.

It is straightforward to show that the span of any set of vectors is again a vector space.

Linear Independence

Given a set of vectors tex2html_wrap_inline416 from a vector space tex2html_wrap_inline418. This set is called linearly independent in tex2html_wrap_inline420 if the equation
displaymath102
implies that tex2html_wrap_inline422 for all i = 1, 2, ..., n.

If a set of vectors is not linearly independent, then it is called linearly dependent. This implies that the equation above has a nonzero solution, that is there exist tex2html_wrap_inline426 which are not all zero, such that
displaymath105
This implies that at least one of the vectors tex2html_wrap_inline428 can be written in terms of the other n-1 vectors in the set. Assuming that tex2html_wrap_inline432 is not zero, we can see that
displaymath107

Any set of vectors containing the zero vector (tex2html_wrap_inline434) is linearly dependent.

Example

To give an example of a linear independent set that everyone has seen, consider the three vectors
displaymath114
in the vector space of vectors in tex2html_wrap_inline436

Consider the equation
displaymath119
If we simplify left-hand side by performing the operations componentwise and write the right-hand side componentwise, we have
displaymath124
which can only be solved if tex2html_wrap_inline438.

A Basis for a Vector Space

 

Let tex2html_wrap_inline440 be a set of vectors in a vector space tex2html_wrap_inline442 and let S be the span of tex2html_wrap_inline446. If tex2html_wrap_inline448 is linearly independent, then we say that these vectors form a basis for S and S has dimension n. Since these vectors span S, any vector tex2html_wrap_inline458 can be written uniquely as
displaymath129
The uniqueness follows from the argument that if there were two such representations
equation131
then by subtracting the two equations, we obtain
displaymath136
which can only happen if all the expressions tex2html_wrap_inline460 are zero, since the vectors tex2html_wrap_inline462 are assumed to be linearly independent. Thus we necessarily have that tex2html_wrap_inline464 for all i=1,2,...,n.

If S is the entire vector space tex2html_wrap_inline470, we say that tex2html_wrap_inline472 forms a basis for tex2html_wrap_inline474, and tex2html_wrap_inline476 has dimension n.


This document maintained by Ken Joy

Comments to the Author

All contents copyright (c) 1996, 1997
Computer Science Department,
University of California, Davis
All rights reserved.



Ken Joy
Mon May 18 08:17:34 PDT 1998