Vectors

Vector space: addition and scaling

A vector is an element in a vector space, which is a collection of objects supporting addition and scalar coefficients.

Vector space operations

  • 𝐯+𝐰 is a vector when 𝐯,𝐰=vectors
  • λ𝐯 is a vector when 𝐯=vector,λ=scalar

Properties of vector operations

  • Commutativity: 𝐯+𝐰=𝐰+𝐯
  • Associativity: 𝐮+(𝐯+𝐰)=(𝐮+𝐯)+𝐰
  • Distributivity: λ(𝐯+𝐰)=λ𝐯+λ𝐰
  • Zero vector: 𝐯+𝟎=𝐯

The elements λ𝐯 also satisfy obvious properties like: 1𝐯=𝐯 and (λ+μ)𝐯=λ𝐯+μ𝐯 and λ(μ𝐯)=(λμ)𝐯

Scalars Scalars (“scal-ers”) could be taken in any field, but for this class, they are just real numbers λ.

Components of vectors

In this class we consider vectors in the plane 2 and vectors in space 3.

Vectors in the plane are ordered pairs 𝐯=(a1,a2) with a1,a2. Vectors in space are ordered triples 𝐯=(a1,a2,a3) with a1,a2,a3.

Addition is componentwise: (a1,a2)+(b1,b2)=(a1+b1,a2+b2) Scalars act by components too: λ(a1,a2)=(λa1,λa2) (Similarly for vectors in space.)

Standard basis vectors These special vectors have their own symbols: 𝐞𝐢=(1,0,0),𝐞𝐣=(0,1,0),𝐞𝐤=(0,0,1)

Components Most often the word ‘component’ of a vector refers to one of the numbers ai in the ordered sequence (a1,a2) or (a1,a2,a3).

Sometimes ‘component’ refers to the basis vector scaled by this number, e.g. a1𝐞𝐢. Notice that we always have (a1,a2,a3)=a1𝐞𝐢+a2𝐞𝐣+a3𝐞𝐤, which is the reason ‘component’ is sometimes used in this second way.

Other bases It is possible to select a different set of special vectors, e.g. 𝐁={𝐮𝟏,𝐮𝟐,𝐮𝟑}, having the property that any vector 𝐯 can be written uniquely as a linear combination in the same way: 𝐯=a1𝐮𝟏+a2𝐮𝟐+a3𝐮𝟑. Any such set is called a basis, and the ai in this case are called components in the basis 𝐁. This topic is considered further in Linear Algebra.

Coordinates Mathematicians say ‘components’ for the parts of a vector, and ‘coordinates’ for the quantities that are used to identify points of space. Since the spaces 2 and 3 are vector spaces, the tuples (a1,a2) or (a1,a2,a3) actually give coordinates and vector components!

In more general curved spaces, points cannot be “added together,” so this relation between coordinates and components breaks down.

Geometric vectors

It is possible to consider vectors purely geometrically as the combined data of direction and magnitude in space. (Provided one has defined space purely geometrically, which nobody does.)

Products of vectors

Vector spaces often come with additional product operations between vectors.

Dot product

The vector space n (any n) comes with an inner product, also called the dot product or scalar product. Every inner product satisfies basic rules: Algebraic properties

  • 𝐮𝐯=𝐯𝐮
  • (𝐮+𝐯)𝐰=𝐮𝐰+𝐯𝐰
  • (λ𝐮)𝐯=λ(𝐮𝐯)
  • 𝟎𝐮=0

Component definition The dot products for 2 and 3 are defined using components:

  • (a1,a2)(b1,b2)=a1b1+a2b2
  • (a1,a2,a3)(b1,b2,b3)=a1b1+a2b2+a3b3
𝐚𝐛=a1b1+a2b2+a3b3

Norm The dot product of a vector with itself gives a number called the (norm or length or magnitude) squared:

  • 𝐮𝐮=|𝐮|2=||𝐮||2

The terminology is justified by the Pythagorean Theorem in 3:

Exercise 03A-01

Parallelogram identity

Let 𝐮=(4,0,3) and 𝐯=(2,1,5). Compute |𝐮𝐯| and |𝐮+𝐯| and |𝐮| and |𝐯|. Show that:

|𝐮+𝐯|2+|𝐮𝐯|2=2|𝐮|2+2|𝐯|2

Geometry The dot product scalar provides information about the geometric relationship of two vectors.

𝐮𝐯=|𝐮||𝐯|cos(θ),

where θ is the angle between 𝐮 and 𝐯. Proof: The rules for dot product imply that:

|𝐮𝐯|2=(𝐮𝐯)(𝐮𝐯)=𝐮𝐮+𝐯𝐯2𝐮𝐯.

On the other hand, the Law of Cosines for the triangle with sides 𝐮,𝐯,𝐮𝐯 gives:

|𝐮𝐯|2=|𝐮|2+|𝐯|22cos(θ)|𝐮||𝐯|.

It is worth noticing that the norm determines the dot product:

𝐮𝐯=12(|𝐮|2+|𝐯|2|𝐮𝐯|2)

The formula for θ has qualitative geometrical consequences:

  • If 𝐮𝐯=0 then 𝐮 and 𝐯 are orthogonal (perpendicular)
  • If 𝐮𝐯>0 then 𝐮 and 𝐯 form an acute angle
  • If 𝐮𝐯<0 then 𝐮 and 𝐯 form an obtuse angle
  • If 𝐮𝐯=|𝐮||𝐯| then 𝐮 and 𝐯 are parallel
Exercise 03A-02

Angle between vectors

Find the angle between (3,6,2) and (4,2,4).

Exercise 03A-03

Orthogonality by hand

Determine which pairs of 𝐮=(2,1,1) and 𝐯=(2,6,1) and 𝐰=(4,1,2) are orthogonal.

Exercise 03A-04

Acute, orthogonal, or obtuse?

Are the angles between 𝐮=(1/2,1/2,5) and 𝐯=(3,1,2) and 𝐰=(4,3,0) obtuse or acute?

Exercise 03A-05

Dot product via unit vectors

Compute the dot product of 4𝐞𝐢3𝐞𝐣 and 𝐞𝐢+2𝐞𝐣+𝐞𝐤.

Unit vectors A vector 𝐮 with |𝐮|=1 is called a unit vector. For example, 𝐞𝐢,𝐞𝐣,𝐞𝐤 are unit vectors.

Thinking geometrically, a unit vector carries the information of direction. One could call them ‘direction vectors’ instead.

Any vector can be renormalized to create a new unit vector by dividing out its length: 𝐞𝐮=1|𝐮|𝐮 Some texts, especially in physics, use the notation 𝐮^ for this unit vector 𝐞𝐮.

Projection The dot product is a quantity telling how much one vector aligns with another. The dot product of two unit vectors is cos(θ) where θ is the angle between them.

One can use the dot product to find the components of a vector in the standard basis. Say 𝐮=(a1,a2,a3) is any vector. Then:

𝐮=(𝐮𝐞𝐢)𝐞𝐢+(𝐮𝐞𝐣)𝐞𝐣+(𝐮𝐞𝐤)𝐞𝐤

This is because 𝐮𝐞𝐢=a1.

More generally, one defines the projection of 𝐮 along 𝐯 (projection along the direction of 𝐯) using the dot product:

𝐮||=proj𝐯(𝐮)=(𝐮𝐞𝐯)𝐞𝐯=(𝐮𝐯𝐯𝐯)𝐯

The scalar coefficient 𝐮𝐞𝐮 is called the parallel component of 𝐮 along 𝐯. (Or, sometimes, 𝐮|| is called the component.)

The projection 𝐮|| points in the direction of 𝐯, and it says how much of 𝐮 lies in that direction.

Another vector called the perpendicular component is given by subtracting the parallel part:

𝐮=𝐮𝐮||

It is called ‘perpendicular’ because:

𝐮𝐯=𝐮𝐯(𝐮𝐯𝐯𝐯)𝐯𝐯=0
Exercise 03B-01

Projection by hand

Let 𝐮=(5,1,3) and 𝐯=(4,4,2).

  • (a) Find the projection of 𝐮 to the direction of 𝐯.
  • (b) Write the vector 𝐮 in terms of parts parallel and perpendicular to 𝐯.

Cauchy-Schwarz inequality The Cauchy-Schwarz inequality says that for any vectors 𝐮, 𝐯, we know:

|𝐮𝐯||𝐮||𝐯|.
Exercise 03B-02

Cauchy-Schwarz

Prove the Cauchy-Schwarz inequality using the angle formula.

The Cauchy-Schwarz inequality is very important in math. There is a version of this inequality in many other settings where it is harder to prove.

Triangle inequality The Triangle inequality says that for any vectors 𝐮, 𝐯, we know:

|𝐮+𝐯||𝐮|+|𝐯|.
Exercise 03B-03

Cauchy-Schwarz Triangle

Prove the Triangle inequality using the Cauchy-Schwarz inequality and an expansion of |𝐮+𝐯|2 with the dot product.

Exercise 03B-04

Orthogonality identity

Suppose that vectors 𝐮 and 𝐯 satisfy |𝐮+𝐯|2=|𝐮|2+|𝐯|2. Show that they must be orthogonal.

Cross product

Another product is defined for vectors in 3 called the cross product. It is also called the vector product. The simplest definition is in terms of components:

𝐮×𝐯=(a2b3a3b2,a1b3+a3b1,a1b2a2b1)

assuming that 𝐮=(a1,a2,a3) and 𝐯=(b1,b2,b3).

There are some mnemonic formulations that can be helpful: Or: “Twist the others, minus in the middle.”

Or:

𝐀×𝐁=+(AyBzAzBy)𝐞𝐢(AxBzAzBx)𝐞𝐣+(AxByAyBx)𝐞𝐤

Or:

(a1,a2,a3)×(b1,b2,b3)=|𝐞𝐢𝐞𝐣𝐞𝐤a1a2a3b1b2b3|

This is a 3×3 determinant. The first row of vector entries should be treated as if scalars when taking this determinant.

Exercise 03B-05

Cross products by hand

Let 𝐮=(1,2,1) and 𝐯=(3,1,2). Compute in coordinates:

  • (a) 𝐮×𝐯
  • (b) 𝐯×𝐮
  • (c) 𝐮×𝐮

Algebraic properties The cross product is not commutative and not associative. But it does satisfy some relations:

  • 𝐮×𝐯=𝐯×𝐮 ( thus 𝐯×𝐯=0 )
  • (λ𝐮)×𝐯=λ(𝐮×𝐯)
  • (𝐮+𝐯)×𝐰=𝐮×𝐰+𝐮×𝐰
  • 𝐮(𝐮×𝐯)=0 ( thus 𝐯(𝐮×𝐯)=0 )
  • 𝐮×𝐯=0 implies 𝐮=λ𝐯 for some λ

Geometry The norm of the cross product satisfies an angle formula analogous to that of the dot product:

|𝐮×𝐯|=|𝐮||𝐯|sin(θ)

The direction of the cross product is perpendicular to the plane spanned by 𝐮,𝐯 and it creates a right-handed system when combined with 𝐮,𝐯. I.e. (𝐮,𝐯,𝐮×𝐯) is right-handed.

The norm of the cross product 𝐮×𝐯 is also the area of the parallelogram formed by 𝐮,𝐯.

Exercise 03B-06

Cross product left-handed system

Use the cross product to find a unit vector 𝐯 that is perpendicular to both 𝐚=(1,4,1) and 𝐛=(2,3,0) such that the triple (𝐚,𝐯,𝐛) forms a left-handed system.

Unit vectors

𝐞𝐢×𝐞𝐣=𝐞𝐤𝐞𝐣×𝐞𝐤=𝐞𝐢𝐞𝐤×𝐞𝐢=𝐞𝐣

These products are right-handed. Left-handed products include a minus sign, such as 𝐞𝐢×𝐞𝐤=𝐞𝐣.

Exercise 03B-07

Cross product via unit vectors

Compute the cross product of 4𝐞𝐢3𝐞𝐣 and 𝐞𝐢+2𝐞𝐣+𝐞𝐤 using the unit vector cross products.

Dot-cross norm identity The dot product and norm of cross product satisfy a simple relationship:

|𝐮×𝐯|2+(𝐮𝐯)2=|𝐮|2|𝐯|2

This identity follows quickly from the angle formulas for dot and cross products.

Triple products

There are some general facts about products taken with three or more vectors.

Dot-cross triple product Given vectors 𝐮=(a1,a2,a3), 𝐯=(b1,b2,b3), 𝐰=(c1,c2,c3), consider the scalar quantity 𝐮(𝐯×𝐰). By combining the effect of the dot product with the determinant formula, we have a determinant formula for this scalar:

𝐮(𝐯×𝐰)=|a1a2a3b1b2b3c1c2c3|

and this formula immediately implies equalities among possible triple products:

𝐮(𝐯×𝐰)=𝐯(𝐰×𝐮)=𝐰(𝐮×𝐯)=𝐮(𝐰×𝐯)=𝐰(𝐯×𝐮)=𝐯(𝐮×𝐰)

(To figure the signs: right-handed triples are equal, and left-handed triples are equal, and right and left differ by a sign.)

The determinant formula also implies a geometric interpretation of the dot-cross product: 𝐮(𝐯×𝐰) is the volume of the parallelepiped spanned by 𝐮, 𝐯, 𝐰.

Cross-cross triple product Given vectors 𝐚=(a1,a2,a3), 𝐛=(b1,b2,b3), 𝐜=(c1,c2,c3), we can form the triple product 𝐚×(𝐛×𝐜). (One should maybe not try to think about this product geometrically. It does arise in electromagnetism.) There is a useful shortcut called the Lagrange triple product identity for computing this product:

𝐚×(𝐛×𝐜)=𝐛(𝐚𝐜)𝐜(𝐚𝐛)

The abnormal order on the right (vector then scalar coefficient) facilitates a famous mnemonic: “Bac–Cab”.

𝐚×(𝐛×𝐜)=𝐛(𝐚𝐜)𝐜(𝐚𝐛)
Exercise 03B-08

Jacobi identity

Use the Lagrange triple product identity to prove the Jacobi identity:

𝐚×(𝐛×𝐜)+𝐛×(𝐜×𝐚)+𝐜×(𝐚×𝐛)=0

Non-associativity

While the cross product is not associative, the difference has a simple expression using the dot product:

(𝐚×𝐛)×𝐜=𝐚×(𝐛×𝐜)+(𝐚𝐛)𝐜𝐚(𝐛𝐜)

This identity can be proved using the Lagrange triple product identity.

(𝐚×𝐛)×𝐜𝐚×(𝐛×𝐜)

Geometric applications of vectors

Lines and planes

Lines Given a point identified with a vector 𝐫𝟎 and a direction vector 𝐯, the line through 𝐫𝟎 in direction 𝐯 is given parametrically by the formula:

𝐫(t)=𝐫0+t𝐯

Given two points 𝐫𝟎 and 𝐫𝟏, the line passing through these two points is given parametrically by:

𝐫(t)=(1t)𝐫0+t𝐫1

The line segment from 𝐫0 to 𝐫1 corresponds to t[0,1]. The point 𝐫(t) may be considered to be a weighted average of 𝐫0 and 𝐫1 with weights 1t and t.

Planes A plane in 3 can be determined as the points (x,y,z) satisfying a single linear equation, such as:

ax+by+cz+d=0

Other formulations of this equation can display more meaning.

A plane is determined in vector form by the data of a single point 𝐫0 through which it passes together with a normal vector 𝐧 that is perpendicular to the plane. The equation of the plane can be formed by simply stating that vectors in the plane from 𝐫0 are perpendicular to 𝐧:

(𝐫𝐫0)𝐧=0

If we have components 𝐫=(x,y,z) and 𝐫0=(x0,y0,z0) and 𝐧=(a,b,c), then this formula can be rewritten as:

a(xx0)+b(yy0)+c(zz0)=0

This equation implies that the a, b, c in the linear equation of the plane are just the components of its normal vector 𝐧.

Exercise 03C-01

Vector plane from scalar plane

Find the vector equation of a plane with scalar equation 7x4y+2z+10=0.

Exercise 03C-02

Scalar plane from vector plane

Find the scalar equation of a plane passing through 𝐫0=(3,1,0) and with normal vector 𝐧=(3,2,5). (Start with the vector form.)

Exercise 03C-03

Line and plane intersection

Find the point at which the plane 3x9y+2z7=0 and the line 𝐫(t)=(1,2,1)+t(2,0,1) intersect.

Exercise 03C-04

Angle between planes

Find a formula for the angle formed between two planes. Use this formula to find the angle between the planes passing through (0,0,0) with normal vectors 𝐧1=(1,2,1) and 𝐧2=(4,1,3), respectively.

Distances

Point to point The distance between 𝐩 and 𝐪 (more accurately, between the point identified by 𝐩 and that identified by 𝐪) is |𝐩𝐪|.

Point to line The vector 𝐮 from a point 𝐩 to a line 𝐫(t)=𝐫0t𝐯, namely to the point on the line closest to 𝐩, is given by taking the vector from 𝐩 to 𝐫0 and removing the component parallel to 𝐯:

𝐮=(𝐫0𝐩)((𝐫0𝐩)𝐞𝐯)𝐞𝐯

The distance from 𝐩 to 𝐫 is then |𝐮|.

Projection gives minimal distance

One can verify the formula for 𝐮 by minimizing the squared distance from 𝐩 to 𝐫(t) using the standard calculus technique.

Point to plane The vector 𝐮 from a point 𝐩 to the plane through 𝐫0 with normal vector 𝐧 (that is, to the nearest point on the plane) is given by projecting 𝐩𝐫0 onto 𝐧, that is:

𝐮=((𝐩𝐫0)𝐞𝐧)𝐞𝐧

So the distance from 𝐩 to this plane is:

|𝐮|=|(𝐩𝐫0)𝐞𝐧|=(𝐩𝐫0)𝐧|𝐧|

Plane to plane

Exercise 03C-05

Distance between parallel planes

Find the distance from the plane given by 15x+3y3z10=0 to the parallel plane given by 5x+yz3=0.

Quaternions

[Optional material.] One can combine 3d vectors and 1d scalers into 4d quantities called quaternions, and written . Quaternions can be added and multiplied and divided.

Quaternions have real number coefficients for each of four basic units:

a+b𝐢+c𝐣+d𝐤

The coefficient a is called the scalar part and the coefficients (b,c,d) are together called the vector part of the quaternion.

Multiplication rules Multiplication for 𝐢, 𝐣, 𝐤 follows the cross product rules (written formerly using 𝐞𝐢 etc. instead), with an additional rule for squares:

𝐢2=𝐣2=𝐤2=1

Using these rules, one can multiply any quaternion sums.

Multiplication charts

𝐢𝐣𝐤=1𝐢2=𝐣2=𝐤2=1

If two vector quaternions (with zero scalar part) are multiplied, then the resulting scalar part is the negative dot product, and the resulting vector part is the cross product, of the vector parts considered as vectors using their components.

Quaternions can also be divided:

1a+b𝐢+c𝐣+d𝐤=ab𝐢c𝐣d𝐤a2+b2+c2+d2

 

 

Problems due 13 Sep 2023, 8:00pm

Problem 03-01

Planes intersection line, parametric

Find a parametric equation for the line formed as the intersection of the two planes 6x3y+z5=0 and x+y+5z5=0. What is the angle between these planes?

Problem 03-02

Plane perpendicular, two scalar planes

Find a plane that is perpendicular to the two planes given by x+y3=0 and x+2yz4=0, respectively.

Problem 03-03

Distance point to line

Compute the distance from the point 𝐩=(1,5,2) to the line given by 𝐫(t)=(2,3,1)+t(4,0,1).

Repeat the problem for 𝐩=(2,1,3) and 𝐫(t)=(1,2,0)+t(1,1,2).

Problem 03-04

Distance between skew lines

Find a general formula for the distance between two skew lines, i.e. lines in space which are not parallel and do not intersect. (Assume they are given parametrically in vector form.)

More problems

Also do 6 exercises from List A and 7 exercises from List B.