Differential Equations - Packet 12

Linear systems I: matrix descriptions

Systems from higher order equations

A system of ODEs looks like this:

$$\begin{array}{cc}{y}_1^{\prime }& =f_1(t,y_1,\dots ,y_n)\\ y_2^{\prime }& =f_2(t,y_1,\dots ,y_n)\\ ⋮& \\ y_n^{\prime }& =f_n(t,y_1,\dots ,y_n).\end{array}$$

The derivative of each variable $y_i$ is determined by its own function of the other variables, $f_i(t,y_1,\dots ,y_n)$.

One reason systems are important is that they offer an alternative to the language of order of a differential equation. Consider a general ODE of order $n$ given by the equation

$$F(t,y,y^{\prime },\dots ,y^{(n)})=0.$$

This ODE (and its complete families of solutions as well as IVPs) is equivalent to a first-order system in which higher derivatives are replaced with new variables:

$$\begin{array}{cc}F(t,y_0,y_1,\dots ,y_n)& =0\\ y_1& =y_0^{\prime }\\ y_2& =y_1^{\prime }\\ y_3& =y_2^{\prime }\\ ⋮& \\ y_n& =y_{n-1}^{\prime }.\end{array}$$

In particular, consider the $n^{\text{th}}$ order linear ODE:

$$y^{(n)}+a_{n-1}(t)y^{(n-1)}+\cdots +a_1(t)y^{\prime }+a_0(t)y=f(t).$$

By defining $y_0,\dots ,y_{n-1}$ with the formulas $y_0=y$ and $y_i=y^{(i)}$, we find an equivalent linear system:

$$\begin{array}{cc}{y}_0^{\prime }& =y_1\\ y_1^{\prime }& =y_2\\ ⋮& \\ y_{n-1}^{\prime }& =-a_{n-1}(t)y_{n-1}-\cdots -a_0(t)y_0+f(t).\end{array}$$

Notice that this system can be represented using matrix multiplication:

$${\left(\begin{array}{c}{y}_0\\ y_1\\ ⋮\\ y_{n-1}\end{array}\right)}^{\prime }=\left(\begin{array}{cccccc}0& 1& 0& 0& \dots & 0\\ 0& 0& 1& 0& \dots & 0\\ ⋮& & & ⋮& \dots & ⋮\\ -a_0(t)& -a_1(t)& -a_2(t)& -a_3(t)& \dots & -a_{n-1}(t)\end{array}\right)\left(\begin{array}{c}{y}_0\\ y_1\\ ⋮\\ y_{n-1}\end{array}\right)+\left(\begin{array}{c}0\\ 0\\ ⋮\\ f(t)\end{array}\right).$$

The last equation suggests vector-matrix formalism for systems of linear equations:

$${𝐲}^{\prime }(t)=𝐀(t)𝐲(t)+𝐟(t),𝐀(t)=\left(\begin{array}{ccc}{a}_{11}(t)& \dots & a_{1n}(t)\\ ⋮& & ⋮\\ a_{n1}(t)& \dots & a_{nn}(t)\end{array}\right),𝐲(t)=\left(\begin{array}{c}{y}_1(t)\\ ⋮\\ y_n(t)\end{array}\right),𝐟(t)=\left(\begin{array}{c}{f}_1(t)\\ ⋮\\ f_n(t)\end{array}\right).$$

This format is called the normal form for the linear system of ODEs.

The next packets address the problem of extending our previous methods for second-order linear equations to the formalism for linear systems.

The methods we will extend:

• Homogeneous – complete family of solutions
• Inhomogeneous – variation of parameters for a particular solution
• Constant coefficients – real, repeated, and complex: exponential, linear factor, and sinusoidal solutions

Some new methods will be introduced to address the complexities of linear interaction between variables:

• Independence – to explain ‘complete’ family of solutions
• Eigenvectors – to describe proportionality between variables having the same overall exponential / sinusoidal behavior
• Matrix calculus – to write a general solution formula for constant coefficient systems

Homogeneous system

When the normal form of the system has nso $𝐟(t)$ term, it is called homogeneous:

$${𝐲}^{\prime }(t)=𝐀(t)𝐲(t),$$

or simply ${𝐲}^{\prime }=𝐀𝐲$.

The important thing about homogeneous systems is that the solutions form a vector space, meaning that solutions can be added and scaled while remaining valid solutions. For example, if ${𝐲}_1(t)$ and ${𝐲}_2(t)$ are vector solutions, then

$$C_1{𝐲}_1(t)+C_2{𝐲}_2(t)$$

is also a valid vector solution for any constants $C_1$ and $C_2$. Here’s a proof:

$$\begin{array}{cc}(C_1{𝐲}_1(t)+C_2{𝐲}_2(t){)}^{\prime }& =C_1{𝐲}_1^{\prime }(t)+C_2{𝐲}_2^{\prime }(t)\\ & =C_1𝐀(t){𝐲}_1(t)+C_2𝐀(t){𝐲}_2(t)\text{(separate solutions)}\\ & =𝐀(t)(C_1{𝐲}_1(t)+C_2{𝐲}_2(t))\text{(linearity of }𝐀\text{).}\end{array}$$

The fact that solutions can be added to form valid solutions is called the superposition principle and it applies to linear homogeneous systems in the same way as it applies to $2^{\text{nd}}$ order linear equations.

Since the complete family of solutions of a system like ${𝐲}^{\prime }=𝐀𝐲$ forms a vector space, we would like to describe this family as the span of a specific set of independent solutions. Just as for any other vectors, a set of solutions ${𝐲}_1,\dots ,{𝐲}_n$ is an independent set when any equation

$$C_1{𝐲}_1+\cdots +C_n{𝐲}_n=0$$

can only be valid when $C_1=\cdots =C_n=0$.

A set of independent solutions is a complete set when every other solution vector can be written as a linear combination of them, i.e. it is in their span:

$$𝐲(t)={\alpha }_1{𝐲}_1+\cdots +{\alpha }_n{𝐲}_n,\text{some }{\alpha }_1,\dots ,{\alpha }_n.$$

In linear algebra, a complete set of independent vectors for a space is called a basis for the space. In ODE theory, a complete set of independent solution vectors is called a fundamental set of solutions. To reiterate: a fundamental set of solutions ${𝐲}_1,\dots ,{𝐲}_n$ is both independent and complete.

Solving ODE system

Solving an ODE system (finding the complete family of solutions) means: finding a fundamental set of solutions.

Given a fundamental set of solution vectors ${𝐲}_1,\dots ,{𝐲}_n$, we can arrange these vectors as the columns of a matrix called the fundamental matrix:

$$𝐘(t)=\left(\begin{array}{ccc}{𝐲}_1& \cdots & {𝐲}_n\end{array}\right).$$

By linear algebra theory, these columns form a basis if and only if this matrix has nonzero determinant. The determinant of any fundamental matrix is called the Wronskian matrix $W(t)$.

Example

Verifying a fundamental matrix

Problem: Consider the ODE system:

$${𝐲}^{\prime }(t)=\left(\begin{array}{ccc}0& 1& 1\\ 1& 0& 1\\ 1& 1& 0\end{array}\right)𝐲(t).$$

Verify that the following is a fundamental matrix for this ODE:

$$𝐘=\left(\begin{array}{ccc}{e}^{2t}& -e^{-t}& 0\\ e^{2t}& 0& e^{-t}\\ e^{2t}& e^{-t}& -e^{-t}\end{array}\right).$$

Solution: First we must check that each column of $𝐘$ is a solution vector for the ODE:

$$\begin{array}{cc}{𝐲}_1^{\prime }={\left(\begin{array}{c}{e}^{2t}\\ e^{2t}\\ e^{2t}\end{array}\right)}^{\prime }& =\left(\begin{array}{c}2e^{2t}\\ 2e^{2t}\\ 2e^{2t}\end{array}\right)=2\left(\begin{array}{c}{e}^{2t}\\ e^{2t}\\ e^{2t}\end{array}\right),\\ & \\ 𝐀{𝐲}_1=\left(\begin{array}{ccc}0& 1& 1\\ 1& 0& 1\\ 1& 1& 0\end{array}\right)\left(\begin{array}{c}{e}^{2t}\\ e^{2t}\\ e^{2t}\end{array}\right)& =\left(\begin{array}{c}0+e^{2t}+e^{2t}\\ e^{2t}+0+e^{2t}\\ e^{2t}+e^{2t}+0\end{array}\right)=2\left(\begin{array}{c}{e}^{2t}\\ e^{2t}\\ e^{2t}\end{array}\right).\end{array}$$

Similarly for the second column vector:

$$\begin{array}{cc}{\left(\begin{array}{c}-e^{-t}\\ 0\\ e^{-t}\end{array}\right)}^{\prime }& =\left(\begin{array}{c}{e}^{-t}\\ 0\\ -e^{-t}\end{array}\right)\\ & \\ \left(\begin{array}{ccc}0& 1& 1\\ 1& 0& 1\\ 1& 1& 0\end{array}\right)\left(\begin{array}{c}-e^{-t}\\ 0\\ e^{-t}\end{array}\right)& =\left(\begin{array}{c}0+0+e^{-t}\\ -e^{-t}+0+e^{-t}\\ -e^{-t}+0+0\end{array}\right)=\left(\begin{array}{c}{e}^{-t}\\ 0\\ -e^{-t}\end{array}\right).\end{array}$$

And similarly for the third column vector.

Secondly, we must verify that these solutions are independent. For that, we compute the determinant of the Wronskian matrix using the formula for $3\times 3$ matrices:

$$\begin{array}{cc}W(t)=\det 𝐘& =\left|\begin{array}{ccc}{e}^{2t}& -e^{-t}& 0\\ e^{2t}& 0& e^{-t}\\ e^{2t}& e^{-t}& -e^{-t}\end{array}\right|\\ & \\ & =e^{2t}\left|\begin{array}{cc}0& e^{-t}\\ e^{-t}& -e^{-t}\end{array}\right|--e^{-t}\left|\begin{array}{cc}{e}^{2t}& e^{-t}\\ e^{2t}& -e^{-t}\end{array}\right|+0\left|\begin{array}{cc}{e}^{2t}& 0\\ e^{2t}& e^{-t}\end{array}\right|\\ & \\ & =e^{2t}(-e^{-2t})+e^{-t}(-2e^t)+0=-1-2=-3.\end{array}$$

Therefore $W(t)=-3$ and is never $0$, so the columns of $𝐘$ are independent. Combining this fact with the first fact, we know that $𝐘$ is a fundamental matrix.

Problems due Wednesday 10 Apr 2024 by 11:59pm

Easier Problems

Problem 12-01

Writing $3^{\text{rd}}$ order linear ODE as $3$D system

Consider the ODE: $y^{\prime \prime \prime }-y^{\prime }+y=\cos t$. Rewrite this ODE as a $3$D system of equations, giving the matrix $𝐀$ and the inhomogeneous vector term $𝐟(t)$.

Problem 12-02

Converting system list to system matrix

Find the matrix + forcing vector formulations of the two ODE systems:

• (a) \begin{align*}x'(t)&= 3x(t)-y(t)+t^2\\y'(t)&= -x(t)+2y(t)+e^t.\end{align*} ParseError: {align*} can be used only in display mode.
• (b) \begin{align*}x'&= x+y+z\\y'&= 2x-y+3z\\z'&= x+5z.\end{align*} ParseError: {align*} can be used only in display mode.

Problem 12-03

Computing $3\times 3$ Wronskian

Find the Wronskian $W(t)$ for the following matrix:

$$\left(\begin{array}{ccc}{e}^t& e^{-t}& e^{2t}\\ e^t& -e^{-t}& 2e^{2t}\\ e^t& e^{-t}& 4e^{2t}\end{array}\right).$$

Are the column vectors of this matrix independent?

Problem 12-04

Derivative of a matrix function

Find the derivative of the following matrix-valued function:

$$\left(\begin{array}{ccc}\sin 2t& \cos 2t& e^{-2t}\\ -\sin 2t& 2\cos 2t& 3e^{-2t}\\ 3\sin 2t& \cos 2t& e^{-2t}\end{array}\right).$$

Problem 12-05

Verifying vector solution of ODE system

Show that the given vector function satisfies the given ODE system:

$$𝐲(t)=\left(\begin{array}{c}{e}^{3t}\\ 2e^{3t}\end{array}\right)\text{satisfies}{𝐲}^{\prime }=\left(\begin{array}{cc}1& 1\\ -2& 4\end{array}\right)𝐲.$$

Problem 12-06

Verifying fundamental matrix of ODE system

Show that the given matrix-valued function is a fundamental matrix for the given ODE system:

$$𝐲(t)=\left(\begin{array}{ccc}{e}^t& 0& 0\\ 0& e^t& e^{5t}\\ 0& e^t& -e^{5t}\end{array}\right)\text{satisfies}{𝐲}^{\prime }=\left(\begin{array}{ccc}1& 0& 0\\ 0& 3& -2\\ 0& -2& 3\end{array}\right)𝐲.$$

Harder Problems

None!