Part A · the equation of motion · spine
Almost no equation of motion can be solved in closed form. This unit is the set of questions you can still answer exactly: how many equilibria, of what type, with which basins, and whether anything periodic exists.
needs 01~2 h slides + 4 h problemsproblems: ./mr problems 02
02 · overview
$\ddot\theta + \gamma\dot\theta + \sin\theta = 0$ — a pendulum with linear damping, in units where the only parameter left is $\gamma$. There is no formula for $\theta(t)$. By the end of the deck we will have proved, each by a short route:
Sections 1–3 work in $\mathbb{R}^n$. Sections 4 and 5 are two-dimensional and say so: they are false in three.
section 1
An autonomous equation is a picture before it is a formula.
02 · flows
Unit 00 reduced $\ddot x = F(x)$ to quadrature by multiplying by $\dot x$. For the pendulum with $\gamma = 0$ that gives
$$\tfrac12\dot\theta^2 - \cos\theta = \text{const},$$and then an elliptic integral for the period. Put $\gamma > 0$ back in and the trick fails at the first step: $\dot\theta(\ddot\theta + \gamma\dot\theta + \sin\theta)$ is not a total derivative, because $\gamma\dot\theta^2$ is not.
This is not a gap in the literature. The set of equations with elementary solutions has measure zero in any reasonable sense, and almost every system in this course after unit 09 is in the complement.
Every one of these is a theorem about $f$ alone, proved without integrating anything. That is the trade this unit offers: less information, all of it certain.
02 · flows
An autonomous system on an open $U \subseteq \mathbb{R}^n$ is $\dot{\mathbf{x}} = f(\mathbf{x})$ with $f : U \to \mathbb{R}^n$ locally Lipschitz. Read $f$ as a vector field: at each point of $U$ it names the velocity of whatever passes through.
A solution is a differentiable curve with $\mathbf{x}'(t) = f(\mathbf{x}(t))$; its image is an orbit. The set of all orbits, drawn in $U$, is the phase portrait.
"Autonomous" means $f$ does not depend on $t$ — the law is the same today as tomorrow. Unit 01 turned every $m\ddot{\mathbf{x}} = F(\mathbf{x}, \dot{\mathbf{x}})$ into one of these on $\mathbb{R}^{2n}$, so this is not a restriction on mechanics, it is mechanics.
With $\omega = \dot\theta$, the damped pendulum is
$$f(\theta, \omega) = \begin{pmatrix}\omega \\ -\gamma\omega - \sin\theta\end{pmatrix}$$on $U = \mathbb{R}^2$. It is $C^\infty$, hence locally Lipschitz, so unit 01 applies: one solution through each point.
Nothing here is approximate. The vector field is the equation; a phase portrait is the equation drawn.
02 · flows · example
At each point $(\theta, \omega)$ draw the arrow $f(\theta,\omega) = (\omega,\ -\gamma\omega - \sin\theta)$. That is the whole equation; nothing has been solved.
Three things can be read off with no algebra:
A solution is a curve that is tangent to the arrow at every point it passes. The orange one is the only kind of thing "solving" adds.
The damped pendulum's field at $\gamma = \tfrac12$; arrow length grows with speed and is capped. The orange orbit, released near $\theta = -2.45$, follows the arrows into the hanging position.
02 · flows
Let $\dot{\mathbf x} = f(\mathbf x)$ be autonomous with $f$ locally Lipschitz. Then
Put $\mathbf y(t) = \mathbf x(t+s)$. Then $\mathbf y'(t) = \mathbf x'(t+s) = f(\mathbf x(t+s)) = f(\mathbf y(t))$ — this is where autonomy is used, and it is the only place. If two orbits share a point $\mathbf p$, shift both in time so that each passes through $\mathbf p$ at $t = 0$; by uniqueness (unit 01) the two solutions agree on their common interval, and on the union of their maximal intervals by the usual continuation argument. So the orbits coincide. $\square$
The orbits partition $U$. In the plane that is a severe constraint: an orbit cannot cross itself or any other, so the picture is forced to be orderly, and section 4 turns that orderliness into an existence theorem for cycles.
1. Orbits may approach each other without meeting — a spiral into a fixed point never arrives.
2. An equilibrium is an orbit, a one-point one. A curve running into an equilibrium reaches it only as $t \to \infty$, so nothing crosses there either.
02 · flows
For $\mathbf x_0 \in U$ let $t \mapsto \varphi_t(\mathbf x_0)$ be the maximal solution with $\varphi_0(\mathbf x_0) = \mathbf x_0$ (unit 01). The family $\{\varphi_t\}$ is the flow of $f$.
$\varphi_{t+s}(\mathbf x_0) = \varphi_t\big(\varphi_s(\mathbf x_0)\big)$ whenever either side is defined, and $\varphi_0 = \mathrm{id}$. If every solution is defined for all $t$, the map $t \mapsto \varphi_t$ is a group homomorphism $(\mathbb{R}, +) \to \mathrm{Homeo}(U)$, the group under composition of homeomorphisms of $U$ — continuous bijections $U \to U$ with continuous inverse.
Fix $s$ and set $\mathbf u(t) = \varphi_{t+s}(\mathbf x_0)$, $\mathbf v(t) = \varphi_t(\varphi_s(\mathbf x_0))$. By the previous slide $\mathbf u$ solves the equation; so does $\mathbf v$; and $\mathbf u(0) = \mathbf v(0) = \varphi_s(\mathbf x_0)$. Uniqueness gives $\mathbf u = \mathbf v$. Taking $s = -t$ gives $\varphi_{-t} = \varphi_t^{-1}$, so each $\varphi_t$ is a bijection, and continuity of $\varphi_t$ and of its inverse is unit 01's continuous dependence on initial data. $\square$
Solutions can blow up in finite time (unit 01), and then $\varphi_t$ is only defined on part of $U$: a local flow, not a group. The pendulum is safe — see the note — and so is every system in this unit that lives on a compact invariant set.
The group property is the reason the phase portrait is a complete description: knowing the picture for one second is knowing it forever, by composition.
It returns in unit 13 as the one-parameter groups Noether's theorem differentiates, and in unit 14 as the Hamiltonian flow, which additionally preserves a volume.
02 · flows · example
Orbits of the damped pendulum at $\gamma = \tfrac12$, integrated numerically for the picture only — every claim on the next slides is proved without them. Dashed red: the separatrix of the undamped system. The two dashed vertical lines are the same line: $\theta$ and $\theta + 2\pi$ are the same state.
02 · flows
$E : U \to \mathbb{R}$, non-constant, with $E(\mathbf x(t))$ constant along every solution. Then every orbit lies inside one level set $\{E = c\}$, and in the plane that is the phase portrait: draw the level curves.
$\dot x_i = -\partial V/\partial x_i$. Along a solution $V$ changes at the rate $\dot V = \sum_i (\partial V/\partial x_i)\,\dot x_i$ — the chain rule, proved on "Differentiating along a solution" in section 3 — so $\dot V = -\sum_i (\partial V/\partial x_i)^2 \le 0$, with equality only at equilibria: $V$ decreases along every non-constant orbit, so no periodic orbit and no cycle of any kind can exist.
$\gamma = 0$: $V = \tfrac12\omega^2 + (1-\cos\theta)$ is a first integral, $\dot V = 0$. The orbits are the level curves of $V$, and unit 00's quadrature is the statement that a level curve can be parametrised by an integral.
$\gamma > 0$: $\dot V = -\gamma\omega^2 \le 0$. Not a gradient system — but $V$ still falls, which is all the proofs in section 3 need. Call such a flow gradient-like.
Conserving a function and contracting one are the two structures that make a flow tractable. Unit 14 shows that mechanics without friction always has the first, in a strong form: the flow preserves $H$ and a volume, which is the symplectic structure.
02 · flows · example
With $\gamma = 0$, $V = \tfrac12\omega^2 + (1-\cos\theta)$ is a first integral, so each orbit lies on one curve $V = c$. Solving for $\omega$,
$$\omega = \pm\sqrt{2\,(c - 1 + \cos\theta)} .$$The whole portrait, from one formula and no integration.
Level curves of $V$ for $c = 0.3,\ 0.8,\ 1.4,\ 1.85$ (closed), $2$ (dashed) and $2.6,\ 3.7$ (open). The shaded region $\{V < 2\}$ is where the bob swings; outside it, it rotates.
section 2
Replace $f$ by its derivative, and know exactly when that is a lie.
02 · linearisation
$f : U \subseteq \mathbb{R}^n \to \mathbb{R}^m$ is differentiable at $\mathbf a$ if there is a linear map $A : \mathbb{R}^n \to \mathbb{R}^m$ with
$$\begin{gathered}f(\mathbf a + \mathbf h) = f(\mathbf a) + A\mathbf h + r(\mathbf h),\\ |r(\mathbf h)|\,/\,|\mathbf h| \to 0 .\end{gathered}$$$A$ is unique; write $Df(\mathbf a)$.
If $f$ is differentiable at $\mathbf a$ then every partial derivative exists and the matrix of $Df(\mathbf a)$ in the standard bases is $\big(\partial f_i/\partial x_j\big)$.
Proof. Put $\mathbf h = t\mathbf e_j$: $\;\frac{f(\mathbf a + t\mathbf e_j) - f(\mathbf a)}{t} = A\mathbf e_j + \frac{r(t\mathbf e_j)}{t} \to A\mathbf e_j$. The left side is by definition $\partial f/\partial x_j$, so $A\mathbf e_j$ is column $j$. $\square$
Partial derivatives can all exist at a point where $f$ is not even continuous. Continuous partials do imply differentiability — proved in unit 03, which is where multivariable calculus is done properly. Everything here is $C^\infty$, so the distinction never bites; it is flagged because it is the standard place to go wrong.
$f(\theta,\omega) = (\omega,\; -\gamma\omega - \sin\theta)$, so
$$Df(\theta,\omega) = \begin{pmatrix} 0 & 1 \\ -\cos\theta & -\gamma\end{pmatrix}.$$Two entries are constant; the whole $\theta$-dependence is one cosine.
02 · linearisation
$\mathbf x^*$ is an equilibrium of $\dot{\mathbf x} = f(\mathbf x)$ if $f(\mathbf x^*) = 0$. Write $\mathbf x = \mathbf x^* + \boldsymbol\xi$; then
$$\dot{\boldsymbol\xi} = f(\mathbf x^* + \boldsymbol\xi) = \underbrace{Df(\mathbf x^*)}_{=:\,A}\boldsymbol\xi + o(|\boldsymbol\xi|).$$The linearisation at $\mathbf x^*$ is the linear system $\dot{\boldsymbol\xi} = A\boldsymbol\xi$, obtained by deleting the remainder.
Nothing so far says the two systems behave alike. They do when $A$ is hyperbolic — no eigenvalue with zero real part — and can disagree completely when it is not. Two slides from here, both halves are made precise.
$f = 0$ forces $\omega = 0$ and $\sin\theta = 0$: the points $(k\pi, 0)$. On the cylinder there are exactly two: $(0,0)$, hanging down, and $(\pi, 0)$, balanced up. Their Jacobians are
$$\begin{pmatrix}0&1\\-1&-\gamma\end{pmatrix}, \qquad \begin{pmatrix}0&1\\1&-\gamma\end{pmatrix}$$— the whole difference is the sign of $\cos\theta$, and it decides everything.
Two equations in two unknowns, solved exactly, with no integration. This is the first question of the six and it is always answerable.
02 · linearisation
For $\dot{\boldsymbol\xi} = A\boldsymbol\xi$ with $A$ real $2\times2$, the eigenvalues solve $\lambda^2 - \tau\lambda + \Delta = 0$ with $\tau = \operatorname{tr}A$, $\Delta = \det A$:
$$\lambda_\pm = \tfrac12\Big(\tau \pm \sqrt{\tau^2 - 4\Delta}\Big).$$So the trace–determinant plane classifies everything. $\Delta < 0$: real eigenvalues of opposite sign, a saddle. $\Delta > 0$ and $\tau^2 > 4\Delta$: a node, stable iff $\tau < 0$. $\tau^2 < 4\Delta$: a spiral, stable iff $\tau < 0$. $\tau = 0 < \Delta$: a centre.
Stability is $\tau < 0$ and $\Delta > 0$ — both conditions, and neither alone.
Where the down equilibrium ($\tau=-\tfrac12$, $\Delta=1$) and the up equilibrium ($\tau=-\tfrac12$, $\Delta=-1$) sit. Moving $\gamma$ slides both horizontally.
02 · linearisation
$A\mathbf v_i = \lambda_i \mathbf v_i$, $\lambda_1 \ne \lambda_2$ real. Then
$\boldsymbol\xi(t) = c_1 e^{\lambda_1 t}\mathbf v_1 + c_2 e^{\lambda_2 t}\mathbf v_2 .$
Differentiate: it solves. The $\mathbf v_i$ are a basis, so any initial condition is met; uniqueness (unit 01) says there is nothing else. Orbits leave along the eigendirection of larger $\lambda$.
$\lambda$ twice. Either $A = \lambda I$ (a star node, every ray an orbit), or there is $\mathbf w$ with $(A-\lambda I)\mathbf w = \mathbf v$ and
$\boldsymbol\xi(t) = e^{\lambda t}\big(c_1\mathbf v + c_2(\mathbf w + t\mathbf v)\big),$
a degenerate node: one eigendirection, approached by everything.
There is a real basis in which $A = \begin{pmatrix}\alpha&-\beta\\\beta&\alpha\end{pmatrix}$ (proof in the notes — no complex exponential needed). In it,
$\boldsymbol\xi(t) = r_0e^{\alpha t}\begin{pmatrix}\cos(\beta t + \phi)\\ \sin(\beta t + \phi)\end{pmatrix}.$
A spiral: $r$ grows by $e^{\alpha t}$, the angle advances at rate $\beta$.
Every case is verified, not derived: differentiate the formula, then invoke uniqueness. That is legitimate and it is all we need — the systematic solution of $\dot{\mathbf x} = A\mathbf x$ in $n$ dimensions, by the matrix exponential, is unit 07. Dimensions: $\lambda$, $\alpha$, $\beta$ are all inverse times, so $\lambda t$ is a pure number, as an exponent must be.
02 · linearisation · example
Every panel is $\dot{\boldsymbol\xi} = A\boldsymbol\xi$ with $A = \begin{pmatrix}0&1\\\pm1&-\gamma\end{pmatrix}$, the linearisation of the pendulum at the top ($+1$) or the bottom ($-1$). Horizontal: the angle offset $\xi_1$; vertical: the angular velocity $\xi_2$. Dashed: the eigendirections $(1, \lambda)$.
Real distinct roots of opposite sign: a saddle, orbits arrive along one eigenline and leave along the other. Of the same sign: a node, every orbit off the faster eigenline enters along the slower one ($\lambda = -0.38$). A double root with one eigenline: every orbit enters tangent to it. Complex roots: a spiral, the radius shrinking by $0.197$ each turn.
02 · linearisation · example
$\lambda_\pm = \tfrac12(-\gamma \pm \sqrt{\gamma^2-4})$. For $0 < \gamma < 2$ complex with $\alpha = -\gamma/2 < 0$: a stable spiral. At $\gamma = 2$, a double root $\lambda = -1$: degenerate node, critical damping. For $\gamma > 2$, two negative real roots: a stable node.
At $\gamma = \tfrac12$: $\;\lambda = -0.25 \pm 0.9682\,i$. The angle advances at $\beta = 0.9682$, so a turn takes $2\pi/\beta = 6.489$ time units and the amplitude is multiplied by $e^{-0.25 \times 6.489} = 0.1974$ each turn.
$\Delta < 0$ for every $\gamma$, so always a saddle: one direction leaves, one arrives, and the balanced pendulum is unstable however much damping you add.
At $\gamma = \tfrac12$: $\lambda = 0.7808$ and $-1.2808$. Check: their sum is $-0.5 = \tau$ and their product is $-1.0000 = \Delta$.
For $l = 1$ m, one time unit is $\sqrt{l/g} = 0.3193$ s. The small undamped period $2\pi$ is $2.006$ s; at $\gamma=\tfrac12$ the damped period $6.489$ is $2.072$ s — damping makes it slower, by $3.3\%$.
02 · linearisation
Let $f$ be $C^1$ near an equilibrium $\mathbf x^*$ and let $A = Df(\mathbf x^*)$ be hyperbolic: $\operatorname{Re}\lambda \ne 0$ for every eigenvalue. Then there are neighbourhoods $U \ni \mathbf x^*$, $W \ni 0$ and a homeomorphism $h : U \to W$ carrying orbits of $\dot{\mathbf x} = f(\mathbf x)$ onto orbits of $\dot{\boldsymbol\xi} = A\boldsymbol\xi$, preserving the time parameter — a topological conjugacy.
not proved here: Perko, Differential Equations and Dynamical Systems, §2.8
So at a hyperbolic equilibrium the linear picture is the true picture, up to a continuous change of coordinates: saddles stay saddles, sinks stay sinks, and nothing new appears nearby.
Centres are excluded. $\operatorname{Re}\lambda = 0$ is precisely the case left out, and it is not an oversight: the next slide shows two systems with the same linearisation $\begin{pmatrix}0&-1\\1&0\end{pmatrix}$, one with every orbit spiralling in, one with every orbit spiralling out.
$h$ is only a homeomorphism. It need not be differentiable, so it does not preserve eigenvalues or rates — only the qualitative picture. Making $h$ smooth needs non-resonance conditions (Sternberg's theorem).
Every frictionless mechanical equilibrium that is not a saddle is a centre. The exclusion is not an edge case in this course; it is half of it.
02 · linearisation · example
The upright equilibrium at $\gamma = \tfrac12$ is hyperbolic ($\lambda = 0.7808,\ -1.2808$), so the theorem applies. Left, the true orbits near it; right, the orbits of its linearisation. Orange: the orbits that run straight into the equilibrium or straight out of it.
Same pattern, different shape. The conjugacy $h$ straightens the curved orange orbits onto the eigenlines and carries every other orbit with them, timing included. Near the centre the two pictures agree to first order; further out the curvature is the $o(|\boldsymbol\xi|)$ remainder at work.
02 · linearisation · example
For $a \in \mathbb{R}$ consider
$$\dot x = -y + a\,x(x^2+y^2), \qquad \dot y = x + a\,y(x^2+y^2).$$The Jacobian at the origin is $\begin{pmatrix}0&-1\\1&0\end{pmatrix}$ for every $a$: $\tau = 0$, $\Delta = 1$, a centre. Now put $r^2 = x^2+y^2$ and differentiate:
$$r\dot r = x\dot x + y\dot y = a(x^2+y^2)^2 = a r^4 \;\Longrightarrow\; \dot r = a r^3 .$$So $r$ grows for $a > 0$, shrinks for $a < 0$, and is constant for $a = 0$. The origin is an unstable spiral, an asymptotically stable spiral, and a centre — with identical linearisations.
$x\dot x + y\dot y = x(-y + axr^2) + y(x + ayr^2) = -xy + xy + a r^2(x^2+y^2) = ar^4$. The linear parts cancel exactly — that is what $\tau = 0$ means — and the cubic terms are what is left.
The next slide draws all three.
02 · linearisation · example
$\dot x = -y + a\,x r^2$, $\dot y = x + a\,y r^2$ with $a = -1,\ 0,\ 1$, from the exact solution $r = r_0(1 - 2ar_0^2t)^{-1/2}$. Left: from $r_0 = 1.1$, 40 time units only bring it to $r = 0.11$ — decay like $t^{-1/2}$. Right: from $r_0 = 0.15$ it leaves the frame at $t = 21.8$ and reaches infinity at $t = 22.2$.
All three linearise to the middle panel. A centre in the linearisation is no information at all about the nonlinear system; section 3 supplies the instrument that decides — for $a < 0$, $V = x^2+y^2$ decreases, and that settles it. Problem P4 is the same trap with $\dot x = -y-x^3$, $\dot y = x-y^3$.
section 3
Prove stability with a function that falls, and get a basin for free.
02 · lyapunov
Let $\mathbf x^*$ be an equilibrium. It is
Attraction does not imply stability: there are systems in which every orbit converges to $\mathbf x^*$ but some first travel a long way away. Stability is the uniform statement, and it is the one that matters physically.
Stability: whatever $\varepsilon$ you are given, some $\delta$ works. Asymptotic stability additionally sends the orbit to the centre.
02 · lyapunov
Let $V : U \to \mathbb{R}$ be differentiable and $\mathbf x(t)$ a solution of $\dot{\mathbf x} = f(\mathbf x)$. Then $t \mapsto V(\mathbf x(t))$ is differentiable, with derivative $\dot V(\mathbf x(t))$, where
$$\dot V(\mathbf x) \;:=\; DV(\mathbf x)\,f(\mathbf x) = \sum_{i=1}^n \partial_i V(\mathbf x)\,f_i(\mathbf x).$$The right-hand side is a function of position alone: no solving required.
Write $\mathbf x(t+s) - \mathbf x(t) = s\,f(\mathbf x(t)) + \boldsymbol\rho(s)$ with $\boldsymbol\rho(s)/s \to 0$. Differentiability of $V$ at $\mathbf x(t)$ gives $V(\mathbf x(t+s)) - V(\mathbf x(t)) = DV(\mathbf x(t))\big(s f + \boldsymbol\rho(s)\big) + r$, where $|r|/|s f + \boldsymbol\rho(s)| \to 0$ and $|sf + \boldsymbol\rho(s)| = O(s)$. Divide by $s$ and let $s \to 0$: the $\boldsymbol\rho$ and $r$ terms vanish. $\square$
With $V = \tfrac12\omega^2 + (1-\cos\theta)$ and $f = (\omega,\,-\gamma\omega-\sin\theta)$:
$$\begin{aligned}\dot V &= \underbrace{\sin\theta}_{\partial_\theta V}\,\omega + \underbrace{\omega}_{\partial_\omega V}\,(-\gamma\omega - \sin\theta)\\ &= -\gamma\omega^2 .\end{aligned}$$Three lines, no solution of anything, and it is exact: the energy of the damped pendulum falls at rate $\gamma\omega^2$, always.
Dimensions: $V$ is an energy over $mgl$, $\dot V$ an inverse time; $\gamma\omega^2$ is $\text{(number)}\times\text{(inverse time)}^2$ — and one power of inverse time is the time unit itself, so both sides match. Limit: $\gamma\to0$ gives $\dot V = 0$, the conservation of unit 00.
02 · lyapunov
Let $\mathbf x^*$ be an equilibrium and $N$ a neighbourhood of it. Suppose $V \in C^1(N)$ satisfies
Then $\mathbf x^*$ is stable. If moreover $\dot V < 0$ on $N \setminus \{\mathbf x^*\}$, it is asymptotically stable. Such a $V$ is a Lyapunov function.
Given $\varepsilon$ with $\overline B_\varepsilon(\mathbf x^*) \subset N$, let $m = \min\{V(\mathbf x) : |\mathbf x - \mathbf x^*| = \varepsilon\}$, which is $>0$ by compactness of the sphere and positivity of $V$. By continuity pick $\delta \in (0,\varepsilon)$ with $V < m$ on $B_\delta$. For $\mathbf x_0 \in B_\delta$, $V(\varphi_t(\mathbf x_0)) \le V(\mathbf x_0) < m$ as long as the orbit stays in $B_\varepsilon$ — so it can never reach the sphere, where $V \ge m$. $\square$
asymptotic part in the notes (N)
It needs no eigenvalues, no hyperbolicity and no linear algebra. It works at the centres Hartman–Grobman excludes. And its conclusion is not local: if $\{V < c\}$ is bounded and $\dot V \le 0$ on it, the whole sublevel set is an invariant region — a basin estimate, which linearisation can never supply.
There is no algorithm for finding $V$. In mechanics there is a standard first guess — the energy — and it works remarkably often, because dissipation is exactly the statement that energy falls.
02 · lyapunov · example
The stability proof in three moves, drawn for the pendulum's energy $V$ with $\gamma = \tfrac12$:
1. On the circle $|\mathbf x| = \varepsilon$ (here $\varepsilon = 2$), $V$ has a minimum $m > 0$: here $m = 1 - \cos 2 = 1.416$, at $(\pm 2, 0)$.
2. The region $\{V < m\}$ (shaded) contains a ball $|\mathbf x| < \delta$; here $\delta = \sqrt{2m} = 1.683$.
3. An orbit from $\mathbf x_0$ in that ball can only go down in $V$, so it never reaches the orange curve $V = m$ — and the circle lies outside that curve.
The orbit crosses each level curve of $V$ inwards and never outwards, because $\dot V \le 0$. It is trapped inside the shaded region, hence inside the $\varepsilon$-circle.
02 · lyapunov · example
Linearisation at $(0,0)$: $\tau = 0$, $\Delta = 1$ — a centre, and by the two slides above that is no information. Take $V = \tfrac12\omega^2 + (1-\cos\theta)$ on $N = \{|\theta| < \pi\} \times \mathbb{R}$:
Lyapunov's theorem applies: the hanging position is stable. Not asymptotically — $\dot V$ is not negative anywhere — and indeed it is not, since the orbits are the closed curves $V = c$.
It gives exactly what is true and nothing more. The same $V$ with the same argument fails to show asymptotic stability, and asymptotic stability is false. A method that had "proved" it would be wrong.
For $\dot x = -y + a x r^2$, $\dot y = x + a y r^2$ with $a < 0$, take $V = x^2+y^2$. Then $\dot V = 2ar^4 < 0$ off the origin, so the origin is asymptotically stable. With $a = 0$, $\dot V = 0$: stable, not asymptotically. With $a > 0$, $\dot V > 0$: unstable. One function, all three cases, where the linearisation could not distinguish them.
02 · lyapunov
For a forward orbit define its omega-limit set
$$\begin{aligned}\omega(\mathbf x_0) = \{\mathbf y :\ &\varphi_{t_n}(\mathbf x_0) \to \mathbf y\\ &\text{for some } t_n \to \infty\}.\end{aligned}$$A set $S$ is invariant if $\varphi_t(S) = S$ for all $t$, and forward invariant if $\varphi_t(S) \subseteq S$ for $t \ge 0$.
If the forward orbit of $\mathbf x_0$ stays in a compact $K \subset U$, then $\omega(\mathbf x_0)$ is non-empty, compact, connected and invariant, and $\operatorname{dist}(\varphi_t(\mathbf x_0), \omega(\mathbf x_0)) \to 0$.
full proof in the notes (N)
The proof is pure metric topology plus one input from unit 01. Non-emptiness and compactness are Bolzano–Weierstrass; invariance is continuous dependence on initial data:
$$\begin{aligned}\varphi_s(\mathbf y) &= \varphi_s\big(\lim \varphi_{t_n}(\mathbf x_0)\big)\\ &= \lim \varphi_{t_n + s}(\mathbf x_0) \in \omega(\mathbf x_0).\end{aligned}$$"Where does the orbit go?" becomes "what is $\omega(\mathbf x_0)$?", and that is a question about a set, which can be pinned down by inequalities. LaSalle (next) and Poincaré–Bendixson (section 4) are both statements about $\omega$-limit sets and nothing else.
02 · lyapunov
Let $\Omega \subset U$ be compact and forward invariant, $V \in C^1$ with $\dot V \le 0$ on $\Omega$. Put
$$\begin{gathered}E = \{\mathbf x \in \Omega : \dot V(\mathbf x) = 0\},\\ M = \text{the largest invariant subset of } E .\end{gathered}$$Then every solution starting in $\Omega$ satisfies $\operatorname{dist}(\varphi_t(\mathbf x_0), M) \to 0$.
$V(\varphi_t)$ is non-increasing and bounded below on the compact $\Omega$, so $V(\varphi_t) \to c$. For $\mathbf y \in \omega(\mathbf x_0)$, continuity gives $V(\mathbf y) = c$: $V \equiv c$ on $\omega(\mathbf x_0)$. But $\omega$ is invariant, so the whole orbit through $\mathbf y$ lies in $\omega$ and $V$ is constant along it, whence $\dot V(\mathbf y) = 0$. Thus $\omega \subseteq E$ and $\omega$ is invariant, so $\omega \subseteq M$; and $\varphi_t \to \omega$. $\square$
Lyapunov's asymptotic half needs $\dot V < 0$ everywhere nearby. In mechanics that almost never holds: damping acts on velocity, so $\dot V$ vanishes on the whole set $\{\text{velocity} = 0\}$, not just at the equilibrium. LaSalle replaces "$\dot V < 0$" by "nothing can stay in $\dot V = 0$", which is exactly the true statement.
Note what it does not need: $V$ positive definite, or $\Omega$ small, or an equilibrium at all. It is a statement about where orbits go, and the conclusion is as global as $\Omega$ is large.
02 · lyapunov · example
Take $\gamma > 0$ and $\Omega = \{V \le c\}$ for any $c < 2$, inside the cylinder. Then:
LaSalle: every orbit starting with $V < 2$ converges to the hanging position — letting $c \uparrow 2$, the basin contains all of $\{V < 2\}$.
It gives asymptotic stability of the down position for $\gamma > 0$ — Hartman–Grobman applies, the equilibrium is hyperbolic — but only on some unspecified neighbourhood. The basin $\{V < 2\}$ is not a local statement and no linear argument produces it.
02 · lyapunov · example
$\gamma = \tfrac12$, $c = 1.5$. The orbit starts on the edge of $\Omega$ and never leaves it. It meets $E$ (circled) only by crossing it vertically — there $\dot\theta = 0$ but $\dot\omega = -\sin\theta \ne 0$ — so it cannot stay on $E$ anywhere except at $M$.
The three bullets of the previous slide, as a picture: $\Omega$ is the shaded oval, $E$ the orange segment of the axis, $M$ the single point at its centre.
Limit $\gamma \to 0$: $E$ becomes all of $\Omega$ and $M$ all of it too — no convergence claimed, correctly.
Sharpness: $\{V < 2\}$ cannot be enlarged to $\{V \le 2\}$, which contains the saddle.
Numbers: released from rest at $\theta_0$, $V = 1-\cos\theta_0 < 2$ unless $\theta_0 = \pi$: from any angle but exactly upright, it ends hanging.
section 4
Proving a cycle exists without computing it — and proving none does.
02 · cycles
A periodic orbit is a non-equilibrium orbit with $\varphi_T(\mathbf x_0) = \mathbf x_0$ for some $T > 0$; the least such $T$ is its period. A limit cycle is a periodic orbit that is the $\omega$-limit set of some orbit not on it — an isolated cycle, which attracts or repels.
The undamped pendulum has a continuum of periodic orbits and no limit cycle: each orbit is surrounded by others, none attracts. A limit cycle is a self-sustained oscillation with an amplitude of its own, picked out by the equations rather than by the initial data — a heartbeat, not a bell.
$\dot x = x - y - x(x^2+y^2)$, $\dot y = x + y - y(x^2+y^2)$. With $r^2 = x^2+y^2$,
$$\begin{gathered}r\dot r = x\dot x + y\dot y = r^2 - r^4,\\ \dot\theta = (x\dot y - y\dot x)/r^2 = 1,\end{gathered}$$so $\dot r = r(1-r^2)$ and $\dot\theta = 1$. The circle $r = 1$ is a periodic orbit of period $2\pi$; $r$ increases for $0 < r < 1$ and decreases for $r > 1$, so every orbit but the origin tends to it. A limit cycle, and we know it exactly because the system was built to be separable in polar form.
Almost nothing else is. The next slide is how one proves a cycle exists when nothing separates.
02 · cycles
Let $f$ be $C^1$ on an open $U \subseteq \mathbb{R}^2$, and suppose the forward orbit of $\mathbf x_0$ stays in a compact $K \subset U$ containing no equilibrium. Then $\omega(\mathbf x_0)$ is a periodic orbit.
not proved here: Perko §3.7, or Hartman, Ordinary Differential Equations, ch. VII
In practice one supplies $K$ as a trapping region: a compact set with the field pointing inwards along its boundary, so no orbit can leave. If it also contains no equilibrium, a cycle exists inside it — proved, without any idea what the cycle looks like.
Why only the plane? The next slide draws the step that needs it.
"$C$ has an inside, and getting in means crossing $C$" is the Jordan curve theorem. In $\mathbb{R}^3$ a closed curve has no inside, the argument dies, and the conclusion is false — a bounded, equilibrium-free orbit can be chaotic. That is unit 17.
So two-dimensionality is not a convenience of the proof. It is the content.
02 · cycles
$\Sigma$ is a segment the field crosses in one direction only. Follow one orbit from its crossing $p_1$ round to its next crossing $p_2$; that arc plus the piece of $\Sigma$ from $p_2$ back to $p_1$ is a closed curve $C$.
The orbit cannot re-cross its own arc (orbits do not cross), and it crosses the piece of $\Sigma$ only outwards. So after $p_2$ it is shut out of $C$ for good, and $p_3$ lies beyond $p_2$: the crossings are monotone along $\Sigma$.
$\dot r = 0.15\,r(1-r^2)$, $\dot\theta = 1$, from $r = 0.2$ on $\Sigma$. Thick: the first lap, which with the segment from $p_2$ to $p_1$ bounds the shaded inside of $C$. The crossings sit at $r = 0.200,\ 0.464,\ 0.802,\ 0.960$ — monotone, as forced.
02 · cycles · example
For $\dot r = r(1-r^2)$, $\dot\theta = 1$ take $K = \{\tfrac12 \le r \le 2\}$, compact.
Poincaré–Bendixson: every orbit starting in $K$ has a periodic orbit as its $\omega$-limit set, so a cycle exists in $K$. Here we happen to know it is $r=1$ with period $2\pi$; the argument never used that.
Problem P6 runs the same three steps on Van der Pol, where no formula for the cycle exists at all.
The annulus $K$, shaded. The orange arrows are the field on its two edges: outwards-and-round at $r = \tfrac12$, inwards-and-round at $r = 2$ — into $K$ both times. One orbit from each edge, from the exact solution, winds onto $r = 1$ within a turn.
02 · cycles
Let $\gamma > 0$ and suppose $\varphi_t$ is $T$-periodic. Then
$$\begin{aligned}0 &= V(\mathbf x(T)) - V(\mathbf x(0))\\ &= \int_0^T \dot V\,\mathrm{d}t = -\gamma\int_0^T \omega^2\,\mathrm{d}t \le 0,\end{aligned}$$so $\omega \equiv 0$ on the orbit, hence $\dot\omega = -\sin\theta \equiv 0$, and the orbit is one of the two equilibria — not a periodic orbit. $\square$
Three lines, valid on the whole cylinder, covering both the swinging orbits and the rotating ones. It needs no two-dimensionality and no index theory: a strictly decreasing quantity is incompatible with returning.
Bendixson–Dulac criterion. If $\partial_x f_1 + \partial_y f_2$ has one strict sign on a simply connected region $D$ — one with no holes, so that every closed curve in it can be shrunk to a point inside it — then $D$ contains no periodic orbit.
Proof by Green's theorem: $\oint_\Gamma (f_1\,\mathrm{d}y - f_2\,\mathrm{d}x) = 0$ along an orbit, while the double integral of the divergence over the enclosed region is nonzero. The line and area integrals arrive in units 04 and 05, and the proof is given there.
For the pendulum $\partial_\theta(\omega) + \partial_\omega(-\gamma\omega-\sin\theta) = -\gamma < 0$: the criterion applies at once. Note it needs simply connected, so on the cylinder it kills only the contractible cycles — the energy argument above is the one that also kills rotation.
section 5
An integer attached to a closed curve, which counts what is inside.
02 · index
Let $f$ be a continuous planar field and $\Gamma$ a closed curve $\sigma : [0,1] \to \mathbb{R}^2$, $\sigma(0)=\sigma(1)$, on which $f \ne 0$. There is a continuous $\vartheta : [0,1] \to \mathbb{R}$ with
$$f(\sigma(s)) = |f(\sigma(s))|\,\big(\cos\vartheta(s),\, \sin\vartheta(s)\big),$$unique up to a constant in $2\pi\mathbb{Z}$. The index of $\Gamma$ is
$$I_f(\Gamma) = \frac{\vartheta(1) - \vartheta(0)}{2\pi} \in \mathbb{Z}.$$In words: the net number of turns the field makes as you walk once round $\Gamma$ — read off the arrows, with no derivatives, no solving and no linearity.
If $\Gamma_0$ and $\Gamma_1$ are homotopic through closed curves on which $f$ never vanishes — joined by a continuous family $\Gamma_u$, $u \in [0,1]$, of such curves — then $I_f(\Gamma_0) = I_f(\Gamma_1)$.
Why: the index along the homotopy is a continuous $\mathbb{Z}$-valued function of the parameter, hence constant on $[0,1]$.
1. A curve shrinkable to a point inside a region where $f \ne 0$ has index $0$: a constant curve turns not at all.
2. No deformation that avoids the zeros of $f$ changes the index — it depends only on which equilibria are enclosed.
02 · index · example
Two circles $\Gamma_1, \Gamma_2$ of radius $1.25$ in the pendulum's plane, round $(0,0)$ and $(\pi,0)$, with the field drawn at sixteen points of each. Right: the continuous angle $\vartheta(s)$ of the field as each circle is walked once anticlockwise.
Round $(0,0)$ the arrow turns once with the walk: $\vartheta$ gains $2\pi$, index $+1$. Round $(\pi, 0)$ it turns once against it: $\vartheta$ loses $2\pi$, index $-1$. Nothing was solved — the arrows are $f$ evaluated on the circle, $\gamma = \tfrac12$.
02 · index
For an isolated equilibrium $\mathbf x^*$, the index of an equilibrium $\operatorname{ind}(\mathbf x^*)$ is $I_f(\Gamma)$ for any small circle around it; homotopy invariance makes the choice irrelevant.
If $A = Df(\mathbf x^*)$ is invertible then $\operatorname{ind}(\mathbf x^*) = \operatorname{sign}(\det A)$: $\;+1$ for nodes, spirals, stars and centres, $\;-1$ for saddles. Hyperbolic is not needed — only $\det A \ne 0$, which is why centres are included.
proof in the notes (N)
If $\Gamma$ bounds a disc $D$ with $f \ne 0$ on $\Gamma$ and finitely many equilibria inside, $\;I_f(\Gamma) = \sum_{\mathbf x^* \in D}\operatorname{ind}(\mathbf x^*)$.
A periodic orbit has index $+1$: the field is tangent to the curve, and the tangent of a simple closed curve turns once.
not proved here: do Carmo, Differential Geometry of Curves and Surfaces, §5-7
Walk anticlockwise round each circle and watch the arrow. On the left it turns once anticlockwise; on the right, once clockwise.
02 · index · example
$\det Df = \cos\theta$ at an equilibrium, so $(0,0)$ has index $\operatorname{sign}(+1) = +1$ and $(\pi,0)$ has $\operatorname{sign}(-1) = -1$: the two indices sum to zero, and along the line of equilibria $(k\pi, 0)$ in the covering strip they alternate $+1, -1, +1, \dots$
Consequences, for any $\gamma$ including $0$:
A rotating pendulum orbit — the bob going over the top again and again, which exists for $\gamma = 0$ and large enough energy — is a closed orbit encircling no equilibrium. It does not contradict anything: it wraps once round the cylinder, so it bounds no disc, and the index theorem assumes a disc.
$\gamma = 0$: contractible cycles exist (the swinging orbits inside the separatrix, each enclosing the index-$+1$ point, as required), and non-contractible ones exist (rotations).
$\gamma > 0$: neither exists — the energy argument of "Ruling cycles out", which never mentions the index.
section 6
What the portrait does as you turn a knob.
02 · bifurcations
A family $\dot{\mathbf x} = f(\mathbf x, \mu)$ has a bifurcation at $\mu_0$ if the phase portrait at $\mu_0$ is not topologically equivalent to those at nearby $\mu$ — no homeomorphism carries its orbits onto theirs, keeping the direction of time (the speed along orbits may change, unlike a conjugacy): equilibria or cycles are created, destroyed or change type.
By Hartman–Grobman, nothing can happen while every equilibrium is hyperbolic and stays so. Bifurcations live exactly where hyperbolicity fails — on the two lines $\Delta = 0$ and $\tau = 0$ of "Planar linear systems: two numbers decide". That is the whole organising principle.
Normal form $\dot x = \mu - x^2$. For $\mu > 0$ two equilibria $x = \pm\sqrt\mu$, one stable ($f'=-2\sqrt\mu<0$) and one unstable; at $\mu = 0$ they collide at $x=0$ with $f'(0) = 0$; for $\mu < 0$ none at all.
Solid: stable; dashed: unstable. The dotted verticals are phase lines, arrows giving the sign of $\dot x = \mu - x^2$: at $\mu < 0$ every $x$ falls, at $\mu = 0.64$ the flow runs into $x = 0.8$ and away from $x = -0.8$.
02 · bifurcations
Normal form $\dot x = \mu x - x^2$. Equilibria $x = 0$ and $x = \mu$ for every $\mu$: they cross at $\mu = 0$ and exchange stability, since $f'(0) = \mu$ and $f'(\mu) = -\mu$. Nothing is created or destroyed.
Supercritical normal form $\dot x = \mu x - x^3$: $x=0$ for all $\mu$, plus $x = \pm\sqrt\mu$ for $\mu > 0$, which are stable ($f' = -2\mu$) while $x=0$ turns unstable.
Subcritical $\dot x = \mu x + x^3$: the two extra branches exist for $\mu < 0$ and are unstable. Same picture, reflected — and physically opposite, since nothing nearby catches the system when $x=0$ loses stability.
Solid stable, dashed unstable. Transcritical: $x = 0$ and $x = \mu$ swap stability where they cross. Supercritical pitchfork: as $x = 0$ turns unstable, the stable pair $x = \pm\sqrt\mu$ grows out of it.
02 · bifurcations
$\dot r = \mu r - r^3$, $\dot\theta = \omega_0$, i.e.
$$\begin{aligned}\dot x &= \mu x - \omega_0 y - x(x^2+y^2),\\ \dot y &= \omega_0 x + \mu y - y(x^2+y^2).\end{aligned}$$Eigenvalues $\mu \pm i\omega_0$ at the origin: stable spiral for $\mu < 0$, unstable for $\mu > 0$, non-hyperbolic exactly at $\mu = 0$. For $\mu > 0$ a limit cycle appears at $r = \sqrt\mu$, period $2\pi/\omega_0$.
If a planar family has eigenvalues $\alpha(\mu) \pm i\beta(\mu)$ crossing the imaginary axis transversally ($\alpha(0)=0$, $\alpha'(0) \ne 0$, $\beta(0) \ne 0$) and one cubic coefficient is non-zero, a unique small limit cycle is born, amplitude $\propto\sqrt{|\mu|}$, period $\to 2\pi/\beta(0)$.
Marsden & McCracken, The Hopf Bifurcation and its Applications, §3; Perko §4.4
Amplitude: $\dot r = 0$ at $r = \sqrt\mu$; $\partial_r(\mu r - r^3) = \mu - 3r^2 = -2\mu < 0$ there, so the cycle attracts. At $\mu = 0.25$ the amplitude is exactly $0.5$.
Scaling: $r \sim \sqrt\mu$ means the cycle grows as the square root of the distance past the threshold — the signature that distinguishes a Hopf bifurcation in data from anything else.
The next slide draws both sides of the threshold.
02 · bifurcations · example
The normal form with $\omega_0 = 1$. Left: a stable spiral. Middle: the origin has turned unstable, and orbits from inside and outside both wind onto the cycle $r = \sqrt{0.25} = 0.5$. Right: the whole family at once — the cycle is born at $\mu = 0$ with zero radius and grows like $\sqrt\mu$.
With $+r^3$ instead, the cycle exists for $\mu < 0$ and is unstable: it is the boundary of the basin of the stable origin, and it shrinks to nothing as $\mu \to 0^-$. Past the threshold the system jumps somewhere far away. Aeroelastic flutter is this case, and it is why the distinction is worth a slide.
02 · bifurcations · example
Drive it: $\ddot\theta + \gamma\dot\theta + \sin\theta = T$, $T$ the applied torque in units of $mgl$. Equilibria need $\omega = 0$ and $\sin\theta = T$:
$\det Df = \cos\theta$ and $\operatorname{tr}Df = -\gamma$, so $\theta_1$ is a sink and $\theta_2$ a saddle: a saddle-node bifurcation at $T = 1$, a $+1$ and a $-1$ annihilating as the note on "Families, and where the portrait breaks" requires.
Sink at $\theta_1 = 0.9273$ rad $= 53.13°$, $\cos\theta_1 = 0.6$: eigenvalues $-0.25 \pm 0.7331\,i$ — still a spiral, but slower than the undriven $0.9682$.
Saddle at $\theta_2 = 2.2143$ rad $= 126.87°$, $\cos\theta_2 = -0.6$: eigenvalues $0.5639$ and $-1.0639$.
02 · bifurcations · example
Left: rest needs $\sin\theta = T$. At $T = 0.8$ the line cuts the sine twice, at $\theta_1 = 53.13°$ (the sink) and $\theta_2 = 126.87°$ (the saddle); at $T = 1$ it touches once at $\pi/2$; at $T = 1.2$ it misses. Right: the same, as $T$ moves — the sideways parabola of "Families, and where the portrait breaks", met in the wild.
Limit $T \to 0$: $\theta_1 \to 0$, $\theta_2 \to \pi$ — the original two equilibria.
Nearing threshold: $\beta = \tfrac12\sqrt{4\cos\theta_1-\gamma^2}$ hits $0$ at $\cos\theta_1 = \gamma^2/4$, i.e. $T = 0.9980$ here: past that the sink is a node, so the colliding pair is real and merges along the $\theta$ axis.
Dimensions: $T$ is a torque over $mgl$, a pure number, so comparing it with $\sin\theta$ is legitimate.
02 · closing
| question | tool | what it gave, exactly |
|---|---|---|
| Where can it rest? | solve $f = 0$ | two points on the cylinder: hanging and upright. |
| What happens to a nudge? | linearisation + Hartman–Grobman | $\gamma=\tfrac12$: stable spiral $-0.25\pm0.9682\,i$ below, saddle $0.7808 / -1.2808$ above. |
| And when $\gamma = 0$? | Lyapunov with the energy | a centre, stable but not asymptotically — the case linearisation cannot decide. |
| Where does it end up? | LaSalle on $\{V < 2\}$ | every orbit inside the separatrix converges to the hanging position. |
| Can it repeat itself? | $\int_0^T\dot V = -\gamma\int\omega^2$ | no periodic orbit at all for $\gamma>0$, swinging or rotating. |
| Which cycles are even possible? | the index | a contractible cycle must enclose the $+1$ point; rotations bound no disc and escape the count. |
| What if we drive it? | saddle-node at $T=1$ | the $+1$ and the $-1$ collide and annihilate; beyond it, no rest at all. |
Not one line of $\theta(t)$ was ever written down, because none exists. Everything above is exact.
02 · checkpoint
Given a planar nonlinear system you have not seen before, you:
Failing it is unambiguous: an unclassified equilibrium, a linearisation trusted at a centre, or a cycle neither produced nor excluded.
Strogatz, Nonlinear Dynamics and Chaos, ch. 5–8 — the same material, slower · Perko, Differential Equations and Dynamical Systems, ch. 2–4 — the proofs cited here · Hirsch, Smale & Devaney, ch. 4–10 (optional).
06 the damped driven oscillator, which linearises everything on this deck and then solves it · 03 multivariable calculus, done properly · 14 where the conserved function becomes a symplectic form · 17 where Poincaré–Bendixson runs out.
./mr problems 02 — twelve problems, four hours. hints one rung at a time and the worked solution under each problem, after your attempt; ./mr done 02 when the checkpoint holds.