Topics
#totalderivative#linearmap#remainder#theorem835#theorem837

Unit 3 · 8.3.1–8.3.3 · First derivatives

Total derivative

f is totally differentiable at x if a linear map approximates f(x + y) − f(x) with an error that vanishes faster than ‖y‖. Then the map is y ↦ ⟨∇f(x), y⟩; continuous partials guarantee it.

Unit 3 · 8.3.1–8.3.3
Formulas at a glance · First derivatives

Partial derivatives

∂f∂xi(x)=limh→0f(x+hei)−f(x)h

Gradient & product rule

∇f(x)=(∂f∂x1(x),…,∂f∂xd(x))

Total derivative

limy→0f(x+y)−f(x)−dfx(y)‖y‖=0

Tangent plane & linearization

z=f(x0,y0)+fx(x0,y0)(x−x0)+fy(x0,y0)(y−y0)

Directional derivatives & steepest ascent

Dvf(x)=⟨∇f(x),v⟩,|Dvf(x)|≤‖∇f(x)‖

Quadratic forms xᵀCx

∇f(x)=x⊤(C+C⊤)=((C+C⊤)x)⊤