Lagrange Multipliers: Optimization Under Constraints
You can't just optimize freely when constraints are in play. Lagrange multipliers turn a constrained optimization into a system of equations by asking: at the solution, which way do the gradients point?