Nominal problem: Dual:
Perturbed problem: Dual of perturbed problem: With same function .
Apply weak duality to perturbed problem: If is differentiable, then is the gradient with respect to