Category: Uncategorized
Connections between optimization methods
In this post, I will start by presenting some famous optimization algorithms. In a second step, I will give some interesting connections between them, allowing the reader to get a better understanding of the field. I. Greedy methods II. Primal methods Gradient descent In this section, we consider a function , that is differentiable and