In this post we describe the use of momentum to speed up gradient descent. We…

# Category: optimization

In this post we describe how to do gradient descent with constraints. We first describe…

In this post we describe the high-level idea behind gradient descent for convex optimization. Much…