Date: 19/11/2024
A stochastic differential equation interpretation of stochastic gradient descent. A stochastic gradient descent can be thought of as a Ornstein-Uhlenbeck process where