Chapter 9 Newton-Raphson and Gradient Descent

Given a function \(f(x)\), the minimum can be found using gradient descent which needs to compute the first derivative \(f'(x)\), or using newton-rapson to find the solution of \(f'(x) = 0\) requiring to compute \(f''(x)\). Gradient descent is mainly used because it only need the first derivative \(f'(x)\).