A Simple Introduction to Gradient Descent

<p>Gradient descent is one of the most common optimization algorithms in machine learning. Understanding its basic implementation is fundamental to understanding all the advanced optimization algorithms built off of it.</p> <h1>Background</h1> <p>This article is supplementary to<a href="https://medium.com/@hunter-j-phillips/a-simple-introduction-to-regression-and-machine-learning-in-python-5e6bd76b0bf8" rel="noopener">&nbsp;An Introduction to Machine Learning in Python: Simple Linear Regression</a>. It should be read first or in conjunction with this article. It would also be beneficial to have a basic understanding of partial derivatives in calculus because this article also examines the partial derivatives of several variations of the Mean Squared Error (MSE).</p> <p><a href="https://medium.com/@hunter-j-phillips/a-simple-introduction-to-gradient-descent-1f32a08b0deb"><strong>Read More</strong></a></p>