For reading part 1 see the following link.
This article is based on the lectures imparted by Peter Richtárik in the Modern Optimization Methods for Big Data class, at the University of Edinburgh, in 2017. Thank you for such a great class.