Chapter 3: Modern Neural Networks

• Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al., 2016. Tensorflow: A System for Large-Scale Machine Learning. In: OSDI, pp. 265–283.
• API Documentation, URL: https://www.tensorflow.org/api_docs/ (accessed December 14, 2018).
• Bottou, L., 2010. Large-Scale Machine Learning with Stochastic Gradient Descent. In: Proceedings of COMPSTAT'2010. Springer, pp. 177–186.
• Bottou, L., Curtis, F.E., Nocedal, J., 2018. Optimization Methods for Large-Scale Machine Learning. SIAM Review 60, 223–311.
• Dozat, T., 2016. Incorporating Nesterov Momentum into Adam.
• Duchi, J., Hazan, E., Singer, Y., 2011. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. Journal of Machine Learning Research 12, 2121–2159.
• Gardner, W.A., 1984. Learning Characteristics of Stochastic Gradient Descent Algorithms: A General Study, Analysis, and Critique. Signal Processing...