In this section, we'll go through some of the most used and impactful convolutional neural networks in use today. We'll start with the classical LeNet-5, before moving move on to the more complex AlexNet, and finally we'll see VGG-16, which will be used many times during the course of this book.
Working with classical networks
LeNet-5
LeNet-5 is a classical neural network architecture that was successfully used on a handwritten digit recognition problem back in 1998. In principle, LeNet-5 was the first architecture that introduced the idea of applying several convolution layers before connecting to a fully-connected hidden layer. Before that, people would construct the features manually and then connect to...
