Capsule networks (Dynamic Routing Between Capsules, https://arxiv.org/abs/1710.09829) were introduced as a way to overcome some of the limitations of standard CNNs. To understand the idea behind capsule networks, we need to understand their limitations first, which we will see in the next section.
Introducing capsule networks
The limitations of convolutional networks
Let's start with a quote from professor Hinton himself:
"The pooling operation used in convolutional neural networks is a big mistake and the fact that it works so well is a disaster."
As we mentioned in Chapter 2, Understanding Convolutional Networks, CNNs are translation-invariant. Let's imagine a picture with a face, located in the right...
