In the next few sections, we'll discuss the mathematical branches related to NNs. Once we've done this, we'll connect them to NNs themselves.
The mathematical apparatus of NNs
Linear algebra
Linear algebra deals with linear equations such as 
and linear transformations (or linear functions) and their representations, such as matrices and vectors.
Linear algebra identifies the following mathematical objects:
- Scalars: A single number.
- Vectors: A one-dimensional array of numbers (or components). Each component of the array has an index. In literature, we will see vectors denoted either with a superscript arrow (
) or in bold (x). The following is an example of a vector:
Throughout this book, we'll mostly...
