Choosing a model representation is an important task in machine learning. So far, we have been referring to models as black boxes. Some data is put in, and, based on training, the model makes a prediction. Before we look inside this black box, let's review some of the linear algebra that we will need to understand deep learning models.
Models
Linear algebra review
Linear algebra is concerned with the representation of linear equations through the use of matrices. In the algebra taught in high school, we were concerned with scalar, that is, single number, values. We have equations, and rules for manipulating these equations, so that they can be evaluated. The same is true when, instead of scalar values, we use matrices...
