Latency

The most common motivation is latency. Because sending data to a server for processing takes time, real-time applications make it impossible to use conventional machine learning. The most striking illustration is self-driving cars. To react quickly to its environment, the car must have the lowest latency possible. Therefore, it is crucial to run the model in the car. Moreover, some devices are used in places where internet access is simply not available.