AWS SageMaker Autopilot

SageMaker Autopilot, as the name suggests, is a fully managed system that provides an automatic ML solution. The goal, as in any automated ML solution, is to try to offload most of the redundant and time-consuming, repetitive work to the machine while humans can do higher-level cognitive tasks. In the following diagram, you can see the parts of the ML life cycle that SageMaker Autopilot covers:

Figure 6.25 – Lifecycle of Amazon SageMaker

As part of the SageMaker ecosystem, SageMaker Autopilot is tasked with being the automated ML engine. A typical automated ML user flow is defined in the following figure, where a user analyzes the tabular data, selects the target prediction column, and then lets Autopilot do its magic of finding the correct algorithm. The secret sauce here is the underlying Bayesian optimizer as defined by Das et al. in their paper Amazon SageMaker Autopilot: a white box AutoML solution at scale (https://www.amazon...