Different scalable compute options in Azure

There are two types of scaling possible in Azure to help us scale our CPUs and/or GPUs:

• Vertical scaling: Increasing the number of CPU cores and the memory of the VM.
• Horizontal scaling: Increasing the number of VMs in the cluster, while keeping the CPU cores and the memory the same in each virtual machine. When we use horizontal scaling, we may have to write additional code to perform parallel or distributed computing using a supported framework.