In this section, we will discuss how to program distributed memory machines using Microsoft's message passing interface (MPI).
MPI is a standard, portable system that has been developed for distributed and parallel systems. It defines the basic set of functions that are utilized by parallel hardware vendors to support distributed memory communication. In the following sections, we will discuss the advantages of using MPI over old messaging libraries and explain how to install and run a simple MPI program.