Chapter 11: Infrastructure Provisioning

While the demand for data analytics grows, data engineers are becoming an expensive and hard-to-find commodity in the marketplace. On the other hand, organizations that hire data engineers are finding innovative methods to do more with less so that they can justify the high resource costs. In a recent trend, most of these organizations have started to use automated infrastructure provisioning as a means to streamline cloud deployments. Until recently, infrastructure provisioning work has typically been handled by the DevOps group, but not anymore.

In the previous chapter, we talked about the dynamic nature of the data engineer's job profile. The modern data engineer needs to keep up with this latest trend and train themselves in a few DevOps skills. This chapter and the next are designed to teach the data engineer a few critical DevOps skills.

Important Note

In today's job market, a data engineer who knows DevOps is a lethal...