Designing Big Data storage

Big Data enables you to store all of your raw data as it gets generated. For better analysis, it is recommended to store all of the data so that the right correlations can be drawn, even if they are used later. In this section, we shall first delve into how storage technologies have evolved to understand the historical context and put into perspective what led to the inflection point for Big Data. Then, we shall explore how Big Data storage works to get a peek into the inner workings of the technology.

Evolution of storage technology

The history of the evolution of storage technology is one of the fascinating stories in the technology world. In a way, it mirrors how computers have come to rule our lives at home and at work. Till recently, the sophistication in storage technology has been largely driven by the increasing demands from business applications on computing and data management needs. Now, with global pervasiveness of connectivity and mobility, individual...