As the use of Hadoop and related technologies in the respective ecosystem gained prominence, a few obvious and salient deficiencies of the Hadoop operational model became apparent. In particular, the ingrained reliance on the MapReduce paradigm, and other facets related to MapReduce, made a truly functional use of the Hadoop ecosystem possible only for major firms that were invested deeply in the respective technologies.
At the UC Berkeley Electrical Engineering and Computer Sciences (EECS) Annual Research Symposium of 2011, a vision for a new research group at the university was announced during a presentation by Prof. Ian Stoica (https://amplab.cs.berkeley.edu/about/). It laid out the foundation of what was to become a pivotal unit that would profoundly change the landscape of Big Data. The AMPLab, launched in February 2011, aimed to deliver a scalable...
