Building a Data Lake for a Telecom Client

This use case is going to focus more on the analytics engine and building a Data Lake on cloud.

Abstract

A telecom company requires a to build a Data Lake on cloud and build an analytics engine on the top of that.

Introduction

The telecom project comprises building a Data Lake as well as data migration for a 25 years old telecom company. The client is a renowned telecom company and has a good presence in Asia, Europe, Africa, and some parts of North America. Their customer base is widely spread across India, Bangladesh, African countries, Latin America, and Middle-Eastern countries. The data resides in various data sources, more than 205. The data includes customer data (even secured), customer location data, tower locations for specific geographies, customer care complaints, feedback, and many other types of data.

Data is in CSV, PSV, TEXT, MSG, audio files, XML, JSON, and even in RDBMS (MySQL, Sybase, Oracle) databases in structured format.

The first...