Documenting the data discovery process

In recent years, manual data discovery has been rapidly deprecated, giving rise to machine learning and other automated solutions, bringing fast insights into data in storage or online spreadsheets, such as Google Sheets.

Nevertheless, many small companies are just starting out their businesses or data areas, so implementing a paid or cost-related solution might not be a good idea right away. As data professionals, we also need to be malleable when applying the first solution to a problem – there will always be space to improve it later.

Getting ready

This recipe will cover the steps to start the data discovery process effectively. Even though, here, the process is more related to the manual discovery steps, you will see it also applies to the automated ones.

Let’s start by downloading the datasets.

For this recipe, we are going to use the The evolution of genes in viruses and bacteria dataset (https://www.kaggle.com...