Summary

In this chapter, we explored some of the hot technologies on the market and in the field of data science. Technological frameworks and tools are always evolving. Therefore, it is the developer’s duty to keep up with the latest updates in technologies.

Web scraping or data extraction is one of the core fields of data science, though data processing and analyzing tasks closely follow. Collecting, gathering, and storing data from target websites using scraping techniques used to be core aspects of web scraping. However, as there have been various breakthroughs in systems that interact with data, providing quality data that can be directly implemented in the systems, stored in formats required by the customer, applicable for real-time processing, and more are also to be considered.

Data or datasets are made available using APIs, through sites dedicated to providing tools for research, and more. Web scraping comes into play when we require specific data from a target...