Explore Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Free Learning

Pandas 1.x Cookbook

You're reading from Pandas 1.x Cookbook Practical recipes for scientific computing, time series analysis, and exploratory data analysis using Python

Product type Paperback

Published in Feb 2020

Publisher Packt

ISBN-13 9781839213106

Length 626 pages

Edition 2nd Edition

Languages

Python

Tools

Pandas

Concepts

Data Analysis

Authors (2):

Theodore Petrou

Matthew Harrison

View More author details

Table of Contents (17) Chapters

Preface

1. Pandas Foundations

2. Essential DataFrame Operations FREE CHAPTER

3. Creating and Persisting DataFrames

4. Beginning Data Analysis

5. Exploratory Data Analysis

6. Selecting Subsets of Data

7. Filtering Rows

8. Index Alignment

9. Grouping for Aggregation, Filtration, and Transformation

10. Restructuring Data into a Tidy Form

11. Combining Pandas Objects

12. Time Series Analysis

13. Visualization with Matplotlib, Pandas, and Seaborn

14. Debugging and Testing Pandas

15. Other Books You May Enjoy

16. Index

Reading HTML tables

You can use pandas to read HTML tables from websites. This makes it easy to ingest tables such as those found on Wikipedia or other websites.

In this recipe, we will scrape tables from the Wikipedia entry for The Beatles Discography. In particular, we want to scrape the table in the image that was in Wikipedia during 2019:

Wikipedia table for studio albums

Wikipedia table for studio albums

How to do it...

Use the read_html function to load all of the tables from https://en.wikipedia.org/wiki/The_Beatles_discography:

>>> url = https://en.wikipedia.org/wiki/The_Beatles_discography
>>> dfs = pd.read_html(url)
>>> len(dfs)
51

Inspect the first DataFrame:

>>> dfs[0]
  The Beatles discography The Beatles discography.1
0  The Beat...             The Beat...
1  Studio a...                      23
2  Live albums                       5
3  Compilat...                      53
4  Video al...                 ...

The rest of the chapter is locked

Register for a free Packt account to unlock a world of extra content!

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at $19.99/month. Cancel anytime

Authors (2)

Matthew Harrison

Matthew Harrison

Matt Harrison has been using Python since 2000. He runs MetaSnake, which provides corporate training for Python and Data Science. He is the author of Machine Learning Pocket Reference, the bestselling Illustrated Guide to Python 3, and Learning the Pandas Library, among other books

See other products by Matthew Harrison

Theodore Petrou

Theodore Petrou

Theodore Petrou is the founder of Dunder Data, a training company dedicated to helping teach the Python data science ecosystem effectively to individuals and corporations. Read his tutorials and attempt his data science challenges at the Dunder Data website.

See other products by Theodore Petrou

Other recommended products

Related to this chapter

Mastering Exploratory Analysis with pandas

Mastering Exploratory Analysis with pandas

Exploratory data analysis exploits the visual properties of the datasets that are commonly used by data scientists. It helps you build custom data pipelines to address data analysis tasks. This book uses pandas, the most popular Python library for data analysis, and helps you build end-to-end exploratory data-analysis solutions

Sep 2018 4h 40m

Mastering Exploratory Analysis with pandas

Mastering Exploratory Analysis with pandas

Exploratory data analysis exploits the visual properties of the datasets that are commonly used by data scientists. It helps you build custom data pipelines to address data analysis tasks. This book uses pandas, the most popular Python library for data analysis, and helps you build end-to-end exploratory data-analysis solutions

Sep 2018 4h 40m

Python Data Cleaning Cookbook

Python Data Cleaning Cookbook

The book shows you how to view data from multiple perspectives, including data frame and column attributes. You will cover common and not-so-common challenges that are faced while cleaning messy data for complex situations. You will learn to manipulate data and get them down to a form that can be useful for making the right decisions.

Dec 2020 14h 32m

Python Data Cleaning Cookbook

Python Data Cleaning Cookbook

The book shows you how to view data from multiple perspectives, including data frame and column attributes. You will cover common and not-so-common challenges that are faced while cleaning messy data for complex situations. You will learn to manipulate data and get them down to a form that can be useful for making the right decisions.

Dec 2020 14h 32m

Python Data Cleaning Cookbook

Python Data Cleaning Cookbook

The book shows you how to view data from multiple perspectives, including data frame and column attributes. You will cover common and not-so-common challenges that are faced while cleaning messy data for complex situations. You will learn to manipulate data and get them down to a form that can be useful for making the right decisions.

Dec 2020 14h 32m

Python Data Cleaning Cookbook

Python Data Cleaning Cookbook

The book shows you how to view data from multiple perspectives, including data frame and column attributes. You will cover common and not-so-common challenges that are faced while cleaning messy data for complex situations. You will learn to manipulate data and get them down to a form that can be useful for making the right decisions.

Dec 2020 14h 32m

Python Data Cleaning Cookbook

Python Data Cleaning Cookbook

The book shows you how to view data from multiple perspectives, including data frame and column attributes. You will cover common and not-so-common challenges that are faced while cleaning messy data for complex situations. You will learn to manipulate data and get them down to a form that can be useful for making the right decisions.

Dec 2020 14h 32m

Python Data Cleaning Cookbook

Python Data Cleaning Cookbook

The book shows you how to view data from multiple perspectives, including data frame and column attributes. You will cover common and not-so-common challenges that are faced while cleaning messy data for complex situations. You will learn to manipulate data and get them down to a form that can be useful for making the right decisions.

Dec 2020 14h 32m

Python Data Cleaning Cookbook

Python Data Cleaning Cookbook

The book shows you how to view data from multiple perspectives, including data frame and column attributes. You will cover common and not-so-common challenges that are faced while cleaning messy data for complex situations. You will learn to manipulate data and get them down to a form that can be useful for making the right decisions.

Dec 2020 14h 32m

Python Data Cleaning Cookbook

Python Data Cleaning Cookbook

The book shows you how to view data from multiple perspectives, including data frame and column attributes. You will cover common and not-so-common challenges that are faced while cleaning messy data for complex situations. You will learn to manipulate data and get them down to a form that can be useful for making the right decisions.

Dec 2020 14h 32m

Python Data Cleaning Cookbook

Python Data Cleaning Cookbook

The book shows you how to view data from multiple perspectives, including data frame and column attributes. You will cover common and not-so-common challenges that are faced while cleaning messy data for complex situations. You will learn to manipulate data and get them down to a form that can be useful for making the right decisions.

Dec 2020 14h 32m

Python Data Cleaning Cookbook

Python Data Cleaning Cookbook

The book shows you how to view data from multiple perspectives, including data frame and column attributes. You will cover common and not-so-common challenges that are faced while cleaning messy data for complex situations. You will learn to manipulate data and get them down to a form that can be useful for making the right decisions.

Dec 2020 14h 32m

Personalised recommendations for you

Based on your interests and search pattern

Pragmatic Microservices with C# and Azure

Pragmatic Microservices with C# and Azure

This book empowers you with in-depth knowledge of microservices architecture using .NET and Azure. Through hands-on tutorials, you'll be able to build, deploy, and manage scalable applications, gaining crucial skills for modern software development.

May 2024 16h 56m

Pragmatic Microservices with C# and Azure

Pragmatic Microservices with C# and Azure

This book empowers you with in-depth knowledge of microservices architecture using .NET and Azure. Through hands-on tutorials, you'll be able to build, deploy, and manage scalable applications, gaining crucial skills for modern software development.

May 2024 16h 56m

Pragmatic Microservices with C# and Azure

Pragmatic Microservices with C# and Azure

This book empowers you with in-depth knowledge of microservices architecture using .NET and Azure. Through hands-on tutorials, you'll be able to build, deploy, and manage scalable applications, gaining crucial skills for modern software development.

May 2024 16h 56m

Pragmatic Microservices with C# and Azure

Pragmatic Microservices with C# and Azure

This book empowers you with in-depth knowledge of microservices architecture using .NET and Azure. Through hands-on tutorials, you'll be able to build, deploy, and manage scalable applications, gaining crucial skills for modern software development.

May 2024 16h 56m

Pragmatic Microservices with C# and Azure

Pragmatic Microservices with C# and Azure

This book empowers you with in-depth knowledge of microservices architecture using .NET and Azure. Through hands-on tutorials, you'll be able to build, deploy, and manage scalable applications, gaining crucial skills for modern software development.

May 2024 16h 56m

Pragmatic Microservices with C# and Azure

Pragmatic Microservices with C# and Azure

This book empowers you with in-depth knowledge of microservices architecture using .NET and Azure. Through hands-on tutorials, you'll be able to build, deploy, and manage scalable applications, gaining crucial skills for modern software development.

May 2024 16h 56m

Pragmatic Microservices with C# and Azure

Pragmatic Microservices with C# and Azure

This book empowers you with in-depth knowledge of microservices architecture using .NET and Azure. Through hands-on tutorials, you'll be able to build, deploy, and manage scalable applications, gaining crucial skills for modern software development.

May 2024 16h 56m

Pragmatic Microservices with C# and Azure

Pragmatic Microservices with C# and Azure

This book empowers you with in-depth knowledge of microservices architecture using .NET and Azure. Through hands-on tutorials, you'll be able to build, deploy, and manage scalable applications, gaining crucial skills for modern software development.

May 2024 16h 56m

Pragmatic Microservices with C# and Azure

Pragmatic Microservices with C# and Azure

This book empowers you with in-depth knowledge of microservices architecture using .NET and Azure. Through hands-on tutorials, you'll be able to build, deploy, and manage scalable applications, gaining crucial skills for modern software development.

May 2024 16h 56m

Pragmatic Microservices with C# and Azure

Pragmatic Microservices with C# and Azure

This book empowers you with in-depth knowledge of microservices architecture using .NET and Azure. Through hands-on tutorials, you'll be able to build, deploy, and manage scalable applications, gaining crucial skills for modern software development.

May 2024 16h 56m

Mastering Python Design Patterns

Mastering Python Design Patterns

Unlock the power of design patterns to build maintainable and scalable software and applications using Python. Authored by Python veterans, this book is your guide to mastering design patterns in Python.

May 2024 9h 52m

Mastering Python Design Patterns

Mastering Python Design Patterns

Unlock the power of design patterns to build maintainable and scalable software and applications using Python. Authored by Python veterans, this book is your guide to mastering design patterns in Python.

May 2024 9h 52m