Technical requirements

The code for this chapter is located in a folder named Chapter05 in the GitHub repository of the book (https://github.com/PacktPublishing/Python-Natural-Language-Processing-Cookbook). In this chapter, you will need to install some additional packages using these commands:

pip install pandas
pip install python-Levenshtein
pip install spacy
pip install nltk
pip install textblob
pip install tqdm
pip install transformers

We will also need an additional package to segment Twitter hashtags, which can be downloaded at https://github.com/jchook/wordseg. After downloading, install it using this command:

python setup.py install