In this chapter, we have learned how to write scraping script using the RSelenium library. First, we worked on how to use selenium drivers on R and then we worked on how to use XPath rules with the RSelenium package. Afterward, we wrote our first web-scraping script using the RSelenium library to collect the user who commented to the specific post and who is mentioned in the comments to the specific post. Then we tried to send a click event and. Finally, we used Regex rules to extract the information that we were interested in.
In the next chapter, we will talk about the fundamentals of cron jobs and databases. At the end of the next chapter, we will be writing our creating cron job to schedule our web-scraping task and learn how to store collected data on databases.
