Web Scrapping Tools and Techniques: A Brief Survey

Abstract

Web scraping can be done using many languages such as C++, Java, JavaScript, PhP, Python, Ruby, etc. Among them, Python stands to be the most powerful language with lots of inbuilt libraries that supports web scraping, extensive support for third-party open-source libraries, and higher speeds compared to other languages. Python libraries for web scraping are designed for fast and highly accurate data extraction. There are many libraries available for web scraping and the developer can choose the respective library in accordance with their scraping application. This paper focuses on the study of several web scraping tools and techniques and analyze the performance of those tools and present the statistical significance of the results.