Abstract:

The Internet is the greatest source of information mankind has ever created. There are various distinct materials in many formats including audio,video, text, etc. However, the data that makes up much of the internet is disorganised, making it challenging to extract and use in automated procedures. Web scraping avoided this labour-intensive manual process of organizing and extracting information, providing an easy way to collect facts and figures from web pages, transform it to a format of your choice, and store it locally. Web scraping has a wide range of uses, which includes brand monitoring, sentiment analysis and data augmentation. Many organizations use different methods to extract useful information. This research paper focuses on various web scraping tools and libraries that have been developed in recent years and are widely utilised to gather data, transform it into structured data, and utilise this organised data in word processing applications. We also discussed the issues and challenges of implementing web scraping techniques in the healthcare industry

Keywords: