What is the difference between Static & Dynamic Web Scraping?
Static HTML pages are traditional websites that store all their contents in an HTML document and present it when a request is made. In this case, the server does not need to maintain a connection since all the information will be available locally. Here, data can be scraped using tools that let you scrap data from static pages.
To make use of a dynamic website, a user has to create an account and log in. After that, the user can create events and write about them using the Markdown syntax. The list of events is then populated to the website.
The HTTP agent is ideal for recording simple interactions such as browsing a static HTML site or executing a few test scripts. For websites that require a high level of dynamic interaction and interface automation, I recommend using the Selenium C# library.
For Scraping Dynamic Web Pages Using Selenium And C# go through the following blog: