Http request activity - Wait for page complete load


I am using http request as web scraping to get the html from a web page in order to avoid web interaction, I have noticed that http request works but not as I would like to, due to the http request out put returns the html before java script finishes loading data.

How can I give a delay to http request in order to wait for the javascript finishes loading data?

This is the example of the web page:

I want to get the data without interact with the web page.

Thank you!

You may want to create a web client and get the content asynchronously. The method below will return a stream which you can send to a string using a stream reader and the readToEnd method. You can implement it using the Invoke Code activity

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.