Data Scraping from Make my Trip

Help
, , ,
1

Hello…

I want to create a project using Make My Trip site. Currently i am just doing data scraping from this website. The issue is on this site there is no next page button. When we scroll the data continuously load on the screen. How to resolve this issue. It will be a great help.

Thanks

2

@Rachana_Chotaliya

Don’t indicate any next page navigator and keep max no. of records as 0 and run it see whether it is scraping full data or not.

3

Thanks for your reply…

It worked but send hotkey(end)value takes me to one scroll down, I want till the data stop loading.

2 Likes
4

Maybe try something with Retry Scope.
If there is some element or image that appears when the data is all scrolled down, use Send Hotkey in Retry Scope, and put that element/image as condition to continue sending hotkeys :slight_smile: