How to scroll LinkedIn Page during data scraping time?

I have used Data Scraping method to scrape data present in first 4 pages(from LinkedIn) but it isn’t working. Every time I would have to scroll down manually to load the data in the current page . What am I suppose to do in this scenario, How can I go to the end of the page by scrolling?
Can we use parallel activity for use both(data scraping and hotkey for scroll down)?

@Ankit_Chauhan,

Use Mouse Scroll activity to scroll till the end and then Use Table Extraction. You don’t need to do scrolling and extraction at the same time.

image

Thanks,
Ashok :slight_smile:

And for the first 4 pages, you can use the URL to navigate to the next pages. As far as I know, the URL remains the same for each page and the page number at the end of the URL keeps changing. So a variable and Go To URL activity will help you.

Thank you so much for helping, but it’s hard to know the no of scrolls on any pages, I have added 500 scrolls and then BOT extracted almost 24+ rows from LinkedIn page in data table, but it’s working, thank you again.

image

@Ankit_Chauhan,

You may check for some Ui Element which will be end of the result or posts. If you get that Ui Element, the use Scroll Type To element.

Thanks,
Ashok :slight_smile:

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.