How to extract all table data from multiple pages when there is no next page button, only Page nos are present like 1 2 3 4 5 6 ...n

i want to fetch all the entries from this table
for that i am using http request but it is not giving me correct results


i want this to give me source code so that i can fetch the details from regx expression

1 Like

@Harshita_Chhabra

Check in the url if there is a number present you can change that in loop and can extract each page and merge tehm

Cheers

1 Like

i have to fetch data from 100 pages so should i use table extraction and run loop 100 times i did that but that is giving me some duplicate results

1 Like

@Harshita_Chhabra

What are you getting duplicate?

If the smae page is coming twice then may be it can duplicate or due to ltency it can get same page twice so wait for new page to load and then extract

Cheers

1 Like

okay i have tried putting delay but it is too slow to fetch data from 100 pages using a loop

1 Like

@Harshita_Chhabra

If it is 100 pages with ui …obviously it would be slow…

Instead of delay you can use wqit for load complete which can increase the speed a little

Cheers

1 Like

So there is no other way to do it instead of loops

1 Like

@Harshita_Chhabra

Looking at the page it seems its using javascript to populate the data so we need to go through ui only…so loops would be your way

Cheers

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.