Hi Team,
I am trying to extract data from website with multiple pages but it’s extracting only first row of the website. remaining data is not getting extracted.
Kindly suggest the solution for this issue.
Hi @dinikokila_k
Welcome back to the UiPath community,
Please find my response below,
You can try to use extract data table with pagination this activity will help you to get your exact data
Let me know if this works for you if you like my content hit the solution button
Hello @dinikokila_k
This usually happens when pagination wasn’t set up properly in the Data Scraping wizard. A few things to check:- Please try to Re-run the Data Scraping wizard and make sure you click Yes when asked Extract data from multiple pages then correctly select the Next button/link on the page.
Try Adding a short Delay 1-2 sec after clicking Next in case the page hasn’t fully loaded before extraction continues.
I have already given yes for multiple page extraction. But its not extracting the data from 1st page itself. its extracting only first row that is 4 fields. In total first page contains 36 data. Attached screenshot for your reference.
Note - Have added delay also for page load
By Looking at your screenshot, this happens because the products are arranged in a grid layout 4 items across per row instead of a regular vertical table. UiPath’s scraper often gets confused by grid containers and stops after the first row.
Here is how to get it to grab all 36 items:
Select an item from the 2nd row when training: Delete your current extraction setup and open the extraction wizard again. Select the first product, but when it asks you to select a similar element, click the first item on the second row the 5th product instead of the item right next to it. This teaches UiPath to look downwards through the whole grid instead of just across row 1.
Remove row indexes from the selector: If you check the Target Selector or Extract Metadata in the activity properties, look for attributes like idx=‘1’, row=‘1’, or tableRow=1 Clear those numbers out or replace them with wildcards (*) so it doesn’t limit itself to the top row.
I tried the same as you told by editing the selector its not giving any data in excel
Can you please share the exact error which you’re getting?
I am not getting any error. Its not extracting any of the data
Use For Each UI Element
Drag a For Each UI Element activity into your workflow.
Indicate one of the product card containers the main box surrounding each item. UiPath will automatically detect all 36 matching product cards on the page.
Extract Details inside the Loop:
Inside the body of the loop, use Get Text activities.
Target the title, price, and item number, making sure to indicate them relative to the current item (CurrentItem).
Append to DataTable:
Use an Add Data Row activity inside the loop to push those values into a pre-created DataTable (dt_Products), then write it to Excel using Write Range.
Hi Anurita,
I resized the browser sized to 50 and did normal data scraping method and it worked for multiple page. The same code is not working again. Extraction is not happening. Any idea on this.
Thanks
Hi @dinikokila_k ,
Root issue is the page layout it’s a grid 4 products per row, not a plain table. UiPath Data Scraping wizard compares item 1 to item 2 and tries to guess the repeating pattern on a grid it usually locks onto the whole row instead of one card, so it stops after 4 items. That’s also likely why the edited selector gave nothing in Excel.
In Studio:
- Open the Staples page in your browser, press F12, click a product, and note the CSS class it shares with the others
- Add a Use Browser or Application/Browser scope around the page.
- Inside it, drag in an Inject JS Script activity search “Inject JS” in the activities panel.
- In its script field, paste:
Array.from(document.querySelectorAll(‘.product-tile’)).map(c => ({
title: c.querySelector(‘.product-title’)?.innerText.trim(),
price: c.querySelector(‘.price’)?.innerText.trim(),
item: c.querySelector(‘.item-number’)?.innerText.trim()
})) - Set the activity’s Result to a string variable, e.g. `jsonResult`, and have the script return `JSON.stringify(…)` of that array.
- Add a Deserialize JSON Array activity, input `jsonResult`, output a `JArray` variable.
- Use a For Each over that JArray, and inside it Add Data Row to `dt_Products` for each item.
- For pagination: wrap steps 3–7 in a Do While loop click the Next button, add a Delay 1-2 sec for the page to load, re-run the script, keep adding rows loop until Next is disabled/missing.
- After the loop ends, use Write Range once to push `dt_Products` to Excel.
Hi @dinikokila_k
You can use extract datatable activity there you will see option called extract from multiple pages if you enable that you will able to extract from multiple pages