Yes, I tried both browsers (IE and Chrome) and yes, I can do a simple scraping from ebay.com. But for what ever reason this one from LinkedIn does not work, though it seems pretty simple.
But several problems:
it doesnt fetch the data
it doesnt traverse the pages
Am beginning to wonder, if LinkedIn actually has done something to actively prevent data scraping.
Hi,
Not sure why you guys facing this issue.
What version your using.
Please update package if available.(Irrelevant though )
Which browser your using.
Please try to change browser chrome\IE.
Is data scraping works fine for other site (eg: amazon,Ebay…etc.
Yes, as written above, I have tried both browsers and am able to scrape from other sites, but not LinkedIn.
I cannot upload, since my status is (still) Rookie, but If you have an example, please feel to share. Would be highly appreciated.
I’ve done the scraping on the Jobs page in Linkedin in Chrome browser and it works fine.
Indicated the first element to scrape
Indicated the last one
Click on “See more jobs” button to scrape even more results
After the scraping i used Write CSV activity to check the results and also a Message box to display the count of the rows in the outputted datatable.
The results are correct.
I’ve also faced the same issue and I think the problem is that the webpage in linkedin isn’t loaded at the beginning, you have to scroll down to load all page items (results) and buttons in the bottom.
Here is what I made to solve the issue:
1- I zoomed out the page to make all result showed without scrolling down.
2- or you can scroll down before you scrip the data.
these solutions made me scrap data from linkedin,
hope I helped you.
Thanks.
Someone, please explain the logic behind the need for zooming out.
Afterall, it is still the same HTML behind the page so why does the zooming/rendering matter?
Hey @AhmadSallam thanks for revert, I tired many wasys , it dint happen , as far as I know and zoom in and out should not impact as it is on web page. may be some issue in table structure as first were actual data given is starting from third row before that 1 row is for header 1 row is blank.
I too have this issue. Tried both IE & Chrome. Can get data if I do not use next page option. If tried to get data from more than one page, no output…no error!
hi
I also have same issue. Even tried @ovi flow in my uipath, that also does not work for me. Any other issue you can think of ? Is it a problem with community edition ? I tried scraping with ebay and that worked fine.
Apologies , should have written about flow a bit.
So I am trying to scrap linkedin, scrappng is part of a flow as below
I open browser with linkedin.com which land me to my feed page.
I search recruiter in search box and hit enter
i apply filter to search particular country and hit apply
the page which i have now is where i am doing scrapping, i have list of people with recruiter mentioned in there profile
trying to get name and link of the profile of each person and saving it to dataTable using deata scrapping , datatable inturn is gettign written to csv
it works find till step3 but for data scrapping i dont get any error nor do i get any data in csv file.I hope that explain what i am tryign to achieve.
)
