Web scraping not fetching all data from the page

Hi All,

I am trying to fetch Job data from LinkedIn site.

But only 8 records are fetched from the page having 25 records.

Preview data wizard after selecting the second element shows all the 25 records but when i run it, only 8 records are fetched. I tried several ways to form the pattern.

selected 1st record, last record
selected 1st record. second record
selected 9th record, tenth record.

<column exact='1' name='Column1' attr='text'>
	<webctrl tag='div' idx='1'/>
	<webctrl tag='ul' class='jobs-search-results__list artdeco-list' idx='1'/>
	<webctrl tag='li' class='occludable-update artdeco-list__item--offset-4 artdeco-list__item p0 ember-view'/>
	<webctrl tag='div'/>
	<webctrl tag='artdeco-entity-lockup' class='artdeco-entity-lockup--size-4 artdeco-entity-lockup ember-view' idx='1'/>
	<webctrl tag='artdeco-entity-lockup-content' class='job-card-search__content-wrapper artdeco-entity-lockup__content ember-view' idx='1'/>
	<webctrl tag='h3' class='job-card-search__title artdeco-entity-lockup__title ember-view' idx='1'/>
</column>

Link: Login into LinkedIn → to go Jobs page → Search for ‘Data science’ and ‘United Kingdom’ → I am trying to search this page.

Could you please help me here?

1 Like

Hi @Dark_matter

I tried its working fine for me
check With your workflow mainly check with your maximum number
If its not working send me your work flow

Regards,
Gulshiyaa

Hi Gulshiyaa,

Maximum number is set to 100.

I am in office right now. Will share the workflow by IST evening.

Thanking you,
Dark_matter

ok @Dark_matter

Main.xaml (11.3 KB)

Attachced is the XAML… Today it is not even fetching any data now.

Could you please help me with it?

Thanking you,
Dark_matter

Trying.xls (539 Bytes)

Main.xaml (12.6 KB)

PFA, This is the latest i build up…
It is fetching only 14 records instead of 25 records.

Thanking you,
Dark_Matter