Cannot scrap multi-pages data

Using data scraping:
Only first page data saved.
The next link was clicked but no data, also no issue was seen.
Website: 华为社招最新招聘信息-华为社会招聘

some pages dont have next button for data scrapping you can simply use while loop and extracted data you can concat

This web pages has the Next Button

我用的是现代模式,试着提取了前4页数据,可以提取的。
I am using the modern mode and tried to extract the first 4 pages of data, it can be extracted.

1 Like

once you scrap the data it will ask you does it have next page there you have to identify the next button

How to set modern mode?

Yes, I did

its working or not now ?

可以直接调整现有项目文件,修改project.json,将 “modernBehavior”: false 改为 true

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.