I am trying to get all the followers list into an excel in a twitter account. when we click the ### Followers link, we get the list of followers which is close to few hundreds now. Future it may increase. I want to get all the followers name and handle into a list.
Tried data scraping it didnt work as there is no next page selector. We have to scroll down to get the entire list.
One more question. how do we check the end of the page has reached or not?
Please let me know if any thoights or solution
Hi @Anandhi,
check the end of the page has reached?
Please try this way.It is thought not for solution.
1 Like
Hello @Anandhi , Can use the Send hotkey activity as a page down for scroll down.
If the followers count is predictable or exctarct it previously, then by using Element Exist you can find the last follower.
For Example,
- Extract the total follower Count (example: 200)
- Use Element Exist to find the IDX 200 and pass the value in the selector as a variable for dynamic
- Use Flow decision Activity, and set Page down hotkey at the false decision, again loop to element exists and set data table extract process in True decision.
- In which, the page will scroll down until it finds the last contact. once the last contact is found, the bot starts to extract the data.