i want to extract comments from amazon.in website. i did a workflow which will extract all reviews from amazon and insert the comments in database.
i did data scraping and extract title,posted_by,post_date,rating,review. and one add data column of product_id.
this is my result output.
but everyday all comments extraction using data scraping is time taking process.so i want to extract only new comments which are not present in data base. how can i do this?
or which will be the best approach to extract new comments?