Find Duplicate values

Learning Initatives Automation Starter
1

one bot getting a data from database in a daily basis every hour it’s running in the first hour it will take 10 records it will process. In 2nd hour it will take 20 record, which is already processed 10 records added here.
Like whole day it will run I don’t want to send duplicates what we have to do here?

2

@Sathish_goud_Bhurewar Please follow these steps.
1-please maintain previous processed records in excel file.
2- when you are runing bot in 2nd time and getting data from database, please join previous record and with new record. get only unique values.
3- after processed unique data maintain previous record as well.

Thanks

3

Hi @Sathish_goud_Bhurewar, I hope you are doing well.
I am assuming you will get the records in a datatable so, after you get the first 10 records save it in datatable named dt now second time again when you get 20 records save it in same datatable dt and after that perform remove duplicate rows activity for the same datatble dt.

This you can put in a loop.

Thanks & Regards,
Shubham Dutta

4

Hi @Sathish_goud_Bhurewar

How about this expression ?

FYI, It will keep only the unique value

(From p in DT.Select() where( From q in DT.Select() where q("Column name").Equals(p("Column Name")) Select q).ToArray.Count=1 Select p).ToArray.CopyToDataTable()

Regards
Gokul