I would like to skip the duplicate records in the database because I occasionally receive duplicate records from the five separate excel files that I receive. I have attached the results from database..number 4&7 are duplicates from different files…Please assist…thank you [image]

@pabaleloh , You can use remove duplicate rows activity to remove duplicate rows. [image] Remove duplicate Rows from Datatable Help @Pravin_Shinde [image] just for your reference . -Ahtesham

If you look at the screenshot there are no actual duplicate rows, the timestamps are different as are the last two columns for rows 4 and 7. @pabaleloh just search the forums and you’ll find how to remove duplicate values from a datatable.

@pabaleloh use like this..as I see onlu the number before time stamp is common dt.AsEnumerable.GroupBy(function(x) x(0).ToString.Trim.Split(" "c).First).Select(function(x) x.First).CopyToDataTable cheers

Which one you want to retain 4 or 7 ? Because the other columns have different values. Is that okay to loose those values ?

Hi @pabaleloh , you can go with @Anil_G or use below syntax to remove the duplicate values in the table. (From p in dt.Select() where(From q in dt.Select() where Convert.ToString(q("ColumnName")).Contains(Convert.ToString(p("ColumnName")).Split(" "c)(0).ToString()) Select q).ToArray.Count>1 Select…

Hey @pabaleloh can you try below expression to remove duplicate rows dtSheet.AsEnumerable().GroupBy(Function(x) x.Field(Of String)("Col ")).Select(Function(y) y.First()).CopyToDataTable()

Skip duplicates from database

Help Studio

ashokkarale (Ashok Karale) March 25, 2025, 4:46pm 2

@pabaleloh,

You can use remove duplicate rows activity to remove duplicate rows.

Topic		Replies	Views
How to remove duplicate Studio datatable , excel , uiautomation , activities , studio , duplicate , question , activities_panel , filter , duplicates	10	88	November 4, 2025
Need to remove complete row if duplicate find in the specific column Studio studio , question , activities_panel	5	178	February 20, 2024
REmove duplicates from datatable excel Help datatable , activities , question	13	2727	November 14, 2019
Is there an efficient way to get all the duplicate rows from the Datatable and then delete them without using for each? Studio datatable , activities , studio , question	7	1644	November 21, 2021
Remove Duplicated Rows using 2 columns Activities excel , activities , question	4	1451	August 6, 2021

Skip duplicates from database

Related topics