Check For Duplicate Row On DT And Mark All The Duplicate With "Duplicate Data"

[Hendaryie_Tjoeng]

Hi, I want to search for duplicate row on my excel, based on multiple column(by all the column except last column). After that I want to marked the row with flag “Duplicate Data” on all duplicate row. I try using 2 DT and loop using for each row, but I wanna know if there any other way to do that more fast and efficient. This is the example of data and expected result. Thank you and have a nice day!
TestData.xlsx (9.5 KB)

[Anil_G]

Hi @Hendaryie_Tjoeng

Please check this… you can modify as per your requirement

How to get duplicate rows for specific column in a datatable

HI @Sunitha_Bist1, Duplicate records from the same data table (From p in dt.Select() where( From q in dt.Select() where string.Join(",",q.ItemArray).Equals(string.Join(",",p.ItemArray)) Select q).ToArray.Count>1 Select p).ToArray.CopyToDataTable() Try this one If you want specific Column alone mention the column name (From p in dt.Select() where( From q in dt.Select() where q("ColumnName").Equals(p("ColumnName")) Select q).ToArray.Count>1 Select p).ToArray.CopyToDataTable() Regards, Arivu …

Getting List of Duplicate Rows with Unique Multiple Columns - LINQ

give a try at: (From d in dtData.AsEnumerable Let sk = String.Join(“_”,{“UID”,“Name”,“Gender”,“Age”}.Select(Function (x) d(x).toString.Trim)) Group d by k=sk into grp = Group Where grp.Count > 1 From g in grp Order by dtData.Rows.IndexOf(g) Select r=g).CopyToDataTable

I hope this is what you are looking for

Cheers

[Hendaryie_Tjoeng]

Thanks for the reply! I will try it

[Gokul001 (Gokul Balaji)]

Hi @Hendaryie_Tjoeng

How about this expression

(From d In DtInput
Group d By k=d(1).toString.Trim Into grp=Group
Where grp.Count >1
Select grp.toList).SelectMany(Function (x) x).CopyToDatatable

Check out this XAML file

DuplicateData.xaml (11.1 KB)

Output

Regards
Gokul

[Hendaryie_Tjoeng]

Thanks for the reply! I’am trying to open the xaml file but unfortunately my version of packages is different, so now I try to update some of the packages. Can you screenshot the flow more close? bcs the ss cannot be zoom

[Gokul001 (Gokul Balaji)]

Hi @Hendaryie_Tjoeng

Check out this Screenshot

Regards
Gokul

[Hendaryie_Tjoeng]

@Gokul001

(From d In DtInput
Group d By k=d(1).toString.Trim Into grp=Group
Where grp.Count >1
Select grp.toList).SelectMany(Function (x) x).CopyToDatatable

Thank you very much, thats work nicely, thanks for the effort of screenshoting the flow too, have a nice day!