REmove duplicates from datatable excel

[CamiCat]

Hello friends,
@AshwinS2 , @arivu96, @Rammohan91, @balupad14, @Florent_Salendres, @vvaidya, @Palaniyappan, @loginerror, @MAHESH1, @Manjuts90

how ot rmeove duplicates from a datatable read from an Excel file?
I tried with REmove duplicates but doesn’t work.
Cami

[Palaniyappan (Forum Leader)]

kindly try with remove duplicate rows activity
or
we can use this expression
dt = dt.Asenumberable().Group(Function(a) a.Field(of string)(“yourcolumnname”).ToString).Select(Functions(b) b.First()).CopyToDatatable()
Cheers @CamiCat

[william.coulson (Will Coulson)]

Hey @CamiCat,

I had a similar issue, have a look through some of the replies to one of my posts.

Deleting an Excel Data Row if it contains the same specific data

Hello, I am having a little trouble with a process I’m developing. I need to take a user ID, name and email from a spreadsheet, and email the user. If a user ID is the same as the previous, the item in the spreadsheet needs to be removed. For example, [Excel_Example] The row in red shows the same user ID as the one above it, so the row in red needs to be removed. How would I go about doing this? I am completely stuck, so any input would be helpful. Thanks in advance!

If you have any questions, feel free to ask

[CamiCat]

@Palaniyappan

dt = dt.Asenumberable().Group(Function(a) a.Field(of string)(“yourcolumnname”).ToString).Select(Functions(b) b.First()).CopyToDatatable()

Thank you so much @Palaniyappan.
For the second option how in case of multiple Columns to insert as columnname?
Thank you,
Cami

[Palaniyappan (Forum Leader)]

but for this case REMOVE DUPLICATE ROWS will work actually
where you facing any issue in that
Cheers @CamiCat

[CamiCat]

When I write it back in excel it appends the row continuosly so doesn’t cancel the duplicates.
Cami

[Palaniyappan (Forum Leader)]

can i have that excel sample if possible
Cheers @CamiCat

[CamiCat]

Indice_13-11-2019.xlsx (8.6 KB)
This one
Can you please help me?
Cami

[Palaniyappan (Forum Leader)]

here you go
if this is not the excel you want
kindly share the output excel you want
cami.zip (16.3 KB)

Cheers @CamiCat

[AshwinS2 (Ashwin S)]

Hi @CamiCat

Try this query

(From p in dt.Select() where( From q in dt.Select() where string.Join(",",q.ItemArray).Equals(string.Join(",",p.ItemArray)) Select q).ToArray.Count>1 Select p).ToArray.CopyToDataTable()

Duplicate records from the same data

And then use remove duplicate rows

Thanks
Ashwin.S

[CamiCat]

Thank you,

I would like only one row at the end, if at the beginning there are multiple.
Cami

[balupad14 (Balamurugan)]

Hi @CamiCat,

To remove duplicate from excel you can use this one . I don’t know if it is useful or not…

Remove duplicate from excel

@ArafatRakib1, I have done some changes in the code. File : Duplicate.zip (7.5 KB) [image] Regards Balamurugan

Regards
Balamurugan,S

[CamiCat]

Thank you @Palaniyappan.

I would like to have file with no rows duplicated.
With your workflow the excel file, in case of 4 identical rows, maintains them at the end.
How to have a file ith no duplicates, but only one row?
Cami

[Palaniyappan (Forum Leader)]

Usually duplicates in excel will be searched along each rows in it
So to group them we can take a common column, a primary column based on that we can group them
Is there any column of such kind

Cheers @CamiCat