Remove duplicate rows is not working for large files .. any alternative?

Hi All,

Remove duplicate rows is not working for large files, Is there any alternative for this ?

UiPath version : 2019.10.4

size of file is 25,500 kb

Hello @Mandava_Naresh

Have you tried the Remove Duplicate Row activity? If yes and not working please check the below post.

@Rahul_Unnikrishnan

I want to delete only when entire row is duplicate … the example which you gave is removing row when first column is duplicate and second column is not duplicate in same row .

can you try the below. It will make a copy of datatable without duplicates.

dataTable new_dt =
old_dt.DefaultView.ToTable(True)

Note:
Useful when we are removing duplicates with respect to every “Column”

@Rahul_Unnikrishnan is this in assign ?

yes…

dataTable new_dt is a datatable variable
old_dt is the old datatable

@Rahul_Unnikrishnan Thank you very much

1 Like

@Rahul_Unnikrishnan evn this is taking too much time and not giving result for more than 1 hour when file is 25,500 kb

Hi @Mandava_Naresh,

If you are using an old version and you think the activity is not working correctly, you can update the package.

The solution has already been shared, this is just a suggestion.

Regards,
MY

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.