Remove Dublicate Rows based on a column

[Karam_Abulawii]

Hi
I’m a beginner in UiPath and i’m trying to solve this task
I’m trying to remove duplicate rows from an excel sheet based on particular column,
if two rows is duplicated then i have to keep the newest row based on “Transaction time” column,

" * Remove duplicate based on the “Main Transaction” column, the priority is based on the “Start Transaction Time” column. keep the newer transactions."

I need help i cant find a solution
Regards.

[ppr (Peter Preuss)]

@Karam_Abulawii
Welcome to the forum

In general we would do it by a groupBy and grouped by 1 col
From the received members we would calculate which one to keep /remove

For GroupBy have a look here:

[HowTo] Overview on different options for grouping data and processing the groups

This HowTo introduces on the different options for grouping data from a datatable in order to process the grouped data. Introduction Grouping data and processing the grouped data is a common scenario e.g. when the grouped data is to aggregate like summing up, find maximum, get the average or concatening items. Lets have a look on following data: [grafik] A possible scenario could be: Create a report containing following information: the region code the sum of CaseCount per RegionCode t…

With some samples provided from your side we can also give more individually help if it is needed

[Karam_Abulawii]

Company_1.xlsx (31.4 KB)
in this excel sheet i need to remove duplicate rows
we can recognize the duplicates by “Main Transaction” column,
the priority is based on the “Start Transaction Time” column we need to keep the newer transactions.

[ppr (Peter Preuss)]

give a try on following

Assign Activity
Leftside: dtResult | DataType: DataTable
Right side:

(From d in YourDataTableVar.AsEnumerable
Group d by k=d("Main Transaction").ToString.Trim into grp=Group
Let go = grp.OrderBy(Function (x) CDate(x("Start Transaction Time").toString.Trim))
Select r=go.Last()).CopyToDataTable

[Karam_Abulawii]

sorry it didn’t work with me
can you please provide a .xaml file that can do hte job so i can see it ?
Thanks in advance for the help

[ppr (Peter Preuss)]

@Karam_Abulawii

sorry it didn’t work with me

Here we prefer allways details. What was done? What is not working. Maybe you can share some screenshots from the omplementation details or your XAML with us

[Karam_Abulawii]

Here’s what’s Happening

[Karam_Abulawii]

sorry but Can you please elaborate it more

[ppr (Peter Preuss)]

@Karam_Abulawii
We would suggest to do the line breaks of the statement as done in example from above
Give another more clear name to variable instead of BuildDataTable
Please show us the variable panel and settings of the origin datatable

Also ensure following:
Group d by k=d(“Main Transaction”).ToString.Trim into grp=Group

ToString instead of String

[AshwinS2 (Ashwin S)]

Hi @Karam_Abulawii

Can you try this linq query with datarow

IEnumerable<DataRow> Transaction =
    table.AsEnumerable().Distinct(DataRowComparer.Default)

And loop it through for each item

Thanks
Ashwin.S

[Dawodm (Mahmoud Dawod)]

@Karam_Abulawii

m a beginner in UiPath and i’m trying to solve this task
I’m trying to remove duplicate rows from an excel sheet based on particular column,
if two rows is duplicated then i have to keep the newest row based on “Transaction time” column,

" * Remove duplicate based on the “Main Transaction” column, the priority is based on the “Start Transaction Time” column. keep the newer transactions."

Hi @Karam_Abulawii

here some videos how to remove duplicates with different methods.
Link 1: https://www.youtube.com/watch?v=w4Pk2AA1lHY
Link 2: https://www.youtube.com/watch?v=3jzVZOEzYI4

Best regards
Mahmoud