How to remove unique values from text file and get only duplicate value list?

[vidya.wagh]

How to remove unique values from text file and get only duplicate value list?

[Jithesh_R]

@vidya.wagh ,
Can you provide us the input file if possible?

[vidya.wagh]

New Text Document.txt (441 Bytes)

[Chirag_Shetty_Divakar (Chirag Shetty)]

Hey @vidya.wagh

Is this what you want

Regards,

[arjunshenoy]

Hi @vidya.wagh

You can use the following approach:

Flow:

Query:

(From row In textDataTable.AsEnumerable()
Select name = row(0).ToString().Trim()
Distinct).ToArray()

Output:

Hope this helps,
Best Regards.

[ppr (Peter)]

@vidya.wagh

get only duplicate value list?

One of many options:

getting the duplicates:

getting the non duplicates:

[ppr (Peter)]

@ppr

getting the duplicates:

In Addition to above, getting all duplicated values but only 1 time:

Also have a look at this report dict:

[vidya.wagh]

thanks for your response. even I have got this output but what i want is to delete unique values also.

[vidya.wagh]

your 1st image is what i want. can you share me the workflow please.

[ppr (Peter)]

was done in immediate panel
Understanding the 6 Debugging Panels of UiPath in the easiest way possible! - News / Tutorials - UiPath Community Forum

Assign Activity:
myFilePath = YourFullFilepathTo The TextFile

Assign Activity:
arrDups | String Array =

File.ReadAllLines(myFilePath).GroupBy(Function (x) x).Where(Function (g) g.count > 1).SelectMany(Function (v) v).toarray

[vidya.wagh]

can you please elaborate it more and write all the records in the text file.

[ppr (Peter)]

@vidya.wagh

can you please elaborate it more

@ppr

Assign Activity:
myFilePath = YourFullFilepathTo The TextFile

@ppr

Assign Activity:
arrDups | String Array =

File.ReadAllLines(myFilePath).GroupBy(Function (x) x).Where(Function (g) g.count > 1).SelectMany(Function

Variable:

Writing back to a file:

String.Join(Environment.NewLine, arrDups)

[vidya.wagh]

“String.Join(Environment.NewLine, arrDups)” this is writing all the records. only want duplicate list with single record.

[ppr (Peter)]

then use other statement

File.ReadAllLines(myFilePath).GroupBy(Function (x) x).Where(Function (g) g.count > 1).SelectMany(Function (v) v).Distinct().toarray

[vidya.wagh]

Thank you so much for help.

[vidya.wagh]

can i apply same logic for 10-100 million records? because it not giving me correct result.

[mwaseemqadirmail (Richard Green)]

I recently stumbled upon DuplicateFilesDeleter and it’s been a game-changer for me. It’s incredibly user-friendly and does the job it promises to do. If you’re tired of sifting through duplicate files on your computer, this program is definitely worth checking out.

[mwaseemqadirmail (Richard Green)]

If you’re looking for a reliable way to clean up your computer and free up space, I highly recommend DuplicateFilesDeleter. It’s a powerful program that quickly identifies and deletes duplicate files, saving you time and hassle. Try it out today and see for yourself how much easier it makes managing your digital files.