Read CSV limit

Help Studio
, ,
1

Hi - first, I know how to read csv. I am very comfortable reading csv to data table and have done so often.

My question is about the limits around the read csv activity. I have a .csv file that has 2.2 million rows (680mb)
Should i be able to use read csv activity on this file? UiPath fails to complete read of this file each attempt. I know that UiPath tables can have up to 16m rows, so what expectations should I have when reading in data from csv?

2

Technically you can, but this will invariably cause your process to spend a very long time reading in the data. CSV files are not limited by size as Excel files are.

3

Thank you Anthony. I notice that if I split the file in half, I can read it successfully. This may be an option for my process, but I’d still like to understand the limitation for future reference. If UiPath is not successful reading the full 2.2m row/680mb file is it potentially due to the processing power in my environment?

4

According to the MSDN documentation on datatables (the output datatype of Read CSV,

The maximum number of rows that a DataTable can store is 16,777,216.

From this documentation:

5

@dgreen, are you getting any error while reading CSV? If yes please share. There is other aspect as well. DataTable are in-memory object so monitor your Memory and CPU utilization while running workflow.

Cheers

6

First a pop-up windows pop up on UiPath Robot Executor:

  • UiPath Robot Executor has stopped working: A problem caused the program to stop working correctly. Windows will close the program and notify you if a solution is available.

then…

Runtime execution error - Message: Job stopped with an unexpected exit code: 0xE0434352
Exception Type: System.Exception

1 Like
7

@dgreen, have you tried step by step Debuging? I am trying to understand where exactly it is failing? During Read CSV? Did you get chance to look into Hardware limitations like Memory/CPU/IO utilization?