Read Huge Csv file

Learning Initatives Naan Mudhalvan Program
1

I want to read a large csv file that is approximately 1GB in size. I’m getting an issue when I try to use the read csv activity. can anyone give me the suggestion for that?

2
  1. You can use the Read CSV activity with by setting the chunk size property in the read csv activity.
  2. Use the Read Text File activity to read the CSV file as a text file. Then, split the text into chunks using the String Manipulation activities, such as Substring or Split.
1 Like
3

@Anish_Kumar2

You can try to use VB or C# code to read your CSV file since it’s large in size, here’s a link that’ll help you:

You can also try out the approach given by @Pallavi_Shirodkar1!

4

HI @Anish_Kumar2

Check out this video link

Thread : Issue while reading large CSV file

Regards
Gokul

5

Hey @Anish_Kumar2 ,

Kindly refer below Thread

Hope it helps you out!

1 Like