How to read comma separated text file having 30 lakh rows and 20 columns and add into data table for data manipulation?

[ppr (Peter Preuss)]

@sharad.bodke

I have an array. Based on the array I am going to filter it.

when array ( we assume string array) is already loaded, so we can check if we will fiter directly e.g. LINQ Where:

[HowTo] LINQ - First Start # Where Operator

This HowTo introduces how to use the Where operator. Introduction The Where operator is used for filtering. For the filtering, a condition is provided. All items matching this condition will pass the filter and will be part of the returned result. The condition has mandatory to return a boolean outcome. In other words: The result of the condition has to be True or False. Example IPO Samples Comment Values: 20,3,17,22,10,25,5 A collection of Numbers Filter Condition: x > 15 x is th…

Maybe you can share some samples

@sharad.bodke

Generate Data Table Activity but it gives error(Can not generate data table because the input file is too big or contains too many rows ).

we would suggest to explore deeper the details. Also Segmenting the data and parsing it in chunks could be an option

@sharad.bodke

ODBC but it is changing number format.

could set the numbers to string, or any other preventive action can be checked

@sharad.bodke

Read text file the write CSV and then read CSV but it gives error due to rows more than 10.48 lakhs.

can use File.Read… or using a buffered stream reading for reading the file content

@sharad.bodke

Filter the text file based in Array and keep the rows which contains the array value in first column.----but this also seems to be not possible.

as mentioned a above LINQ Where can be checked