The Filter Wizard of Filter Data Table activity doesn't work

Hi,

I used data Scraping wizard to read values from a table which has age column.Then I wanted to find the records where Age>60. So I used the following filter but since may be because when data scraping, we dont define the data type of the Age column, the resulting table(dt_Result) doesn’t have any records when I have records where Age>60 in the dt_Data input table.
Am I doing something wrong or I cant use Filter wizard to achieve this?

@Asiri

Try this expression once.

dt_Result = dt_Data.Select(“Age > ‘60’”).CopyToDataTable

@Asiri
try this.i got the wanted result

Assign NewTable = CurrentTable.Select(“Convert([Age],‘System.Int32’)>60”).CopyToDataTable.

Hi @Asiri
Please write the value as 60.00 and try.

please ensure the column name in proper Case

Hi @Asiri
i created a data table and i tried to get the age values whose are greater than 60 by using Filter Data Table activity and its working perfectly. So, kindly check the column name and please check in debug mode, i am sure you will find out the reason…

Thank You
KumarMain.xaml (6.4 KB) New Microsoft Excel Worksheet.xlsx (9.3 KB) project.json (887 Bytes)

Hi, Is there a limitation on # of rows and columns for Filter wizard to work? I have a table with 38 columns and 190 rows of data. and simple filter is not working. Is there some limitation? could you please let me know.
Thanks,
V

Hi, @Vidya_Lingappa Good Morning,
There is no limitation like that because, i tried with DataTable which contains 564 rows and i didn’t face any problem, i mean its working perfectly…

Thanks

Kumar

Hi @KumarD, Thank you for confirming. The column headings have spaces…Issue Color Status. All columns are defined like this. is this a problem and thats the reason my data table filter not working?

Hi @Vidya_Lingappa Good Morning,
Can you please send me a screen Shoot then i may better understand your problem…

Thanks

HI @KumarD, my whole table the column headings have spaces. Should I first remove them?

I used data Scraping wizard

I’m going to bet this is the issue. If you don’t build your datatable previously, data scraping activities tend to read everything as a String, hence why you can’t use numerical comparisons.

Basically, try using Build Datatable right before you scrape it, set the columns (and their data types) accordingly.

1 Like

Hi @Vidya_Lingappa Good Morning,
I don’t think you need to remove the spaces, if you didn’t remove the spaces also it will work. Here, spaces doesn’t matter…!
screen%20shoot|690x13

ThankQ

@KumarD, Thanks for confirming. It started working. I have another requirement where in a column date is in the format Jan-12-1998 and I have to compare it with Today(). Which is the best way? Do I need to first convert this date? Could you please help?
Thanks,
V

Hi @Kumar, MY filter table has these 3 options:
image
when I run my script, I am getting the error:
image

I tried several ways, but unable to resolve it. Could you please help?
Thanks,
V

@kumarD, Could you please help me with the issue I sent along with the screenshot of the filter table as mentioned above. I am in urgent need to resolve the issue.
Thanks,
Vidya