How to validate table data based on on column response(yes/no) and delay for 5min and again validate the same table after 5 min & extract the datatable output?

Help Studio
, ,
1

Hi.
I have a table data where I need to scrape whole pages data & check if one column has yes/no response. If column has no values then get all that particular row data into a data table which has no values. Then wait for 5 minutes. Again scrape the data and get the no response list of data into a data table. Anyone suggest how to do?

2

Hi @vnsatyasunil -

  • Define variable Exception Status (string)
  • Take a while loop and define the condition as Exception Status.equals("True")
  • Within the loop, use Data Scraping, enclose in a Try Catch block, within the catch block update the Exception Status value as True and break the loop using Break Activity (will let you know why break activity used)
  • Take if condition, use the exp below
dt.AsEnumerable.All(Function(r) string.IsNullOrEmpty(r(0).ToString))
  • it gives the column has null or empty values
  • If true, then do required actions, else ignore
  • Navigate to next page using click activity
  • It goes back to the loop and repeats the process
  • If there is no data to scrape, then it throws exception, that handles by the catch block (look at point 3)
3

how to extract no values data then?

4

@vnsatyasunil - Below exp give null or empty values from data table

Variable of type DataTable DT1 = DT.AsEnumerable.Where(Function(x) String.IsNullOrEmpty(x(0).ToString)).CopyToDataTable
  • DT is the data scraping activity output
5

Hi @vnsatyasunil

Can you try this-

  1. Use the “Data Scraping” wizard to extract the data from the table on the web page. This will generate a data table with all the rows and columns.
  2. Use a “For Each Row” loop activity to iterate over each row in the data table.
  3. Use an “If” activity to check the value in the column that has the Yes/No response. If the column value is empty, add the row data to a new data table.
  4. Use the “Delay” activity to wait for 5 minutes.
  5. Repeat steps 1-4 to scrape the updated table data after 5 minutes, and extract the rows with no values in the column with Yes/No response.

Thanks!

6

I tried this already. How to add the row data to a new data table, if the column value is empty?
In delay activity how we can give delay for 5 minutes without hardcoded value?
for eg by using expressions without hh:mm:ss format.Can you help please?

7

You can put all the values in the Config file and then pull the data from there in your process.

8

Thanks. Any idea about delay activity?

9

@vnsatyasunil

Follow the steps

  1. Use a while loop with conditionas true and for safety include max iteration values as 50 or so
  2. Inside that use extract datatable to extract the table data
  3. Use filter datatable activity and filter the required column with No
  4. Use if condition and check filtereddt.Rowcount>0 and on then side use delay…and on else side can use break as I guess you need not check again if there are no rows with no

Hope this helps

Cheers

10

@vnsatyasunil - Check the below link

11

Can we repeat data scraping activity by giving delay for 5 min in retry scope activity?

12

Data table consists data of 4 columns (name, course, fees, paid status). We have to check paid status column is having no value or not? If no value is there, then we have to copy that row no data information to a text file. Can anyone please help?

Is this the correct way to handle this?

extraction

13

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.