Getting typeerror when trying to data scrape

Help Studio
1

I’m trying to pull data from a website and keep gettin the error “circular reference in value argument not supported”. Any ideas why this is happening and how to fix it?

2

Check this link and see if this applies to your data somehow.

How are you doing the datascraping?
may need to split the datascraping like do certain columns at a time

3

I’m not sure what you mean. I was just using the datascraping button. Any time i click on anything on the webpage it gives me the circular reference error.

4

Is it just that webpage? Is it publicly accessible for us to look at?

5

yes it’s just usaspending.gov and im using the advanced search tool to look over companies.

6

Is this the table?
If so i was able to extract it column by column. Using chrome btw

image
image1464×737 79.2 KB

image

7

oh awesome! I didn’t know you could do that. could you upload a screen shot of your work flow?

8

this is also my first time using the datascraping…how do i extract column by column?

9

I’ll try uploading this video, let’s hope it lets me

10

However, it seems like you need to scroll down for it to refresh more data. That might get complicated.
There is a download button on the top which probably lets you export the results. You can try that as well.

11

thank you!! I will try this. Not sure why it didn’t work for me the first time.

12

i am still getting the same error for some reason. Does your default browser open to chrome or internet explorer from UiPath? I tried to use chrome and it would not work for me again.

13

I just used chrome for testing. I just tried scraping on IE but got the same error as you.
I believe that’s just a bug in the activity maybe.

However, the workaround is to just move the Extract Structured Data activity under an attach browser for IE and it should work still.

Copy the following and paste it in your workflow sequence. It’s what i have.

<?xml version="1.0" encoding="utf-16"?><ClipboardData Version="1.0" xmlns="http://schemas.microsoft.com/netfx/2009/xaml/activities/presentation" xmlns:p="http://schemas.microsoft.com/netfx/2009/xaml/activities" xmlns:sap2010="http://schemas.microsoft.com/netfx/2010/xaml/activities/presentation" xmlns:scg="clr-namespace:System.Collections.Generic;assembly=mscorlib" xmlns:ui="http://schemas.uipath.com/workflow/activities" xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml"><ClipboardData.Data><scg:List x:TypeArguments="x:Object" Capacity="1"><ui:BrowserScope Browser="{x:Null}" SearchScope="{x:Null}" TimeoutMS="{x:Null}" UiBrowser="{x:Null}" x:Name="__ReferenceID0" BrowserType="IE" DisplayName="Attach Browser 'iexplore.exe Federal'" VirtualizedContainerService.HintSize="554,22" InformativeScreenshot="160d011ac02c448b6f23908959f7e658" Selector="&lt;html title='Federal Awards | Advanced Search | USAspending' /&gt;"><ui:BrowserScope.Body><p:ActivityAction x:TypeArguments="x:Object"><p:ActivityAction.Argument><p:DelegateInArgument x:TypeArguments="x:Object" Name="ContextTarget" /></p:ActivityAction.Argument><p:Sequence DisplayName="Do" VirtualizedContainerService.HintSize="376,198"><WorkflowViewStateService.ViewState><scg:Dictionary x:TypeArguments="x:String, x:Object"><x:Boolean x:Key="IsExpanded">True</x:Boolean></scg:Dictionary></WorkflowViewStateService.ViewState><ui:ExtractData DelayBetweenPagesMS="{x:Null}" NextLinkSelector="{x:Null}" ContinueOnError="True" DataTable="[ExtractDataTable]" DisplayName="Extract Structured Data 'DIV'" ExtractMetadata="&lt;extract&gt;&lt;row exact='1'&gt;&lt;webctrl tag='div' /&gt;&lt;/row&gt;&lt;column exact='1' name='Award ID' attr='text'&gt;&lt;webctrl tag='div' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;webctrl tag='a' idx='1' /&gt;&lt;/column&gt;&lt;column exact='1' name='Recipient' attr='text'&gt;&lt;webctrl tag='div' /&gt;&lt;webctrl tag='div' idx='2' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;webctrl tag='a' idx='1' /&gt;&lt;/column&gt;&lt;column exact='1' name='Amount' attr='text'&gt;&lt;webctrl tag='div' /&gt;&lt;webctrl tag='div' idx='5' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;/column&gt;&lt;/extract&gt;" VirtualizedContainerService.HintSize="334,106" MaxNumberOfResults="0" SimulateClick="True"><ui:ExtractData.Target><ui:Target ClippingRegion="{x:Null}" Element="{x:Null}" Id="3df7e784-fed2-461e-9af8-6dcb6550e468" InformativeScreenshot="071e13fefa7995c472026dab2d0dfa1b" Selector="&lt;webctrl aria-role='presentation' css-selector='body&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div' parentid='results-section-table' tag='DIV' /&gt;" WaitForReady="COMPLETE"><ui:Target.TimeoutMS><p:InArgument x:TypeArguments="x:Int32" /></ui:Target.TimeoutMS></ui:Target></ui:ExtractData.Target></ui:ExtractData></p:Sequence></p:ActivityAction></ui:BrowserScope.Body><WorkflowViewStateService.ViewState><scg:Dictionary x:TypeArguments="x:String, x:Object"><x:Boolean x:Key="IsExpanded">False</x:Boolean><x:Boolean x:Key="IsPinned">False</x:Boolean></scg:Dictionary></WorkflowViewStateService.ViewState></ui:BrowserScope></scg:List></ClipboardData.Data><ClipboardData.Metadata><scg:List x:TypeArguments="x:Object" Capacity="4"><scg:List x:TypeArguments="x:Object" Capacity="4"><x:Reference>__ReferenceID0</x:Reference></scg:List></scg:List></ClipboardData.Metadata></ClipboardData>
14

I finally figured it out thank you!! I am looking for more help with another task on this. I put up another question up if you have any ideas!

15 
<?xml version="1.0" encoding="utf-16"?><ClipboardData Version="1.0" xmlns="http://schemas.microsoft.com/netfx/2009/xaml/activities/presentation" xmlns:p="http://schemas.microsoft.com/netfx/2009/xaml/activities" xmlns:sap2010="http://schemas.microsoft.com/netfx/2010/xaml/activities/presentation" xmlns:scg="clr-namespace:System.Collections.Generic;assembly=mscorlib" xmlns:ui="http://schemas.uipath.com/workflow/activities" xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml"><ClipboardData.Data><scg:List x:TypeArguments="x:Object" Capacity="1"><ui:BrowserScope Browser="{x:Null}" SearchScope="{x:Null}" TimeoutMS="{x:Null}" UiBrowser="{x:Null}" x:Name="__ReferenceID0" BrowserType="IE" DisplayName="Attach Browser 'iexplore.exe Federal'" VirtualizedContainerService.HintSize="554,22" InformativeScreenshot="160d011ac02c448b6f23908959f7e658" Selector="&lt;html title='Federal Awards | Advanced Search | USAspending' /&gt;"><ui:BrowserScope.Body><p:ActivityAction x:TypeArguments="x:Object"><p:ActivityAction.Argument><p:DelegateInArgument x:TypeArguments="x:Object" Name="ContextTarget" /></p:ActivityAction.Argument><p:Sequence DisplayName="Do" VirtualizedContainerService.HintSize="376,198"><WorkflowViewStateService.ViewState><scg:Dictionary x:TypeArguments="x:String, x:Object"><x:Boolean x:Key="IsExpanded">True</x:Boolean></scg:Dictionary></WorkflowViewStateService.ViewState><ui:ExtractData DelayBetweenPagesMS="{x:Null}" NextLinkSelector="{x:Null}" ContinueOnError="True" DataTable="[ExtractDataTable]" DisplayName="Extract Structured Data 'DIV'" ExtractMetadata="&lt;extract&gt;&lt;row exact='1'&gt;&lt;webctrl tag='div' /&gt;&lt;/row&gt;&lt;column exact='1' name='Award ID' attr='text'&gt;&lt;webctrl tag='div' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;webctrl tag='a' idx='1' /&gt;&lt;/column&gt;&lt;column exact='1' name='Recipient' attr='text'&gt;&lt;webctrl tag='div' /&gt;&lt;webctrl tag='div' idx='2' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;webctrl tag='a' idx='1' /&gt;&lt;/column&gt;&lt;column exact='1' name='Amount' attr='text'&gt;&lt;webctrl tag='div' /&gt;&lt;webctrl tag='div' idx='5' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;webctrl tag='div' idx='1' /&gt;&lt;/column&gt;&lt;/extract&gt;" VirtualizedContainerService.HintSize="334,106" MaxNumberOfResults="0" SimulateClick="True"><ui:ExtractData.Target><ui:Target ClippingRegion="{x:Null}" Element="{x:Null}" Id="3df7e784-fed2-461e-9af8-6dcb6550e468" InformativeScreenshot="071e13fefa7995c472026dab2d0dfa1b" Selector="&lt;webctrl aria-role='presentation' css-selector='body&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div&amp;gt;div' parentid='results-section-table' tag='DIV' /&gt;" WaitForReady="COMPLETE"><ui:Target.TimeoutMS><p:InArgument x:TypeArguments="x:Int32" /></ui:Target.TimeoutMS></ui:Target></ui:ExtractData.Target></ui:ExtractData></p:Sequence></p:ActivityAction></ui:BrowserScope.Body><WorkflowViewStateService.ViewState><scg:Dictionary x:TypeArguments="x:String, x:Object"><x:Boolean x:Key="IsExpanded">False</x:Boolean><x:Boolean x:Key="IsPinned">False</x:Boolean></scg:Dictionary></WorkflowViewStateService.ViewState></ui:BrowserScope></scg:List></ClipboardData.Data><ClipboardData.Metadata><scg:List x:TypeArguments="x:Object" Capacity="4"><scg:List x:TypeArguments="x:Object" Capacity="4"><x:Reference>__ReferenceID0</x:Reference></scg:List></scg:List></ClipboardData.Metadata></ClipboardData>

Could you please tell me exactly where to paste this data in my sequence