Get FullText Activity is not consistent between dev and unattended staging environment

Hi Everyone,

I use UiPath to scrape health plan data for my company. For one website: medicare.gov, I use the get full text activity, and then parse out values for insertion into a db.

My script works on my local dev machine, on a work laptop, but does not work on an AWS VM with an unattended bot. As far as I can tell, on the first iteration of plan scraping, the bot fails to scrape any text and has an empty string. After that, it does scrape the string variable as expected, but I get this error that a value I’m parsing out of the string cannot be assigned to an out argument variable in one of my components:

message: Gather Start, End positions within input string to find the length of the string to be sliced out : Can not assign ‘Strings.Mid(in_TherapyServicesText, SliceStart, SliceLen)’ to ‘out_OccupationalTherapyVisit’.

(I’ve fixed this)
or when it does, the format of the string is different than what is being scraped on my dev environment. I’ve also just realized that it’s failing to expand a section of the page to reveal more data it needs in the string to parse values out correctly. (I’ve fixed this)

The main quirk of this script that I can’t explain is that it needs an instance of google to be active on my work laptop, but not on my dev machine for the get full text activity to properly scrape the text. Can anyone explain why?

During runtime, the bot opens up a url to a specific plan on medicare.gov, expands one of the clickable buttons, then scrapes the full text with these selectors:

“wnd app=‘chrome.exe’ cls=‘Chrome_WidgetWin_1’ title=’’ />
<ctrl name=’
’ role=‘document’ /”

The resulting string looks like:
@"An official website of the United States government Here’s how you know Cambiar a Español
Basics Health & Drug Plans Providers & Services Log in
Back to search results
Humana Gold Plus SNP-DE H0028-007 (HMO D-SNP) Humana
Plan type: Medicare Advantage with drug coverage
SNP type: Dual Eligible
Plan ID: H0028-007-0 Print
Plan website Non-members: phone number 1-800-833-2364 Members: phone number 1-800-457-4708 Contact plan to enroll
What you’ll pay Total monthly premium
$0.00 Health deductible $0.00 Primary doctor $0
copay
Overview Benefits & Costs Drug Coverage Extra Benefits Star Ratings Overview PREMIUMS Total monthly premium $0.00 Health premium $0.00 Drug premium $0.00 Standard Part B premium $170.10 Part B premium reduction No DEDUCTIBLES The amount you must pay each year before your plan starts to pay for covered services or drugs. Health deductible $0 Drug deductible $400.00 MAXIMUM YOU PAY FOR HEALTH SERVICES Maximum you pay for health services $3,450 In-network CONTACT INFORMATION Plan address 500 West Main Street
Louisville, KY 40202
Benefits & Costs DOCTOR SERVICES View Provider Network Directory Primary doctor visit $0 copay Specialist visit $0 copay Limits apply TESTS, LABS, & IMAGING Diagnostic tests & procedures $0 copay Limits apply Lab services $0 copay Limits apply Diagnostic radiology services (like MRI) $0 copay Limits apply Outpatient x-rays $0 copay Limits apply Emergency care $0 copay Urgent care $0 copay HOSPITAL SERVICES Inpatient hospital coverage $0 copay Limits apply Outpatient hospital coverage $0 copay Limits apply SKILLED NURSING FACILITY Skilled nursing facility $0 copay Limits apply PREVENTIVE SERVICES Health care to prevent illness or detect illness at an early stage, when treatment is likely to work best (like Pap tests, flu shots, and screening mammograms).
Learn more about your costs for preventive services
Preventive services $0 copay
AMBULANCE
Ground ambulance $0 copay
THERAPY SERVICES
Occupational therapy visit $0 copay Limits apply
Physical therapy & speech & language therapy visit $0 copay Limits apply
Collapse more benefits & costs
MENTAL HEALTH SERVICES
Outpatient group therapy with a psychiatrist $0 copay Limits apply
Outpatient individual therapy with a psychiatrist $0 copay Limits apply
Outpatient group therapy visit $0 copay Limits apply
Outpatient individual therapy visit $0 copay Limits apply
OPIOID TREATMENT PROGRAM SERVICES
Opioid treatment program services 0% coinsurance Limits apply
OTHER SERVICES
Durable medical equipment (like wheelchairs & oxygen) $0 copay Limits apply
Prosthetics (like braces, artificial limbs) $0 copay Limits apply
Dialysis 0% coinsurance Limits apply
Diabetes supplies $0 copay Limits apply
Drug Coverage
See if there’s help to lower costs for drugs you take.
COSTS BY DRUG TIER
Plans group their drug lists into tiers. The drug costs below show how much you’ll pay for drugs in each tier based on the coverage phase you’re in.
Learn more about drug tiers.
TIER DRUG COST FOR
Change
Tiers Initial coverage phase Gap coverage phase Catastrophic coverage phase Low income subsidy
Preferred Generic $2.00 copay Generic drugs: 25%
Brand-name drugs:
25% Generic drugs: $3.95 copay or 5% (whichever costs more) Brand-name drugs: $9.85 copay or 5% (whichever costs more) Generic drugs: $0 copay; or
$1.35 copay; or
$3.95 copay; or
15%

Brand-name drugs: $0 copay; or
$4.00 copay; or
$9.85 copay; or
15%

Generic $12.00 copay Generic drugs: 25%
Brand-name drugs:
25% Generic drugs: $3.95 copay or 5% (whichever costs more) Brand-name drugs: $9.85 copay or 5% (whichever costs more) Generic drugs: $0 copay; or
$1.35 copay; or
$3.95 copay; or
15%

Brand-name drugs: $0 copay; or
$4.00 copay; or
$9.85 copay; or
15%

Preferred Brand $47.00 copay Generic drugs: 25%
Brand-name drugs:
25% Generic drugs: $3.95 copay or 5% (whichever costs more) Brand-name drugs: $9.85 copay or 5% (whichever costs more) Generic drugs: $0 copay; or
$1.35 copay; or
$3.95 copay; or
15%

Brand-name drugs: $0 copay; or
$4.00 copay; or
$9.85 copay; or
15%

Non-Preferred Drug $100.00 copay Generic drugs: 25%
Brand-name drugs:
25% Generic drugs: $3.95 copay or 5% (whichever costs more) Brand-name drugs: $9.85 copay or 5% (whichever costs more) Generic drugs: $0 copay; or
$1.35 copay; or
$3.95 copay; or
15%

Brand-name drugs: $0 copay; or
$4.00 copay; or
$9.85 copay; or
15%

Specialty Tier 26% Generic drugs: 25%
Brand-name drugs:
25% Generic drugs: $3.95 copay or 5% (whichever costs more) Brand-name drugs: $9.85 copay or 5% (whichever costs more) Generic drugs: $0 copay; or
$1.35 copay; or
$3.95 copay; or
15%

Brand-name drugs: $0 copay; or
$4.00 copay; or
$9.85 copay; or
15%

PART B DRUGS
These are drugs you usually get at a doctor’s office or hospital outpatient setting, like the flu shot, chemotherapy, or other shots.
Chemotherapy drugs $0 copay Limits apply
Other Part B drugs $0 copay Limits apply
Extra benefits
HEARING
Hearing exam $0 copay Limits apply
Fitting/evaluation $0 copay Limits apply
Hearing aids - all types $0 copay Limits apply
PREVENTIVE DENTAL
Care to prevent or find problems with your teeth and gums.
Oral exam $0 copay Limits apply
Cleaning $0 copay Limits apply
Fluoride treatment $0 copay Limits apply
Dental x-rays $0 copay Limits apply
COMPREHENSIVE DENTAL
Care to maintain or treat problems with your teeth and gums.
Non-routine services $0 copay Limits apply
Diagnostic services Not covered
Restorative services $0 copay Limits apply
Endodontics Not covered
Periodontics $0 copay Limits apply
Extractions $0 copay Limits apply
Prosthodontics, other oral/maxillofacial surgery, & other services $0 copay Limits apply
VISION
Routine eye exam $0 copay Limits apply
Contact lenses $0 copay Limits apply
Eyeglasses (frames & lenses) $0 copay Limits apply
Eyeglass frames only Not covered
Eyeglass lenses only Not covered
Upgrades Not covered
View more extra benefits
Overall rating is based on the categories below.4.5 stars4.5 stars4.5 stars Star ratings Expand All Ratings
Overall star rating
Health plan star rating
Summary rating of health plan quality
Drug plan star rating
Summary rating of drug plan quality
A federal government website managed and paid for by the U.S. Centers for Medicare & Medicaid Services.
7500 Security Boulevard, Baltimore, MD 21244 About Medicare Medicare Glossary Nondiscrimination/Accessibility Privacy Policy Privacy Setting Linking Policy Using this site Plain Writing

"
On my VM,

The get full text activity fails to scrape anything on the first plan it’s supposed to scrape, then following that, it scrapes a string without the expanded content it needs. I tried to address the fact that the script needs an instance of google open by having the bot open up a chrome window first, but it doesn’t solve the first iteration where the full text activity results in an empty string.

If anyone was able to read through this whole thing, I’d really like some guidance cause I’m lost.

Hey @cho_cho

Also could you please show the screenshot of the page to understand ?

And why are you going with Get Full Text ?

Thanks
#nK