Failed Trained Pipeline Activity

[Mgevisa_Khoza]

Hi Fellow UIPath Developers, I need urgent assistance with getting to a solution to training our current pipeline.

we serve quite a large dataset for our client and thus process more than 1500 document types a day. Our train pipeline has been running successfully to date albeit the pipeline is taking significantly longer periods to complete its training.

We have now encountered error message: Pipeline failed due to Infra Issue,

Log Message Reads: Deployment failed with out of memory exception
… 31400
… 31500

I have now attempted to retrain the model but it takes even longer to run through the pipeline and i get the same “Deployment Failed with out of memory exception”

After re-attempting the failed Job it returns error Message Below: Unknown error occurred in Job Deployment for jobName: f0a7bebe-6928-44cf-97c5-b2506556a859

Could I get insight and advice on what could be the issue? i have also looked at our dataset and the data from our document extracted text is OK.

I have also attached log data of the Pipeline run with the failed result and the failed re-attempted run.

1-58842a6e-3739-415e-b36f-5ffc2621e1ed_Out of Memory Exception.txt (4.6 KB)
2-f0a7bebe-6928-44cf-97c5-b2506556a859 Unexpected Error-Re-attempted Run.txt (12.6 KB)