Pipeline is taking too much of time in Ai center

Is it ok to use AI center for invoice processing. Because pipeline is taking too much of time in AI center
How to resolve this issue. This will create problem in our project we don’t have that much of time to process the documents.

1 Like

Hi,

Is it always showing “wait for license” or is it taking a long time to complete a train pipeline?

If so whats your dataset size?

Hi @Anusha_Pydepalli ,
If it is waiting for resources more than 30 minutes please check the AI Robot license usage and GPU usage it can be due to no availability of free GPU and AI Robot license.

And if you want to have a faster pipeline please enable GPU while starting a pipeline.

License can be check in AI Center click on right side corner 3 dots:

You can view this:

Thanks & Regards,
Shubham Dutta

Thankyou for your reply

Initially it showed Waiting for license, then running and after 12 hours it got failed.

HI

Thankyou for your reply

For enabling GPU , do we need any license .

please find my license details in attached screenshot

Hi @Anusha_Pydepalli ,
Yes you need an extra license for that.

For your current license you can check for AI Robots/AI Units availability

Thanks & Regards,
Shubham Dutta

Extra license in the sense??

Wont it come with enterprise trial version

Hi

Hi @Anusha_Pydepalli ,

Depending upon the number of ML Skills deployed and number of pipelines already running, it will take some time for the licenses to get allocated presuming that a license is still available.

If you need help in Creating a Successful pipeline, Do let us know some more details of the pipeline configuration, Model used and Log information.

Hi ,

I have not created any ML Skill and created only one pipeline.
But it is getting failed saying
Pipeline failed due to ML Package Issue.

Below is the log file.

2022-10-16 10:57:33,990 - uipath_core.trainer_run:main:73 - INFO: Starting training job…
2022-10-16 10:57:36,978 - matplotlib:get_config_or_cache_dir:500 - WARNING: Matplotlib created a temporary config/cache directory at /tmp/matplotlib-4ku9fye because the default path (/.config/matplotlib) is not a writable directory; it is highly recommended to set the MPLCONFIGDIR environment variable to a writable directory, in particular to speed up the import of Matplotlib and to better support multiprocessing.
2022-10-16 10:57:37,715 - matplotlib.font_manager:_load_fontmanager:1624 - INFO: generated new fontManager
2022-10-16 10:57:39,754 - uipath_core.storage.azure_storage_client:download:115 - INFO: Dataset from bucket folder training-90fc3aab-7aa3-4585-bd2b-95aadb4b163f/a83e136c-9494-44dd-95dc-dbf6a0301771/faf10b61-a42a-4999-b4d8-3ab648fb2698/export with size 41 downloaded successfully
2022-10-16 10:57:39,755 - uipath_core.training_plugin:train_model:116 - INFO: Start model training…
2022-10-16 10:57:39,755 - uipath_core.training_plugin:initialize_model:110 - INFO: Start model initialization…
2022-10-16 10:57:39,756 - root:initialize_package:146 - INFO: Using package type provided by runtime argument with value: purchase_orders
2022-10-16 10:57:39,756 - root:initialize_package:155 - INFO: Initializing purchase_orders package options …
2022-10-16 10:57:39,757 - root:_valid_doctype_folder_structure:81 - ERROR: schema.json is empty / does not exist for purchase_orders dataset
2022-10-16 10:57:39,758 - uipath_core.training_plugin:model_run:152 - ERROR: Training failed for pipeline type: TRAIN_ONLY, error: Document type purchase_orders not valid, check that document type data is in dataset folder and follows folder structure.
2022-10-16 10:57:39,760 - uipath_core.trainer_run:main:90 - ERROR: Training Job failed, error: Document type purchase_orders not valid, check that document type data is in dataset folder and follows folder structure.
Traceback (most recent call last):
File “/model/bin/uipath_core/trainer_run.py”, line 85, in main
wrapper.run()
File “/workspace/model/microservice/training_wrapper.py”, line 64, in run
return self.training_plugin.model_run()
File “/model/bin/uipath_core/training_plugin.py”, line 153, in model_run
raise e
File “/model/bin/uipath_core/training_plugin.py”, line 145, in model_run
self.run_train_only()
File “/model/bin/uipath_core/training_plugin.py”, line 214, in run_train_only
self.train_model(self.local_dataset_directory)
File “/model/bin/uipath_core/training_plugin.py”, line 118, in train_model
self.model.train(directory)
File “/model/bin/uipath_core/training_plugin.py”, line 106, in model
self.initialize_model()
File “/model/bin/uipath_core/training_plugin.py”, line 112, in initialize_model
self._model = train.Main()
File “/workspace/model/microservice/train.py”, line 21, in init
self.opt = package_util.initialize_package(args)
File “”, line 157, in initialize_package
File “”, line 117, in get_package_opt
File “”, line 66, in configure_training_options
File “”, line 120, in configure_options
Exception: Document type purchase_orders not valid, check that document type data is in dataset folder and follows folder structure.
2022-10-16 10:58:16,940 - uipath_core.trainer_run:main:73 - INFO: Starting training job…
2022-10-16 10:58:19,818 - matplotlib:_get_config_or_cache_dir:500 - WARNING: Matplotlib created a temporary config/cache directory at /tmp/matplotlib-q6w7y3o2 because the default path (/.config/matplotlib) is not a writable directory; it is highly recommended to set the MPLCONFIGDIR environment variable to a writable directory, in particular to speed up the import of Matplotlib and to better support multiprocessing.
2022-10-16 10:58:20,550 - matplotlib.font_manager:_load_fontmanager:1624 - INFO: generated new fontManager
2022-10-16 10:58:21,400 - uipath_core.logs.upload_log_service:upload_logs_file:87 - INFO: Retry Training Triggered:
2022-10-16 10:58:22,083 - uipath_core.storage.azure_storage_client:download:115 - INFO: Dataset from bucket folder training-90fc3aab-7aa3-4585-bd2b-95aadb4b163f/a83e136c-9494-44dd-95dc-dbf6a0301771/faf10b61-a42a-4999-b4d8-3ab648fb2698/export with size 41 downloaded successfully
2022-10-16 10:58:22,084 - uipath_core.training_plugin:train_model:116 - INFO: Start model training…
2022-10-16 10:58:22,084 - uipath_core.training_plugin:initialize_model:110 - INFO: Start model initialization…
2022-10-16 10:58:22,085 - root:initialize_package:146 - INFO: Using package type provided by runtime argument with value: purchase_orders
2022-10-16 10:58:22,085 - root:initialize_package:155 - INFO: Initializing purchase_orders package options …
2022-10-16 10:58:22,086 - root:_valid_doctype_folder_structure:81 - ERROR: schema.json is empty / does not exist for purchase_orders dataset
2022-10-16 10:58:22,086 - uipath_core.training_plugin:model_run:152 - ERROR: Training failed for pipeline type: TRAIN_ONLY, error: Document type purchase_orders not valid, check that document type data is in dataset folder and follows folder structure.
2022-10-16 10:58:22,088 - uipath_core.trainer_run:main:90 - ERROR: Training Job failed, error: Document type purchase_orders not valid, check that document type data is in dataset folder and follows folder structure.
Traceback (most recent call last):
File “/model/bin/uipath_core/trainer_run.py”, line 85, in main
wrapper.run()
File “/workspace/model/microservice/training_wrapper.py”, line 64, in run
return self.training_plugin.model_run()
File “/model/bin/uipath_core/training_plugin.py”, line 153, in model_run
raise e
File “/model/bin/uipath_core/training_plugin.py”, line 145, in model_run
self.run_train_only()
File “/model/bin/uipath_core/training_plugin.py”, line 214, in run_train_only
self.train_model(self.local_dataset_directory)
File “/model/bin/uipath_core/training_plugin.py”, line 118, in train_model
self.model.train(directory)
File “/model/bin/uipath_core/training_plugin.py”, line 106, in model
self.initialize_model()
File “/model/bin/uipath_core/training_plugin.py”, line 112, in initialize_model
self._model = train.Main()
File “/workspace/model/microservice/train.py”, line 21, in init
self.opt = package_util.initialize_package(args)
File “”, line 157, in initialize_package
File “”, line 117, in get_package_opt
File “”, line 66, in configure_training_options
File “”, line 120, in configure_options
Exception: Document type purchase_orders not valid, check that document type data is in dataset folder and follows folder structure.

Regards
Anusha

@Anusha_Pydepalli ,
From the logs we can point out that there might be an issue with the dataset being selected or how it was prepared. (Mostly the Selection)

But as stated previously, we do need some more details of the Pipeline configuration and model being used.

THANKYOU FOR YOUR REPLY

ITS WORKING NOW

@Anusha_Pydepalli ,

Let us know what was the method used to solve it and close the Topic by marking the Appropriate post as Solution so that others having similar issues can benefit from it.

Hi ,

In AI Center after labelling fields we need to export it.
when we are exporting
There are 3 options
Label new.
Schema.
All

Initially i was selected label new and started creating pipeline

It didn’t work and took lot of time even to throw an error.(package issue)

Later i have selected All while exporting
Then it worked successfully

Regards
Anusha

1 Like