Pipeline for Data Manager failed

Hi !

I’ve created a Pipeline for training the new created Data label and I received the following error:

Train only of DocumentUnderstandingPackage 10.0 launched - Run c9d678c9-3b7f-42c6-af43-c734a7b88c28
Train only of DocumentUnderstandingPackage 10.0 scheduled - Run c9d678c9-3b7f-42c6-af43-c734a7b88c28
Train only of DocumentUnderstandingPackage 10.0 started - Run c9d678c9-3b7f-42c6-af43-c734a7b88c28
Train only of DocumentUnderstandingPackage 10.0 failed - Run c9d678c9-3b7f-42c6-af43-c734a7b88c28

Error Details : Pipeline failed due to ML Package Issue



2021-06-16 11:33:56,826 - uipath_core.trainer_run:main:66 - INFO: Starting training job...
2021-06-16 11:34:01,260 - uipath_core.storage.azure_storage_client:download:95 - INFO: Dataset from bucket folder training-7529d73a-c168-49b8-b630-cd58f97bb25a/a9d84d39-3bb8-49b7-ac04-969186501871/a90fb08e-6e6f-4a8f-9b44-5db98857b25b with size 43 downloaded successfully
2021-06-16 11:34:01,261 - uipath_core.training_plugin:train_model:109 - INFO: Start model training...
2021-06-16 11:34:01,261 - uipath_core.training_plugin:initialize_model:103 - INFO: Start model initialization...
2021-06-16 11:34:01,262 - root:_valid_doctype_folder_structure:63 - ERROR: images/ directory does not exist / is empty for {'name': 'default', 'folder': '', 'dataset': {'account_name': None, 'folder': '', 'path': '/microservice/dataset', 'dataloader_workers': 0, 'vocabulary_padding_id': 0, 'vocabulary_unknown_id': 1, 'text_pp_remove_symbols': False, 'text_pp_lemmatization': False, 'text_pp_remove_stop_words': False, 'word_embedding': 'unknown_id', 'max_words': 10000, 'max_image_size': [300, 300], 'date_format_classifier_data': ['receipts', 'invoices', 'invoices_au', 'invoices_india', 'utility_bills', 'purchase_orders', 'invoices_japan', 'unknown'], 'replace_patterns': ['date', 'number', 'checkbox'], 'doctype2id': {}, 'clftask2id': {}, 'id2clftask': {}, 'clf_tasks_by_doctype': defaultdict(<class 'list'>, {})}, 'path': '/microservice/dataset/', 'split': '/microservice/dataset/split.csv', 'schema': '/microservice/dataset/schema.json'} dataset
2021-06-16 11:34:01,263 - uipath_core.training_plugin:model_run:145 - ERROR: Training failed for pipeline type: TRAIN_ONLY, error: Document type default not valid, check that document type data is in dataset folder and follows folder structure.
2021-06-16 11:34:01,267 - uipath_core.trainer_run:main:81 - ERROR: Training Job failed, error: Document type default not valid, check that document type data is in dataset folder and follows folder structure.
Traceback (most recent call last):
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/trainer_run.py", line 76, in main
wrapper.run()
File "/microservice/training_wrapper.py", line 57, in run
return self.training_plugin.model_run()
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/training_plugin.py", line 146, in model_run
raise e
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/training_plugin.py", line 138, in model_run
self.run_train_only()
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/training_plugin.py", line 207, in run_train_only
self.train_model(self.local_dataset_directory)
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/training_plugin.py", line 111, in train_model
self.model.train(directory)
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/training_plugin.py", line 99, in model
self.initialize_model()
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/training_plugin.py", line 105, in initialize_model
self._model = train.Main()
File "/microservice/train.py", line 24, in __init__
self.opt = self.get_options()
File "/microservice/train.py", line 105, in get_options
opt = preprocess.configure_options(opt)
File "<frozen extraction.model_tag.preprocess>", line 99, in configure_options
Exception: Document type default not valid, check that document type data is in dataset folder and follows folder structure.
2021-06-16 11:34:10,093 - uipath_core.trainer_run:main:66 - INFO: Starting training job...
2021-06-16 11:34:13,486 - uipath_core.logs.upload_log_service:upload_logs_file:56 - INFO: Retry Training Triggered:
2021-06-16 11:34:14,395 - uipath_core.storage.azure_storage_client:download:95 - INFO: Dataset from bucket folder training-7529d73a-c168-49b8-b630-cd58f97bb25a/a9d84d39-3bb8-49b7-ac04-969186501871/a90fb08e-6e6f-4a8f-9b44-5db98857b25b with size 43 downloaded successfully
2021-06-16 11:34:14,395 - uipath_core.training_plugin:train_model:109 - INFO: Start model training...
2021-06-16 11:34:14,395 - uipath_core.training_plugin:initialize_model:103 - INFO: Start model initialization...
2021-06-16 11:34:14,397 - root:_valid_doctype_folder_structure:63 - ERROR: images/ directory does not exist / is empty for {'name': 'default', 'folder': '', 'dataset': {'account_name': None, 'folder': '', 'path': '/microservice/dataset', 'dataloader_workers': 0, 'vocabulary_padding_id': 0, 'vocabulary_unknown_id': 1, 'text_pp_remove_symbols': False, 'text_pp_lemmatization': False, 'text_pp_remove_stop_words': False, 'word_embedding': 'unknown_id', 'max_words': 10000, 'max_image_size': [300, 300], 'date_format_classifier_data': ['receipts', 'invoices', 'invoices_au', 'invoices_india', 'utility_bills', 'purchase_orders', 'invoices_japan', 'unknown'], 'replace_patterns': ['date', 'number', 'checkbox'], 'doctype2id': {}, 'clftask2id': {}, 'id2clftask': {}, 'clf_tasks_by_doctype': defaultdict(<class 'list'>, {})}, 'path': '/microservice/dataset/', 'split': '/microservice/dataset/split.csv', 'schema': '/microservice/dataset/schema.json'} dataset
2021-06-16 11:34:14,397 - uipath_core.training_plugin:model_run:145 - ERROR: Training failed for pipeline type: TRAIN_ONLY, error: Document type default not valid, check that document type data is in dataset folder and follows folder structure.
2021-06-16 11:34:14,402 - uipath_core.trainer_run:main:81 - ERROR: Training Job failed, error: Document type default not valid, check that document type data is in dataset folder and follows folder structure.
Traceback (most recent call last):
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/trainer_run.py", line 76, in main
wrapper.run()
File "/microservice/training_wrapper.py", line 57, in run
return self.training_plugin.model_run()
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/training_plugin.py", line 146, in model_run
raise e
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/training_plugin.py", line 138, in model_run
self.run_train_only()
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/training_plugin.py", line 207, in run_train_only
self.train_model(self.local_dataset_directory)
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/training_plugin.py", line 111, in train_model
self.model.train(directory)
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/training_plugin.py", line 99, in model
self.initialize_model()
File "/home/aifabric/.local/lib/python3.8/site-packages/uipath_core/training_plugin.py", line 105, in initialize_model
self._model = train.Main()
File "/microservice/train.py", line 24, in __init__
self.opt = self.get_options()
File "/microservice/train.py", line 105, in get_options
opt = preprocess.configure_options(opt)
File "<frozen extraction.model_tag.preprocess>", line 99, in configure_options
Exception: Document type default not valid, check that document type data is in dataset folder and follows folder structure.

I wanted the mention that the files from Data Manager are exported by clicking the Export button.



Many thanks !

1 Like

Hello @DragosPadurariu!

It seems that you have trouble getting an answer to your question in the first 24 hours.
Let us give you a few hints and helpful links.

First, make sure you browsed through our Forum FAQ Beginner’s Guide. It will teach you what should be included in your topic.

You can check out some of our resources directly, see below:

  1. Always search first. It is the best way to quickly find your answer. Check out the image icon for that.
    Clicking the options button will let you set more specific topic search filters, i.e. only the ones with a solution.

  2. Topic that contains most common solutions with example project files can be found here.

  3. Read our official documentation where you can find a lot of information and instructions about each of our products:

  4. Watch the videos on our official YouTube channel for more visual tutorials.

  5. Meet us and our users on our Community Slack and ask your question there.

Hopefully this will let you easily find the solution/information you need. Once you have it, we would be happy if you could share your findings here and mark it as a solution. This will help other users find it in the future.

Thank you for helping us build our UiPath Community!

Cheers from your friendly
Forum_Staff

Select the subfolder folder directly while creating pipeline instead of selecting InvoiceDataSet.
image

3 Likes

Hi Dragos,

I encountered the same issue. Did you find the reason for it?

Thanks,
Iulian

Facing same issue. Anybody got any resolution?

(post deleted by author)

You need to add at least 20 files to the training set in data manager. Then it should work.

HI,

I have the exact same error and I have only 11 samples documents for training. Is there something I can do? Is there any workaround?

Thanks,
Eric

Donot select the complete DataSet while creating pipeline. Structure of data set should be like:
Dataset>Export>packageName

2 Likes

Hi,
Bro, Actually you need to upload a Folder Directly instead of a Zip file trained in Datamanager inside the dataset. And provide the same subfolder in package and Pipeline creation.
It will work. I was getting the same issue got resolved.

Hope this clears your doubt bro

Thanks
Sourav Singh

Hello, I’m also having this issue even after following the suggestions on here. I exported the data from Data Manager and it create a new folder in the Data Set → Export path.

However when I create a new pipeline, I can only select “InvoiceDataSet2” and not the specific folder I just exported.

What else am I missing?

Thanks.

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.