2021-09-25 21:32:58,558 - uipath_core.trainer_run:main:66 - INFO:  Starting training job...
2021-09-25 21:40:52,610 - uipath_core.storage.azure_storage_client:download:96 - INFO:  Dataset from bucket folder training-000da386-4e96-4a8b-8d7c-c3c5e7ef4c46/38c1572f-41c1-4666-950f-2d0017a694e8/72e52879-31c0-4402-be85-f6279d21bb12 with size 42184 downloaded successfully
2021-09-25 21:40:52,611 - uipath_core.training_plugin:train_model:104 - INFO:  Start model training...
2021-09-25 21:40:52,611 - uipath_core.training_plugin:initialize_model:98 - INFO:  Start model initialization...
2021-09-25 21:40:52,614 - uipath_core.training_plugin:initialize_model:101 - INFO:  Model initialized successfully
2021-09-25 21:40:52,615 - root:train:49 - INFO:  Creating Dataset ...
2021-09-25 21:41:30,586 - root:build_df_from_files:169 - INFO:  train: (33747, 3)
2021-09-25 21:41:30,606 - root:build_df_from_files:170 - INFO:  test: (8437, 3)
2021-09-25 21:41:30,606 - root:build_df_from_files:172 - INFO:  ratio: 0.200005
2021-09-25 21:41:30,641 - root:preprocess_df:149 - INFO:  Preprocess dataframe
2021-09-25 21:54:14,881 - root:preprocess_df:149 - INFO:  Preprocess dataframe
2021-09-25 21:57:52,509 - root:build_vocabulary:129 - INFO:  Building vocabulary...
2021-09-25 21:58:18,655 - root:prepare_df_for_bow:161 - INFO:  Prepare bow
2021-09-25 21:58:57,206 - root:prepare_df_for_bow:161 - INFO:  Prepare bow
2021-09-25 21:59:06,621 - root:train:53 - INFO:  Vectorizing
2021-09-25 22:00:50,385 - root:train:67 - INFO:  Training
2021-09-26 22:00:13,558 - root:train:70 - INFO:  Train Accuracy: 0.958782
2021-09-26 22:00:13,560 - root:eval:78 - INFO:  Evaluating Test Set
2021-09-26 22:00:13,561 - root:predict_internal:102 - INFO:  Vectorizing
2021-09-26 22:02:11,396 - root:eval:91 - INFO:  Test Accuracy: 0.827901
2021-09-26 22:02:11,945 - root:eval:96 - INFO:  {
  "global": {
    "top_1_accuracy": 0.8279009126466753,
    "top_3_accuracy": 0.9679981035913239,
    "micro_map": 0.9026594975608762,
    "macro_map": 0.7641566653897569,
    "f1_score": 0.8279009126466753
  },
  "class_level": {
    "ClaimIndexing.SupportingDocuments.AccidentReportForm": {
      "average_precision": 0.9192439504308614
    },
    "ClaimIndexing.SupportingDocuments.Alarmlogreport": {
      "average_precision": 0.45
    },
    "ClaimIndexing.SupportingDocuments.AssessorInvoice": {
      "average_precision": 0.005613395170530217
    },
    "ClaimIndexing.SupportingDocuments.AssessorReport": {
      "average_precision": 0.9785362575621749
    },
    "ClaimIndexing.SupportingDocuments.AssetRegister": {
      "average_precision": 0.5197171741358818
    },
    "ClaimIndexing.SupportingDocuments.AttorneyInvoice": {
      "average_precision": 0.6924603174603174
    },
    "ClaimIndexing.SupportingDocuments.AttorneyReport": {
      "average_precision": 0.3470063574018949
    },
    "ClaimIndexing.SupportingDocuments.AuthorisationforRepairs": {
      "average_precision": 0.6890074144311433
    },
    "ClaimIndexing.SupportingDocuments.BankSettlementLetter": {
      "average_precision": 0.517547229568289
    },
    "ClaimIndexing.SupportingDocuments.BankingDetailsCorrespondence": {
      "average_precision": 0.9110708709584979
    },
    "ClaimIndexing.SupportingDocuments.BusinessRegistrationCertificate": {
      "average_precision": 0.8775000576980775
    },
    "ClaimIndexing.SupportingDocuments.CarHireInvoice": {
      "average_precision": 0.9969202465462427
    },
    "ClaimIndexing.SupportingDocuments.CertifiedcopyofIdentityDocument(ID)": {
      "average_precision": 0.8893911803447611
    },
    "ClaimIndexing.SupportingDocuments.ClaimFNOL": {
      "average_precision": 0.08644184465726987
    },
    "ClaimIndexing.SupportingDocuments.ClaimForm": {
      "average_precision": 0.3124988373062551
    },
    "ClaimIndexing.SupportingDocuments.ClaimInformation": {
      "average_precision": 0.857348303797134
    },
    "ClaimIndexing.SupportingDocuments.ClaimsInvoice": {
      "average_precision": 0.7149380153492819
    },
    "ClaimIndexing.SupportingDocuments.ClearanceCertificate": {
      "average_precision": 0.9539491947633781
    },
    "ClaimIndexing.SupportingDocuments.Completedclaimform": {
      "average_precision": 0.9253611162030363
    },
    "ClaimIndexing.SupportingDocuments.Damagereport": {
      "average_precision": 0.6483756434229838
    },
    "ClaimIndexing.SupportingDocuments.Deregistrationcertificate": {
      "average_precision": 0.8178571428571427
    },
    "ClaimIndexing.SupportingDocuments.DriversLicense": {
      "average_precision": 0.9299426478293827
    },
    "ClaimIndexing.SupportingDocuments.EngineeringReport": {
      "average_precision": 0.40798222514812377
    },
    "ClaimIndexing.SupportingDocuments.ExcessStructure": {
      "average_precision": 0.5434782608695652
    },
    "ClaimIndexing.SupportingDocuments.FleetList": {
      "average_precision": 1.0
    },
    "ClaimIndexing.SupportingDocuments.ForensicReport": {
      "average_precision": 0.31666666666666665
    },
    "ClaimIndexing.SupportingDocuments.InsurableInterest": {
      "average_precision": 1.0
    },
    "ClaimIndexing.SupportingDocuments.InvestigationReport": {
      "average_precision": 0.8384112120879329
    },
    "ClaimIndexing.SupportingDocuments.InvestigatorInvoice": {
      "average_precision": 0.6682416877406292
    },
    "ClaimIndexing.SupportingDocuments.Logo": {
      "average_precision": 0.89609829962162
    },
    "ClaimIndexing.SupportingDocuments.LossAdjustorReport": {
      "average_precision": 0.8970939050745592
    },
    "ClaimIndexing.SupportingDocuments.MMValue": {
      "average_precision": 0.9928104881856903
    },
    "ClaimIndexing.SupportingDocuments.MotorAssessorInvoice": {
      "average_precision": 0.974643121544103
    },
    "ClaimIndexing.SupportingDocuments.MotorBodyRepairerInvoice": {
      "average_precision": 0.9181905947275314
    },
    "ClaimIndexing.SupportingDocuments.MotorGlassWindscreenInvoice": {
      "average_precision": 0.9972075468117187
    },
    "ClaimIndexing.SupportingDocuments.NoCoverLetter": {
      "average_precision": 1.0
    },
    "ClaimIndexing.SupportingDocuments.Non-MotorLossAdjusterInvoice": {
      "average_precision": 0.7297461263565661
    },
    "ClaimIndexing.SupportingDocuments.Paidupletter": {
      "average_precision": 1.0
    },
    "ClaimIndexing.SupportingDocuments.Photo": {
      "average_precision": 0.8661020090731153
    },
    "ClaimIndexing.SupportingDocuments.Policecasereference": {
      "average_precision": 0.6347837485019687
    },
    "ClaimIndexing.SupportingDocuments.Policyschedule": {
      "average_precision": 0.9818611281729956
    },
    "ClaimIndexing.SupportingDocuments.Premiumconfirmation-statement": {
      "average_precision": 0.9128550780875978
    },
    "ClaimIndexing.SupportingDocuments.QuantitySurveyorInvoice": {
      "average_precision": 0.8058479532163743
    },
    "ClaimIndexing.SupportingDocuments.QuantitySurveyorReport": {
      "average_precision": 0.5333333333333333
    },
    "ClaimIndexing.SupportingDocuments.Quotation": {
      "average_precision": 0.8895898757185591
    },
    "ClaimIndexing.SupportingDocuments.RejectionLetter": {
      "average_precision": 0.976190476190476
    },
    "ClaimIndexing.SupportingDocuments.SAP21": {
      "average_precision": 0.7501185255422543
    },
    "ClaimIndexing.SupportingDocuments.SectionIIExcess": {
      "average_precision": 0.6804945054945054
    },
    "ClaimIndexing.SupportingDocuments.Settlementletterifvehicleisfinanced": {
      "average_precision": 0.24330034372407255
    },
    "ClaimIndexing.SupportingDocuments.SignedAOL": {
      "average_precision": 0.9376171418748042
    },
    "ClaimIndexing.SupportingDocuments.Signedchangeofownership": {
      "average_precision": 0.9973214285714286
    },
    "ClaimIndexing.SupportingDocuments.Summons": {
      "average_precision": 1.0
    },
    "ClaimIndexing.SupportingDocuments.SupplierInvoice": {
      "average_precision": 0.7753043774466473
    },
    "ClaimIndexing.SupportingDocuments.TowingInvoice": {
      "average_precision": 0.8190324227818961
    },
    "ClaimIndexing.SupportingDocuments.TracerReport": {
      "average_precision": 0.5562745604387047
    },
    "ClaimIndexing.SupportingDocuments.TracingAgentsInvoice": {
      "average_precision": 0.49328283344929647
    },
    "ClaimIndexing.SupportingDocuments.TransUnion(eNATISUnicodeetc)": {
      "average_precision": 0.924973814258283
    },
    "ClaimIndexing.SupportingDocuments.UnsignedAgreementofLoss": {
      "average_precision": 0.9172742386136344
    },
    "ClaimIndexing.SupportingDocuments.ValuationCertificate": {
      "average_precision": 0.7819349962207105
    },
    "ClaimIndexing.SupportingDocuments.ValuecardQuote": {
      "average_precision": 0.9715750985239532
    },
    "ClaimIndexing.SupportingDocuments.VehicleCertificateofRegistration": {
      "average_precision": 0.9431913668113127
    }
  }
}
2021-09-26 22:03:07,457 - uipath_core.trainer_run:main:66 - INFO:  Starting training job...
2021-09-26 22:03:11,769 - uipath_core.training_plugin:download_dataset:403 - WARNING:  Deleting already existing folder name: /data/dataset
2021-09-26 22:03:11,953 - uipath_core.logs.upload_log_service:upload_logs_file:56 - INFO:  Retry Training Triggered:
2021-09-26 22:11:46,563 - uipath_core.storage.azure_storage_client:download:96 - INFO:  Dataset from bucket folder training-000da386-4e96-4a8b-8d7c-c3c5e7ef4c46/38c1572f-41c1-4666-950f-2d0017a694e8/72e52879-31c0-4402-be85-f6279d21bb12 with size 42184 downloaded successfully
2021-09-26 22:11:46,564 - uipath_core.training_plugin:train_model:104 - INFO:  Start model training...
2021-09-26 22:11:46,564 - uipath_core.training_plugin:initialize_model:98 - INFO:  Start model initialization...
2021-09-26 22:11:46,567 - uipath_core.training_plugin:initialize_model:101 - INFO:  Model initialized successfully
2021-09-26 22:11:46,567 - root:train:49 - INFO:  Creating Dataset ...
2021-09-26 22:12:32,077 - root:build_df_from_files:169 - INFO:  train: (33747, 3)
2021-09-26 22:12:32,097 - root:build_df_from_files:170 - INFO:  test: (8437, 3)
2021-09-26 22:12:32,098 - root:build_df_from_files:172 - INFO:  ratio: 0.200005
2021-09-26 22:12:32,135 - root:preprocess_df:149 - INFO:  Preprocess dataframe
2021-09-26 22:25:20,339 - root:preprocess_df:149 - INFO:  Preprocess dataframe
2021-09-26 22:28:59,473 - root:build_vocabulary:129 - INFO:  Building vocabulary...
2021-09-26 22:29:27,153 - root:prepare_df_for_bow:161 - INFO:  Prepare bow
2021-09-26 22:30:06,501 - root:prepare_df_for_bow:161 - INFO:  Prepare bow
2021-09-26 22:30:19,206 - root:train:53 - INFO:  Vectorizing
2021-09-26 22:32:07,147 - root:train:67 - INFO:  Training
2021-09-27 04:42:35,751 - uipath_core.trainer_run:main:66 - INFO:  Starting training job...
2021-09-27 04:42:39,645 - uipath_core.training_plugin:download_dataset:403 - WARNING:  Deleting already existing folder name: /data/dataset
2021-09-27 04:42:39,780 - uipath_core.logs.upload_log_service:upload_logs_file:56 - INFO:  Retry Training Triggered:
2021-09-27 04:50:44,868 - uipath_core.storage.azure_storage_client:download:96 - INFO:  Dataset from bucket folder training-000da386-4e96-4a8b-8d7c-c3c5e7ef4c46/38c1572f-41c1-4666-950f-2d0017a694e8/72e52879-31c0-4402-be85-f6279d21bb12 with size 42184 downloaded successfully
2021-09-27 04:50:44,869 - uipath_core.training_plugin:train_model:104 - INFO:  Start model training...
2021-09-27 04:50:44,869 - uipath_core.training_plugin:initialize_model:98 - INFO:  Start model initialization...
2021-09-27 04:50:44,871 - uipath_core.training_plugin:initialize_model:101 - INFO:  Model initialized successfully
2021-09-27 04:50:44,872 - root:train:49 - INFO:  Creating Dataset ...
2021-09-27 04:51:30,927 - root:build_df_from_files:169 - INFO:  train: (33747, 3)
2021-09-27 04:51:30,947 - root:build_df_from_files:170 - INFO:  test: (8437, 3)
2021-09-27 04:51:30,947 - root:build_df_from_files:172 - INFO:  ratio: 0.200005
2021-09-27 04:51:30,984 - root:preprocess_df:149 - INFO:  Preprocess dataframe
2021-09-27 05:04:31,400 - root:preprocess_df:149 - INFO:  Preprocess dataframe
2021-09-27 05:08:15,475 - root:build_vocabulary:129 - INFO:  Building vocabulary...
2021-09-27 05:08:43,609 - root:prepare_df_for_bow:161 - INFO:  Prepare bow
2021-09-27 05:09:25,472 - root:prepare_df_for_bow:161 - INFO:  Prepare bow
2021-09-27 05:09:35,898 - root:train:53 - INFO:  Vectorizing
2021-09-27 05:11:20,948 - root:train:67 - INFO:  Training
2021-09-27 20:54:03,179 - uipath_core.trainer_run:main:66 - INFO:  Starting training job...
2021-09-27 20:54:07,825 - uipath_core.training_plugin:download_dataset:403 - WARNING:  Deleting already existing folder name: /data/dataset
2021-09-27 20:54:08,001 - uipath_core.logs.upload_log_service:upload_logs_file:56 - INFO:  Retry Training Triggered: