Dataset upload failure in AI Center due to Mixed Content error in browser

Dataset upload failed intermittently in AI Center.

Issue description:

Dataset upload failed intermittently in AI Center, with detailed UI error message: Failed to upload items(s), it may be due to slow or lost internet connection. Error "The page at 'https://objectstore.' was loaded over HTTPS, but requested an insecure resource http://rook-ceph-rgw-rook-ceph.rook-ceph.svc.cluster.local.This request has been blocked; the content must be served over HTTPS." can be seen in the browser console.

Validation:

  • Check the HAR trace while uploading the file/folder in dataset.
  • The upload happens over http://rook-ceph-rgw-rook-ceph.rook-ceph.svc.cluster.local rather than https://objectstore.
  • Error "The page at 'https://objectstore.' was loaded over HTTPS, but requested an insecure resource http://rook-ceph-rgw-rook-ceph.rook-ceph.svc.cluster.local.This request has been blocked; the content must be served over HTTPS." can be seen in the browser console.

Resolution:

Rolling start ai-trainer-deployment pods resolved the issue:

1. Enable kubectl
export KUBECONFIG=/etc/rancher/rke2/rke2.yaml && export PATH=$PATH:/var/lib/rancher/rke2/bin

2. Restart ai-trainer deployment
kubectl rollout restart deploy ai-trainer-deployment -n uipath

3. Wait till ai-trainer pods are up and running
kubectl get pod -n uipath | grep ai-trainer-deployment