If there are 2 GPU licenses allocated out of which only one is being used for training the Pipeline. So, will the the AI units be deducted for the unused GPU license, or will it get deducted only when the GPU license is being used?
- AI units will not be deducted for the unused GPU license. If running a pipeline using 1 GPU, then the usage shall show 1 out of 2.
A GPU is just a different processing unit that speeds up some types of computations. The efficiency gain by using a GPU runtime is heavily dependent on the code being run.
- The formula to calculate the consumption is as follows: input size x unit cost of the model.
For example, the consumption for UiPath Custom Named Entity Recognition model with input size 5000 characters is as follows:
5000 characters = 3 units
Consumption: 3 units x 0.5 (unit cost) = 1.5 AI units
ashokkarale
sharazkm32
Nidhi_Gupta1
Matt67
RobertRussell_Monsalud
Youri98
Slow_Learner
Roman-Routinuum
adi.mehare
Akash_Javalekar1