Using a Custom Fine-Tuned Model in GenAI Activities

Help Integration Service
1

Hey everyone!

I have a question about using fine-tuned custom models with the GenAI Activities. I noticed that custom model support is available in UiPath Agents, but I don’t see a similar option in the GenAI Activities package. Since GenAI Activities rely on a GenAI Integration Connection, it doesn’t seem possible to use an additional connection like the “OpenAI” Integration Service.

Has anyone found a way to use fine-tuned models within GenAI Activities within a Trust Layer setup and not via an Agent? Any guidance or suggestions would be greatly appreciated!

2

@Melroy_Dsa

By default it uses the latest microsoft model ..so you cannot choose or use your own model with those activities

cheers

3

Oh, thanks for the info @Anil_G. I really wish we could use our own models (like in Agents) the current models although powerful are too generalized, and the only way to make them specific is through the system prompt.

1 Like
4

@Melroy_Dsa

agreed. If you want more flexibility then go with building an agent directly..there you have option to choose your own model as well

cheers

5

Yes, that’s true, but(as far as I know) unfortunately we cannot control the number of LLM calls the Agent makes. It may consume a lot more units than anticipated. Hence why I’m trying to use the GenAI Activity instead.

1 Like
6

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.