Uploading Open Source LLMs to AI center in Ui Path and then training it on AI center

Help AI Center
,
1

How do I upload the open source LLM Llama 2 model on Ui Path AI center? Also after uploading it how do I train it on AI center itself? Please help me out on this…

2

You cannot simply train a Large Language Model (LLM). If you wish for the model to incorporate specific custom data, you should consider using a vector store database and integrating new documents into the training pipeline.

To begin, you can create a Python project that supports LLM (including API calls to LLM and vector store retrievers, etc.) that meets the following requirements:

If your project adheres to the structure specified in the documentation above, you should be able to upload it to AI Center and even ‘train’ it within AI Center pipelines. This is contingent on having a defined training function in your Python project, which is responsible for uploading the relevant information to the vector store.