Deepak Das
I have total of around 22 years of IT experience.
In Red Hat, I have competed around 11 years and 8 months.
Red Hat India Private LImited
Job title –Senior Software Maintenance Engineer
Session
RHEL AI is a Red Hat product based on upstream InstructLab project allowing user to customize Large Language Models (LLM) using private data.
Accuracy of the custom LLM is critical to achieve optimal performance of AI.
Best practices and optimization is required at every stage of LLM customization to achieve accurate custom LLM for inferencing.
- Data Seed stage
- Synthetic Data Generation stage
- Training stage
- Evaluation and Re-Training stage
- Prompt Engineering
The session will cover best practices and optimization techniques which can be used on each stage to achieve optimal and accurate LLMs.
The information shared in the session can also be used on upstream InstructLab or 3rd party LLM Models in general.