Fine-Tuning Your Own Customized Typhoon Model
This page contains materials from the special training AI Bootcamp: LLM Fine Tuning and Deployment, co-hosted by the Typhoon team and Float16. The one-day program covers both theory and hands-on practice. We’ve recorded the training sessions and collected all materials so you can learn at your own pace—anytime, anywhere.
Note: The video recordings are spoken in Thai.
Requirements
Section titled “Requirements”You should have basic knowledge in the following areas before starting:
- Python programming skills
- Foundational knowledge of deep learning concepts
- Familiarity with a Linux or Unix-like environment
Part 1: LLM Fine Tuning
Section titled “Part 1: LLM Fine Tuning”Topics covered in the first session:
- Intro to Typhoon LLMs and Fine Tuning
- Preparing for Fine Tuning
- Choosing the Right Fine Tuning Method
- Intro to LLM Evaluation
- Workshop Time 💻
Lecture Video (Theory)
Section titled “Lecture Video (Theory)”Tip: click “Watch on YouTube” for the best viewing experience
Lecture Slides
Section titled “Lecture Slides”Topic Discussed
Section titled “Topic Discussed”1. Intro to Typhoon LLMs and Fine Tuning
2. Preparing for Fine Tuning
3. Choosing The Right Fine Tuning Method
4. Intro to LLM Evaluation
5. Workshop Time 💻
Workshop Resources
Section titled “Workshop Resources”Fine-Tune Task: Sentiment Analysis The demonstration workshop fine-tunes a model for Sentiment Analysis tasks.
- Base Model: Typhoon2-Llama3.2-3b-instruct
- Dataset: Wisesight Sentiment
- Logging tool: WanDB.ai (please create your own account)
- Demo code: https://colab.float16.cloud/shared/fccac052-bootcamp-typhoon-x-float16-ai-bootcamp-llm-fine-tuning—deployment
(For the morning session, use the file named “Fine-Tuning”)
Part 2: Deployment
Section titled “Part 2: Deployment”Topics covered in the second session:
- Introduction to GGUF and Model Conversion
- Preparing the Model for GGUF Format
- Merging LoRA into the Full Model
- OpenAI API Compatibility (Endpoint Creation)
- Structured Outputs with Open-Source Models
- Workshop Time 💻
Lecture Video (Theory)
Section titled “Lecture Video (Theory)”Tip: click “Watch on YouTube” for the best viewing experience
Lecture Slides
Section titled “Lecture Slides”Workshop Resources
Section titled “Workshop Resources”(For the afternoon session, use the file named “Deployment”)