Skip to content

Typhoon Documentation & Developer Guide

👋 Welcome to Typhoon Documentation

Explore Typhoon — Thai-first, multilingual large language models optimized for practical deployment and developer accessibility. Whether you’re prototyping in a notebook, scaling an AI product, or just getting started with automation, you’ll find everything you need here.

🗺️ Overview: Where & How to Access Typhoon Models

Section titled “🗺️ Overview: Where & How to Access Typhoon Models”

Typhoon is available across multiple platforms. Choose what fits your workflow and infrastructure:

Best for: Fast experimentation and prompt design

No setup required — just start typing. Our playgrounds support both text and multimodal input.

Best for: Web apps, agents, automation workflows, and scalable integrations

Includes everything where you send a request and get a response over HTTP — regardless of where the model is hosted. This would include:

Typhoon API (hosted by Typhoon team)

Together.ai (official partner)

OpenRouter (community router)

Cloud Marketplaces (e.g. AWS, Azure)

Key Features

  • OpenAI-Compatible API: Drop-in replacement for existing OpenAI-based apps
  • Streaming Support: Token-by-token real-time responses
  • Zero cost for light usage — ideal for startups and prototyping
  • Hosted and maintained by Typhoon

Available Text Models

Model IDSizeDescriptionContext WindowRate LimitsRelease Date
typhoon-v2.5-30b-a3b-instruct30BBest model for instruction-following, tool use, and Thai NLP128K tokens5 req/s, 200 req/m2025-10-20
typhoon-v2.1-12b-instruct12BPowerful model for general purpose with reasoning mode toggle56K tokens5 req/s, 200 req/m2025-05-05

We also have APIs for OCR and ASR models.

Jump in and start building with Thai-first LLMs in just a few steps:

  1. 🔑 Create your API key — Sign up on the Typhoon Playground to generate your free API key.

  2. 📘 Follow the Quickstart Guide — Learn how to make your first API call with step-by-step instructions.

  3. 💡 Explore real-world use cases + source codes! — See you can use Typhoon in business, automation, and research.

  4. 💻 Browse example code and templates — Speed up your integration with ready-to-use API calls and workflows.

If you’re looking to scale Typhoon in your business or product with guaranteed availability, high throughput, and simple billing, Together.ai is our official cloud partner.

Why Together.ai?

  • Production-ready infrastructure — optimized for low latency and stability

  • Almost no rate limits — deploy large-scale agents or multi-user apps

  • Simple pay-as-you-go billing — scale from startup to enterprise

🔧 Available Typhoon Models on Together.ai

ModelSizeDescriptionEndpointNote
Typhoon 2.1 Gemma12BLightweight and powerful for most common use cases🔗 Endpoint.

📘 Read our quickstart guide

OpenRouter is a rising favorite among developers for its flexibility and ease of use. Typhoon models are now available on OpenRouter, making it easy to:

  • 🔄 Compare Typhoon with other top open-source models
  • ⚙️ Plug directly into automation tools like n8n, Zapier, and Make.com
  • 🧩 Use Typhoon in custom chatbot frameworks and no-code/low-code agents. This is ideal for Thai startups building agents, lead-generation bots, or content automation flows.

📘 View Typhoon on OpenRouter

Deploy Typhoon in your existing cloud environment.

  • AWS Marketplace: Coming soon

Please refer to respective platforms for deployment and billing setup.

These tools support local use:

Use Typhoon entirely offline — great for R&D, privacy-sensitive use, or enterprise IT environments.

  • Fine-tune and run Typhoon models with the transformers library

  • Use in offline, on-premise settings

  • Access models in GGUF, Safetensors, and standard formats

🔗 Explore Typhoon on Hugging Face

Use Typhoon on your laptop with local tools. No GPU? No problem — use quantized models with CPU inference.

  • LM Studio: GUI app for offline use (GGUF format)

  • Ollama: Run with one CLI command

🔗 Typhoon on Ollama

📘 Ollama Quickstart Guide

📘 LM Studio Quickstart Guide