> For the complete documentation index, see [llms.txt](https://docs.bonzai.sh/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.bonzai.sh/generation-guide/text.md).

# Text Models

BonzAI supports a broad catalog of local language models plus custom GGUF language models stored on your computer.

## Choose by purpose

* Small general models for fast everyday chat.
* Reasoning models for structured analysis.
* Coder models for programming and technical work.
* Creative/roleplay models for companions and fiction.
* Larger models for difficult instructions when hardware permits.
* Abliterated models for lawful local experimentation with reduced refusal behavior.

Notable current families include Qwen, DeepSeek, Gemma, GLM 4/5, MiniMax M2/M3, Ornith 9B/35B, Hermes, Mistral, Llama, Phi, Codestral, Yi Coder, GPT-OSS, and DiffusionGemma. Exact variants and quants appear in Desktop because the catalog evolves faster than a static list.

## Quantization

Quantization compresses a model. Smaller quants need less memory and run faster; larger quants preserve more quality. BonzAI emphasizes Unsloth-compatible GGUF sources where available and displays hardware guidance.

## Context and recall

Conversation context contains the current exchange. Persistent memory contains selected useful knowledge across time. Keeping them separate prevents every old message from overwhelming every new prompt.

## Custom GGUF

Custom GGUF import is for language models only. The file remains on your storage. Compatibility depends on whether the bundled local inference runtime supports that model architecture.