Skip to main content
Model is where you choose the local model Chat and Personas use on this computer. Click your name at the bottom of the sidebar, then Settings, then Model. Picking a model does not download it yet. Apply starts the download and load.

Choose a model

1

Open Model

Click your name at the bottom of the sidebar, then Settings, then Model.
2

Open the catalog

Click the model field. Pick a family, then a size. Some models also ask you to pick a quantization.
3

Check that it fits

Each choice shows how much memory it needs. A laptop mark means that model is already on this computer. A download mark means it is not. The footer shows free disk space.
4

Apply

Click Apply. Progress appears in the header as Downloading model or Loading model, with a percent. A model published in several parts shows which part is in progress.
If that model is already loaded, Apply stays off until you pick a different one. While the same model is downloading, click Apply again to stop it.
Thinking mode appears when the selected model can show its reasoning. It starts on. Leave it on to get Thinking and Thought process in Chat. Turn it off to skip that reasoning step.
Some catalog models need a Hugging Face token before the first download. Save the token when the form appears, then click Apply.

Personas on this page

The Persona list is on the same Settings page. Local Personas use the model you applied above. Click + New Persona to create one, or open a row to edit it. For chatting with a Persona and the full create flow, see Personas.

Common questions