Get started
Download and install#
- Open the downloads section.
- Download the package for your operating system.
- Install it and start Assistant.
| OS | Packages |
|---|---|
| Windows | Installer (.exe) or portable .zip |
| macOS | Disk image (.dmg) or .zip, universal |
| Linux | Debian package (.deb) or .tar.gz |
The Windows and macOS packages are not signed. The operating system shows a warning on the first start. Confirm it to continue.
The app includes a model runner (llama.cpp) for your CPU. On macOS it uses the GPU (Metal). On a computer with an NVIDIA graphics card you can add GPU acceleration later. See Models and engines.
First run#
The setup wizard opens after the first start. It has five steps. Each step saves when you leave it.
- Introduction.
- Basics. Set an app-lock PIN (6 digits, optional), your time zone, your home location and the update check.
- Inference engine. Keep the built-in model runner, or enter the address of a llama.cpp server that you run elsewhere and press Test. Select the memory model. When the built-in runner has no model, the wizard downloads a starter model (a small file, a few hundred MB). An optional TypeSafe key adds Jev, a decision model for group conversations.
- Starter personas and recipes. Select the ones you want.
- Done.
Skip setup keeps the defaults. You can change every value later in Settings.
Your first chat#
- Wait until the status bar shows the engine online. The first request loads the model, which takes a moment.
- Type a message and press Enter.
- The reply streams in. Press Esc to stop it.
Open the conversation settings panel (View → Conversation Settings Panel) to select another model or change the prompt. See Chat.
Add a model#
Models are files in the GGUF format. Open Settings → Engines, open the Built-in llama.cpp engine and use the Download list. Or copy a GGUF file into the models folder shown there. See Models and engines.