Improve models configuration

This commit is contained in:
ben
2025-09-20 14:30:22 +02:00
parent 65839496c4
commit 1c19200e73
4 changed files with 39 additions and 33 deletions

View File

@@ -31,14 +31,13 @@ Note that it is probably possible to run the project on other GPUs or modern Mac
## How to launch the server
Choose the models you wish to use in the `docker-compose.yaml` file.
Choose the models you wish to use in the `.env` file. Put the embedding model first and the default model second.
```bash
environment:
- MODELS=...
MODELS=gemma3n:e4b,nomic-embed-text,gpt-oss:20b,llama3.1:8b,llama3.2:3b,gemma3:12b-it-qat
```
Add an API key to secure server access by adding a `.env` file like this:
Add an API key to secure server access by adding a `.env` file like this (you can generate one with `openssl rand -hex 16`):
```bash
LLM_API_KEY=1234567890