Improve models configuration
This commit is contained in:
@@ -31,14 +31,13 @@ Note that it is probably possible to run the project on other GPUs or modern Mac
|
||||
|
||||
## How to launch the server
|
||||
|
||||
Choose the models you wish to use in the `docker-compose.yaml` file.
|
||||
Choose the models you wish to use in the `.env` file. Put the embedding model first and the default model second.
|
||||
|
||||
```bash
|
||||
environment:
|
||||
- MODELS=...
|
||||
MODELS=gemma3n:e4b,nomic-embed-text,gpt-oss:20b,llama3.1:8b,llama3.2:3b,gemma3:12b-it-qat
|
||||
```
|
||||
|
||||
Add an API key to secure server access by adding a `.env` file like this:
|
||||
Add an API key to secure server access by adding a `.env` file like this (you can generate one with `openssl rand -hex 16`):
|
||||
|
||||
```bash
|
||||
LLM_API_KEY=1234567890
|
||||
|
||||
Reference in New Issue
Block a user