ben/ai_env
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Isolating containers from internet access to enhance security.

Browse Source
This commit is contained in:
ben
2023-03-04 22:22:22 +01:00
parent f3eae794ac
commit 207592ff57
9 changed files with 53 additions and 22 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
README.md
View File

@@ -46,7 +46,7 @@ Add an API key to secure server access by adding a `.env` file like this:
LLM_API_KEY=1234567890
```
Create a user authentication for aichat web UI:
Create a user authentication for aichat Web UI:
```
htpasswd -c src/nginx/htpasswd user
@@ -60,7 +60,7 @@ docker compose up --build -d
Then wait for the models to finish downloading using the following command to display the status:
```
docker-compose logs -f llm_provision
docker-compose logs -f ollama_provision
```
## How to use
@@ -120,3 +120,9 @@ Example:
export TTS_API_HOST="https://your-remote-domain"
./tools/speech.sh ...
```
## Web UI
A web application to interact with supported LLMs directly from your browser is available at [http://127.0.0.1:8000/playground](http://127.0.0.1:8000/playground).
A web platform to compare different LLMs side-by-side is available at [http://127.0.0.1:8000/arena](http://127.0.0.1:8000/arena).