ben/ai_env
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Add informations about performances.

Browse Source
This commit is contained in:
ben
2025-01-12 16:22:23 +01:00
parent d07e573d30
commit 09fda93a20
1 changed files with 7 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
README.md
View File

@@ -20,11 +20,15 @@ Everything is free, open-source and automated using Docker Compose and shell scr
## Requirements ## Requirements
To run this project efficiently, a modern computer with a recent NVIDIA GPU is required. To run this project efficiently, a powerful computer with a recent NVIDIA GPU is required.
As an example, I achieved good performance with an Intel(R) Core(TM) i7-14700HX, a GeForce RTX 4050, and 32GB of RAM. As an example, I achieved good performance with an Intel(R) Core(TM) i7-14700HX, a GeForce RTX 4050, and 32GB of RAM using the [qwen2.5:7b](https://ollama.com/library/qwen2.5) model.
You must use Linux and the [NVIDIA Container Toolkit](https://github.com/NVIDIA/nvidia-container-toolkit). The model [qwen2.5-coder:32b](https://ollama.com/library/qwen2.5-coder:32b) is usable but slow with this configuration.
Note that more modest models like [llama3.2:3b](https://ollama.com/library/llama3.2) require much fewer resources and still allow you to do a lot of things.
On GNU/Linux, you must use the [NVIDIA Container Toolkit](https://github.com/NVIDIA/nvidia-container-toolkit).
Note that it is probably possible to run the project on other GPUs or modern MacBooks, but this is not the purpose of this project. Note that it is probably possible to run the project on other GPUs or modern MacBooks, but this is not the purpose of this project.