From 09fda93a208e3e6a996cb621b3509a8bb3b61d00 Mon Sep 17 00:00:00 2001 From: ben Date: Sun, 12 Jan 2025 16:22:23 +0100 Subject: Add informations about performances. --- README.md | 10 +++++++--- 1 file changed, 7 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index e9b3d7b..c51b461 100644 --- a/README.md +++ b/README.md @@ -20,11 +20,15 @@ Everything is free, open-source and automated using Docker Compose and shell scr ## Requirements -To run this project efficiently, a modern computer with a recent NVIDIA GPU is required. +To run this project efficiently, a powerful computer with a recent NVIDIA GPU is required. -As an example, I achieved good performance with an Intel(R) Core(TM) i7-14700HX, a GeForce RTX 4050, and 32GB of RAM. +As an example, I achieved good performance with an Intel(R) Core(TM) i7-14700HX, a GeForce RTX 4050, and 32GB of RAM using the [qwen2.5:7b](https://ollama.com/library/qwen2.5) model. -You must use Linux and the [NVIDIA Container Toolkit](https://github.com/NVIDIA/nvidia-container-toolkit). +The model [qwen2.5-coder:32b](https://ollama.com/library/qwen2.5-coder:32b) is usable but slow with this configuration. + +Note that more modest models like [llama3.2:3b](https://ollama.com/library/llama3.2) require much fewer resources and still allow you to do a lot of things. + +On GNU/Linux, you must use the [NVIDIA Container Toolkit](https://github.com/NVIDIA/nvidia-container-toolkit). Note that it is probably possible to run the project on other GPUs or modern MacBooks, but this is not the purpose of this project. -- cgit v1.2.3