3LM-setup-wizard

llama-cpp-python, which is mainly used to run GGUF local LLM models. It's very convenient, but the setup is quite tedious, so this tool allows you to install the optimal llama-cpp-python for most environments all in one go. Since the main focus is on installing llama-cpp-python, please research and install any other necessary files yourself.

It also includes functionality to decide whether or not to create a virtual environment, and after setup, to temporarily (or permanently) download a lightweight model from HuggingFace and test whether it actually works.