π Quickstart
π» System Requirements
LLM-VM uses Python and is compatible with version 3.8 and higher.
Dependencies Used
LLM-VM makes use of the following Python dependencies and versions.
These can be installed automatically from the LLM-VM folder with
pip3 install .
Installing with the
--editable
flag allows your changes to the codebase take effect without rebuilding with pip3 install .
Supported Models
Which model you choose to use will be the biggest impact on your systemβs requirements.
LLM-VM comes with support for some default models intended to get people experimenting with LLMs. You can see their specifications here.
We recommend making sure you have enough RAM to load the models.
Our section on Local LLMs has more information on specifying LLM models.
Visit our Github Repo
Interested in learning more? Come see the code!