Dependencies Used

LLM-VM makes use of the following Python dependencies and versions.

These can be installed automatically from the LLM-VM folder with

pip3 install .
Installing with the --editable flag allows your changes to the codebase take effect without rebuilding with pip3 install .

Supported Models

Which model you choose to use will be the biggest impact on your system’s requirements.

LLM-VM comes with support for some default models intended to get people experimenting with LLMs. You can see their specifications here.

We recommend making sure you have enough RAM to load the models.

Our section on Local LLMs has more information on specifying LLM models.

Visit our Github Repo

Interested in learning more? Come see the code!