jncraton/languagemodels is a simple Python library for running LLMs locally. Supports instruction and embedding use cases. Chooses models according to available RAM.

github.com GitHub - jncraton/languagemodels: Explore large language models in 512MB of RAM

Explore large language models in 512MB of RAM. Contribute to jncraton/languagemodels development by creating an account on GitHub.