LM Studio
- Discover, download, and run local LLMs
- Download
- Youtube video of how to run a model
Gpt4All
- A free-to-use, locally running, privacy-aware chatbot. No GPU or internet required.
- Download
LocalAI
Setup Rest API for GPT
- Install Conda / MiuniConda
- Create Environment
- Add to environment:
- Pytorch
- Transformers
- Flask