LocalAI

Free open-source OpenAI-compatible API server for local models

Code & DevelopmentFree

LocalAI is an open-source server that provides an OpenAI-compatible REST API for running AI models locally. Developers can drop in LocalAI as a self-hosted OpenAI replacement, enabling any OpenAI-compatible application to run on local models. It supports text generation, image generation, speech, and embeddings across dozens of model formats.

Key Features

• ✓OpenAI-compatible REST API server
• ✓Text, image, speech, and embeddings support
• ✓Multiple model format support (GGUF, ONNX)
• ✓Docker-based deployment
• ✓GPU and CPU inference modes