← Browse tools

Inference & serving

LocalAI

Composable self-hosted API service that loads model-specific backends on demand.

Overview

Research summary

LocalAI is a self-hosted AI engine that places compatible inference APIs in front of different model backends. Its core loads backend components as needed, allowing deployments to combine supported language, vision, speech, and generation models without installing every engine in advance. The project also includes user controls and agent features such as tools, retrieval, and MCP integration. Hardware support depends on the selected backend, with CPU and multiple accelerator options documented. LocalAI's MIT license applies to its implementation; downloaded models and backend dependencies retain their own terms.

Repository summary

Stars
Unavailable
Open issues
Unavailable
Last push
Unavailable
Commits, 90 days
Unavailable
Repository activity
Not scored
Version
Unavailable

Recorded catalogue figures. View repository data and provenance →

Classification

Pricing & services

Paid services unknown

Whether the provider offers paid products or services has not been established.

Licence scope

Implementation

Recorded implementation details and interfaces for LocalAI.

Implementation details

Go API server with independently packaged inference backends

Languages
Go
Repository type
source

Recorded interfaces and capabilities

Licence scope

Repository

Repository snapshots, release information and recorded maintenance signals.

Repository snapshot

mudler/LocalAI ↗

Stars
Unavailable
Open issues
Unavailable
Last push
Unavailable
Commits, 90 days
Unavailable
Repository activity
Not scored
Archived
Not recorded

Repository activity is a snapshot, not a quality or popularity ranking. It combines recent-push freshness (50%), 90-day commits (30%) and issue pressure (20%).

Maintenance and provenance

Catalogue snapshot
2026-10-06

Documentation

Recorded references and research provenance for this entry.

Recorded sources 4

Research metadata

Research date
2026-10-02
Catalogue snapshot
2026-10-06

Community & social 3 channels

Communities

Social & updates