← Browse tools

Inference & serving

MLC LLM

A shared compiled inference engine spanning server, desktop, browser, and mobile deployments.

Overview

Research summary

MLC LLM is a compiler-based deployment system for running language models across supported hardware and operating systems. Its MLCEngine runtime is exposed through interfaces for Python, JavaScript, mobile applications, and an OpenAI-compatible REST server. The project targets several accelerator backends, including CUDA, Vulkan, Metal, and browser WebGPU, with support varying by platform and model. Developers use its compilation and packaging workflow when they need native execution across devices. This entry covers the deployment engine; WebLLM remains a separately identified browser integration in the catalogue.

Repository summary

Stars
Unavailable
Open issues
Unavailable
Last push
Unavailable
Commits, 90 days
Unavailable
Repository activity
Not scored
Version
Unavailable

Recorded catalogue figures. View repository data and provenance →

Classification

Pricing & services

Paid services unknown

Whether the provider offers paid products or services has not been established.

Licence scope

Implementation

Recorded implementation details and interfaces for MLC LLM.

Implementation details

Machine-learning compilation stack and cross-platform model runtime

Languages
Python
Repository type
source

Recorded interfaces and capabilities

Licence scope

Repository

Repository snapshots, release information and recorded maintenance signals.

Repository snapshot

mlc-ai/mlc-llm ↗

Stars
Unavailable
Open issues
Unavailable
Last push
Unavailable
Commits, 90 days
Unavailable
Repository activity
Not scored
Archived
Not recorded

Repository activity is a snapshot, not a quality or popularity ranking. It combines recent-push freshness (50%), 90-day commits (30%) and issue pressure (20%).

Maintenance and provenance

Catalogue snapshot
2026-10-06

Documentation

Recorded references and research provenance for this entry.

Recorded sources 4

Research metadata

Research date
2026-10-02
Catalogue snapshot
2026-10-06

Community & social 1 channels

Communities