← Browse tools

Inference & serving

SGLang

Inference runtime that combines model serving with cache reuse and hardware-specific deployment recipes.

Overview

Research summary

SGLang is an inference framework for deploying language and multimodal models on supported local or cloud hardware. Its runtime provides scheduling, caching, and model execution infrastructure for applications that generate many related requests, including agent workloads and reinforcement learning rollouts. Developers launch a model server and configure it for the selected model and accelerator. The project publishes platform guides and deployment recipes covering several hardware families. This entry describes the serving framework; model weights and companion training projects have their own distribution and licensing.

Repository summary

Stars
Unavailable
Open issues
Unavailable
Last push
Unavailable
Commits, 90 days
Unavailable
Repository activity
Not scored
Version
Unavailable

Recorded catalogue figures. View repository data and provenance →

Classification

Pricing & services

Paid services unknown

Whether the provider offers paid products or services has not been established.

Licence scope

Implementation

Recorded implementation details and interfaces for SGLang.

Implementation details

Python inference framework with native accelerator kernels

Languages
Python
Repository type
source

Recorded interfaces and capabilities

Licence scope

Repository

Repository snapshots, release information and recorded maintenance signals.

Repository snapshot

sgl-project/sglang ↗

Stars
Unavailable
Open issues
Unavailable
Last push
Unavailable
Commits, 90 days
Unavailable
Repository activity
Not scored
Archived
Not recorded

Repository activity is a snapshot, not a quality or popularity ranking. It combines recent-push freshness (50%), 90-day commits (30%) and issue pressure (20%).

Maintenance and provenance

Catalogue snapshot
2026-10-06

Documentation

Recorded references and research provenance for this entry.

Recorded sources 4

Research metadata

Research date
2026-10-02
Catalogue snapshot
2026-10-06

Community & social 4 channels

Communities

Social & updates