Inference & serving
Xinference
One model lifecycle and API layer across several open-model types and inference backends.
Overview
Research summary
Xinference, also called Xorbits Inference, provides a model-serving layer for running supported open models on personal hardware or server infrastructure. It offers command-line and programmatic workflows for launching models, alongside APIs that applications can use for inference. The project supports multiple model families and inference backends, including language, embedding, and multimodal workloads. Developers use it to manage deployment and model access without integrating every engine directly. This entry covers the Apache-2.0 serving implementation; hosted or enterprise offerings and individual model weights have separate terms.
Repository summary
- Stars
- Unavailable
- Open issues
- Unavailable
- Last push
- Unavailable
- Commits, 90 days
- Unavailable
- Repository activity
- Not scored
- Version
- Unavailable
Recorded catalogue figures. View repository data and provenance →
Classification
Pricing & services
Paid services unknown
Whether the provider offers paid products or services has not been established.
Licence scope
Implementation
Recorded implementation details and interfaces for Xinference.
Implementation details
Python model management and inference-serving service
- Languages
- Python
- Repository type
- source
Recorded interfaces and capabilities
Licence scope
Repository
Repository snapshots, release information and recorded maintenance signals.
Repository snapshot
- Stars
- Unavailable
- Open issues
- Unavailable
- Last push
- Unavailable
- Commits, 90 days
- Unavailable
- Repository activity
- Not scored
- Archived
- Not recorded
Repository activity is a snapshot, not a quality or popularity ranking. It combines recent-push freshness (50%), 90-day commits (30%) and issue pressure (20%).
Maintenance and provenance
- Catalogue snapshot
- 2026-10-06
Documentation
Recorded references and research provenance for this entry.
Recorded sources 4
- https://inference.readthedocs.io Project page · Documentation
- https://github.com/xorbitsai/inference Linked repository · Research reference
- https://github.com/xorbitsai/inference/blob/main/README.md Research reference
- https://api.github.com/repos/xorbitsai/inference Research reference
Research metadata
- Research date
- 2026-10-02
- Catalogue snapshot
- 2026-10-06
Community & social 3 channels
Communities
- Discorddiscord.gg/Xw9tszSkr5Official
- Telegramt.me/+nCNpwmySwk9iYmI1Official
Social & updates
- Xx.com/xorbitsioOfficial