Inference & serving
mistral.rs
Rust-native multi-model inference with both embedded SDKs and compatible serving APIs.
Overview
Research summary
mistral.rs is a Rust inference project for running a range of supported language and multimodal model architectures. It provides command-line tools, a model server, and Python and Rust interfaces for embedding inference into applications. The project documents quantized model loading, hardware-specific execution, and compatibility with common request formats. Developers can use it for local or hosted inference while choosing the appropriate model and build configuration. Despite its name, it is an independent multi-model engine rather than a hosted Mistral AI service.
Repository summary
- Stars
- Unavailable
- Open issues
- Unavailable
- Last push
- Unavailable
- Commits, 90 days
- Unavailable
- Repository activity
- Not scored
- Version
- Unavailable
Recorded catalogue figures. View repository data and provenance →
Classification
Pricing & services
Paid services unknown
Whether the provider offers paid products or services has not been established.
Licence scope
Implementation
Recorded implementation details and interfaces for mistral.rs.
Implementation details
Rust inference engine with Python bindings and HTTP serving
- Languages
- Rust
- Repository type
- source
Recorded interfaces and capabilities
Licence scope
Repository
Repository snapshots, release information and recorded maintenance signals.
Repository snapshot
- Stars
- Unavailable
- Open issues
- Unavailable
- Last push
- Unavailable
- Commits, 90 days
- Unavailable
- Repository activity
- Not scored
- Archived
- Not recorded
Repository activity is a snapshot, not a quality or popularity ranking. It combines recent-push freshness (50%), 90-day commits (30%) and issue pressure (20%).
Maintenance and provenance
- Catalogue snapshot
- 2026-10-06
Documentation
Recorded references and research provenance for this entry.
Recorded sources 3
- https://github.com/EricLBuehler/mistral.rs Project page · Linked repository · Research reference
- https://github.com/EricLBuehler/mistral.rs/blob/master/README.md Research reference
- https://api.github.com/repos/EricLBuehler/mistral.rs Research reference
Research metadata
- Research date
- 2026-10-02
- Catalogue snapshot
- 2026-10-06
Community & social 2 channels
Communities
- Discorddiscord.gg/SZrecqK8qwOfficial
- GitHub Discussionsgithub.com/EricLBuehler/mistral.rs/discussionsOfficial
Link details for GitHub Discussions
- Last checked