Inference & serving
bitsandbytes
Provides low-bit linear layers and optimizer states that existing model frameworks can adopt directly.
Overview
Research summary
bitsandbytes supplies low-bit operations used to reduce memory requirements when running or adapting large models. Its main components include 8-bit optimizers, 8-bit inference and 4-bit quantization primitives used by QLoRA workflows. These components integrate with PyTorch and the Hugging Face ecosystem rather than presenting a standalone model server. Supported accelerators, numerical formats and operating systems depend on the available backend. The project is useful when memory consumption limits experimentation or deployment on a given machine.
Repository summary
- Stars
- 8,509
- Open issues
- Unavailable
- Last push
- 2026-09-07
- Commits, 90 days
- Unavailable
- Repository activity
- Not scored
- Version
- Unavailable
Recorded catalogue figures. View repository data and provenance →
Classification
Pricing & services
Paid services unknown
Whether the provider offers paid products or services has not been established.
Licence scope
Implementation
Recorded implementation details and interfaces for bitsandbytes.
Implementation details
Python library and supporting tools
- Languages
- Python
- Repository type
- source
Recorded interfaces and capabilities
Licence scope
Repository
Repository snapshots, release information and recorded maintenance signals.
Repository snapshot
bitsandbytes-foundation/bitsandbytes ↗
- Stars
- 8,509
- Open issues
- Unavailable
- Last push
- 2026-09-07
- Commits, 90 days
- Unavailable
- Repository activity
- Not scored
- Archived
- Not recorded
Repository activity is a snapshot, not a quality or popularity ranking. It combines recent-push freshness (50%), 90-day commits (30%) and issue pressure (20%).
Maintenance and provenance
- Catalogue snapshot
- 2026-10-06
- Stars source
- Recorded fallback
- Last push source
- Recorded fallback
Documentation
Recorded references and research provenance for this entry.
Recorded sources 5
- https://huggingface.co/docs/bitsandbytes/main/en/index Project page · Documentation
- https://github.com/bitsandbytes-foundation/bitsandbytes Linked repository · Research reference
- https://api.github.com/repos/bitsandbytes-foundation/bitsandbytes Research reference
- https://github.com/bitsandbytes-foundation/bitsandbytes/blob/main/README.md Research reference
- https://github.com/bitsandbytes-foundation/bitsandbytes/blob/main/LICENSE Research reference
Research metadata
- Research date
- 2026-10-02
- Catalogue snapshot
- 2026-10-06
Community & social 1 channels
Communities
- GitHub Discussionsgithub.com/bitsandbytes-foundation/bitsandbytes/discussionsOfficial
Link details for GitHub Discussions
- Last checked