Inference & serving
llama-swap
On-demand process and model swapping in front of existing local inference servers.
Overview
Research summary
llama-swap is a Go proxy for managing multiple local model servers from one configuration. It routes compatible OpenAI or Anthropic requests to configured backends and starts or unloads model processes as needed. The approach lets developers keep several model definitions available while controlling which processes occupy memory. It supports different inference servers instead of implementing its own model execution engine. Deployment uses a standalone binary and configuration file, making it suitable for local development and self-hosted model routing.
Repository summary
- Stars
- Unavailable
- Open issues
- Unavailable
- Last push
- Unavailable
- Commits, 90 days
- Unavailable
- Repository activity
- Not scored
- Version
- Unavailable
Recorded catalogue figures. View repository data and provenance →
Classification
Pricing & services
Paid services unknown
Whether the provider offers paid products or services has not been established.
Licence scope
Implementation
Recorded implementation details and interfaces for llama-swap.
Implementation details
Standalone Go reverse proxy and model-process manager
- Languages
- Go
- Repository type
- source
Recorded interfaces and capabilities
Licence scope
Repository
Repository snapshots, release information and recorded maintenance signals.
Repository snapshot
- Stars
- Unavailable
- Open issues
- Unavailable
- Last push
- Unavailable
- Commits, 90 days
- Unavailable
- Repository activity
- Not scored
- Archived
- Not recorded
Repository activity is a snapshot, not a quality or popularity ranking. It combines recent-push freshness (50%), 90-day commits (30%) and issue pressure (20%).
Maintenance and provenance
- Catalogue snapshot
- 2026-10-06
Documentation
Recorded references and research provenance for this entry.
Recorded sources 3
- https://github.com/mostlygeek/llama-swap Project page · Linked repository · Research reference
- https://github.com/mostlygeek/llama-swap/blob/main/README.md Research reference
- https://api.github.com/repos/mostlygeek/llama-swap Research reference
Research metadata
- Research date
- 2026-10-02
- Catalogue snapshot
- 2026-10-06
Community & social 1 channels
Communities
- GitHub Discussionsgithub.com/mostlygeek/llama-swap/discussionsOfficial
Link details for GitHub Discussions
- Last checked