Inference & serving
Jlama
Provides embedded and distributed LLM inference from a JVM implementation, alongside a standalone serving CLI.
Overview
Research summary
Jlama runs supported language models inside Java applications and also provides a CLI, an OpenAI-compatible REST service and a chat interface. Its inference implementation handles SafeTensors models, several model architectures, quantized weights, embeddings, classification and tool calling. Applications can embed the core library directly or use its LangChain4j integration.
Distributed coordinator and worker commands allow inference work to be shared across machines. The project uses Java's Vector API, with optional native SIMD and experimental WebGPU backends, so deployment requirements depend on the selected runtime and backend. Its core, native and parent Maven artifacts represent one inference engine.
Repository summary
- Stars
- Unavailable
- Open issues
- Unavailable
- Last push
- Unavailable
- Commits, 90 days
- Unavailable
- Repository activity
- Not scored
- Version
- Unavailable
Recorded catalogue figures. View repository data and provenance →
Classification
Pricing & services
Paid services unknown
Whether the provider offers paid products or services has not been established.
Licence scope
Implementation
Recorded implementation details and interfaces for Jlama.
Implementation details
Java inference engine using the Vector API, with optional native SIMD and experimental WebGPU backends.
- Languages
- Java
- Repository type
- source
Recorded interfaces and capabilities
Licence scope
Repository
Repository snapshots, release information and recorded maintenance signals.
Repository snapshot
- Stars
- Unavailable
- Open issues
- Unavailable
- Last push
- Unavailable
- Commits, 90 days
- Unavailable
- Repository activity
- Not scored
- Archived
- Not recorded
Repository activity is a snapshot, not a quality or popularity ranking. It combines recent-push freshness (50%), 90-day commits (30%) and issue pressure (20%).
Maintenance and provenance
- Catalogue snapshot
- 2026-10-06
Documentation
Recorded references and research provenance for this entry.
Recorded sources 3
- https://github.com/tjake/Jlama Project page · Linked repository · Research reference
- https://central.sonatype.com/artifact/com.github.tjake/jlama-core Research reference
- https://github.com/tjake/Jlama/blob/main/LICENSE Research reference
Research metadata
- Research date
- 2026-10-02
- Catalogue snapshot
- 2026-10-06
Community & social 2 channels
Communities
- Discorddiscord.gg/HsYXHrMu6JOfficialInvitation requiredDiscussionSupport
Link details for Discord
- Last checked
- GitHub Discussionsgithub.com/tjake/Jlama/discussionsOfficialDiscussion
Link details for GitHub Discussions
- Last checked