Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM
☆279Sep 27, 2026Updated this week
Alternatives and similar repositories for jitllm
Users that are interested in jitllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An extension to Llama2.java implementation accelerated with GPUs, using TornadoVM☆27Aug 1, 2024Updated 2 years ago
- Fast Gemma 4 inference in pure Java☆67Apr 24, 2026Updated 5 months ago
- 🎥 A Java implementation of Kinect Fusion running on Tornado VM.☆28Updated this week
- Write Java. Run on GPUs. Fast.☆1,513Updated this week
- Benchmarks, data and scripts for comparing Leyden with Graal Native Image☆34May 22, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Jlama is a modern LLM inference engine for Java☆1,309Oct 12, 2025Updated 11 months ago
- Llama 3+ inference in pure Java☆818Apr 24, 2026Updated 5 months ago
- Docker build scripts for TornadoVM on GPUs: https://github.com/beehive-lab/TornadoVM☆32Updated this week
- A library for working with colors based on go-colorful.☆20Apr 11, 2026Updated 5 months ago
- A real-time ray tracer in Java, accelerated on heterogeneous hardware using TornadoVM☆12Updated this week
- ☆20Apr 6, 2025Updated last year
- A library of useful Stream Gatherers (custom intermediate operations) for Java.☆184Sep 20, 2026Updated last week
- Example demonstrating how to execute native machine code directly from Java.☆15Jan 22, 2026Updated 8 months ago
- An advanced Java based inference engine for Large Language Models☆38Sep 20, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Java Code Isolation☆17Apr 26, 2021Updated 5 years ago
- Lightweight and type-safe parser combinators for Java.☆41Nov 15, 2025Updated 10 months ago
- Apple Silicon mlx with Zero Dependency Java☆53Aug 11, 2026Updated last month
- Parallel Bytecode Interpreter For Heterogeneous Hardware☆15Aug 27, 2021Updated 5 years ago
- Virtual-thread based safe concurrency & streaming☆424Sep 14, 2026Updated last week
- A file system implementation to access the contents of Java modules in a unified way.☆41Jun 18, 2026Updated 3 months ago
- Default parameter values for Java via annotation processing☆37Jan 9, 2026Updated 8 months ago
- Pure Java Protobuf tools☆36Updated this week
- Inference Llama 2 in one file of pure Java