Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs
☆295Nov 3, 2026Updated this week
Alternatives and similar repositories for jitllm
Users that are interested in jitllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Write Java. Run on GPUs. Fast.☆1,558Updated this week
- An extension to Llama2.java implementation accelerated with GPUs, using TornadoVM☆27Aug 1, 2024Updated 2 years ago
- Docker build scripts for TornadoVM on GPUs: https://github.com/beehive-lab/TornadoVM☆32Oct 27, 2026Updated last week
- Fast Gemma 4 inference in pure Java☆70Apr 24, 2026Updated 6 months ago
- 🎥 A Java implementation of Kinect Fusion running on Tornado VM.☆28Oct 27, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Jlama is a modern LLM inference engine for Java☆1,310Oct 12, 2025Updated last year
- Llama 3+ inference in pure Java☆817Apr 24, 2026Updated 6 months ago
- An advanced Java based inference engine for Large Language Models☆44Updated this week
- AI sovereignty for the world's most trusted runtime.☆188Oct 27, 2026Updated last week
- Benchmarks, data and scripts for comparing Leyden with Graal Native Image☆34May 22, 2025Updated last year
- Java numerations - a library which has various numerical analysis (High-performance pure Java 25 & Kotlin numerical computing and tensor …☆33Oct 21, 2026Updated 2 weeks ago
- A CLI to manage install and configure llama inference implemenation in multiple languages☆63Jan 4, 2024Updated 2 years ago
- A real-time ray tracer in Java, accelerated on heterogeneous hardware using TornadoVM☆12Oct 27, 2026Updated last week
- A library for working with colors based on go-colorful.☆20Apr 11, 2026Updated 6 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Set of examples written for hardware acceleration via TornadoVM☆17Feb 26, 2025Updated last year
- Llama3.java Inference engine with OpenAI Chat Completion REST API/☆28Feb 3, 2025Updated last year
- A library of useful Stream Gatherers (custom intermediate operations) for Java.☆189Oct 22, 2026Updated 2 weeks ago
- TornadoInsight: Unleashing the Power of TornadoVM in IntelliJ IDEA☆15Updated this week
- High-performance and modular quantum simulator in Java☆20Jun 12, 2023Updated 3 years ago
- Fast Qwen 3.5 inference in pure Java☆16May 10, 2026Updated 5 months ago
- A Java library for building modern terminal user interfaces.☆696Updated this week
- The simplest way to build data apps and webapps in Java. Inspired by Streamlit.☆141Jun 6, 2026Updated 5 months ago
- Java Code Isolation☆17Apr 26, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Parallel Bytecode Interpreter For Heterogeneous Hardware☆15Aug 27, 2021Updated 5 years ago
- Lightweight and type-safe parser combinators for Java.☆42Nov 15, 2025Updated 11 months ago
- Virtual-thread based safe concurrency & streaming☆427Updated this week
- Apple Silicon mlx with Zero Dependency Java☆55Oct 13, 2026Updated 3 weeks ago
- Inference Llama 2 in one file of pure Java☆227May 17, 2024Updated 2 years ago
- Pure Java rsync-like library for local to/from remote ssh/sftp. Can be used programmatically or via the command-line. Works on all platfo…☆61Dec 6, 2025Updated 11 months ago
- ☆20Apr 6, 2025Updated last year
- Native JVM WebAssembly runtime☆1,144Jul 6, 2026Updated 4 months ago
- LLM Testing Library for Java: Fault Injections, Prompt Injections, Adversarial Attacks, Guardrails Testing, Bias Testing☆21Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- https://openjdk.org/projects/babylon☆160Updated this week
- Example demonstrating how to execute native machine code directly from Java.☆15Jan 22, 2026Updated 9 months ago
- Default parameter values for Java via annotation processing☆37Jan 9, 2026Updated 9 months ago
- Effects for Java☆19Jan 28, 2019Updated 7 years ago
- Pure Java Protobuf tools☆36Updated this week
- A file system implementation to access the contents of Java modules in a unified way.☆41Jun 18, 2026Updated 4 months ago
- ☆59Jul 4, 2026Updated 4 months ago