Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs
☆290Oct 7, 2026Updated last week
Alternatives and similar repositories for jitllm
Users that are interested in jitllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An extension to Llama2.java implementation accelerated with GPUs, using TornadoVM☆27Aug 1, 2024Updated 2 years ago
- Fast Gemma 4 inference in pure Java☆70Apr 24, 2026Updated 5 months ago
- 🎥 A Java implementation of Kinect Fusion running on Tornado VM.☆28Oct 7, 2026Updated last week
- Write Java. Run on GPUs. Fast.☆1,528Updated this week
- Benchmarks, data and scripts for comparing Leyden with Graal Native Image☆34May 22, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Jlama is a modern LLM inference engine for Java☆1,313Oct 12, 2025Updated last year
- Llama 3+ inference in pure Java☆820Apr 24, 2026Updated 5 months ago
- Docker build scripts for TornadoVM on GPUs: https://github.com/beehive-lab/TornadoVM☆32Oct 9, 2026Updated last week
- A library for working with colors based on go-colorful.☆20Apr 11, 2026Updated 6 months ago
- A real-time ray tracer in Java, accelerated on heterogeneous hardware using TornadoVM☆12Updated this week
- A library of useful Stream Gatherers (custom intermediate operations) for Java.☆184Updated this week
- Java Code Isolation☆17Apr 26, 2021Updated 5 years ago
- An advanced Java based inference engine for Large Language Models☆40Updated this week
- Lightweight and type-safe parser combinators for Java.☆42Nov 15, 2025Updated 11 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Parallel Bytecode Interpreter For Heterogeneous Hardware☆15Aug 27, 2021Updated 5 years ago
- Apple Silicon mlx with Zero Dependency Java☆53Aug 11, 2026Updated 2 months ago
- ☆20Apr 6, 2025Updated last year
- Inference Llama 2 in one file of pure Java☆229May 17, 2024Updated 2 years ago
- https://openjdk.org/projects/babylon☆159Updated this week
- Pure Java rsync-like library for local to/from remote ssh/sftp. Can be used programmatically or via the command-line. Works on all platfo…☆61Dec 6, 2025Updated 10 months ago
- Virtual-thread based safe concurrency & streaming☆424Updated this week
- A Java library for building modern terminal user interfaces.☆682Updated this week
- The simplest way to build data apps and webapps in Java. Inspired by Streamlit.☆139Jun 6, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Native JVM WebAssembly runtime☆1,140Jul 6, 2026Updated 3 months ago
- ☆59Jul 4, 2026Updated 3 months ago
- Llama3.java Inference engine with OpenAI Chat Completion REST API/☆28Feb 3, 2025Updated last year
- Default parameter values for Java via annotation processing☆37Jan 9, 2026Updated 9 months ago
- Effects for Java☆19Jan 28, 2019Updated 7 years ago
- A file system implementation to access the contents of Java modules in a unified way.☆41Jun 18, 2026Updated 4 months ago
- Example demonstrating how to execute native machine code directly from Java.☆15Jan 22, 2026Updated 8 months ago
- ☆124May 19, 2026Updated 4 months ago
- Pure Java Protobuf tools☆36Oct 1, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A real-time ray tracer in Java, accelerated on heterogeneous hardware using TornadoVM☆26Jul 24, 2024Updated 2 years ago
- A Linux graphical shell written in modern Java with the new Foreign Function & Memory APIs☆41Apr 1, 2024Updated 2 years ago
- A controlled concurrency testing framework for the JVM☆495Jul 17, 2026Updated 3 months ago
- A pluggable actor system written in java leveraging modern features from JDK21+☆41Jul 25, 2026Updated 2 months ago
- A platform independent tensor library with autograd for the JVM☆91Jan 25, 2026Updated 8 months ago
- Set of examples written for hardware acceleration via TornadoVM☆17Feb 26, 2025Updated last year
- Website for jbang.dev☆14Updated this week