Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM
☆279Sep 27, 2026Updated this week
Alternatives and similar repositories for jitllm
Users that are interested in jitllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An extension to Llama2.java implementation accelerated with GPUs, using TornadoVM☆27Aug 1, 2024Updated 2 years ago
- Fast Gemma 4 inference in pure Java☆67Apr 24, 2026Updated 5 months ago
- 🎥 A Java implementation of Kinect Fusion running on Tornado VM.☆28Updated this week
- Write Java. Run on GPUs. Fast.☆1,513Updated this week
- Benchmarks, data and scripts for comparing Leyden with Graal Native Image☆34May 22, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Jlama is a modern LLM inference engine for Java☆1,309Oct 12, 2025Updated 11 months ago
- Llama 3+ inference in pure Java☆818Apr 24, 2026Updated 5 months ago
- Docker build scripts for TornadoVM on GPUs: https://github.com/beehive-lab/TornadoVM☆32Updated this week
- A library for working with colors based on go-colorful.☆20Apr 11, 2026Updated 5 months ago
- A real-time ray tracer in Java, accelerated on heterogeneous hardware using TornadoVM☆12Updated this week
- ☆20Apr 6, 2025Updated last year
- A library of useful Stream Gatherers (custom intermediate operations) for Java.☆184Sep 20, 2026Updated last week
- Example demonstrating how to execute native machine code directly from Java.☆15Jan 22, 2026Updated 8 months ago
- An advanced Java based inference engine for Large Language Models☆38Sep 20, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Java Code Isolation☆17Apr 26, 2021Updated 5 years ago
- Lightweight and type-safe parser combinators for Java.☆41Nov 15, 2025Updated 10 months ago
- Apple Silicon mlx with Zero Dependency Java☆53Aug 11, 2026Updated last month
- Parallel Bytecode Interpreter For Heterogeneous Hardware☆15Aug 27, 2021Updated 5 years ago
- Virtual-thread based safe concurrency & streaming☆424Sep 14, 2026Updated last week
- A file system implementation to access the contents of Java modules in a unified way.☆41Jun 18, 2026Updated 3 months ago
- Default parameter values for Java via annotation processing☆37Jan 9, 2026Updated 8 months ago
- Pure Java Protobuf tools☆36Updated this week
- Inference Llama 2 in one file of pure Java☆228May 17, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Pure Java rsync-like library for local to/from remote ssh/sftp. Can be used programmatically or via the command-line. Works on all platfo…☆61Dec 6, 2025Updated 9 months ago
- A pluggable actor system written in java leveraging modern features from JDK21+☆41Jul 25, 2026Updated 2 months ago
- ☆59Jul 4, 2026Updated 2 months ago
- https://openjdk.org/projects/babylon☆157Updated this week
- Native JVM WebAssembly runtime☆1,136Jul 6, 2026Updated 2 months ago
- Effects for Java☆19Jan 28, 2019Updated 7 years ago
- A controlled concurrency testing framework for the JVM☆493Jul 17, 2026Updated 2 months ago
- ☆124May 19, 2026Updated 4 months ago
- A platform independent tensor library with autograd for the JVM☆91Jan 25, 2026Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The simplest way to build data apps and webapps in Java. Inspired by Streamlit.☆138Jun 6, 2026Updated 3 months ago
- A Linux graphical shell written in modern Java with the new Foreign Function & Memory APIs☆41Apr 1, 2024Updated 2 years ago
- A real-time ray tracer in Java, accelerated on heterogeneous hardware using TornadoVM☆26Jul 24, 2024Updated 2 years ago
- A Java library for building modern terminal user interfaces.☆658Updated this week
- Set of examples written for hardware acceleration via TornadoVM☆17Feb 26, 2025Updated last year
- Website for jbang.dev☆14Updated this week
- Serializer project☆97Updated this week