A universal scalable machine learning model deployment solution
☆248Feb 28, 2026Updated this week
Alternatives and similar repositories for djl-serving
Users that are interested in djl-serving are comparing it to the libraries listed below
Sorting:
- The Java implementation of Dive into Deep Learning (D2L.ai)☆191Feb 23, 2026Updated last week
- ☆110Jan 16, 2025Updated last year
- ☆45Aug 4, 2025Updated 6 months ago
- An Engine-Agnostic Deep Learning Framework in Java☆4,771Feb 3, 2026Updated 3 weeks ago
- This open-source project delivers a complete pipeline for converting multi-page documents (PDFs/images) into structured JSON using Vision…☆15Aug 4, 2025Updated 6 months ago
- One stop shop for running AI/ML on AWS.☆1,141Updated this week
- ☆133Feb 20, 2026Updated last week
- Training and inference on AWS Trainium and Inferentia chips.☆261Updated this week
- Large Language Model Hosting Container☆91Oct 9, 2025Updated 4 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆255Apr 11, 2025Updated 10 months ago
- TensorFlow Serving API of all programming language supported by protobuf and grpc.☆27Oct 16, 2020Updated 5 years ago
- Deployment code for image generative AI and other related image based tasks.☆22May 15, 2023Updated 2 years ago
- Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆412Nov 20, 2023Updated 2 years ago
- A Java port of whisper 3, based on the huggingface version, using DJL.☆20Apr 3, 2024Updated last year
- Apache Spark based framework for analysis A/B experiments☆15Nov 3, 2024Updated last year
- Hands-on workshop for distributed training and hosting on SageMaker☆152Nov 4, 2025Updated 3 months ago
- ☆81May 10, 2024Updated last year
- Tools to measure latency for LLM in Amazon Bedrook☆22Jan 20, 2026Updated last month
- ☆25Feb 18, 2026Updated last week
- Repository for training and deploying Generative AI models, including text-text, text-to-image generation and prompt engineering playgrou…☆200Updated this week
- Spring Deep Java Library 通过利用DJL框架与其他Spring框架进行整合，进行深度学习模型训练和推导。☆24Mar 16, 2022Updated 3 years ago
- Unofficial implementation of DreamTalk in ComfyUI☆12Aug 15, 2024Updated last year
- A vision-language model with an improved cross-attention mechanism for scalable streaming inference☆27Dec 24, 2025Updated 2 months ago
- 🚀 LLM inference optimization simulator, modeling compute-bound prefill and memory-bound decode phases.☆13Jul 12, 2025Updated 7 months ago
- This is a hands-on for ML beginners to perform SimCSE step-by-step. Implemented both supervised SimCSE and unsupervisied SimCSE, and dist…☆22Oct 6, 2023Updated 2 years ago
- Foundation Model Evaluations Library☆276Aug 7, 2025Updated 6 months ago
- ☆145Jan 23, 2023Updated 3 years ago
- ☆11Jan 1, 2024Updated 2 years ago
- PredictionIO Engine integrated with Sparkling Water. Open Source project Spring 2015 @CMU.☆12Oct 5, 2015Updated 10 years ago
- Scala.js bindings for TensorFlow.js. Train and deploy ML models in your browser with Scala.☆17Aug 12, 2018Updated 7 years ago
- FM-Leaderboard-er allows you to create leaderboard to find the best LLM/prompt for your own business use case based on your data, task, p…☆19Oct 31, 2024Updated last year
- Notebooks and sample code for Build On Trainium☆47Jan 14, 2026Updated last month
- ☆21Feb 13, 2026Updated 2 weeks ago
- ☆13Oct 22, 2019Updated 6 years ago
- ☆13Dec 19, 2025Updated 2 months ago
- DJL Spring Boot Starter☆115Jan 21, 2024Updated 2 years ago
- ☆88Nov 29, 2022Updated 3 years ago
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆199Jul 8, 2025Updated 7 months ago
- ☆287Aug 20, 2025Updated 6 months ago