Learn the ins and outs of efficiently serving Large Language Models (LLMs). Dive into optimization techniques, including KV caching and Low Rank Adapters (LoRA), and gain hands-on experience with Predibase’s LoRAX framework inference server.
☆22Apr 12, 2024Updated 2 years ago
Alternatives and similar repositories for Efficiently-Serving-LLMs
Users that are interested in Efficiently-Serving-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Plant-FATE EVM☆10Apr 14, 2026Updated 3 months ago
- A monolingual parallel corpus for sentence simplification☆11Jul 4, 2016Updated 10 years ago
- This is the code for neural-Jacana aligner, and the data for MultiMWA dataset.☆20Feb 12, 2023Updated 3 years ago
- Deploy, launch and use LLMs on AWS☆16Jun 2, 2023Updated 3 years ago
- Klexikon: A German Dataset for Joint Summarization and Simplification☆17Oct 5, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Deploy SageMaker models with Terraform☆23Feb 14, 2018Updated 8 years ago
- minimal implementation of sft with gpt2-124M☆15Nov 10, 2025Updated 8 months ago
- Tutorial for LLM developers about engine design, service deployment, evaluation/benchmark, etc. Provide a C/S style optimized LLM inferen…☆19Sep 5, 2023Updated 2 years ago
- Claude Code monitoring and observability tool☆41Jan 24, 2026Updated 6 months ago
- CNN for Text Classification in Pytorch☆19Nov 27, 2017Updated 8 years ago
- AI Software Bill of Materials for EU AI Act☆11Jan 18, 2024Updated 2 years ago
- ☆10Aug 18, 2021Updated 4 years ago
- Здесь собирается каталог ссылок на полезные языковые ресурсы башкирского языка☆17Jul 25, 2024Updated 2 years ago
- ☆25May 9, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆18Nov 26, 2023Updated 2 years ago
- Why is LLM inference slow — and how do you make it fast? A hands-on, first-principles course: roofline → KV cache → quantization → parall…☆19Jul 1, 2026Updated 3 weeks ago
- oneNeuron Pytroch basics course docs plus code☆10Mar 14, 2022Updated 4 years ago
- The Chia Network Nebula Graph database Importer☆11Jan 16, 2023Updated 3 years ago
- Machine Learning for Mathematics Faculty (HSE) 2018☆18Jan 23, 2022Updated 4 years ago
- This repository contains my solutions for the Coursera course TensorFlow: Advanced Techniques Specialization. Expand your knowledge of th…☆32Jun 22, 2021Updated 5 years ago
- ☆27Aug 20, 2018Updated 7 years ago
- ☆14Oct 11, 2023Updated 2 years ago
- Programming assignments and labs from the TensorFlow Advanced Techniques Specialization offered by deeplearning.ai on Coursera.☆29Apr 3, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Ideas on how to quickly learn to build command-line tools☆11Feb 26, 2022Updated 4 years ago
- Companion repository for the Orchestrating Workflows for GenAI Applications course on Deeplearning.AI: https://bit.ly/45P4WQN☆32Jun 11, 2025Updated last year
- LLM Evals Leaderboard☆48Nov 21, 2023Updated 2 years ago
- Nebula docker image for development☆16Apr 1, 2026Updated 3 months ago
- A Python package that helps you create paths relative to the project root☆15Dec 27, 2022Updated 3 years ago
- Community detection in complex networks using hybrid quantum annealing on Amazon Braket☆13Jul 6, 2023Updated 3 years ago
- Repository for React Fundamentals classroom demonstration contacts app☆11Nov 19, 2024Updated last year
- Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 30+ benchmarks☆15Feb 17, 2025Updated last year
- This project scrapes text from Telugu books(Novels)☆10Aug 3, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code showing how to use a model based on the ML model base class.☆10Sep 30, 2022Updated 3 years ago
- data related codebase for polyglot project☆19Mar 30, 2023Updated 3 years ago
- Encountering 14 different Naive RAG fails and using KG to solve it☆30Dec 4, 2025Updated 7 months ago
- Exercises for the CERN Openlab GPU lecture☆12Jul 22, 2025Updated last year
- Russian morphological tagset converters library.☆43Oct 4, 2019Updated 6 years ago
- A compute framework for building Search, RAG, Recommendations and Analytics over complex (structured+unstructured) data, with ultra-modal…☆12Sep 16, 2024Updated last year
- ☆15Oct 22, 2023Updated 2 years ago