Learn the ins and outs of efficiently serving Large Language Models (LLMs). Dive into optimization techniques, including KV caching and Low Rank Adapters (LoRA), and gain hands-on experience with Predibase’s LoRAX framework inference server.
☆23Apr 12, 2024Updated 2 years ago
Alternatives and similar repositories for Efficiently-Serving-LLMs
Users that are interested in Efficiently-Serving-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A monolingual parallel corpus for sentence simplification☆11Jul 4, 2016Updated 10 years ago
- It is the collection of the imp projects i have done.☆13May 30, 2020Updated 6 years ago
- Deploy SageMaker models with Terraform☆23Feb 14, 2018Updated 8 years ago
- Tutorial for LLM developers about engine design, service deployment, evaluation/benchmark, etc. Provide a C/S style optimized LLM inferen…☆19Sep 5, 2023Updated 3 years ago
- AI Software Bill of Materials for EU AI Act☆12Jan 18, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Code for L4DC 2022 paper: Joint Synthesis of Safety Certificate and Safe Control Policy Using Constrained Reinforcement Learning.☆14Jul 31, 2023Updated 3 years ago
- ☆18Nov 26, 2023Updated 2 years ago
- Repo for the simplified text alignment tools.☆21Dec 4, 2020Updated 5 years ago
- oneNeuron Pytroch basics course docs plus code☆10Mar 14, 2022Updated 4 years ago
- The Chia Network Nebula Graph database Importer☆11Jan 16, 2023Updated 3 years ago
- ☆10Aug 24, 2023Updated 3 years ago
- This repository contains my solutions for the Coursera course TensorFlow: Advanced Techniques Specialization. Expand your knowledge of th…☆32Jun 22, 2021Updated 5 years ago
- ☆27Aug 20, 2018Updated 8 years ago
- Ideas on how to quickly learn to build command-line tools☆11Feb 26, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning☆17Jul 20, 2020Updated 6 years ago
- LLM Evals Leaderboard☆49Nov 21, 2023Updated 2 years ago
- a set of notebooks for training llms on cairo☆32May 18, 2024Updated 2 years ago
- You’ll explore new advancements like ChatGPT’s function calling capability, and build a conversational agent using a new syntax called La…☆16Oct 28, 2023Updated 2 years ago
- Nebula docker image for development☆16Apr 1, 2026Updated 5 months ago
- A Python package that helps you create paths relative to the project root☆15Dec 27, 2022Updated 3 years ago
- Community detection in complex networks using hybrid quantum annealing on Amazon Braket☆13Jul 6, 2023Updated 3 years ago
- Repository for React Fundamentals classroom demonstration contacts app☆11Nov 19, 2024Updated last year
- Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 30+ benchmarks☆15Feb 17, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A Java library for quantum programming using Quil.☆16Jul 23, 2018Updated 8 years ago
- AI assisted Quantum technologies☆16Nov 27, 2022Updated 3 years ago
- This repository contains publicly available speech and text data in Luganda.☆12Sep 4, 2020Updated 6 years ago
- Official implementation of the paper: Safe Model-Based Reinforcement Learning with an Uncertainty-Aware Reachability Certificate☆25Dec 4, 2023Updated 2 years ago
- Exercises for the CERN Openlab GPU lecture☆15Aug 5, 2026Updated last month
- Russian morphological tagset converters library.☆43Oct 4, 2019Updated 6 years ago
- AI-driving Vehicle Simulation using Machine Learning(CNN) | PyTorch implementation of "End to End Learning for Self-Driving Cars" (arXiv:…☆21Jan 18, 2020Updated 6 years ago
- A compute framework for building Search, RAG, Recommendations and Analytics over complex (structured+unstructured) data, with ultra-modal…☆12Sep 16, 2024Updated last year
- Generate a dataset to finetune a LLM to generate Cypher code from questions given in natural language (English).☆15May 24, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow. Exercises and Solutions to accompany Sutton's Book a…☆10Oct 21, 2020Updated 5 years ago
- Python version for Doug Biber's Multidimensional Analysis (MDA)☆42May 24, 2026Updated 3 months ago
- Packed Memory Array☆17May 14, 2014Updated 12 years ago
- Analysis using reduced NanoAOD files created from CMS open data producing a high statistics di-muon spectrum☆14Sep 5, 2023Updated 3 years ago
- Google Cloud Platform (GCP) CLI and utils☆14May 6, 2023Updated 3 years ago
- Code generation with LLMs 🔗☆53Aug 4, 2023Updated 3 years ago
- Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.☆50Jan 12, 2024Updated 2 years ago