Learn the ins and outs of efficiently serving Large Language Models (LLMs). Dive into optimization techniques, including KV caching and Low Rank Adapters (LoRA), and gain hands-on experience with Predibase’s LoRAX framework inference server.
☆22Apr 12, 2024Updated 2 years ago
Alternatives and similar repositories for Efficiently-Serving-LLMs
Users that are interested in Efficiently-Serving-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- It is the collection of the imp projects i have done.☆13May 30, 2020Updated 6 years ago
- This is the code for neural-Jacana aligner, and the data for MultiMWA dataset.☆20Feb 12, 2023Updated 3 years ago
- Deploy, launch and use LLMs on AWS☆16Jun 2, 2023Updated 3 years ago
- Klexikon: A German Dataset for Joint Summarization and Simplification☆17Oct 5, 2022Updated 3 years ago
- Deploy SageMaker models with Terraform☆23Feb 14, 2018Updated 8 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Simplification Automatic evaluation Measure through Semantic Annotation☆17Mar 11, 2019Updated 7 years ago
- Official Github Repository for "Spectral-Risk Safe Reinforcement Learning with Convergence Guarantees". (NeurIPS 2024)☆11Nov 30, 2025Updated 8 months ago
- Tutorial for LLM developers about engine design, service deployment, evaluation/benchmark, etc. Provide a C/S style optimized LLM inferen…☆19Sep 5, 2023Updated 2 years ago
- ☆11Mar 5, 2024Updated 2 years ago
- CNN for Text Classification in Pytorch☆19Nov 27, 2017Updated 8 years ago
- ☆10Aug 18, 2021Updated 5 years ago
- Code space for L4DC paper "State-wise Safe Reinforcement Learning With Pixel Observations"☆11Apr 5, 2024Updated 2 years ago
- Code for L4DC 2022 paper: Joint Synthesis of Safety Certificate and Safe Control Policy Using Constrained Reinforcement Learning.☆14Jul 31, 2023Updated 3 years ago
- Здесь собирается каталог ссылок на полезные языковые ресурсы башкирского языка☆17Jul 25, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆25May 9, 2022Updated 4 years ago
- ☆18Nov 26, 2023Updated 2 years ago
- Repo for the simplified text alignment tools.☆21Dec 4, 2020Updated 5 years ago
- oneNeuron Pytroch basics course docs plus code☆10Mar 14, 2022Updated 4 years ago
- Concurrent inverse Bloom filter.☆15Feb 3, 2015Updated 11 years ago
- The Chia Network Nebula Graph database Importer☆11Jan 16, 2023Updated 3 years ago
- Constrained decoding utilities for text generation using Huggingface seq2seq models☆25Jan 25, 2023Updated 3 years ago
- ☆10Aug 24, 2023Updated 2 years ago
- Code for AINL2018 paper Deep Convolutional Networks for Supervised Morpheme Segmentation of Russian Language☆25Aug 23, 2019Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Machine Learning for Mathematics Faculty (HSE) 2018☆18Jan 23, 2022Updated 4 years ago
- COMET for African languages☆11Jan 24, 2025Updated last year
- ☆27Aug 20, 2018Updated 7 years ago
- ☆14Oct 11, 2023Updated 2 years ago
- Ideas on how to quickly learn to build command-line tools☆11Feb 26, 2022Updated 4 years ago
- For my IBM Data Science Professional certificate capstone project in early 2020, I used pandas, the FourSquare API, Folium, and other Pyt…☆13Dec 31, 2020Updated 5 years ago
- LLM Evals Leaderboard☆49Nov 21, 2023Updated 2 years ago
- ☆19Jun 15, 2023Updated 3 years ago
- A python program which learns to recognize an unknown face using Principal Component Analysis (PCA).☆12Jun 29, 2017Updated 9 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- You’ll explore new advancements like ChatGPT’s function calling capability, and build a conversational agent using a new syntax called La …☆16Oct 28, 2023Updated 2 years ago
- Nebula docker image for development☆16Apr 1, 2026Updated 4 months ago
- Super Mario is a legendary game we all cherish! In this project, we will deploy Super Mario on Amazon EKS (Elastic Kubernetes Service) us…☆13Feb 3, 2026Updated 6 months ago
- Community detection in complex networks using hybrid quantum annealing on Amazon Braket☆13Jul 6, 2023Updated 3 years ago
- Repository for React Fundamentals classroom demonstration contacts app☆11Nov 19, 2024Updated last year
- Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 30+ benchmarks☆15Feb 17, 2025Updated last year
- A SSD-based graph processing engine for billion-node graphs☆12Feb 1, 2015Updated 11 years ago