Learn the ins and outs of efficiently serving Large Language Models (LLMs). Dive into optimization techniques, including KV caching and Low Rank Adapters (LoRA), and gain hands-on experience with Predibase’s LoRAX framework inference server.
☆23Apr 12, 2024Updated 2 years ago
Alternatives and similar repositories for Efficiently-Serving-LLMs
Users that are interested in Efficiently-Serving-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Human Evaluation Benchmark for Text Simplification☆10Sep 6, 2018Updated 8 years ago
- Enhance your skills in prompt engineering for vision models. Learn to effectively prompt, fine-tune, and track experiments for models lik…☆10May 13, 2024Updated 2 years ago
- ☆13Jul 22, 2023Updated 3 years ago
- TikTok LIVE API for Python: The definitive 3rd-party library to receive livestream events (comments, gifts, etc.) in realtime from TikTok…☆22Sep 5, 2026Updated 2 months ago
- Deploy SageMaker models with Terraform☆23Feb 14, 2018Updated 8 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Klexikon: A German Dataset for Joint Summarization and Simplification☆17Oct 5, 2022Updated 4 years ago
- Simplification Automatic evaluation Measure through Semantic Annotation☆17Mar 11, 2019Updated 7 years ago
- A multi-function Discord bot☆17Sep 19, 2026Updated last month
- Unlock automation and system building with the ChatGPT API. Master chain calls, Python interactions, and create a customer service chatbo…☆19Jun 21, 2023Updated 3 years ago
- Tutorial for LLM developers about engine design, service deployment, evaluation/benchmark, etc. Provide a C/S style optimized LLM inferen…☆19Sep 5, 2023Updated 3 years ago
- oneNeuron Pytroch basics course docs plus code☆10Mar 14, 2022Updated 4 years ago
- Здесь собирается каталог ссылок на полезные языковые ресурсы башкирского языка☆19Jul 25, 2024Updated 2 years ago
- ☆25May 9, 2022Updated 4 years ago
- Code space for L4DC paper "State-wise Safe Reinforcement Learning With Pixel Observations"☆11Apr 5, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- "🐈 nanobot: The Ultra-Lightweight Clawdbot"☆20Feb 7, 2026Updated 9 months ago
- Repo for the simplified text alignment tools.☆21Dec 4, 2020Updated 5 years ago
- ☆10Aug 24, 2023Updated 3 years ago
- ☆13Mar 5, 2024Updated 2 years ago
- Showing the relationship between ImageNet ID and labels and pytorch pre-trained model output ID and labels☆10Oct 11, 2020Updated 6 years ago
- AI Software Bill of Materials for EU AI Act☆12Jan 18, 2024Updated 2 years ago
- Concurrent inverse Bloom filter.☆15Feb 3, 2015Updated 11 years ago
- Train a tiny LLaMA model from scratch to repeat your words using Reinforcement Learning from Human Feedback (RLHF)☆18May 23, 2024Updated 2 years ago
- RuSimpleSentEval (RSSE) shared task repo☆21Apr 26, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15Aug 7, 2025Updated last year
- Programming assignments and labs from the TensorFlow Advanced Techniques Specialization offered by deeplearning.ai on Coursera.☆29Apr 3, 2023Updated 3 years ago
- A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning☆17Jul 20, 2020Updated 6 years ago
- COMET for African languages☆11Jan 24, 2025Updated last year
- Qpi project☆11Mar 10, 2023Updated 3 years ago
- Ideas on how to quickly learn to build command-line tools☆11Feb 26, 2022Updated 4 years ago
- For my IBM Data Science Professional certificate capstone project in early 2020, I used pandas, the FourSquare API, Folium, and other Pyt…☆13Dec 31, 2020Updated 5 years ago
- DeepLearning.ai course: Knowledge Graphs for RAG☆22Jun 16, 2024Updated 2 years ago
- ☆14Oct 11, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Implementation of the G-CORE graph query language on Spark☆15Aug 25, 2021Updated 5 years ago
- LLM Evals Leaderboard☆50Nov 21, 2023Updated 2 years ago
- A python program which learns to recognize an unknown face using Principal Component Analysis (PCA).☆12Jun 29, 2017Updated 9 years ago
- ☆20Jun 15, 2023Updated 3 years ago
- This repository contains publicly available speech and text data in Luganda.☆12Sep 4, 2020Updated 6 years ago
- The RAFT project integrates Retrieval-Augmented Generation (RAG) with fine-tuning approaches to provide a versatile question-answering sy…☆10Apr 24, 2024Updated 2 years ago
- Code showing how to use a model based on the ML model base class.☆10Sep 30, 2022Updated 4 years ago
Are these results useful?