Tutorial for building LLM router
☆256Jul 19, 2024Updated 2 years ago
Alternatives and similar repositories for llm-router
Users that are interested in llm-router are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆5,321Aug 10, 2024Updated 2 years ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆174Jun 13, 2024Updated 2 years ago
- Fine-tune an LLM to perform batch inference and online serving.☆122May 29, 2025Updated last year
- A curated list of awesome approaches to AI model routing☆239Mar 24, 2025Updated last year
- ☆45Dec 14, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A modular, agentic-AI-based adaptive cybersecurity architecture for digital ecosystems. Combines Zero Trust, real-time telemetry, and int…☆22Jul 4, 2025Updated last year
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆206Jul 17, 2024Updated 2 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 2 years ago
- Framework for Cost-Effective Language Model Choice☆16Dec 12, 2023Updated 2 years ago
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,261Mar 13, 2025Updated last year
- Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".☆70Jun 29, 2024Updated 2 years ago
- ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…☆2,175Oct 8, 2024Updated last year
- Tools for merging pretrained large language models.☆19Jun 12, 2024Updated 2 years ago
- AI_Powered_Dev_Search_Engine☆12Mar 10, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,920Jan 21, 2024Updated 2 years ago
- II-Thought-RL is our initial attempt at developing a large-scale, multi-domain Reinforcement Learning (RL) dataset☆30Apr 8, 2025Updated last year
- ☆15Nov 25, 2025Updated 8 months ago
- This is the code for our paper: PLACES: Prompting Language Models for Social Conversation Synthesis☆11Feb 17, 2023Updated 3 years ago
- Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models☆2,961Jan 7, 2025Updated last year
- This repository serves as a collection of scrapers procuring and structuring various legal datasets☆19Jun 16, 2023Updated 3 years ago
- SUQL: Conversational Search over Structured and Unstructured Data with LLMs☆308Updated this week
- ☆37May 5, 2025Updated last year
- ☆23Jul 10, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A workbench application to test out different prompts on a variety of AI models to see how they perform☆15Feb 9, 2025Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆121Apr 27, 2026Updated 3 months ago
- Open-source AI for voice control, rivaling Alexa and Siri☆13Mar 9, 2024Updated 2 years ago
- ☆209Jun 26, 2025Updated last year
- Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads☆2,764Jun 25, 2024Updated 2 years ago
- ☆10Oct 31, 2023Updated 2 years ago
- ☆13Jan 14, 2025Updated last year
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…☆5,762Jun 25, 2026Updated last month
- Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …☆349Jun 16, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- code for the ICLR'22 paper: On Robust Prefix-Tuning for Text Classification☆27Mar 21, 2022Updated 4 years ago
- Python Server for C3 AI app. A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) with…☆24Jan 7, 2024Updated 2 years ago
- TLS & API keys for your LLM APIs☆20Dec 17, 2025Updated 7 months ago
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆3,690Jul 25, 2025Updated last year
- ☆32Nov 14, 2024Updated last year
- ☆13Jun 15, 2023Updated 3 years ago
- Code for Evolving Language Models without Labels: Majority Drives Selection, Novelty Promotes Variation (EVOL-RL).☆51Mar 31, 2026Updated 4 months ago