Tutorial for building LLM router
☆251Jul 19, 2024Updated last year
Alternatives and similar repositories for llm-router
Users that are interested in llm-router are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,917Aug 10, 2024Updated last year
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆160Jun 13, 2024Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆120May 29, 2025Updated 11 months ago
- A curated list of awesome approaches to AI model routing☆199Mar 24, 2025Updated last year
- ☆44Dec 14, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆205Jul 17, 2024Updated last year
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 2 years ago
- Framework for Cost-Effective Language Model Choice☆16Dec 12, 2023Updated 2 years ago
- II-Thought-RL is our initial attempt at developing a large-scale, multi-domain Reinforcement Learning (RL) dataset☆31Apr 8, 2025Updated last year
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆165Oct 19, 2024Updated last year
- [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…☆1,212Apr 8, 2026Updated last month
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,267Mar 13, 2025Updated last year
- Ask question to your Airtable base in natural language☆39Aug 12, 2023Updated 2 years ago
- ☆30Apr 29, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- SUQL: Conversational Search over Structured and Unstructured Data with LLMs☆302May 13, 2026Updated last week
- Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".☆70Jun 29, 2024Updated last year
- ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…☆2,179Oct 8, 2024Updated last year
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,913Jan 21, 2024Updated 2 years ago
- AI_Powered_Dev_Search_Engine☆12Mar 10, 2024Updated 2 years ago
- Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models☆2,897Jan 7, 2025Updated last year
- Generate Structured JSON with probs from Language Models☆17Mar 23, 2025Updated last year
- Examples and Demos using the Cohere APIs☆23Nov 3, 2023Updated 2 years ago
- This repository serves as a collection of scrapers procuring and structuring various legal datasets☆19Jun 16, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is the code for our paper: PLACES: Prompting Language Models for Social Conversation Synthesis☆11Feb 17, 2023Updated 3 years ago
- Automated testing and benchmarking for code generation agents.☆18Jun 27, 2023Updated 2 years ago
- CLI tool for collecting and analyzing codebases — secret detection, code metrics, linting, minification, and security checks☆41Sep 25, 2024Updated last year
- Framework-Agnostic RL Environments for LLM Fine-Tuning☆44May 14, 2026Updated last week
- Codebase for running (conditional) probing experiments☆21Nov 13, 2022Updated 3 years ago
- ☆23Jul 10, 2023Updated 2 years ago
- ☆37May 5, 2025Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆119Apr 27, 2026Updated 3 weeks ago
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…☆5,558Mar 19, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆10Oct 31, 2023Updated 2 years ago
- Python Server for C3 AI app. A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) with…☆24Jan 7, 2024Updated 2 years ago
- ☆209Jun 26, 2025Updated 10 months ago
- Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads☆2,741Jun 25, 2024Updated last year
- A workbench application to test out different prompts on a variety of AI models to see how they perform☆16Feb 9, 2025Updated last year
- Open-ended wargames with large language models☆55Feb 11, 2026Updated 3 months ago
- This repository demonstrates how a simple memory file can be incorporated into an Agents routine using the AutoGen framework.☆50Oct 4, 2023Updated 2 years ago