anyscale / llm-router
Tutorial for building LLM router
☆193Updated 8 months ago
Alternatives and similar repositories for llm-router:
Users that are interested in llm-router are comparing it to the libraries listed below
- A simple Python sandbox for helpful LLM data agents☆247Updated 9 months ago
- Routing on Random Forest (RoRF)☆139Updated 6 months ago
- Testing and evaluation framework for voice agents☆102Updated last month
- A Lightweight Library for AI Observability☆239Updated last month
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆268Updated 3 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆223Updated 11 months ago
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆120Updated last month
- This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.☆303Updated last week
- Fast parallel LLM inference for MLX☆178Updated 9 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated last year
- Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …☆339Updated 9 months ago
- ☆143Updated 8 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆162Updated 6 months ago
- Synthetic Data for LLM Fine-Tuning☆113Updated last year
- XTR/WARP is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.☆122Updated 5 months ago
- An Awesome list of curated DSPy resources.☆305Updated last month
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆80Updated last year
- Framework for building, orchestrating and deploying multi-agent systems. Managed by OpenAI Solutions team. Experimental framework.☆90Updated 6 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆103Updated 4 months ago
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆144Updated last year
- Function Calling Benchmark & Testing☆86Updated 9 months ago
- Self-host LLMs with vLLM and BentoML☆100Updated this week
- A toolkit for building computer use AI agents☆155Updated 3 weeks ago
- A flexible, adaptive classification system for dynamic text classification☆150Updated last month
- Solving data for LLMs - Create quality synthetic datasets!☆145Updated 2 months ago
- Verdict is a library for scaling judge-time compute.☆193Updated 3 weeks ago
- awesome synthetic (text) datasets☆267Updated 5 months ago
- ☆194Updated 11 months ago
- Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.☆191Updated this week
- ☆117Updated 7 months ago