danthegoodman1 / AnthropicRequestHedgingLinks
Will send the same request to one or more sources to exchange cost for reduced latency for inference
☆11Updated last year
Alternatives and similar repositories for AnthropicRequestHedging
Users that are interested in AnthropicRequestHedging are comparing it to the libraries listed below
Sorting:
- Superpipe - optimized LLM pipelines for structured data☆109Updated last year
- Structured LLM APIs☆157Updated 2 years ago
- Work with web-enabled agents quickly — whether running a quick task or bootstrapping a full-stack product.☆93Updated last year
- Train a language model to answer Slack messages as you.☆257Updated 8 months ago
- Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry☆371Updated this week
- Agent accuracy measurements for LLMs☆204Updated last year
- Fine-tuning and serving LLMs on any cloud☆90Updated 2 years ago
- Realtime Postgres data in React.☆55Updated last year
- CLI to the Cedana Service☆58Updated 7 months ago
- Deep Research for your internal data☆350Updated 6 months ago
- A program synthesis agent that autonomously fixes its output by running tests!☆467Updated last year
- Prompt engineering, automated.☆350Updated 7 months ago
- Prototyping a question and answer bot over PDFs☆39Updated 2 years ago
- Let the LLM review your code.☆214Updated 2 years ago
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆198Updated last year
- Postgres/pgvector Python Client☆280Updated 8 months ago
- A simple DAG for executing LLM calls and using tools.☆42Updated 2 years ago
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆52Updated last year
- Telemetry for applications that use LLM tools.☆26Updated 2 years ago
- Open source AI Agent evaluation framework for web tasks 🐒🍌☆327Updated 11 months ago
- ☆112Updated last year
- ☆174Updated 2 years ago
- Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…☆264Updated last week
- ☆106Updated 2 years ago
- A single API for product integrations☆611Updated last year
- LLM fine-tuning and eval☆346Updated last year
- GPT-based Conversation Summarizer☆151Updated 2 years ago
- AI web parser library + CLI☆48Updated 7 months ago
- Cloudstate is a JavaScript database runtime.☆205Updated 5 months ago
- Fully typed & consistent chat APIs for OpenAI, Anthropic, Groq, and Azure's chat models for browser, edge, and node environments.☆169Updated last year