SpellcraftAI / oaib
Use the OpenAI Batch tool to make async batch requests to the OpenAI API.
☆96Updated last year
Alternatives and similar repositories for oaib:
Users that are interested in oaib are comparing it to the libraries listed below
- Scaling inference-time compute for LLM-as-a-judge, automated evaluations, guardrails, and reinforcement learning.☆189Updated last week
- ☆195Updated 10 months ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆99Updated last year
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆50Updated 5 months ago
- Just a bunch of benchmark logs for different LLMs☆119Updated 7 months ago
- Sphynx Hallucination Induction☆53Updated last month
- Chat Markup Language conversation library☆55Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated 11 months ago
- GPT-based Conversation Summarizer☆148Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- Logging and caching superpowers for the openai sdk☆103Updated last year
- ⛓️ build cognitive systems, pythonic☆331Updated 4 months ago
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆186Updated 10 months ago
- ☆136Updated last year
- auto fine tune of models with synthetic data☆75Updated last year
- ☆106Updated last year
- Claude API Test Project☆87Updated 11 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆80Updated last year
- A simple wrapper for OpenAI to log input/outputs.☆105Updated last year
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆224Updated 10 months ago
- Simple embedding -> text model trained on a small subset of Wikipedia sentences.☆153Updated last year
- ☆48Updated last year
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆122Updated 5 months ago
- Fluid Database☆114Updated 6 months ago
- ☆131Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆102Updated 3 months ago
- A simple Python sandbox for helpful LLM data agents☆237Updated 9 months ago
- ☆113Updated 7 months ago
- Routing on Random Forest (RoRF)☆136Updated 6 months ago
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆76Updated 5 months ago