fixie-ai / ai-benchmarksLinks
Benchmarking suite for popular AI APIs
☆86Updated 4 months ago
Alternatives and similar repositories for ai-benchmarks
Users that are interested in ai-benchmarks are comparing it to the libraries listed below
Sorting:
- Website with current metrics on the fastest AI models.☆41Updated 6 months ago
- Benchmark suite for LLMs from Fireworks.ai☆75Updated 3 weeks ago
- Just a bunch of benchmark logs for different LLMs☆119Updated 10 months ago
- Tutorial for building LLM router☆207Updated 10 months ago
- Simple examples using Argilla tools to build AI☆53Updated 6 months ago
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆37Updated last year
- SGLang is fast serving framework for large language models and vision language models.☆23Updated 3 months ago
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆86Updated last week
- ☆149Updated 2 weeks ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆61Updated 9 months ago
- ☆157Updated 10 months ago
- ☆77Updated last year
- Efficient and Scalable Estimation of Tool Representations in Vector Space☆23Updated 9 months ago
- Self-host LLMs with vLLM and BentoML☆114Updated last week
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated last year
- ☆66Updated last year
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆86Updated last week
- A framework for evaluating function calls made by LLMs☆37Updated 10 months ago
- Self-host LLMs with LMDeploy and BentoML☆19Updated 2 months ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆121Updated 11 months ago
- AI Evaluation Platform☆46Updated last week
- ☆460Updated last year
- An OpenAI Completions API compatible server for NLP transformers models☆65Updated last year
- ☆53Updated last year
- Vector Database with support for late interaction and token level embeddings.☆54Updated 8 months ago
- ☆198Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆104Updated 5 months ago
- ☆36Updated 2 years ago
- One Line To Build Zero-Data Classifiers in Minutes☆55Updated 8 months ago