fixie-ai / ai-benchmarksLinks
Benchmarking suite for popular AI APIs
☆88Updated 6 months ago
Alternatives and similar repositories for ai-benchmarks
Users that are interested in ai-benchmarks are comparing it to the libraries listed below
Sorting:
- Website with current metrics on the fastest AI models.☆43Updated 9 months ago
- Benchmark suite for LLMs from Fireworks.ai☆80Updated this week
- Tutorial for building LLM router☆224Updated last year
- ☆102Updated last year
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated this week
- Self-host LLMs with vLLM and BentoML☆140Updated this week
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆42Updated last year
- ☆467Updated last year
- ☆63Updated 5 months ago
- ☆199Updated last year
- Data preparation code for Amber 7B LLM☆91Updated last year
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆223Updated last week
- ☆161Updated 3 weeks ago
- Just a bunch of benchmark logs for different LLMs☆120Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- ☆55Updated 2 months ago
- A collection of all available inference solutions for the LLMs☆91Updated 5 months ago
- Synthetic Data for LLM Fine-Tuning☆120Updated last year
- IBM development fork of https://github.com/huggingface/text-generation-inference☆61Updated 3 months ago
- Comparison of Language Model Inference Engines☆229Updated 8 months ago
- A framework for evaluating function calls made by LLMs☆38Updated last year
- ☆51Updated last year
- ☆119Updated last year
- Beating the GAIA benchmark with Transformers Agents. 🚀☆133Updated 6 months ago
- Vector Database with support for late interaction and token level embeddings.☆55Updated 2 months ago
- An OpenAI Completions API compatible server for NLP transformers models☆65Updated last year
- Transformer GPU VRAM estimator☆66Updated last year
- Routing on Random Forest (RoRF)☆195Updated 11 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 6 months ago
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆88Updated this week