Alternatives and similar repositories for ai-benchmarks

Users that are interested in ai-benchmarks are comparing it to the libraries listed below

• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆72Updated this week
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆87Updated 3 weeks ago
• fixie-ai / thefastest.ai
  Website with current metrics on the fastest AI models.
  ☆41Updated 6 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆109Updated last week
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated 11 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 9 months ago
• ray-project / llmperf-leaderboard
  ☆460Updated last year
• mourad-ghafiri / NockNockDoc
  An experimental and alternative approach to Finetuning and RAG.
  ☆35Updated last year
• etalab-ia / albert-models
  Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
  ☆42Updated 10 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆61Updated 8 months ago
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆98Updated 3 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 3 months ago
• terryyz / llm-benchmark
  A list of LLM benchmark frameworks.
  ☆66Updated last year
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated last year
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 9 months ago
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆147Updated 3 months ago
• CogNLP / CogAGENT
  ☆37Updated 2 years ago
• nyunAI / PruneGPT
  ☆53Updated 11 months ago
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆150Updated 7 months ago
• cognitivecomputations / OpenChatML
  ☆156Updated 10 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• AnswerDotAI / fastdata
  ☆151Updated 5 months ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆118Updated 11 months ago
• Arize-ai / open-inference-spec
  A specification for OpenInference, a semantic mapping of ML inferences
  ☆46Updated last year
• fw-ai / cookbook
  Collection of recipes aiding Gen AI model development
  ☆106Updated last week
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆59Updated 3 weeks ago
• bentoml / llm-bench
  ☆50Updated 5 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year