Alternatives and similar repositories for ai-benchmarks

Users that are interested in ai-benchmarks are comparing it to the libraries listed below

• fixie-ai / thefastest.ai
  Website with current metrics on the fastest AI models.
  ☆43Updated 10 months ago
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆90Updated last week
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆83Updated 2 weeks ago
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆228Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆225Updated this week
• AlexBodner / How_Much_VRAM
  ☆102Updated last year
• etalab-ia / albert-models
  Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
  ☆43Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆91Updated last year
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆38Updated last year
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆55Updated 3 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• QuixiAI / OpenChatML
  ☆161Updated last month
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆149Updated last week
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆170Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• nyunAI / PruneGPT
  ☆51Updated last year
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆128Updated 2 years ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆55Updated 10 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 6 months ago
• substratusai / vllm-docker
  ☆64Updated 5 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆72Updated last year
• ray-project / llmperf-leaderboard
  ☆468Updated last year
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆61Updated this week
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆64Updated last year
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆29Updated 9 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated last year
• promptslab / LLMtuner
  FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
  ☆242Updated last year