Alternatives and similar repositories for ai-benchmarks

Users that are interested in ai-benchmarks are comparing it to the libraries listed below

• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆41Updated last year
• fixie-ai / thefastest.ai
  Website with current metrics on the fastest AI models.
  ☆41Updated 7 months ago
• nyunAI / PruneGPT
  ☆53Updated last year
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆87Updated 3 weeks ago
• cognitivecomputations / kraken
  ☆66Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆62Updated 10 months ago
• mkuchnik / relm
  ReLM is a Regular Expression engine for Language Models
  ☆106Updated 2 years ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆211Updated 11 months ago
• cognitivecomputations / OpenChatML
  ☆157Updated 11 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 11 months ago
• brendanhogan / picoDeepResearch
  ☆63Updated last month
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆65Updated last year
• etalab-ia / albert-models
  Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
  ☆42Updated 11 months ago
• llmonpy / needle-in-a-needlestack
  ☆116Updated 4 months ago
• runpod-workers / worker-sglang
  SGLang is fast serving framework for large language models and vision language models.
  ☆23Updated 4 months ago
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆81Updated 5 months ago
• CogNLP / CogAGENT
  ☆36Updated 2 years ago
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆76Updated 3 weeks ago
• bentoml / BentoLMDeploy
  Self-host LLMs with LMDeploy and BentoML
  ☆20Updated 2 weeks ago
• adarshxs / TokenTally
  Estimate Your LLM's Token Toll Across Various Platforms and Configurations
  ☆35Updated 4 months ago
• substratusai / vllm-docker
  ☆62Updated 3 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆123Updated this week
• SqueezeAILab / Tool2Vec
  Efficient and Scalable Estimation of Tool Representations in Vector Space
  ☆23Updated 9 months ago
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆119Updated last year
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 7 months ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆124Updated last year
• bentoml / llm-bench
  ☆54Updated 7 months ago
• mourad-ghafiri / NockNockDoc
  An experimental and alternative approach to Finetuning and RAG.
  ☆35Updated last year