Alternatives and similar repositories for ai-benchmarks:

Users that are interested in ai-benchmarks are comparing it to the libraries listed below

• fixie-ai / thefastest.ai
  Website with current metrics on the fastest AI models.
  ☆40Updated 4 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆70Updated last month
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆64Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆189Updated 8 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆97Updated this week
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆84Updated 2 weeks ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated 11 months ago
• cognitivecomputations / OpenChatML
  ☆152Updated 8 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆86Updated 10 months ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆111Updated 9 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• character-ai / MuKoe
  ☆52Updated 11 months ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• fw-ai / cookbook
  Collection of recipes aiding Gen AI model development
  ☆100Updated 2 weeks ago
• terryyz / llm-benchmark
  A list of LLM benchmark frameworks.
  ☆65Updated last year
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆17Updated last year
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆84Updated last year
• langchain-ai / kork
  Natural Language Interfaces Powered by LLMs
  ☆90Updated 8 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 8 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• jjovalle99 / DSPy-Text2SQL
  DSPY on action with OpenSource LLMs.
  ☆68Updated 11 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆102Updated 3 months ago
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆54Updated last year
• deep-diver / llamaduo
  This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.
  ☆302Updated last month
• mlc-ai / web-llm-assistant
  AI Assistant running within your browser.
  ☆62Updated 3 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 8 months ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆21Updated 2 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 4 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆35Updated 11 months ago