fixie-ai / ai-benchmarks

Related projects ⓘ

Alternatives and complementary repositories for ai-benchmarks

• fixie-ai / thefastest.ai
  Website with current metrics on the fastest AI models.
  ☆36Updated last week
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆74Updated this week
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆165Updated 2 weeks ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆58Updated 2 weeks ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆115Updated 3 months ago
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆97Updated 11 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆84Updated last month
• fw-ai / cookbook
  Collection of recipes aiding Gen AI model development
  ☆88Updated last week
• run-ai / runai-model-streamer
  ☆120Updated this week
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆78Updated 3 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆55Updated 3 months ago
• cognitivecomputations / OpenChatML
  ☆149Updated 4 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated 10 months ago
• cognitivecomputations / kraken
  ☆64Updated 5 months ago
• DataformerAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆137Updated last month
• nyunAI / PruneGPT
  ☆53Updated 5 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆40Updated this week
• deepseek-ai / ESFT
  Expert Specialized Fine-Tuning
  ☆145Updated last month
• agentsea / surfkit
  A toolkit for building multimodal AI agents
  ☆111Updated this week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆163Updated 4 months ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆36Updated 7 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆29Updated 6 months ago
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆74Updated 2 months ago
• AlexBodner / How_Much_VRAM
  ☆94Updated 2 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆83Updated 6 months ago
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆36Updated 9 months ago
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆81Updated this week
• EQ-bench / EQ-Bench
  A benchmark for emotional intelligence in large language models
  ☆197Updated 3 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆35Updated 3 months ago