Alternatives and similar repositories for llm-speed-benchmark

Users that are interested in llm-speed-benchmark are comparing it to the libraries listed below

• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• IBM / vllm
  vLLM with support for span semantics
  ☆21Updated 2 weeks ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆32Updated 11 months ago
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆83Updated 11 months ago
• Preemo-Inc / text-generation-inference
  ☆198Updated last year
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆76Updated 2 years ago
• dottxt-ai / benchmarks
  Benchmark structured generation libraries
  ☆30Updated last year
• Aider-AI / refactor-benchmark
  Aider's refactoring benchmark exercises based on popular python repos
  ☆78Updated last year
• llmonpy / needle-in-a-needlestack
  ☆115Updated 10 months ago
• bigcode-project / jupytercoder
  ☆142Updated 2 years ago
• balisujohn / localpilot
  codellama on CPU without Docker
  ☆25Updated last year
• fixie-ai / llm-frameworks
  ☆19Updated last year
• closedai-project / closedai
  Drop in replacement for OpenAI, but with Open models.
  ☆153Updated 2 years ago
• irthomasthomas / undecidability
  ☆23Updated last year
• adrienbrault / json-schema-to-gbnf
  Converts JSON-Schema to GBNF grammar to use with llama.cpp
  ☆55Updated 2 years ago
• BBischof / yapping
  Verbosity control for AI agents
  ☆64Updated last year
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆33Updated last year
• nhtlongcs / StarListify
  StarListify is a Python package that classifies GitHub stars history into organized category lists based on user-defined criteria.
  ☆31Updated last year
• QuixiAI / OpenChatML
  ☆164Updated 4 months ago
• groq / realtime-eval
  Realtime News and Information Eval
  ☆15Updated last month
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆46Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆238Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆74Updated 2 years ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆18Updated 2 years ago
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆97Updated 10 months ago
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆54Updated 6 months ago
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆88Updated 10 months ago
• NolanoOrg / InstructLLaMa.cpp
  Fast inference of Instruct tuned LLaMa on your personal devices.
  ☆23Updated 2 years ago
• exo-explore / gym
  EXO Gym is an open-source Python toolkit that facilitates distributed AI research.
  ☆88Updated 3 weeks ago