Alternatives and similar repositories for llm_context_benchmarks

Users that are interested in llm_context_benchmarks are comparing it to the libraries listed below

• GusLovesMath / Llama3_MacSilicon
  Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework…
  ☆11Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆99Updated last year
• QuixiAI / dolphin-logger
  ☆107Updated last month
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆99Updated 5 months ago
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆109Updated last year
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆51Updated 7 months ago
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆43Updated 5 months ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆96Updated last year
• itsPreto / VECTR8
  Embed anything.
  ☆27Updated last year
• yamalight / litlytics
  🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis
  ☆103Updated last year
• SingularityMan / vector_stock_market_bot
  A stock market bot that automatically, once a day, rebalances your Robinhood portfolio by gathering information about each ticker in the …
  ☆58Updated 9 months ago
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆232Updated last week
• QuixiAI / generate
  ☆28Updated last year
• Doriandarko / MLX-GRPO
  A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.
  ☆219Updated last month
• Goekdeniz-Guelmez / mlx-kan
  KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon
  ☆31Updated 6 months ago
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆128Updated 10 months ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆84Updated 7 months ago
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆148Updated 5 months ago
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆53Updated last year
• dair-ai / m2-deep-research
  Deep research agents using MiniMax-M2 interleaved thinking
  ☆143Updated 3 weeks ago
• chigkim / Ollama-MMLU-Pro
  ☆108Updated 3 months ago
• AtakanTekparmak / tiny_fnc_engine
  tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.
  ☆38Updated last year
• mzbac / mlx.voxtral
  ☆16Updated 4 months ago
• RamboRogers / mlx-gui
  MLX-GUI MLX Inference Server for Apple Silicone
  ☆157Updated this week
• remichu-ai / gallama
  ☆134Updated last week
• mshumer / portal
  ☆30Updated last year
• remichu-ai / gallamaUI
  ☆23Updated last week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆85Updated last week
• Vaibhavs10 / experiments-with-mcp
  ☆101Updated 6 months ago
• ivanfioravanti / autogram
  Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  ☆82Updated last year