Alternatives and similar repositories for llm_context_benchmarks

Users that are interested in llm_context_benchmarks are comparing it to the libraries listed below

• GusLovesMath / Llama3_MacSilicon
  Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework…
  ☆11Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆99Updated 6 months ago
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆43Updated 6 months ago
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆109Updated last year
• SingularityMan / vector_stock_market_bot
  A stock market bot that automatically, once a day, rebalances your Robinhood portfolio by gathering information about each ticker in the …
  ☆58Updated 10 months ago
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆50Updated 7 months ago
• itsPreto / VECTR8
  Embed anything.
  ☆27Updated last year
• QuixiAI / dolphin-logger
  ☆107Updated 2 months ago
• xNul / codestral-mamba-for-vscode
  Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
  ☆29Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆100Updated last year
• voxmenthe / mlx_finetune_demo
  ☆20Updated 2 months ago
• remichu-ai / gallama
  ☆134Updated last month
• chigkim / Ollama-MMLU-Pro
  ☆108Updated 4 months ago
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆239Updated last month
• MaximeRivest / ovllm
  ☆37Updated 5 months ago
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆49Updated 3 months ago
• firstbatchxyz / dria-agent
  powerful and fast tool calling agents
  ☆79Updated 9 months ago
• agno-agi / streamlit-app
  ☆15Updated last year
• pnmartinez / simple-computer-use
  Open source implementation for computer use, using light OCR models and LLMs. Get Android app in link below.
  ☆30Updated last week
• Forest-Person / smolResearcher
  Use smol agents to do research and then update csv coumns with its findings.
  ☆41Updated 11 months ago
• mzau / mlx-knife
  ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)
  ☆121Updated this week
• 0xSero / minimax-m2-proxy
  A proxy for minimax-m2, enabling interleaved thinking, and tool calls.
  ☆36Updated last month
• raeudigerRaeffi / turbular
  A MCP server allowing LLM agents to easily connect and retrieve data from any database
  ☆99Updated 5 months ago
• Goekdeniz-Guelmez / mlx-kan
  KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon
  ☆31Updated 6 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆72Updated last year
• MehulG / memX
  A real-time shared memory layer for multi-agent LLM systems.
  ☆50Updated 6 months ago
• sammcj / moa
  Mixture-of-Ollamas
  ☆30Updated last year
• ivanfioravanti / lmstudio_hf
  A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.
  ☆73Updated 2 months ago
• Vaibhavs10 / experiments-with-mcp
  ☆101Updated 7 months ago
• ivanfioravanti / autogram
  Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  ☆82Updated last year