Alternatives and similar repositories for anemll-server

Users that are interested in anemll-server are comparing it to the libraries listed below

• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆100Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆100Updated 7 months ago
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆110Updated last year
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆263Updated 3 weeks ago
• Anemll / anemll-bench
  ☆45Updated 3 months ago
• OoriData / Toolio
  GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…
  ☆132Updated last month
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆49Updated 3 months ago
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆284Updated 7 months ago
• kspviswa / pyOllaMx
  Your gateway to both Ollama & Apple MlX models
  ☆149Updated 11 months ago
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆85Updated 5 months ago
• antranapp / awesome-mlx
  ☆196Updated 10 months ago
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆50Updated 8 months ago
• cubist38 / mlx-openai-server
  A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI…
  ☆203Updated this week
• reka-ai / rekaquant
  ☆62Updated 6 months ago
• priontific / PromptExpander-Diffusionkit
  A little file for doing LLM-assisted prompt expansion and image generation using Flux.schnell - complete with prompt history, prompt queu…
  ☆26Updated last year
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆245Updated this week
• Goekdeniz-Guelmez / mlx-kan
  KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon
  ☆31Updated 7 months ago
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆53Updated last year
• priontific / MLX-text-completion-notebook
  A simple Jupyter Notebook for learning MLX text-completion fine-tuning!
  ☆123Updated last year
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆43Updated 7 months ago
• mzau / mlx-knife
  ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)
  ☆126Updated last week
• ivanfioravanti / lmstudio_hf
  A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.
  ☆77Updated 2 months ago
• stockeh / mlx-optimizers
  A collection of optimizers for MLX
  ☆54Updated last month
• JosefAlbers / PVM
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆273Updated 2 months ago
• Blaizzy / mlx-video
  MLX-Video is the best package for inference and finetuning of Image-Video-Audio generation models on your Mac using MLX.
  ☆106Updated last week
• IST-DASLab / gptq-gguf-toolkit
  Efficient non-uniform quantization with GPTQ for GGUF
  ☆58Updated 4 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆72Updated last year
• vllm-project / vllm-metal
  Community maintained hardware plugin for vLLM on Apple Silicon
  ☆349Updated this week
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆93Updated last week
• firstbatchxyz / dria-agent
  powerful and fast tool calling agents
  ☆80Updated 10 months ago