Alternatives and similar repositories for anemll-server

Users that are interested in anemll-server are comparing it to the libraries listed below

• Anemll / anemll-bench
  ☆25Updated 2 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆84Updated 5 months ago
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆76Updated last month
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆77Updated this week
• AlexBefest / highCompute.py
  ☆28Updated last month
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆30Updated 2 months ago
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆165Updated last week
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆64Updated 7 months ago
• d0rc / deepdive
  Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…
  ☆42Updated 9 months ago
• Toy-97 / Chat-WebUI
  Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools.
  ☆30Updated 3 months ago
• chigkim / Ollama-MMLU-Pro
  ☆90Updated 5 months ago
• flamingrickpat / private-machine
  I'll be your machinery.
  ☆14Updated last month
• smpanaro / ModernBERT-AppleNeuralEngine
  ModernBERT model optimized for Apple Neural Engine.
  ☆26Updated 4 months ago
• cognitivecomputations / dolphin-logger
  ☆75Updated 2 weeks ago
• cavit99 / mlx-LLM-cheatsheet
  This repo maintains a 'cheat sheet' for LLMs that are undertrained on mlx
  ☆17Updated 2 months ago
• martinbowling / thoughtful-lightning
  Thoughtful Lightning AI Assistant - Dual-engine system with DeepSeek reasoning and Groq inference, featuring Gradio UI, secure API manage…
  ☆20Updated 4 months ago
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆104Updated last year
• s-smits / automatic-learning-amplifier
  MLX-based QA pair generator and LLM finetuning tool in Streamlit
  ☆34Updated 5 months ago
• SouthBridgeAI / llm-transcription-study
  Useful resources for LLM-based Diarization and Transcription.
  ☆55Updated 7 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆92Updated 10 months ago
• teknium1 / ShareGPT-Builder
  ☆114Updated 5 months ago
• mark-lord / PromptExpander-Diffusionkit
  A little file for doing LLM-assisted prompt expansion and image generation using Flux.schnell - complete with prompt history, prompt queu…
  ☆26Updated 9 months ago
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆26Updated 7 months ago
• uogbuji / mlx-notes
  Shared personal notes created while working with the Apple MLX machine learning framework
  ☆24Updated last week
• willccbb / claude-code-mcp
  Letting Claude Code develop his own MCP tools :)
  ☆105Updated 2 months ago
• zenforic / csm-multi
  Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…
  ☆23Updated 2 months ago
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆399Updated last week
• ivanfioravanti / lmstudio_hf
  A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.
  ☆38Updated 3 months ago
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 5 months ago
• fidecastro / llama-cpp-connector
  Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!
  ☆24Updated 3 weeks ago