Alternatives and similar repositories for MLX-Textgen

Users that are interested in MLX-Textgen are comparing it to the libraries listed below

• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆109Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆97Updated last year
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆42Updated 4 months ago
• mzau / mlx-knife
  ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)
  ☆108Updated last week
• remichu-ai / gallama
  ☆133Updated 6 months ago
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆273Updated last year
• mark-lord / MLX-text-completion-notebook
  A simple Jupyter Notebook for learning MLX text-completion fine-tuning!
  ☆122Updated 11 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated last year
• SomeOddCodeGuy / OfflineWikipediaTextApi
  This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …
  ☆100Updated 2 months ago
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆196Updated 3 weeks ago
• rodrigobaron / anthill
  ☆24Updated 9 months ago
• otriscon / llm-structured-output
  ☆89Updated 9 months ago
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆52Updated 8 months ago
• OoriData / Toolio
  GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…
  ☆128Updated last month
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆61Updated last year
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆42Updated 2 weeks ago
• chigkim / Ollama-MMLU-Pro
  ☆104Updated 2 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆81Updated last week
• matteoserva / GraphLLM
  ☆206Updated last month
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆118Updated last year
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆145Updated 2 weeks ago
• andrewginns / CoT-at-Home
  Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.
  ☆44Updated last year
• rooben-me / tone-changer-open
  This project is a reverse-engineered version of Figma's tone changer. It uses Groq's Llama-3-8b for high-speed inference and to adjust th…
  ☆90Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆57Updated 10 months ago
• TC-Zheng / ActuosusAI
  AI management tool
  ☆121Updated 11 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆79Updated last year
• mzbac / mlx-lora
  ☆38Updated last year
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆332Updated 7 months ago