Alternatives and similar repositories for MLX-Textgen

Users that are interested in MLX-Textgen are comparing it to the libraries listed below

• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆100Updated last year
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆110Updated last year
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆43Updated 7 months ago
• remichu-ai / gallama
  ☆134Updated 2 months ago
• chigkim / Ollama-MMLU-Pro
  ☆109Updated 5 months ago
• otriscon / llm-structured-output
  ☆93Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆246Updated last year
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆284Updated 7 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆72Updated last year
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆86Updated last year
• priontific / MLX-text-completion-notebook
  A simple Jupyter Notebook for learning MLX text-completion fine-tuning!
  ☆123Updated last year
• OoriData / Toolio
  GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…
  ☆132Updated 2 months ago
• QuixiAI / dolphin-logger
  ☆107Updated 3 months ago
• rodrigobaron / anthill
  ☆24Updated last year
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆258Updated this week
• mzbac / mlx-lora
  ☆38Updated last year
• JosefAlbers / PVM
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆273Updated 3 months ago
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆273Updated this week
• rooben-me / tone-changer-open
  This project is a reverse-engineered version of Figma's tone changer. It uses Groq's Llama-3-8b for high-speed inference and to adjust th…
  ☆90Updated last year
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆49Updated 3 months ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• ivanfioravanti / autogram
  Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  ☆81Updated 2 years ago
• Vaibhavs10 / experiments-with-mcp
  ☆100Updated 8 months ago
• AtakanTekparmak / tiny_fnc_engine
  tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.
  ☆38Updated last year
• gradion-ai / freeact
  Code action agent with local execution sandbox and first-class support for programmatic tool calling
  ☆121Updated this week
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆53Updated last year
• mzau / mlx-knife
  ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)
  ☆127Updated last week
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆56Updated last year
• jeffrey-fong / Invoker
  The one who calls upon functions - Function-Calling Language Model
  ☆36Updated 2 years ago
• d0rc / deepdive
  Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…
  ☆44Updated last year