Alternatives and similar repositories for anemll-bench

Users that are interested in anemll-bench are comparing it to the libraries listed below

• cyrilzakka / EMG
  ☆76Updated last year
• smpanaro / coreml-llm-cli
  CLI to demonstrate running a large language model (LLM) on Apple Neural Engine.
  ☆117Updated 11 months ago
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆337Updated 9 months ago
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆236Updated last month
• antranapp / awesome-mlx
  ☆195Updated 9 months ago
• PicoMLX / PicoMLXServer
  The easiest way to run the fastest MLX-based LLMs locally
  ☆306Updated last year
• kunal732 / MLX-Model-Manager
  MLX Model Manager unifies loading and inferencing with LLMs and VLMs.
  ☆103Updated 10 months ago
• mzbac / flux.swift
  Swift implementation of Flux.1 using mlx-swift
  ☆112Updated 4 months ago
• mzau / mlx-knife
  ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)
  ☆120Updated last week
• mcantillon21 / local-search
  ☆74Updated 6 months ago
• kyutai-labs / moshi-swift
  ☆126Updated 5 months ago
• vegaluisjose / mlx-rag
  Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.
  ☆179Updated last year
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆275Updated last month
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆236Updated 2 weeks ago
• rounak / MLXTinyGPT
  MLX Swift implementation of Andrej Karpathy's Let's build GPT video
  ☆62Updated last year
• RamboRogers / mlx-gui
  MLX-GUI MLX Inference Server for Apple Silicone
  ☆157Updated last week
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆230Updated last year
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆285Updated 6 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆99Updated 5 months ago
• da-z / mlx-ui
  A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.
  ☆260Updated last month
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆109Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆99Updated last year
• mzbac / flux.swift.cli
  CLI tool for text to image generation using the FLUX.1 model.
  ☆67Updated 5 months ago
• cavit99 / mlx-LLM-cheatsheet
  This repo maintains a 'cheat sheet' for LLMs that are undertrained on mlx
  ☆18Updated 9 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆238Updated last year
• DePasqualeOrg / mlx-swift-audio
  Swift tools for text to speech (TTS) and speech to text (STT) powered by MLX
  ☆50Updated this week
• PicoMLX / PicoDocs
  import documents for LLMs
  ☆46Updated 11 months ago
• alexgusevski / anemll-server
  An OpenAI API compatible FastAPI server that sits on top of the Anemll repo. Tested with Open WebUI.
  ☆17Updated 8 months ago
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆625Updated this week
• OoriData / Toolio
  GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…
  ☆129Updated 2 weeks ago