Anemll / anemll-bench
☆21Updated last month
Alternatives and similar repositories for anemll-bench:
Users that are interested in anemll-bench are comparing it to the libraries listed below
- MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…☆304Updated last week
- MLX Model Manager unifies loading and inferencing with LLMs and VLMs.☆86Updated 2 months ago
- MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.☆136Updated last week
- ☆87Updated 3 weeks ago
- ☆161Updated last month
- FastMLX is a high performance production ready API to host MLX models.☆289Updated last month
- Swift implementation of Flux.1 using mlx-swift☆79Updated 4 months ago
- An implementation of the CSM(Conversation Speech Model) for Apple Silicon using MLX.☆306Updated last week
- SmolVLM2 Demo☆137Updated last month
- import documents for LLMs☆41Updated 3 months ago
- ☆75Updated 4 months ago
- The easiest way to run the fastest MLX-based LLMs locally☆277Updated 5 months ago
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆265Updated 7 months ago
- This repo maintains a 'cheat sheet' for LLMs that are undertrained on mlx☆17Updated last month
- For inferring and serving local LLMs using the MLX framework☆101Updated last year
- Your gateway to both Ollama & Apple MlX models☆120Updated last month
- Distributed Inference for mlx LLm☆87Updated 8 months ago
- CLI to demonstrate running a large language model (LLM) on Apple Neural Engine.☆96Updated 3 months ago
- A wannabe Ollama equivalent for Apple MlX models☆65Updated last month
- run embeddings in MLX☆86Updated 6 months ago
- Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.☆168Updated last year
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆76Updated 4 months ago
- MLX Swift implementation of Andrej Karpathy's Let's build GPT video☆57Updated last year
- SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.☆262Updated last week
- 📋 NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)☆275Updated last month
- A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple S…☆478Updated last week
- mlx image models for Apple Silicon machines☆77Updated last week
- ☆80Updated last month
- MLX-based QA pair generator and LLM finetuning tool in Streamlit☆33Updated 4 months ago
- Fast parallel LLM inference for MLX☆181Updated 9 months ago