Blaizzy / fastmlx
FastMLX is a high performance production ready API to host MLX models.
☆163Updated last week
Related projects: ⓘ
- SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.☆207Updated last week
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆206Updated last week
- Start a server from the MLX library.☆157Updated last month
- A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.☆219Updated 2 months ago
- For inferring and serving local LLMs using the MLX framework☆77Updated 5 months ago
- MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.☆187Updated this week
- The easiest way to run the fastest MLX-based LLMs locally☆202Updated 2 months ago
- Fast parallel LLM inference for MLX☆118Updated 2 months ago
- MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.☆60Updated 3 weeks ago
- Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.☆144Updated 7 months ago
- ☆101Updated this week
- 🤖 Headless IDE for AI agents☆110Updated this week
- Generate accurate transcripts using Apple's MLX framework☆154Updated last week
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆223Updated 4 months ago
- ☆133Updated 9 months ago
- ☆91Updated last month
- An mlx project to train a base model on your whatsapp chats using (Q)Lora finetuning☆156Updated 8 months ago
- Port of Suno's Bark TTS transformer in Apple's MLX Framework☆62Updated 7 months ago
- WIP - Allows you to create DSPy pipelines using ComfyUI☆170Updated last month
- AI API implementation for Mac which supports tool-calling & other structured LLM response generation (e.g. conform to JSON schema)☆86Updated this week
- run embeddings in MLX☆68Updated last month
- Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB☆115Updated 7 months ago
- Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.☆76Updated 7 months ago
- FastAPI wrapper around DSPy☆201Updated 6 months ago
- A simple script to enhance text editing across your Mac, leveraging the power of MLX. Designed for seamless integration, it offers real-t…☆99Updated 6 months ago
- Create keyboard shortcuts for an LLM using OpenAI GPT, Ollama, HuggingFace with Automator on macOS.☆134Updated 6 months ago
- Chat with MLX is a high-performance macOS application that connects your local documents to a personalized large language model (LLM).☆158Updated 6 months ago
- A python application that routes incoming prompts to an LLM by category, and can support a single incoming connection from a front end to…☆133Updated this week
- ☆101Updated 5 months ago
- 🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.☆195Updated last week