armbues / SiLLM
SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
☆226Updated this week
Related projects ⓘ
Alternatives and complementary repositories for SiLLM
- FastMLX is a high performance production ready API to host MLX models.☆218Updated 3 weeks ago
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆237Updated 2 months ago
- MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.☆496Updated this week
- A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.☆227Updated last month
- 👾🍎 Apple MLX engine for LM Studio☆213Updated this week
- For inferring and serving local LLMs using the MLX framework☆89Updated 7 months ago
- Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.☆145Updated 9 months ago
- ☆149Updated 4 months ago
- The easiest way to run the fastest MLX-based LLMs locally☆212Updated 3 weeks ago
- Fast parallel LLM inference for MLX☆149Updated 4 months ago
- Chat with MLX is a high-performance macOS application that connects your local documents to a personalized large language model (LLM).☆163Updated 8 months ago
- Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.☆348Updated 2 months ago
- On-device Inference of Diffusion Models for Apple Silicon☆509Updated 3 weeks ago
- ☆227Updated last month
- A python application that routes incoming prompts to an LLM by category, and can support a single incoming connection from a front end to…☆167Updated this week
- A simple Jupyter Notebook for learning MLX text-completion fine-tuning!☆91Updated last week
- 1.58 Bit LLM on Apple Silicon using MLX☆146Updated 6 months ago
- ☆99Updated 3 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆221Updated 6 months ago
- run embeddings in MLX☆73Updated last month
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆55Updated last week
- Blazing fast whisper turbo for ASR (speech-to-text) tasks☆159Updated last month
- Port of Suno's Bark TTS transformer in Apple's MLX Framework☆71Updated 9 months ago
- Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.☆129Updated last week
- A multimodal, function calling powered LLM webui.☆208Updated last month
- 📋 NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)☆180Updated 2 weeks ago
- Efficient visual programming for AI language models☆299Updated 2 months ago
- A fast batching API to serve LLM models☆172Updated 6 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆493Updated 3 months ago
- ☆104Updated 8 months ago