armbues / SiLLM
SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
β223Updated last week
Related projects β
Alternatives and complementary repositories for SiLLM
- FastMLX is a high performance production ready API to host MLX models.β212Updated last week
- πΎπ Apple MLX engine for LM Studioβ171Updated this week
- For inferring and serving local LLMs using the MLX frameworkβ89Updated 7 months ago
- A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.β225Updated last month
- MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.β471Updated this week
- The easiest way to run the fastest MLX-based LLMs locallyβ208Updated last week
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Siliconβ235Updated 2 months ago
- Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.β328Updated 2 months ago
- Fast parallel LLM inference for MLXβ146Updated 4 months ago
- β148Updated 3 months ago
- A simple Jupyter Notebook for learning MLX text-completion fine-tuning!β89Updated last month
- β96Updated 2 months ago
- Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.β146Updated 9 months ago
- Chat with MLX is a high-performance macOS application that connects your local documents to a personalized large language model (LLM).β162Updated 8 months ago
- A python application that routes incoming prompts to an LLM by category, and can support a single incoming connection from a front end toβ¦β160Updated last week
- On-device Inference of Diffusion Models for Apple Siliconβ494Updated last week
- Port of Suno's Bark TTS transformer in Apple's MLX Frameworkβ71Updated 8 months ago
- Blazing fast whisper turbo for ASR (speech-to-text) tasksβ143Updated 2 weeks ago
- Start a server from the MLX library.β159Updated 3 months ago
- π NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)β152Updated last week
- MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.β75Updated 3 weeks ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.β51Updated last week
- β223Updated 2 weeks ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAIβ222Updated 6 months ago
- function calling-based LLM agentsβ278Updated last month
- β103Updated 7 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM β¦β488Updated 3 months ago
- Distributed Inference for mlx LLmβ68Updated 3 months ago
- Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computerβ¦β405Updated this week
- Open source LLM UI, compatible with all local LLM providers.β165Updated last month