GusLovesMath / Local_LLM_Training_Apple_SiliconLinks
Created and enhanced a local LLM training system on Apple Silicon with MLX and Metal API, overcoming the absence of CUDA support. Fine-tuned the Llama3 model on 16 GPUs for streamlined solution of verbose math word problems. Result: a powerful, privacy-preserving chatbot that runs smoothly on-device.
☆22Updated last year
Alternatives and similar repositories for Local_LLM_Training_Apple_Silicon
Users that are interested in Local_LLM_Training_Apple_Silicon are comparing it to the libraries listed below
Sorting:
- 🧠Retrieval Augmented Generation (RAG) example☆19Updated 5 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆97Updated last year
- Your gateway to both Ollama & Apple MlX models☆150Updated 11 months ago
- run ollama & gguf easily with a single command☆52Updated last year
- API Server for Transformer Lab☆83Updated 2 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Updated last year
- Rivet plugin for integration with Ollama, the tool for running LLMs locally easily☆43Updated 8 months ago
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆118Updated last year
- Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma☆34Updated last year
- Transcribe and summarize videos using whisper and llms on apple mlx framework☆77Updated 2 years ago
- A simple Jupyter Notebook for learning MLX text-completion fine-tuning!☆123Updated last year
- Minimal, clean code implementation of RAG with mlx using gguf model weights☆53Updated last year
- Convert Files / Folders / GitHub Repos Into AI / LLM-ready Files☆162Updated last year
- Distributed Inference for mlx LLm☆100Updated last year
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆127Updated last year
- ☆30Updated last year
- Generate train.jsonl and valid.jsonl files to use for fine-tuning Mistral and other LLMs.☆96Updated 2 years ago
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆103Updated 5 months ago
- ☆34Updated last year
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆273Updated 3 months ago
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Updated last year
- ☆58Updated 11 months ago
- ☆17Updated last year
- ☆109Updated 5 months ago
- A wannabe Ollama equivalent for Apple MlX models☆83Updated 11 months ago
- Local first human friendly agents toolkit for the browser and Nodejs☆45Updated last week
- Use locally running LLMs directly from Siri 🦙🟣☆185Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16Updated 9 months ago
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆43Updated 7 months ago
- Using Langroid's Multi-Agent Framework to Build LLM Apps☆147Updated 7 months ago