GusLovesMath / Local_LLM_Training_Apple_SiliconLinks
Created and enhanced a local LLM training system on Apple Silicon with MLX and Metal API, overcoming the absence of CUDA support. Fine-tuned the Llama3 model on 16 GPUs for streamlined solution of verbose math word problems. Result: a powerful, privacy-preserving chatbot that runs smoothly on-device.
☆20Updated last year
Alternatives and similar repositories for Local_LLM_Training_Apple_Silicon
Users that are interested in Local_LLM_Training_Apple_Silicon are comparing it to the libraries listed below
Sorting:
- 🧠 Retrieval Augmented Generation (RAG) example☆18Updated 3 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆96Updated last year
- Your gateway to both Ollama & Apple MlX models☆149Updated 8 months ago
- Generate train.jsonl and valid.jsonl files to use for fine-tuning Mistral and other LLMs.☆96Updated last year
- Unsloth Studio☆118Updated 7 months ago
- Complex RAG backend☆29Updated last year
- A simple Jupyter Notebook for learning MLX text-completion fine-tuning!☆122Updated last year
- ☆32Updated last year
- 📋 NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)☆324Updated 8 months ago
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆276Updated 3 weeks ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆119Updated last year
- Minimal, clean code implementation of RAG with mlx using gguf model weights☆53Updated last year
- Link you Ollama models to LM-Studio☆145Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16Updated 6 months ago
- For inferring and serving local LLMs using the MLX framework☆109Updated last year
- A little file for doing LLM-assisted prompt expansion and image generation using Flux.schnell - complete with prompt history, prompt queu…☆26Updated last year
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆118Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated last year
- A simple Flask app that lets you text back and forth with Open Interpreter. Probably a bad idea.☆22Updated 2 years ago
- run ollama & gguf easily with a single command☆52Updated last year
- Rivet plugin for integration with Ollama, the tool for running LLMs locally easily☆43Updated 5 months ago
- API Server for Transformer Lab☆80Updated last week
- A wannabe Ollama equivalent for Apple MlX models☆81Updated 8 months ago
- Own your AI, search the web with it🌐😎☆92Updated 10 months ago
- Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma☆34Updated last year
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆103Updated last year
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆190Updated last year
- Webinterface for administrating Ollama and model Quantization with public endpoints and automized OPENAI proxy☆49Updated 8 months ago
- Ollama Mixture of Experts in 50 lines of code☆33Updated last year
- Median is an open-source flashcard application that leverages the power of spaced repetition and artificial intelligence to transform the…☆23Updated last year