GusLovesMath / Local_LLM_Training_Apple_SiliconLinks
Created and enhanced a local LLM training system on Apple Silicon with MLX and Metal API, overcoming the absence of CUDA support. Fine-tuned the Llama3 model on 16 GPUs for streamlined solution of verbose math word problems. Result: a powerful, privacy-preserving chatbot that runs smoothly on-device.
☆20Updated last year
Alternatives and similar repositories for Local_LLM_Training_Apple_Silicon
Users that are interested in Local_LLM_Training_Apple_Silicon are comparing it to the libraries listed below
Sorting:
- Your gateway to both Ollama & Apple MlX models☆146Updated 7 months ago
- Generate train.jsonl and valid.jsonl files to use for fine-tuning Mistral and other LLMs.☆96Updated last year
- A simple Jupyter Notebook for learning MLX text-completion fine-tuning!☆122Updated 11 months ago
- 🧠 Retrieval Augmented Generation (RAG) example☆18Updated 2 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆96Updated last year
- run ollama & gguf easily with a single command☆52Updated last year
- Unsloth Studio☆111Updated 6 months ago
- Rivet plugin for integration with Ollama, the tool for running LLMs locally easily☆42Updated 4 months ago
- API Server for Transformer Lab☆79Updated this week
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆118Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16Updated 5 months ago
- A wannabe Ollama equivalent for Apple MlX models☆79Updated 7 months ago
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆187Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated last year
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆42Updated 4 months ago
- ☆24Updated 9 months ago
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆102Updated 11 months ago
- ☆32Updated last year
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆118Updated last year
- Complex RAG backend☆29Updated last year
- ☆102Updated 2 months ago
- Link you Ollama models to LM-Studio☆145Updated last year
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆127Updated last year
- Copy a bunch of files into your clipboard to provide context for LLMs☆109Updated 4 months ago
- For inferring and serving local LLMs using the MLX framework☆109Updated last year
- Own your AI, search the web with it🌐😎☆90Updated 9 months ago
- Convert Files / Folders / GitHub Repos Into AI / LLM-ready Files☆161Updated 8 months ago
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆52Updated 8 months ago
- Use locally running LLMs directly from Siri 🦙🟣☆182Updated last year
- A comprehensive platform for managing, testing, and leveraging Ollama AI models with advanced features for customization, workflow automa…☆46Updated 7 months ago