GusLovesMath / Local_LLM_Training_Apple_SiliconLinks
Created and enhanced a local LLM training system on Apple Silicon with MLX and Metal API, overcoming the absence of CUDA support. Fine-tuned the Llama3 model on 16 GPUs for streamlined solution of verbose math word problems. Result: a powerful, privacy-preserving chatbot that runs smoothly on-device.
β20Updated last year
Alternatives and similar repositories for Local_LLM_Training_Apple_Silicon
Users that are interested in Local_LLM_Training_Apple_Silicon are comparing it to the libraries listed below
Sorting:
- A simple Jupyter Notebook for learning MLX text-completion fine-tuning!β120Updated 9 months ago
- π§ Retrieval Augmented Generation (RAG) exampleβ17Updated last year
- Your gateway to both Ollama & Apple MlX modelsβ142Updated 5 months ago
- Local RAG as a simple CLI, for standalone use or as a gptme toolβ40Updated 6 months ago
- Gradio based tool to run opensource LLM models directly from Huggingfaceβ94Updated last year
- For inferring and serving local LLMs using the MLX frameworkβ109Updated last year
- β75Updated 10 months ago
- Experiments with open source LLMsβ74Updated last week
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation β¦β184Updated last year
- Local first human friendly agents toolkit for the browser and Nodejsβ43Updated this week
- Generate train.jsonl and valid.jsonl files to use for fine-tuning Mistral and other LLMs.β96Updated last year
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.β42Updated last month
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage aβ¦β118Updated last year
- Minimal, clean code implementation of RAG with mlx using gguf model weightsβ52Updated last year
- RAG example using DSPy, Gradio, FastAPIβ83Updated last year
- Own your AI, search the web with itππβ87Updated 6 months ago
- β123Updated last year
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).β102Updated 9 months ago
- A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.β259Updated 2 months ago
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.β26Updated 4 months ago
- SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.β277Updated last month
- My version of an LLM Websearch Agent using a local SearXNG server because SearXNG is great.β37Updated 5 months ago
- Locally running LLM with internet accessβ96Updated last month
- run ollama & gguf easily with a single commandβ52Updated last year
- β95Updated 7 months ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?β22Updated last year
- One click templates for inferencing Language Modelsβ203Updated last week
- Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference anβ¦β22Updated 3 months ago
- Using Langroid's Multi-Agent Framework to Build LLM Appsβ142Updated last month
- β29Updated 10 months ago