GusLovesMath / Local_LLM_Training_Apple_SiliconLinks
Created and enhanced a local LLM training system on Apple Silicon with MLX and Metal API, overcoming the absence of CUDA support. Fine-tuned the Llama3 model on 16 GPUs for streamlined solution of verbose math word problems. Result: a powerful, privacy-preserving chatbot that runs smoothly on-device.
☆20Updated last year
Alternatives and similar repositories for Local_LLM_Training_Apple_Silicon
Users that are interested in Local_LLM_Training_Apple_Silicon are comparing it to the libraries listed below
Sorting:
- Your gateway to both Ollama & Apple MlX models☆150Updated 9 months ago
- Generate train.jsonl and valid.jsonl files to use for fine-tuning Mistral and other LLMs.☆96Updated last year
- A simple Jupyter Notebook for learning MLX text-completion fine-tuning!☆122Updated last year
- 🧠 Retrieval Augmented Generation (RAG) example☆18Updated 4 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆96Updated last year
- Unsloth Studio☆120Updated 8 months ago
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆118Updated last year
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆119Updated last year
- run ollama & gguf easily with a single command☆52Updated last year
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Modified to use local Ollama endpoint☆49Updated last year
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆103Updated last year
- 🤖 Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra…☆32Updated 6 months ago
- Rivet plugin for integration with Ollama, the tool for running LLMs locally easily☆43Updated 6 months ago
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆43Updated 6 months ago
- RAG example using DSPy, Gradio, FastAPI☆86Updated last year
- ☆108Updated 4 months ago
- Using Langroid's Multi-Agent Framework to Build LLM Apps☆145Updated 5 months ago
- A toolkit for building computer use AI agents☆180Updated 5 months ago
- A Dockerfile for autogen studio☆56Updated last year
- This project implements a demonstrator agent that compares the Cache-Augmented Generation (CAG) Framework with traditional Retrieval-Augm…☆31Updated 11 months ago
- API Server for Transformer Lab☆81Updated last month
- A wannabe Ollama equivalent for Apple MlX models☆81Updated 9 months ago
- For inferring and serving local LLMs using the MLX framework☆109Updated last year
- Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma☆34Updated last year
- ☆55Updated 3 months ago
- Link you Ollama models to LM-Studio☆148Updated last year
- 😎 Awesome list of tools and projects with the awesome LangChain framework☆19Updated 2 years ago
- Experiments with open source LLMs☆74Updated 3 months ago
- A microframework for creating simple AI agents.☆94Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Updated last year