GusLovesMath / Local_LLM_Training_Apple_Silicon
Created and enhanced a local LLM training system on Apple Silicon with MLX and Metal API, overcoming the absence of CUDA support. Fine-tuned the Llama3 model on 16 GPUs for streamlined solution of verbose math word problems. Result: a powerful, privacy-preserving chatbot that runs smoothly on-device.
☆17Updated 8 months ago
Alternatives and similar repositories for Local_LLM_Training_Apple_Silicon:
Users that are interested in Local_LLM_Training_Apple_Silicon are comparing it to the libraries listed below
- Unsloth Studio☆49Updated 2 months ago
- ☆20Updated 5 months ago
- Simple Chainlit UI for running llms from Groq and LangChain☆17Updated 11 months ago
- 😎 Awesome list of tools and projects with the awesome LangChain framework☆13Updated last year
- Run CrewAI agent workflows on local LLM models with Llamafile and Ollama☆38Updated 8 months ago
- Upgrades in deploying open-source Large Language Models (LLMs) on local inference servers using LM Studio and implements the Google Voic…☆13Updated 8 months ago
- A QT GUI for large language models☆28Updated last year
- 🤖👽💬 Boost your AI platform with OARC! A multimodal AI toolkit Class, and local API. Enjoy real-time audio 🎙️ and text 🔍 chats, agent…☆73Updated last week
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆23Updated last year
- Your Python AI Coder!☆32Updated last week
- A clean Gradio theme with dark and light variants.☆28Updated 9 months ago
- A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…☆12Updated last year
- ☆51Updated this week
- Median is an open-source flashcard application that leverages the power of spaced repetition and artificial intelligence to transform the…☆22Updated 2 months ago
- ☆22Updated 5 months ago
- Run language models on consumer hardware.☆25Updated last year
- On-device real-time RAG App built using Jina Reader, Mediapipe, Gemma 2b IT LLM.☆12Updated 9 months ago
- Simple Chainlit UI for running llms locally using Ollama and LangChain☆41Updated 11 months ago
- This project implements a demonstrator agent that compares the Cache-Augmented Generation (CAG) Framework with traditional Retrieval-Augm…☆24Updated last month
- Gradio based tool to run opensource LLM models directly from Huggingface☆90Updated 7 months ago
- Widest collection of generative ai usecases in enterprise & startups☆17Updated last year
- A ChatGPT powered FAQ chatbot template for connecting your external data sources to an LLM using Llama Index as backend☆19Updated last year
- ☆21Updated 8 months ago
- WhisperAnywhere: Effortless speech-to-text everywhere on your Mac. Use a hotkey to dictate in any app, powered by Whisper AI and Groq API…☆23Updated 4 months ago
- A quick Crew AI tutorial☆23Updated 8 months ago
- Chat with Phi 3.5/3 Vision LLMs. Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which includ…☆32Updated 3 weeks ago
- My version of an LLM Websearch Agent using a local SearXNG server because SearXNG is great.☆17Updated 3 weeks ago
- Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.☆48Updated 11 months ago
- Simple Chainlit UI for running llms locally using Ollama and LangChain☆110Updated 5 months ago
- Groq-Whisper Fast Transcription App built using Groq API and Streamlit.☆21Updated 4 months ago