GusLovesMath / Llama3_MacSiliconLinks
Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework, with install guide & perf tips. Aims to optimize LLM performance on Mac silicon for devs & researchers.
☆11Updated last year
Alternatives and similar repositories for Llama3_MacSilicon
Users that are interested in Llama3_MacSilicon are comparing it to the libraries listed below
Sorting:
- unsloth-5090-multiple☆57Updated 6 months ago
- a suite of finetuned LLMs for atomically precise function calling 🧪☆16Updated 3 weeks ago
- Simple Implementation of a Transformer in the new framework MLX by Apple☆18Updated last year
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆19Updated last month
- run ollama & gguf easily with a single command☆52Updated last year
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆43Updated 5 months ago
- ☆21Updated last year
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆16Updated last month
- GPT-4 Level Conversational QA Trained In a Few Hours☆65Updated last year
- ☆11Updated 2 years ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16Updated 6 months ago
- GGUF Quantization of any LLM.☆41Updated last year
- Minimal, clean code implementation of RAG with mlx using gguf model weights☆52Updated last year
- ☆101Updated 5 months ago
- AI_Powered_Dev_Search_Engine☆12Updated last year
- Very minimal (and stateless) agent framework☆45Updated 10 months ago
- Probably one of the lightest native RAG + Agent apps out there,experience the power of Agent-powered models and Agent-driven knowledge ba…☆26Updated 5 months ago
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated 8 months ago
- BH hackathon☆13Updated last year
- Fastest way to build, prototype and deploy AI Agents or ANY LLM Application with built-in security layer.☆61Updated this week
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆29Updated 8 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆51Updated last year
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆23Updated last year
- Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…☆22Updated 6 months ago
- A forest of autonomous agents.☆17Updated 9 months ago
- Your Python AI Coder!☆35Updated 6 months ago
- Fast-track AI apps to production with LLaMA 3, Mistral, and other top LLMs!☆21Updated last year
- ☆17Updated last year
- OpenPipe Reinforcement Learning Experiments☆32Updated 8 months ago
- An offline CPU-first low-resource chat application to perform RAG on your corpus of data. Powered by OpenChat and CTranslate2.☆13Updated 6 months ago