GusLovesMath / Llama3_MacSiliconLinks
Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework, with install guide & perf tips. Aims to optimize LLM performance on Mac silicon for devs & researchers.
☆11Updated last year
Alternatives and similar repositories for Llama3_MacSilicon
Users that are interested in Llama3_MacSilicon are comparing it to the libraries listed below
Sorting:
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆13Updated last week
- Web Interface for Vision Language Models Including InternVLM2☆22Updated 10 months ago
- Simple Implementation of a Transformer in the new framework MLX by Apple☆20Updated 6 months ago
- Python Server for C3 AI app. A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) with…☆23Updated last year
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆24Updated last year
- A python command-line tool to download & manage MLX AI models from Hugging Face.☆17Updated 9 months ago
- ☆11Updated last year
- Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…☆22Updated last month
- ☆21Updated 7 months ago
- Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.☆45Updated last year
- Minimal, clean code implementation of RAG with mlx using gguf model weights☆50Updated last year
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆40Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆30Updated last year
- ☆20Updated last year
- Tools for merging pretrained large language models.☆19Updated 11 months ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆19Updated 7 months ago
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆34Updated last year
- A forest of autonomous agents.☆19Updated 4 months ago
- BH hackathon☆14Updated last year
- This Repo focuses on defending against 'adversarial prompts,' detecting and attempting to mitigate objectionable content in real time.☆13Updated last year
- Simple playground chat app that interacts with OpenAI's functions with memory and custom tools.☆18Updated last year
- AI_Powered_Dev_Search_Engine☆12Updated last year
- CogNetX is an advanced, multimodal neural network architecture inspired by human cognition. It integrates speech, vision, and video proce…☆14Updated last week
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated 3 months ago
- Simple CogVLM client script☆14Updated last year
- A chatbot UI for RAG, multimodal, text completion. (support Transformers, llama.cpp, MLX, vLLM)☆19Updated last year
- Modified Beam Search with periodical restart☆12Updated 8 months ago
- This project breathes life into video characters by using AI to describe their personality and then chat with you as them.☆46Updated last year
- ☆16Updated last year
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆39Updated 4 months ago