GusLovesMath / Llama3_MacSiliconLinks
Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework, with install guide & perf tips. Aims to optimize LLM performance on Mac silicon for devs & researchers.
☆11Updated last year
Alternatives and similar repositories for Llama3_MacSilicon
Users that are interested in Llama3_MacSilicon are comparing it to the libraries listed below
Sorting:
- Simple Implementation of a Transformer in the new framework MLX by Apple☆19Updated last year
- ☆11Updated 2 years ago
- a suite of finetuned LLMs for atomically precise function calling 🧪☆17Updated last week
- Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge ba…☆31Updated 6 months ago
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆17Updated 2 months ago
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆20Updated 2 months ago
- ☆22Updated last year
- ☆57Updated last week
- ☆46Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16Updated 7 months ago
- ☆17Updated last year
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆37Updated last year
- unsloth-5090-multiple☆60Updated 6 months ago
- Build your own RAG and run it locally on your laptop: ColBERT + DSPy + Streamlit☆58Updated last year
- 📊 LLM Context Benchmarks - A comprehensive benchmarking tool for testing LLMs with varying context sizes using Ollama. Features dual b…☆18Updated 2 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 8 months ago
- Elasticsearch integration into LangChain☆69Updated last week
- ☆43Updated last month
- Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!☆16Updated this week
- AI_Powered_Dev_Search_Engine☆12Updated last year
- An open source framework for Retrieval-Augmented System (RAG) uses semantic search helps to retrieve the expected results and generate h…☆22Updated 3 weeks ago
- Experimenting text-embeddings-inference server on both CPU and GPU☆18Updated 2 years ago
- ☆22Updated last year
- Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…☆23Updated 7 months ago
- ☆101Updated 6 months ago
- A python command-line tool to download & manage MLX AI models from Hugging Face.☆19Updated last year
- Your own GPT-powered Personal Assistant to whom you can ORDER or INSTRUCT to do some task or search for something using your VOICE comman…☆20Updated 2 years ago
- Unsloth Studio☆120Updated 8 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- This project breathes life into video characters by using AI to describe their personality and then chat with you as them.☆49Updated last year