GusLovesMath / Llama3_MacSiliconLinks
Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework, with install guide & perf tips. Aims to optimize LLM performance on Mac silicon for devs & researchers.
☆11Updated last year
Alternatives and similar repositories for Llama3_MacSilicon
Users that are interested in Llama3_MacSilicon are comparing it to the libraries listed below
Sorting:
- Simple Implementation of a Transformer in the new framework MLX by Apple☆19Updated last year
- A collection of notebooks for the Hugging Face blog series (https://huggingface.co/blog).☆46Updated last year
- unsloth-5090-multiple☆60Updated 7 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 9 months ago
- 📊 LLM Context Benchmarks - A comprehensive benchmarking tool for testing LLMs with varying context sizes using Ollama. Features dual b…☆18Updated 3 months ago
- ☆11Updated 2 years ago
- GGUF Quantization of any LLM.☆41Updated last year
- ☆22Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆69Updated last month
- Experimenting text-embeddings-inference server on both CPU and GPU☆18Updated 2 years ago
- ☆43Updated 2 months ago
- An agent to generate stunning images :)☆23Updated 7 months ago
- ☆20Updated last year
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆23Updated last year
- AI_Powered_Dev_Search_Engine☆12Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16Updated 8 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆66Updated last year
- ☆46Updated 2 years ago
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆43Updated 6 months ago
- Your Python AI Coder!☆35Updated 7 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…☆23Updated 8 months ago
- Retrieval-augmented generation (RAG) for remote & local LLM use☆44Updated 7 months ago
- a suite of finetuned LLMs for atomically precise function calling 🧪☆17Updated last month
- ☆57Updated 11 months ago
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆103Updated last year
- Python client SDK for Ultravox.☆16Updated last month
- ☆62Updated 6 months ago
- BH hackathon☆14Updated last year
- Embed anything.☆27Updated last year