Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework, with install guide & perf tips. Aims to optimize LLM performance on Mac silicon for devs & researchers.
☆11May 4, 2024Updated last year
Alternatives and similar repositories for Llama3_MacSilicon
Users that are interested in Llama3_MacSilicon are comparing it to the libraries listed below
Sorting:
- 📊 LLM Context Benchmarks - A comprehensive benchmarking tool for testing LLMs with varying context sizes using Ollama. Features dual b…☆35Feb 21, 2026Updated last week
- Created and enhanced a local LLM training system on Apple Silicon with MLX and Metal API, overcoming the absence of CUDA support. Fine-tu…☆22May 29, 2024Updated last year
- A powerful Laravel storage driver that enables seamless synchronization of files across multiple disks, with an integrated cache disk for…☆15Nov 11, 2025Updated 3 months ago
- 🐆A lightweight, high-performance string manipulation library optimized for speed-sensitive applications.☆14Jan 6, 2026Updated 2 months ago
- A batched implementation for efficient Qwen2.5-VL inference.☆22Jul 16, 2025Updated 7 months ago
- An easy-to-install ChatGPT clone you can host on your own web server and access from a web browser.☆10May 26, 2023Updated 2 years ago
- A SystemVerilog-based simulation and design of a Last Level Cache (LLC) implementing the MESI protocol, featuring Pseudo-LRU replacement,…☆15Nov 24, 2025Updated 3 months ago
- A multimodal RAG application that enables semantic search on multimedia sources like audio, video and images☆41Nov 18, 2023Updated 2 years ago
- The SEAL-CPU backend is a Reference backend engine for HEBench which is a shared library that implements the required functions specified…☆11Mar 3, 2023Updated 3 years ago
- High performance async Mssql library for Python.☆17Feb 20, 2026Updated 2 weeks ago
- GenPiCam - a RaspberryPi based camera that reimagines the world with GenAI.☆10Jun 28, 2023Updated 2 years ago
- A higher quality RVC pretrained model to accelerate your training process.☆21Nov 11, 2025Updated 3 months ago
- This repo contains documentation related to the operation of the OpenBytes project.☆13Oct 29, 2021Updated 4 years ago
- This is a matlab implementation of J.Park's work "High Quality Depth Map Upsampling for 3D-TOF Cameras" . We test our implementation wit…☆11May 5, 2019Updated 6 years ago
- An experimental python library to compile and analyze the cost of any desired composite simulation in real or imaginary time, and with or…☆10Feb 9, 2024Updated 2 years ago
- A relatively simple, unified method for reporting on Kubernetes resource issues.☆12Mar 5, 2020Updated 6 years ago
- Indexing framework designed for the automated creation of structured knowledge bases in Azure AI Search☆14Jun 18, 2025Updated 8 months ago
- Support page for the 'AR Foundation Remote' plugin on the Asset Store☆11Dec 5, 2023Updated 2 years ago
- A curated collection of practical Laravel tips, tricks, and best practices to help you write cleaner, faster, and more efficient code. Wh…☆10Apr 13, 2025Updated 10 months ago
- Automatic Thief Detection via CCTV with Alarm System and Perpetrator Image Capture using YOLOv5 + ROI. This project utilizes computer vis…☆14Oct 21, 2024Updated last year
- Evaluation of Oasis Platform - simple install, UI and API☆14Feb 9, 2026Updated 3 weeks ago
- Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization☆12Dec 3, 2024Updated last year
- Application for Agent re-engineering for better and reliable Gen AI workflows.☆10Jul 20, 2025Updated 7 months ago
- Sparse Matrix Factorization (SMF) is a key component in many machine learning problems and there exist a verity a applications in real-w…☆11Jan 25, 2016Updated 10 years ago
- Estimate dense depth maps from RGB image and sparse depth maps☆14Oct 4, 2018Updated 7 years ago
- Sample code for using WatchConnectivity framework to communicate between Apple Watch and iPhone☆10Jun 19, 2015Updated 10 years ago
- Libraries/Plugins for Xamarin apps☆10Dec 8, 2022Updated 3 years ago
- A C# cross-platform template for StereoKit! Works with .Net Core, Xamarin, and UWP.☆10Feb 26, 2025Updated last year
- Generate train.jsonl and valid.jsonl files to use for fine-tuning Mistral and other LLMs.☆97Feb 5, 2024Updated 2 years ago
- My personal dotfiles with automated macOS setup. Features smart installation scripts, Bats testing (bash), performance monitoring, and 2…☆11Feb 6, 2026Updated last month
- [Applied Intelligence 2022] Python code for ACP☆12Sep 5, 2023Updated 2 years ago
- Deploy Detectron2 with Triton inference server☆10Aug 15, 2022Updated 3 years ago
- Effortlessly process invoices with AI! This project uses the Llama3.2 Vision Model for OCR, converting invoice images into structured, ma…☆10Feb 5, 2025Updated last year
- ☆11Aug 15, 2024Updated last year
- A Bunyan stream to send events to Seq☆11May 7, 2025Updated 9 months ago
- Active Response plugin. Osquery to execute wazuh/ossec active response plugins. You can write your own plugins, easy to plug☆11Jun 20, 2020Updated 5 years ago
- ☆15Apr 7, 2024Updated last year
- ☆12Jun 21, 2023Updated 2 years ago
- My bachelor's thesis about face recognition with depth camera☆10Feb 19, 2019Updated 7 years ago