Run and explore Llama models locally with minimal dependencies on CPU
☆188Oct 12, 2024Updated last year
Alternatives and similar repositories for run-llama-locally
Users that are interested in run-llama-locally are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Minimal LLM inference in Rust☆1,036Oct 24, 2024Updated last year
- World's first Nintendo 3DS emulator for Apple devices based on Citra.☆18Apr 7, 2023Updated 3 years ago
- Docker-based inference engine for AMD GPUs☆234Oct 7, 2024Updated last year
- Sequential Logic☆114May 24, 2026Updated last month
- This is a python implementation for stitching images.☆230Oct 3, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- LUPINE is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.☆2,312Updated this week
- VortexNet: Neural Computing through Fluid Dynamics☆50Jan 19, 2025Updated last year
- Control your Roku with hand gestures using Mediapipe and Python☆17Dec 5, 2024Updated last year
- Sync your personal dotfiles to an encrypted github☆18Mar 19, 2024Updated 2 years ago
- Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.☆629Feb 24, 2025Updated last year
- Analyze your image in seconds with AI☆63May 28, 2024Updated 2 years ago
- A project providing a Graphic Walker Pane for use with HoloViz Panel.☆353Dec 3, 2025Updated 6 months ago
- ☆198May 5, 2025Updated last year
- A Modern C++ Wrapper for TensorFlow☆55May 8, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- OpenCV+YOLO+LLAVA powered video surveillance system☆792Oct 21, 2025Updated 8 months ago
- Omni SenseVoice: High-Speed Speech Recognition with words timestamps 🗣️🎯☆896Dec 10, 2025Updated 6 months ago
- LD_PRELOADable library for exploring the glibc heap☆108Mar 6, 2025Updated last year
- minimal carball on linux. fun for humans and ai!☆203Oct 29, 2024Updated last year
- LLM Analytics☆714Oct 19, 2024Updated last year
- A browser-based, WebGL2 implementation of GPT-2 with transform block and attention matrix visualization☆346Oct 24, 2025Updated 8 months ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆289May 16, 2026Updated last month
- In-browser g-code simulator☆134Feb 28, 2026Updated 4 months ago
- Self-hosted environment for programming tutorial by LLM☆300Jun 11, 2026Updated 2 weeks ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Felafax is building AI infra for non-NVIDIA GPUs☆570Jan 24, 2025Updated last year
- Personal Cloud Storage and File Management Solution with Privacy and Security☆18Nov 12, 2024Updated last year
- Financial instrument definitions built with Python and Pydantic☆198Feb 14, 2025Updated last year
- Work with LLMs on a local environment using containers☆291Jun 22, 2026Updated last week
- Simple inbound/outbound packet sniffer☆31Oct 2, 2024Updated last year
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆361May 21, 2025Updated last year
- Self-hostable TikTok feed for your clips. Make a TikTok feed with your own videos☆352Mar 13, 2026Updated 3 months ago
- A simple app for downloading YouTube Shorts transcripts. Built to self-host with Python and Streamlit. Free and open source.☆32Dec 4, 2024Updated last year
- Collection of high-performance, CUDA-accelerated fluid dynamics and physics simulators, including SPH, hypersonic flow, and reaction-diff…☆63May 7, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A simple app for downloading YouTube videos, transcripts, thumbnails, and channel data all in one place. Built to self-host with Python,…☆18Dec 4, 2024Updated last year
- donut is a zero setup required SRT+MPEG-TS -> WebRTC Bridge powered by Pion.☆358Jun 7, 2024Updated 2 years ago
- ☆356Mar 4, 2025Updated last year
- ai for jq☆249Sep 20, 2024Updated last year
- ☆38Nov 9, 2024Updated last year
- Animating R1's thoughts.☆380Feb 17, 2025Updated last year
- A professional, lock-in-free Jupyter dev env for coders, teams and non-trivial, large Jupyter projects☆39Feb 16, 2021Updated 5 years ago