Run and explore Llama models locally with minimal dependencies on CPU
☆188Oct 12, 2024Updated 2 years ago
Alternatives and similar repositories for run-llama-locally
Users that are interested in run-llama-locally are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Minimal LLM inference in Rust☆1,031Oct 24, 2024Updated 2 years ago
- Sequential Logic☆114Aug 29, 2026Updated 2 months ago
- Docker-based inference engine for AMD GPUs☆234Oct 7, 2024Updated 2 years ago
- This is a python implementation for stitching images.☆229Oct 3, 2024Updated 2 years ago
- Analyze your image in seconds with AI☆63May 28, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ban☆23Aug 1, 2025Updated last year
- Scripts and ideas to manage tons and tons of images and movies☆17Jul 8, 2026Updated 3 months ago
- Financial instrument definitions built with Python and Pydantic☆197Feb 14, 2025Updated last year
- ☆196May 5, 2025Updated last year
- Sync your personal dotfiles to an encrypted github☆18Mar 19, 2024Updated 2 years ago
- A project providing a Graphic Walker Pane for use with HoloViz Panel.☆350Dec 3, 2025Updated 10 months ago
- Self-hosted environment for programming tutorial by LLM☆303Updated this week
- LUPINE is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.☆2,453Oct 15, 2026Updated 2 weeks ago
- Felafax is building AI infra for non-NVIDIA GPUs☆568Jan 24, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Omni SenseVoice: High-Speed Speech Recognition with words timestamps 🗣️🎯☆896Dec 10, 2025Updated 10 months ago
- LLM Analytics☆715Jul 8, 2026Updated 3 months ago
- Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.☆629Feb 24, 2025Updated last year
- This GUI aims to simplify the process of converting GGUF files to llamafile format by providing an intuitive and convenient way for users…☆14Jan 2, 2026Updated 9 months ago
- SATRE-Compliant TRE implementation on Kubernetes☆18Oct 22, 2026Updated last week
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆288Sep 8, 2026Updated last month
- A realtime agent overlay for life☆26Mar 16, 2026Updated 7 months ago
- minimal carball on linux. fun for humans and ai!☆204Oct 29, 2024Updated 2 years ago
- Simple inbound/outbound packet sniffer☆31Oct 2, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- OpenCV+YOLO+LLAVA powered video surveillance system☆793Oct 21, 2025Updated last year
- Animating R1's thoughts.☆378Feb 17, 2025Updated last year
- dead mans switch without reliance on your system, infra, or application☆335Updated this week
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆106Oct 4, 2024Updated 2 years ago
- Personal Cloud Storage and File Management Solution with Privacy and Security☆18Nov 12, 2024Updated last year
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆361May 21, 2025Updated last year
- A collection of tamagotchi characters to give AI assistants an identity.☆58Oct 28, 2024Updated 2 years ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆221Dec 16, 2024Updated last year
- A browser-based, WebGL2 implementation of GPT-2 with transform block and attention matrix visualization☆348Oct 24, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Llama 2 Everywhere (L2E)☆1,521Aug 27, 2025Updated last year
- browser plugin to send youtube, insta (all social videos) to local backend and process audio and video in all sorts of ways.☆250Aug 31, 2025Updated last year
- Terminal tool to share your terminal history with anyone.☆16Feb 14, 2026Updated 8 months ago
- Weight tracking and analysis tools☆16May 4, 2026Updated 5 months ago
- A professional, lock-in-free Jupyter dev env for coders, teams and non-trivial, large Jupyter projects☆39Feb 16, 2021Updated 5 years ago
- A simple app for downloading YouTube videos, transcripts, thumbnails, and channel data all in one place. Built to self-host with Python,…☆18Dec 4, 2024Updated last year
- Python sdk for zero-shot time-series forecasting☆89Jan 26, 2026Updated 9 months ago