Run and explore Llama models locally with minimal dependencies on CPU
☆188Oct 12, 2024Updated 2 years ago
Alternatives and similar repositories for run-llama-locally
Users that are interested in run-llama-locally are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Minimal LLM inference in Rust☆1,032Oct 24, 2024Updated 2 years ago
- Sequential Logic☆115Nov 1, 2026Updated 2 weeks ago
- Docker-based inference engine for AMD GPUs☆233Updated this week
- This is a python implementation for stitching images.☆228Oct 3, 2024Updated 2 years ago
- Analyze your image in seconds with AI☆63May 28, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Self-hosted environment for programming tutorial by LLM☆303Updated this week
- ban☆23Aug 1, 2025Updated last year
- Control your Roku with hand gestures using Mediapipe and Python☆18Dec 5, 2024Updated last year
- Scripts and ideas to manage tons and tons of images and movies☆17Updated this week
- Financial instrument definitions built with Python and Pydantic☆197Feb 14, 2025Updated last year
- ☆196May 5, 2025Updated last year
- Sync your personal dotfiles to an encrypted github☆18Mar 19, 2024Updated 2 years ago
- A project providing a Graphic Walker Pane for use with HoloViz Panel.☆352Dec 3, 2025Updated 11 months ago
- LUPINE is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.☆2,471Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Felafax is building AI infra for non-NVIDIA GPUs☆569Jan 24, 2025Updated last year
- LLM Analytics☆717Jul 8, 2026Updated 4 months ago
- Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.☆630Feb 24, 2025Updated last year
- Omni SenseVoice: High-Speed Speech Recognition with words timestamps 🗣️🎯☆897Dec 10, 2025Updated 11 months ago
- Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…☆288Sep 8, 2026Updated 2 months ago
- A browser extension to monitor if a website you are visiting might have some job opportunities open☆11Jan 5, 2023Updated 3 years ago
- minimal carball on linux. fun for humans and ai!☆204Oct 29, 2024Updated 2 years ago
- Animating R1's thoughts.☆377Feb 17, 2025Updated last year
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆106Oct 4, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- dead mans switch without reliance on your system, infra, or application☆334Updated this week
- OpenCV+YOLO+LLAVA powered video surveillance system☆794Oct 21, 2025Updated last year
- Collaborative C4 architecture modelling and diagramming — offline-first, real-time, self-hostable (AGPL-3.0)☆27Updated this week
- Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …☆363May 21, 2025Updated last year
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆222Dec 16, 2024Updated last year
- browser plugin to send youtube, insta (all social videos) to local backend and process audio and video in all sorts of ways.☆251Aug 31, 2025Updated last year
- A browser-based, WebGL2 implementation of GPT-2 with transform block and attention matrix visualization☆349Oct 24, 2025Updated last year
- Wikipedia-like interface for querying an OLLAMA language model. Users can input their queries, and the app will generate informative resp…☆13Nov 4, 2024Updated 2 years ago
- Terminal tool to share your terminal history with anyone.☆16Feb 14, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Trans…☆12Updated this week
- A collection of tamagotchi characters to give AI assistants an identity.☆58Oct 28, 2024Updated 2 years ago
- Weight tracking and analysis tools☆16May 4, 2026Updated 6 months ago
- Llama 2 Everywhere (L2E)☆1,518Aug 27, 2025Updated last year
- AcSecurity is a Python module designed to scan applications for common security vulnerabilities. It checks for hardcoded secrets, depende…☆15Oct 28, 2026Updated 3 weeks ago
- ☆38Nov 9, 2024Updated 2 years ago
- VortexNet: Neural Computing through Fluid Dynamics☆50Jan 19, 2025Updated last year
Are these results useful?