Alternatives and similar repositories for run-llama-locally

Users that are interested in run-llama-locally are comparing it to the libraries listed below

• slashml / amd_inference
  Docker-based inference engine for AMD GPUs
  ☆231Updated 10 months ago
• andyk / recursive_llm
  Implement recursion using English as the programming language and an LLM as the runtime.
  ☆239Updated 2 years ago
• arc53 / llm-price-compass
  This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …
  ☆220Updated 8 months ago
• robertjakob / rigorous
  A comprehensive suite of tools, built to liberate science by making the creation, evaluation, and dissemination of research more transpar…
  ☆209Updated 2 weeks ago
• M4THYOU / TokenDagger
  High-Performance Implementation of OpenAI's TikToken.
  ☆445Updated last month
• vlm-run / vlmrun-cookbook
  Examples and guides for using the VLM Run API
  ☆288Updated last month
• Tsadoq / ErisForge
  Dead Simple LLM Abliteration
  ☆231Updated 6 months ago
• Dicklesworthstone / visual_astar_python
  Generate Cool-Looking Mazes and Animations Illustrating the A* Pathfinding Algorithm
  ☆177Updated 6 months ago
• simonw / llm-hacker-news
  LLM plugin for pulling content from Hacker News
  ☆116Updated 3 months ago
• taylorai / aiq
  ai for jq
  ☆244Updated 11 months ago
• martianlantern / ThinkMesh
  Parallel thinking for LLMs. Confidence‑gated, strategy‑driven, offline‑friendly
  ☆146Updated this week
• joennlae / tensorli
  Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).
  ☆253Updated last year
• Foreseerr / TScale
  ☆197Updated 3 months ago
• dipampaul17 / KVSplit
  Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …
  ☆356Updated 3 months ago
• adenta / fire_red_agent
  ☆164Updated 5 months ago
• C-Naoki / image-stitcher
  This is a python implementation for stitching images.
  ☆232Updated 10 months ago
• roryclear / clearcam
  Add object detection, tracking, and mobile notifications to any RTSP Camera or iPhone.
  ☆338Updated this week
• bravenewxyz / agent-c
  Ultra-lightweight AI Agent
  ☆250Updated this week
• Z-Gort / Reservoirs-Lab
  ☆279Updated 2 months ago
• ivanbelenky / RL
  R.L. methods and techniques.
  ☆199Updated 9 months ago
• ngafar / llama-scan
  Transcribe PDFs with local LLMs
  ☆543Updated this week
• dhealy05 / frames_of_mind
  Animating R1's thoughts.
  ☆384Updated 6 months ago
• randombk / llm2sh
  Ask GPT to run a command
  ☆194Updated 5 months ago
• tearflake / flake-ui
  fractal-structure inspired, parent-children orbiting, zooming-elements based interactive graph visualization user interface
  ☆130Updated 5 months ago
• Dicklesworthstone / bakery_algorithm
  Lamport's Bakery Algorithm Demonstrated in Python
  ☆96Updated last year
• moonshine-ai / qc_npu_benchmark
  Code sample showing how to run and benchmark models on Qualcomm's Window PCs
  ☆101Updated 10 months ago
• klara-research / klarity
  See Through Your Models
  ☆399Updated last month
• simonmysun / ell
  A command-line interface for LLMs written in Bash.
  ☆436Updated 6 months ago
• ListenNotes / notebooklm-detector
  Detect whether or not an audio file was generated by NotebookLM
  ☆138Updated 8 months ago
• DarkStar1982 / Orbidium
  ☆96Updated 10 months ago