Alternatives and similar repositories for run-llama-locally

Users that are interested in run-llama-locally are comparing it to the libraries listed below

• slashml / amd_inference
  Docker-based inference engine for AMD GPUs
  ☆231Updated 9 months ago
• andyk / recursive_llm
  Implement recursion using English as the programming language and an LLM as the runtime.
  ☆238Updated 2 years ago
• robertjakob / rigorous
  A comprehensive suite of tools, built to liberate science by making the creation, evaluation, and dissemination of research more transpar…
  ☆199Updated last month
• M4THYOU / TokenDagger
  High-Performance Implementation of OpenAI's TikToken.
  ☆432Updated last week
• Tsadoq / ErisForge
  Dead Simple LLM Abliteration
  ☆222Updated 4 months ago
• Dicklesworthstone / visual_astar_python
  Generate Cool-Looking Mazes and Animations Illustrating the A* Pathfinding Algorithm
  ☆177Updated 4 months ago
• arc53 / llm-price-compass
  This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …
  ☆221Updated 7 months ago
• Z-Gort / Reservoirs-Lab
  ☆278Updated last month
• adenta / fire_red_agent
  ☆163Updated 3 months ago
• vlm-run / vlmrun-cookbook
  Examples and guides for using the VLM Run API
  ☆281Updated last week
• Foreseerr / TScale
  ☆196Updated 2 months ago
• dipampaul17 / KVSplit
  Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …
  ☆356Updated last month
• C-Naoki / image-stitcher
  This is a python implementation for stitching images.
  ☆232Updated 9 months ago
• DarkStar1982 / Orbidium
  ☆96Updated 8 months ago
• simonw / llm-hacker-news
  LLM plugin for pulling content from Hacker News
  ☆114Updated 2 months ago
• brianmg / voynich-nlp-analysis
  ☆123Updated last month
• taylorai / aiq
  ai for jq
  ☆243Updated 9 months ago
• iosifache / annas-mcp
  MCP server and CLI tool for searching and downloading documents from Anna's Archive
  ☆281Updated this week
• SureScaleAI / cleverbee
  CleverBee - The Open Source Deep Researcher Tool
  ☆302Updated last month
• tearflake / flake-ui
  fractal-structure inspired, parent-children orbiting, zooming-elements based interactive graph visualization user interface
  ☆131Updated 4 months ago
• klara-research / klarity
  See Through Your Models
  ☆398Updated last week
• blackrabbit17 / xenolab
  A monitoring station for carnivorous flora.
  ☆131Updated 2 months ago
• Dicklesworthstone / bakery_algorithm
  Lamport's Bakery Algorithm Demonstrated in Python
  ☆96Updated last year
• dhealy05 / frames_of_mind
  Animating R1's thoughts.
  ☆383Updated 4 months ago
• randombk / llm2sh
  Ask GPT to run a command
  ☆195Updated 4 months ago
• fzliu / radient
  Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.
  ☆278Updated 3 weeks ago
• rentruewang / bocoel
  Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…
  ☆285Updated 2 weeks ago
• joennlae / tensorli
  Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).
  ☆252Updated last year
• matiasmolinas / evolving-agents
  Your toolkit for autonomous, evolving agent ecosystems. Create, execute, govern, and evolve agents that learn from experience, collaborat…
  ☆439Updated last week
• moonshine-ai / qc_npu_benchmark
  Code sample showing how to run and benchmark models on Qualcomm's Window PCs
  ☆100Updated 9 months ago