Alternatives and similar repositories for llm-inference-handbook

Users that are interested in llm-inference-handbook are comparing it to the libraries listed below

• Brandon-c-tech / RAG-logger
  RAG Logger is an open-source logging tool designed specifically for Retrieval-Augmented Generation (RAG) applications. It serves as a lig…
  ☆225Updated 10 months ago
• trvon / yams
  Content addressable storage with excellent search
  ☆352Updated last week
• M4THYOU / TokenDagger
  High-Performance Implementation of OpenAI's TikToken.
  ☆457Updated 3 months ago
• martianlantern / ThinkMesh
  Parallel thinking for LLMs. Confidence‑gated, strategy‑driven, offline‑friendly
  ☆257Updated last month
• jamsocket / forevervm
  Securely run AI-generated code in stateful sandboxes that run forever.
  ☆221Updated 6 months ago
• fiddlecube / compliant-llm
  Build Secure and Compliant AI agents and MCP Servers. YC W23
  ☆152Updated 4 months ago
• simonw / llm-hacker-news
  LLM plugin for pulling content from Hacker News
  ☆120Updated 5 months ago
• dhealy05 / frames_of_mind
  Animating R1's thoughts.
  ☆385Updated 8 months ago
• Growth-Kinetics / DiffMem
  Git Based Memory Storage for Conversational AI Agent
  ☆664Updated last month
• perone / vectorvfs
  Your filesystem as a vector database
  ☆484Updated 6 months ago
• hemanth / paws-on-mcp
  A comprehensive Model Context Protocol (MCP) server implementing the latest specification.
  ☆334Updated 4 months ago
• klara-research / klarity
  See Through Your Models
  ☆400Updated 3 months ago
• Foreseerr / TScale
  ☆198Updated 5 months ago
• pixeltable / pixelagent
  Pixelagent — Multimodal stateful agents
  ☆220Updated 4 months ago
• habedi / cogitator
  A Python toolkit for chain-of-thought prompting 🐍
  ☆175Updated 2 months ago
• arc53 / llm-price-compass
  This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …
  ☆220Updated 10 months ago
• matiasmolinas / evolving-agents
  Your toolkit for autonomous, evolving agent ecosystems. Create, execute, govern, and evolve agents that learn from experience, collaborat…
  ☆443Updated 2 months ago
• wyattjoh / jmap-mcp
  A Model Context Protocol (MCP) server that provides tools for interacting with JMAP (JSON Meta Application Protocol) email servers. Built…
  ☆150Updated 2 months ago
• repomirrorhq / repomirror
  ☆382Updated 2 months ago
• jolibrain / colette
  Multimodal RAG to search and interact locally with technical documents of any kind
  ☆273Updated last week
• mohsen1 / llm-debugger-vscode-extension
  VSCode extension that demonstrates the use of large language models (LLMs) for active debugging of programs
  ☆353Updated 8 months ago
• anishathalye / semlib
  Build data processing and data analysis pipelines that leverage the power of LLMs 🧠
  ☆226Updated last week
• llama-farm / llamafarm
  Deploy any AI model, agent, database, RAG, and pipeline locally or remotely in minutes
  ☆560Updated last week
• Masony817 / ask-human-mcp
  ☆150Updated 3 months ago
• simedw / spegel
  Spegel - Reflect the web through AI
  ☆316Updated 3 months ago
• agentsea / r1-computer-use
  Applying the ideas of Deepseek R1 to computer use
  ☆216Updated 8 months ago
• irthomasthomas / llm-cerebras
  llm plugin for Cerebras fast inference API
  ☆31Updated 3 months ago
• icarito / gtk-llm-chat
  A GTK graphical interface for chatting with large language models (LLMs)
  ☆81Updated last month
• andyk / recursive_llm
  Implement recursion using English as the programming language and an LLM as the runtime.
  ☆236Updated 2 years ago
• anordin95 / run-llama-locally
  Run and explore Llama models locally with minimal dependencies on CPU
  ☆189Updated last year