Alternatives and similar repositories for llm-inference-handbook

Users that are interested in llm-inference-handbook are comparing it to the libraries listed below

• Brandon-c-tech / RAG-logger
  RAG Logger is an open-source logging tool designed specifically for Retrieval-Augmented Generation (RAG) applications. It serves as a lig…
  ☆222Updated 6 months ago
• arc53 / llm-price-compass
  This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …
  ☆221Updated 7 months ago
• klara-research / klarity
  See Through Your Models
  ☆398Updated last week
• RedPlanetHQ / core
  Your personal plug and play memory layer for LLMs
  ☆417Updated last week
• simonw / llm-hacker-news
  LLM plugin for pulling content from Hacker News
  ☆114Updated 2 months ago
• M4THYOU / TokenDagger
  High-Performance Implementation of OpenAI's TikToken.
  ☆435Updated 2 weeks ago
• fiddlecube / compliant-llm
  Build Secure and Compliant AI agents and MCP Servers. YC W23
  ☆145Updated last month
• taylorai / aiq
  ai for jq
  ☆243Updated 9 months ago
• SureScaleAI / cleverbee
  CleverBee - The Open Source Deep Researcher Tool
  ☆301Updated last month
• agentsea / r1-computer-use
  Applying the ideas of Deepseek R1 to computer use
  ☆214Updated 5 months ago
• dhealy05 / frames_of_mind
  Animating R1's thoughts.
  ☆383Updated 5 months ago
• matiasmolinas / evolving-agents
  Your toolkit for autonomous, evolving agent ecosystems. Create, execute, govern, and evolve agents that learn from experience, collaborat…
  ☆439Updated this week
• habedi / cogitator
  A Python toolkit for chain-of-thought prompting 🐍
  ☆172Updated last week
• hemanth / paws-on-mcp
  A comprehensive Model Context Protocol (MCP) server implementing the latest specification.
  ☆329Updated 3 weeks ago
• anordin95 / run-llama-locally
  Run and explore Llama models locally with minimal dependencies on CPU
  ☆191Updated 9 months ago
• Tsadoq / ErisForge
  Dead Simple LLM Abliteration
  ☆224Updated 5 months ago
• jamsocket / forevervm
  Securely run AI-generated code in stateful sandboxes that run forever.
  ☆208Updated 3 months ago
• merliot / hub
  Merliot Device Hub
  ☆145Updated last month
• Foreseerr / TScale
  ☆196Updated 2 months ago
• dipampaul17 / KVSplit
  Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …
  ☆356Updated last month
• janwilmake / efficient-recorder
  Attempt to create an Open Source Privacy Focused Rewind.ai Alternative for data capture
  ☆216Updated 5 months ago
• aerugo / prelude
  A very simple tool to build LLM prompts from your code repositories.
  ☆154Updated 5 months ago
• helixml / genai-cicd-ref
  Cloud-Native GenAI Reference Architecture
  ☆73Updated 8 months ago
• pixeltable / pixelagent
  Pixelagent — Multimodal stateful agents
  ☆205Updated last month
• elijah-potter / ofc
  A command-line Ollama client for scripting.
  ☆80Updated 4 months ago
• pancsta / secai
  Platform for AI Agents with a local reasoning layer
  ☆78Updated 3 weeks ago
• banagale / FileKitty
  GUI for selecting text files for concatenation and submission to LLMs
  ☆176Updated last week
• vlm-run / vlmrun-cookbook
  Examples and guides for using the VLM Run API
  ☆283Updated this week
• Z-Gort / Reservoirs-Lab
  ☆278Updated last month
• andyk / recursive_llm
  Implement recursion using English as the programming language and an LLM as the runtime.
  ☆238Updated 2 years ago