Alternatives and similar repositories for llm-inference-calculator

Users that are interested in llm-inference-calculator are comparing it to the libraries listed below

• RayFernando1337 / LLM-Calc
  Instantly calculate the maximum size of quantized language models that can fit in your available RAM, helping you optimize your models fo…
  ☆242Updated 8 months ago
• Hairetsu / Notate
  Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…
  ☆261Updated 9 months ago
• daeisbae / open-repo-wiki
  You don’t need to read the code to understand how to build!
  ☆241Updated this week
• anishgowda21 / tiny-ollama-chat
  A lightweight UI for chatting with Ollama models. Streaming responses, conversation history, and multi-model support.
  ☆145Updated 9 months ago
• TesslateAI / Agent-Builder
  ☆200Updated 3 months ago
• masterFoad / NanoSage
  Local LLM Powered Recursive Search & Smart Knowledge Explorer
  ☆257Updated 2 months ago
• RamboRogers / mlx-gui
  MLX-GUI MLX Inference Server for Apple Silicone
  ☆157Updated this week
• justinlietz93 / neuroca
  This project was generated 100% by AI, with one prompt. NOTE: This neuroca project was generated in 3 hours on 3/3/2025. There are depend…
  ☆47Updated 8 months ago
• hyepartners-gmail / vibevideo-mcp
  Agent MCP for ffmpeg
  ☆210Updated 6 months ago
• kspviswa / pyOllaMx
  Your gateway to both Ollama & Apple MlX models
  ☆150Updated 9 months ago
• persys-ai / persys
  Welcome!
  ☆140Updated last year
• open-webui / bot
  beep boop 🤖 (experimental)
  ☆118Updated 11 months ago
• sammcj / ingest
  Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMs
  ☆317Updated 3 weeks ago
• ivanfioravanti / lmstudio_hf
  A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.
  ☆68Updated last month
• platinum-hill / cobolt
  This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support
  ☆226Updated 4 months ago
• Harry-027 / DocuMind
  A document based RAG application
  ☆131Updated 8 months ago
• AndreaDev3D / OllamaChat
  ☆74Updated 7 months ago
• navedmerchant / MyDeviceAI
  A cross patform app that unlocks your devices Gen AI capabilities
  ☆68Updated last week
• rockbite / localforge
  Local coding agent with neat UI
  ☆335Updated 7 months ago
• NPC-Worldwide / npc-studio
  the AI IDE for work, research, development, and play.
  ☆213Updated last week
• victorb / ollama-swarm
  Educational framework exploring ergonomic, lightweight multi-agent orchestration. Modified to use local Ollama endpoint
  ☆49Updated last year
• sammcj / llamalink
  Link you Ollama models to LM-Studio
  ☆148Updated last year
• Fus3n / gem-assist
  Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools
  ☆112Updated 5 months ago
• JasonHonKL / spy-search
  LLM search engine faster than perplexity!
  ☆369Updated 4 months ago
• taylorwilsdon / reddacted
  reddacted lets you analyze & sanitize your online footprint using LLMs, PII detection & sentiment analysis to identify anything that migh…
  ☆113Updated 4 months ago
• iluxu / llmbasedos
  llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work
  ☆278Updated 3 months ago
• remichu-ai / pai
  Your personal and private AI
  ☆52Updated 8 months ago
• Gimer-Studios / APIMyLlama
  API up your Ollama Server.
  ☆188Updated 2 months ago
• kesor / ollama-proxy
  Nginx proxy server in a Docker container to Authenticate & Proxy requests to Ollama from Public Internet via Cloudflare Tunnel
  ☆154Updated 3 months ago
• dujonwalker / project-nova
  A multi-agent AI architecture that connects 25+ specialized agents through n8n and MCP servers. Project NOVA routes requests to domain-sp…
  ☆248Updated 6 months ago