alexziskind1 / llm-inference-calculatorLinks
☆134Updated last month
Alternatives and similar repositories for llm-inference-calculator
Users that are interested in llm-inference-calculator are comparing it to the libraries listed below
Sorting:
- Instantly calculate the maximum size of quantized language models that can fit in your available RAM, helping you optimize your models fo…☆242Updated 6 months ago
- beep boop 🤖 (experimental)☆115Updated 10 months ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆256Updated 8 months ago
- A cross patform app that unlocks your devices Gen AI capabilities☆65Updated last month
- CoexistAI is a modular, developer-friendly research assistant framework . It enables you to build, search, summarize, and automate resear…☆343Updated 2 weeks ago
- MLX-GUI MLX Inference Server for Apple Silicone☆132Updated 2 months ago
- Agent MCP for ffmpeg☆209Updated 5 months ago
- Your gateway to both Ollama & Apple MlX models☆148Updated 8 months ago
- Link you Ollama models to LM-Studio☆146Updated last year
- Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMs☆310Updated 2 months ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆266Updated 8 months ago
- reddacted lets you analyze & sanitize your online footprint using LLMs, PII detection & sentiment analysis to identify anything that migh…☆111Updated 3 months ago
- A multi-agent AI architecture that connects 25+ specialized agents through n8n and MCP servers. Project NOVA routes requests to domain-sp…☆239Updated 5 months ago
- A lightweight UI for chatting with Ollama models. Streaming responses, conversation history, and multi-model support.☆139Updated 7 months ago
- Welcome!☆140Updated 10 months ago
- Open WebUI Desktop 🌐 (Alpha)☆699Updated 3 months ago
- You don’t need to read the code to understand how to build!☆221Updated 9 months ago
- This project was generated 100% by AI, with one prompt. NOTE: This neuroca project was generated in 3 hours on 3/3/2025. There are depend…☆46Updated 7 months ago
- the IDE for research, built from the ground up with AI integrations☆158Updated last week
- This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support☆225Updated 2 months ago
- Local AI voice assistant stack for Home Assistant (GPU-accelerated) with persistent memory, follow-up conversation, and Ollama model reco…☆215Updated 3 months ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆102Updated 7 months ago
- Your AI mate into your favourite terminal☆109Updated 2 months ago
- Official python implementation of UTCP. UTCP is an open standard that lets AI agents call any API directly, without extra middleware.☆584Updated last week
- A platform to self-host AI on easy mode☆173Updated this week
- A unified search engine for all your online knowledge → The Invisible Companion for Work + Life☆135Updated 2 months ago
- LLM plugin for models hosted by OpenRouter☆278Updated last month
- ☆190Updated 7 months ago
- 100% Local Memory layer and Knowledge base for agents with WebUI☆535Updated 3 months ago
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆254Updated 3 weeks ago