alexziskind1 / llm-inference-calculatorLinks
☆139Updated 2 months ago
Alternatives and similar repositories for llm-inference-calculator
Users that are interested in llm-inference-calculator are comparing it to the libraries listed below
Sorting:
- Instantly calculate the maximum size of quantized language models that can fit in your available RAM, helping you optimize your models fo…☆243Updated 7 months ago
- Welcome!☆140Updated 11 months ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆257Updated 9 months ago
- Link you Ollama models to LM-Studio☆145Updated last year
- You don’t need to read the code to understand how to build!☆233Updated this week
- Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMs☆314Updated 3 months ago
- ☆195Updated 2 months ago
- A lightweight UI for chatting with Ollama models. Streaming responses, conversation history, and multi-model support.☆142Updated 8 months ago
- LM Studio Python SDK☆705Updated last month
- MLX-GUI MLX Inference Server for Apple Silicone☆149Updated 3 months ago
- Nginx proxy server in a Docker container to Authenticate & Proxy requests to Ollama from Public Internet via Cloudflare Tunnel☆151Updated 2 months ago
- Agent MCP for ffmpeg☆210Updated 5 months ago
- TermNet is an AI-powered terminal assistant that bridges a Large Language Model (LLM) with your local environment. It can safely run shel…☆91Updated 2 months ago
- beep boop 🤖 (experimental)☆117Updated 10 months ago
- Easily access your Ollama models within LMStudio☆124Updated last year
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, and more with your permission every ste…☆81Updated last year
- Your gateway to both Ollama & Apple MlX models☆149Updated 8 months ago
- A cross patform app that unlocks your devices Gen AI capabilities☆66Updated 2 months ago
- CoexistAI is a modular, developer-friendly research assistant framework . It enables you to build, search, summarize, and automate resear…☆369Updated last month
- Official python implementation of UTCP. UTCP is an open standard that lets AI agents call any API directly, without extra middleware.☆612Updated last week
- ✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)☆472Updated 2 months ago
- A platform to self-host AI on easy mode☆178Updated last week
- An Open Source, Claude Code Like Tool, With RAG + Graph RAG + MCP Integration, and Supports Most LLMs (Incomplete But Functional & Usable…☆121Updated 4 months ago
- ☆70Updated 3 months ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆269Updated 8 months ago
- 100% Local Memory layer and Knowledge base for agents with WebUI☆608Updated 4 months ago
- LM Studio JSON configuration file format and a collection of example config files.☆206Updated last year
- Build an AI Agent from Libraries of Functions -- My most advanced agent framework☆137Updated 5 months ago
- Local coding agent with neat UI☆329Updated 6 months ago
- AI Studio is an independent app for utilizing LLMs.☆340Updated this week