alexziskind1 / llm-inference-calculatorLinks
☆148Updated 4 months ago
Alternatives and similar repositories for llm-inference-calculator
Users that are interested in llm-inference-calculator are comparing it to the libraries listed below
Sorting:
- Instantly calculate the maximum size of quantized language models that can fit in your available RAM, helping you optimize your models fo…☆249Updated 9 months ago
- A cross platform App that gives you the best UX to run models locally or remotely on your own hardware☆72Updated last month
- Link you Ollama models to LM-Studio☆150Updated last year
- Explore the unknown, build the future, own your data.☆234Updated this week
- A lightweight UI for chatting with Ollama models. Streaming responses, conversation history, and multi-model support.☆148Updated 10 months ago
- beep boop 🤖 (experimental)☆118Updated last year
- You don’t need to read the code to understand how to build!☆254Updated 2 weeks ago
- This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support☆226Updated 5 months ago
- Your gateway to both Ollama & Apple MlX models☆149Updated 10 months ago
- Agent MCP for ffmpeg☆214Updated 7 months ago
- This project was generated 100% by AI, with one prompt. NOTE: This neuroca project was generated in 3 hours on 3/3/2025. There are depend…☆48Updated 9 months ago
- Easily access your Ollama models within LMStudio☆130Updated last year
- reddacted lets you analyze & sanitize your online footprint using LLMs, PII detection & sentiment analysis to identify anything that migh…☆116Updated 6 months ago
- ☆200Updated 10 months ago
- GitNexus: The Zero-Server Code Intelligence Engine - GitNexus is a client-side knowledge graph creator that runs entirely in your b…☆362Updated this week
- API Server for Transformer Lab☆82Updated 2 months ago
- AIVA (AI Virtual Assistant) Mock Interviews is an interactive platform that simulates real interview scenarios using AI-generated questio…☆69Updated 3 months ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆262Updated 11 months ago
- the composable multi-agent shell☆199Updated this week
- A persistent local memory for AI, LLMs, or Copilot in VS Code.☆187Updated 3 months ago
- MLX-GUI MLX Inference Server for Apple Silicone☆176Updated 2 weeks ago
- ✨ A extension can help you open git ingest to turn any git repository into a prompt-friendly text ingest for LLMs.☆200Updated 5 months ago
- Ollama desktop client for everyday use☆89Updated 8 months ago
- Fast local speech-to-text for any app using faster-whisper☆146Updated 4 months ago
- CoexistAI is a modular, developer-friendly research assistant framework . It enables you to build, search, summarize, and automate resear…☆418Updated 3 months ago
- ☆205Updated 4 months ago
- This project benchmarks 41 open-source large language models across 19 evaluation tasks using the lm-evaluation-harness library.☆89Updated 4 months ago
- Welcome!☆141Updated last year
- AI Studio is an independent app for utilizing LLMs.☆379Updated last week
- ICLR 2026☆150Updated this week