alexziskind1 / llm-inference-calculatorLinks
☆127Updated 2 weeks ago
Alternatives and similar repositories for llm-inference-calculator
Users that are interested in llm-inference-calculator are comparing it to the libraries listed below
Sorting:
- Instantly calculate the maximum size of quantized language models that can fit in your available RAM, helping you optimize your models fo…☆242Updated 6 months ago
- A cross patform app that unlocks your devices Gen AI capabilities☆64Updated last month
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆257Updated 7 months ago
- Welcome!☆140Updated 10 months ago
- Official python implementation of UTCP. UTCP is an open standard that lets AI agents call any API directly, without extra middleware.☆582Updated last week
- A lightweight UI for chatting with Ollama models. Streaming responses, conversation history, and multi-model support.☆122Updated 7 months ago
- the IDE for research, built from the ground up with AI integrations☆136Updated last week
- This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support☆224Updated 2 months ago
- Link you Ollama models to LM-Studio☆145Updated last year
- Agent MCP for ffmpeg☆206Updated 4 months ago
- MLX-GUI MLX Inference Server for Apple Silicone☆125Updated 2 months ago
- Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMs☆306Updated 2 months ago
- Local AI voice assistant stack for Home Assistant (GPU-accelerated) with persistent memory, follow-up conversation, and Ollama model reco…☆212Updated 2 months ago
- CoexistAI is a modular, developer-friendly research assistant framework . It enables you to build, search, summarize, and automate resear…☆314Updated last week
- ☆92Updated 3 months ago
- Local coding agent with neat UI☆318Updated 5 months ago
- You don’t need to read the code to understand how to build!☆215Updated 9 months ago
- ☆179Updated last month
- API Server for Transformer Lab☆79Updated last week
- Finally, an open source Youtube Summarizer extension☆79Updated 5 months ago
- Easily access your Ollama models within LMStudio☆121Updated last year
- beep boop 🤖 (experimental)☆114Updated 9 months ago
- Open Source Local Data Analysis Assistant.☆41Updated 2 weeks ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆262Updated 7 months ago
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆254Updated 8 months ago
- This project was generated 100% by AI, with one prompt. NOTE: This neuroca project was generated in 3 hours on 3/3/2025. There are depend…☆46Updated 6 months ago
- This project benchmarks 41 open-source large language models across 19 evaluation tasks using the lm-evaluation-harness library.☆76Updated last month
- Nginx proxy server in a Docker container to Authenticate & Proxy requests to Ollama from Public Internet via Cloudflare Tunnel☆142Updated last month
- All-in-one MCP server that can connect your AI agents to any native endpoint, powered by UTCP☆144Updated last month
- GitNexus is a client-side knowledge graph creator that runs entirely in your browser. Drop in a GitHub repo or ZIP file, and get an inter…☆105Updated 2 weeks ago