alexziskind1 / llm-inference-calculator
☆91Updated this week
Alternatives and similar repositories for llm-inference-calculator:
Users that are interested in llm-inference-calculator are comparing it to the libraries listed below
- A lightweight UI for chatting with Ollama models. Streaming responses, conversation history, and multi-model support.☆107Updated last month
- beep boop 🤖 (experimental)☆102Updated 3 months ago
- Welcome!☆140Updated 4 months ago
- RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…☆73Updated 4 months ago
- Fast local speech-to-text for any app using faster-whisper☆63Updated 3 weeks ago
- A Discord bot for large language models. Add Gemini 2.5 Pro, Claude Sonnet 3.7, GPT 4.1, and other models. Easily change models, edit pro…☆81Updated last week
- WIP: Open WebUI Chrome Extension (Requires Open WebUI v0.2.0+)☆120Updated 11 months ago
- reddacted lets you analyze & clean up your online footprint surgically by using LLMs, PII & sentiment analysis to identify that might be …☆57Updated 3 weeks ago
- ☆67Updated last month
- Link you Ollama models to LM-Studio☆136Updated 9 months ago
- Ollama app for macos☆86Updated 7 months ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆166Updated last month
- ☆93Updated this week
- Local LLM inference speed tests on various devices☆65Updated last month
- Easily access your Ollama models within LMStudio☆105Updated 11 months ago
- API Server for Transformer Lab☆52Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆96Updated last month
- Your gateway to both Ollama & Apple MlX models☆124Updated last month
- “A locally hosted, memory-aware AI microservice—designed for cultural continuity, decentralized intelligence, and ethical autonomy.”☆23Updated this week
- Instantly calculate the maximum size of quantized language models that can fit in your available RAM, helping you optimize your models fo…☆218Updated last week
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆250Updated 2 months ago
- This project was generated 100% by AI, with one prompt. NOTE: This neuroca project was generated in 3 hours on 3/3/2025. There are depend…☆48Updated 3 weeks ago
- ☆169Updated last week
- A Python-based tool that generates engaging podcast conversations using Google's Gemini 2.0 Flash Experimental model for script generatio…☆107Updated 3 months ago
- ☆176Updated 3 weeks ago
- Apple MLX engine for LM Studio☆524Updated this week
- Testing the different LLM and RAG Tests while I learn along the way☆118Updated 2 weeks ago
- This provide A Zero-Server Web Interface for use with Ollama local LLM's and provides AI search via Perplexity (API Key required) and ima…☆33Updated last month
- A comprehensive platform for managing, testing, and leveraging Ollama AI models with advanced features for customization, workflow automa…☆47Updated last month
- Capture, tag, and search images locally with OSS models.☆40Updated 3 months ago