RayFernando1337 / LLM-CalcLinks
Instantly calculate the maximum size of quantized language models that can fit in your available RAM, helping you optimize your models for inference.
☆242Updated 6 months ago
Alternatives and similar repositories for LLM-Calc
Users that are interested in LLM-Calc are comparing it to the libraries listed below
Sorting:
- Qwen 2.5 Coder 1.5B with Code Interpreter☆289Updated last year
- Provider-agnostic, open-source evaluation infrastructure for language models☆641Updated last week
- A simple Python program to implement the search-extract-summarize flow.☆273Updated 4 months ago
- FastMLX is a high performance production ready API to host MLX models.☆332Updated 7 months ago
- API Server for Transformer Lab☆78Updated this week
- ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)☆111Updated this week
- Pipecat voice AI agents running locally on macOS☆291Updated 2 months ago
- The Open Deep Research app – generate reports with OSS LLMs☆303Updated this week
- Examples on how to use various LLM providers with a Wine Classification problem☆132Updated 3 weeks ago
- MLX-GUI MLX Inference Server for Apple Silicone☆132Updated 2 months ago
- ☆78Updated 10 months ago
- ☆188Updated 11 months ago
- Hallucination Detector is a free and open-source tool that helps you verify the accuracy of your LLM generated content instantly.☆291Updated 5 months ago
- ☆134Updated last month
- 📋 NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)☆322Updated 8 months ago
- Letting Claude Code develop his own MCP tools :)☆123Updated 8 months ago
- Together Open Deep Research☆353Updated 6 months ago
- the simplest self-building general autonomous agent☆325Updated last year
- ☆240Updated this week
- You don’t need to read the code to understand how to build!☆221Updated 9 months ago
- Train Large Language Models on MLX.☆205Updated last month
- A powerful Python tool for performing technical searches using the Perplexity API, optimized for retrieving precise facts, code examples,…☆210Updated 9 months ago
- beep boop 🤖 (experimental)☆115Updated 10 months ago
- ☆317Updated 10 months ago
- ☆137Updated 9 months ago
- Your gateway to both Ollama & Apple MlX models☆148Updated 8 months ago
- Optimize Document Retrieval with Fine-Tuned KnowledgeBases☆165Updated 8 months ago
- For LLMs to better code with Jina API☆171Updated 2 months ago
- Dabarqus is incredibly fast RAG that runs everywhere.☆60Updated 9 months ago
- Local Groq Desktop chat app with MCP support☆364Updated last week