RayFernando1337 / LLM-CalcLinks
Instantly calculate the maximum size of quantized language models that can fit in your available RAM, helping you optimize your models for inference.
☆243Updated 7 months ago
Alternatives and similar repositories for LLM-Calc
Users that are interested in LLM-Calc are comparing it to the libraries listed below
Sorting:
- Examples on how to use various LLM providers with a Wine Classification problem☆131Updated last month
- Qwen 2.5 Coder 1.5B with Code Interpreter☆289Updated last year
- A powerful Python tool for performing technical searches using the Perplexity API, optimized for retrieving precise facts, code examples,…☆209Updated 10 months ago
- FastMLX is a high performance production ready API to host MLX models.☆332Updated 8 months ago
- Local Groq Desktop chat app with MCP support☆372Updated last week
- Hallucination Detector is a free and open-source tool that helps you verify the accuracy of your LLM generated content instantly.☆297Updated 2 weeks ago
- The Open Deep Research app – generate reports with OSS LLMs☆308Updated last week
- Provider-agnostic, open-source evaluation infrastructure for language models☆661Updated last week
- ☆241Updated this week
- ☆113Updated 4 months ago
- ☆188Updated last year
- ☆137Updated 9 months ago
- A simple Python program to implement the search-extract-summarize flow.☆275Updated 5 months ago
- 📋 NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)☆324Updated 8 months ago
- Together Open Deep Research☆352Updated 7 months ago
- ☆78Updated 11 months ago
- ☆319Updated 11 months ago
- ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)☆115Updated last week
- Make any LLM to think like OpenAI o1 and deepseek R1☆492Updated 9 months ago
- You don’t need to read the code to understand how to build!☆233Updated this week
- An automated machine learning system that leverages O1 and Claude to iteratively develop, improve, and optimize ML solutions.☆89Updated 10 months ago
- An MCP Server that's also an MCP Client. Useful for letting Claude develop and test MCPs without needing to reset the application.☆123Updated 8 months ago
- ✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)☆472Updated 2 months ago
- ☆93Updated 10 months ago
- Optimize Document Retrieval with Fine-Tuned KnowledgeBases☆167Updated 3 weeks ago
- The easiest way to run the fastest MLX-based LLMs locally☆306Updated last year
- A fork of OpenAI Swarm that supports Groq and Anthropic☆124Updated 9 months ago
- RAT is a powerful tool that improves AI responses by leveraging DeepSeek's reasoning capabilities to guide other models through a structu…☆656Updated 10 months ago
- Convert PowerPoint files into semantically rich text using vision language models☆107Updated 2 weeks ago
- Voice-Enabled Math Tutor Powered by Groq that Calculates and Renders Live Problems and Instruction with LaTeX in Seconds!☆236Updated 11 months ago