0xSojalSec / gpu_poorLinks
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
☆12Updated 11 months ago
Alternatives and similar repositories for gpu_poor
Users that are interested in gpu_poor are comparing it to the libraries listed below
Sorting:
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆47Updated 2 months ago
- Build AI applications that can see, hear, and speak using your screens, microphones, and cameras as inputs.☆20Updated 3 months ago
- xpander.ai is the runtime and control plane to build, run, and ship reliable AI agents fast and anywhere☆772Updated 2 weeks ago
- Open Source AI Platform - AI Chat with advanced features that works with every LLM☆197Updated this week
- RAGLight is a modular framework for Retrieval-Augmented Generation (RAG). It makes it easy to plug in different LLMs, embeddings, and vec…☆608Updated 3 weeks ago
- Anemoi: A Semi-Centralized Multi-agent Systems Based on Agent-to-Agent Communication MCP server from Coral Protocol☆369Updated 3 months ago
- A powerful tool for creating fine-tuning datasets for LLM☆46Updated 3 months ago
- Tensorlake is a Document Ingestion API and a serverless platform for building data processing and orchestration APIs☆775Updated this week
- RunAgent simplifies serverless deployment of your AI agents. With a powerful CLI, multi-language SDK support, built-in agent invocation &…☆383Updated this week
- Generative AI Usecases☆77Updated 7 months ago
- ☆333Updated this week
- Model-agnostic plug-n-play LangChain/LangGraph agents powered entirely by MCP tools over HTTP/SSE.☆745Updated last month
- The Operating System for AGI Work.☆59Updated 3 weeks ago
- ☆695Updated 2 months ago
- ☆427Updated last month
- Gemini-cli or claude code? Why not both? LangCode combines all CLI capabilities and models in one place ☂️!☆417Updated last week
- AirLLM 70B inference with single 4GB GPU☆62Updated 2 months ago
- Add long-term memory to any AI in minutes. Self-hosted, open, and framework-free.☆2,094Updated last week
- A managed RAG API server.☆331Updated 6 months ago
- ☆210Updated 3 months ago
- SDK for processing PDF files with doctly.ai☆91Updated last month
- ☆451Updated last week
- META‑AGENTIC α‑AGI 👁️✨ — Mission 🎯 End‑to‑end: Identify 🔍 → Out‑Learn 📚 → Out‑Think 🧠 → Out‑Design 🎨 → Out‑Strategise ♟️ → Out‑Exe…☆265Updated this week
- ☆168Updated 7 months ago
- Agentic RAG, Multi-Agent Systems, and Vision Reasoning are three pipelines to find the perfect LLM☆123Updated 3 months ago
- Interactive command-line chat application powered by Langchain, Langgraph, Prompt Toolkit and Rich☆131Updated last week
- Python package and backend for the Elysia platform app.☆1,814Updated last week
- Build AI applications that can see, hear, and speak using your screens, microphones, and cameras as inputs.☆1,037Updated this week
- Frontend Repository for Elysia☆161Updated last week
- 🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by Scra…☆560Updated last month