☆2,328Nov 29, 2025Updated 3 months ago
Alternatives and similar repositories for ollm
Users that are interested in ollm are comparing it to the libraries listed below
Sorting:
- The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU cluste…☆4,815Updated this week
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.☆53,029Updated this week
- The conversational control layer for customer-facing AI agents - Parlant is a context-engineering framework optimized for controlling cus…☆17,799Updated this week
- Official inference framework for 1-bit LLMs☆28,697Feb 3, 2026Updated last month
- Build Real-Time Knowledge Graphs for AI Agents☆23,192Feb 28, 2026Updated last week
- A system for agentic LLM-powered data processing and ETL☆3,669Feb 2, 2026Updated last month
- Supercharge Your LLM with the Fastest KV Cache Layer☆7,272Updated this week
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆37,994Updated this week
- Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations,…☆17,889Feb 27, 2026Updated last week
- Open-source context retrieval layer for AI agents☆5,901Updated this week
- The fullstack MCP framework to develop MCP Apps for ChatGPT / Claude & MCP Servers for AI Agents.☆9,377Updated this week
- Universal memory layer for AI Agents☆48,604Updated this week
- ☆2,137Mar 17, 2025Updated 11 months ago
- AirLLM 70B inference with single 4GB GPU☆12,954Sep 3, 2025Updated 6 months ago
- Python package and backend for the Elysia platform app.☆1,882Feb 6, 2026Updated last month
- "AutoAgent: Fully-Automated and Zero-Code LLM Agent Framework"☆8,616Oct 16, 2025Updated 4 months ago
- Expose your FastAPI endpoints as Model Context Protocol (MCP) tools, with Auth!☆11,600Nov 24, 2025Updated 3 months ago
- Get your documents ready for gen AI☆54,754Updated this week
- Run frontier AI locally.☆41,955Updated this week
- GenAI Agent Framework, the Pydantic way☆15,256Updated this week
- Knowledge Engine for AI Agent Memory in 6 lines of code☆12,885Updated this week
- Paper2Agent is a multi-agent AI system that automatically transforms research papers into interactive AI agents with minimal human input.☆2,011Feb 10, 2026Updated 3 weeks ago
- A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.☆3,803Feb 25, 2026Updated last week
- The official repo for “Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting”, ACL, 2025.☆8,852Dec 17, 2025Updated 2 months ago
- [MLsys2026]: RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on …☆10,252Updated this week
- "DeepCode: Open Agentic Coding (Paper2Code & Text2Web & Text2Backend)"☆14,758Updated this week
- Toolkit for linearizing PDFs for LLM datasets/training☆16,947Feb 19, 2026Updated 2 weeks ago
- "RAG-Anything: All-in-One RAG Framework"☆13,867Feb 27, 2026Updated last week
- SGLang is a high-performance serving framework for large language models and multimodal models.☆23,905Updated this week
- Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement…☆8,695Feb 28, 2026Updated last week
- Communicate with an LLM provider using a single interface☆1,708Updated this week
- Build, run, manage agentic software at scale.☆38,276Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆71,883Updated this week
- Generate High-Quality Synthetics, Train, Measure, and Evaluate in a Single Pipeline☆839Updated this week
- 🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines☆3,809Updated this week
- 🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN☆61,332Updated this week
- Fast State-of-the-Art Static Embeddings☆2,007Feb 28, 2026Updated last week
- File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.☆7,342Feb 21, 2025Updated last year
- 📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG☆20,626Updated this week