Lightning-AI / LitServe
Lightning-fast serving engine for AI models. Flexible. Easy. Enterprise-scale.
☆2,055Updated this week
Related projects: ⓘ
- RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry☆3,155Updated this week
- Run PyTorch LLMs locally on servers, desktop and mobile☆3,100Updated this week
- ☆2,652Updated this week
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆2,739Updated last week
- The easiest way to use Agentic RAG in any enterprise☆3,132Updated this week
- A Native-PyTorch Library for LLM Fine-tuning☆3,942Updated this week
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆2,817Updated 2 weeks ago
- ☆1,161Updated 3 weeks ago
- Parse files for optimal RAG☆2,450Updated this week
- High-quality datasets, tools, and concepts for LLM fine-tuning.☆1,664Updated last month
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!☆2,884Updated last month
- ☆1,705Updated this week
- Llama-3 agents that can browse the web by following instructions and talking to you☆1,317Updated 2 months ago
- One-click deploy of a Knowledge Graph powered RAG (GraphRAG) in Azure☆1,655Updated this week
- 🦜⛏️ Did you say you like data?☆1,018Updated 2 months ago
- Neo4j graph construction from unstructured data using LLMs☆2,072Updated this week
- AdalFlow: The “PyTorch” library to auto-optimize any LLM tasks.☆1,294Updated this week
- Desktop app for prototyping and debugging LangGraph applications locally.☆1,464Updated last week
- 🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide…☆994Updated this week
- PraisonAI application combines AutoGen and CrewAI or similar frameworks into a low-code solution for building and managing multi-agent LL…☆2,112Updated 2 weeks ago
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆6,008Updated this week
- Training LLMs with QLoRA + FSDP☆1,382Updated last week
- No-code LLM Platform to launch APIs and ETL Pipelines to structure unstructured documents☆957Updated this week
- Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models☆2,531Updated last month
- Fast, Accurate, Lightweight Python library to make State of the Art Embedding☆1,371Updated this week
- HippoRAG is a novel RAG framework inspired by human long-term memory that enables LLMs to continuously integrate knowledge across externa…☆1,237Updated last month
- 🔥🕷️ Crawl4AI: Open-source LLM Friendly Web Crawler & Scrapper☆2,763Updated last week
- VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and…☆1,786Updated last week
- Blazingly fast LLM inference.☆3,406Updated this week
- tiny vision language model☆4,893Updated 3 weeks ago