Alternatives and similar repositories for TurboRAG:

Users that are interested in TurboRAG are comparing it to the libraries listed below

• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆91Updated 5 months ago
• hao-ai-lab / Dynasor
  Simple extension on vLLM to help you speed up reasoning model without training.
  ☆146Updated last month
• IAAR-Shanghai / PGRAG
  PGRAG
  ☆48Updated 9 months ago
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆101Updated 3 weeks ago
• Bui1dMySea / MemLong
  ☆94Updated 4 months ago
• codefuse-ai / D2LLM
  ☆30Updated 8 months ago
• SqueezeAILab / LLM2LLM
  [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
  ☆181Updated last year
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆82Updated last month
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆113Updated 4 months ago
• FasterDecoding / REST
  REST: Retrieval-Based Speculative Decoding, NAACL 2024
  ☆199Updated 4 months ago
• thu-coai / SPaR
  ☆47Updated 4 months ago
• RUCAIBox / EASYEP
  ☆14Updated this week
• 18907305772 / FuseAI
  FuseAI Project
  ☆85Updated 2 months ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆131Updated 10 months ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆47Updated 5 months ago
• jshuadvd / LongRoPE
  Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
  ☆130Updated 8 months ago
• gomate-community / rageval
  Evaluation tools for Retrieval-augmented Generation (RAG) methods.
  ☆150Updated 4 months ago
• GAIR-NLP / ProX
  Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
  ☆236Updated 2 months ago
• myeon9h / PlanRAG
  Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24
  ☆139Updated 10 months ago
• thunlp / LLMxMapReduce
  ☆197Updated this week
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆36Updated 2 months ago
• Zoeyyao27 / SirLLM
  This repository contains the code for the paper: SirLLM: Streaming Infinite Retentive LLM
  ☆57Updated 10 months ago
• QingFei1 / LongRAG
  [EMNLP 2024] LongRAG: A Dual-perspective Retrieval-Augmented Generation Paradigm for Long-Context Question Answering
  ☆102Updated 2 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆126Updated 2 months ago
• RUC-GSAI / YuLan-Mini
  A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
  ☆170Updated this week
• yale-nlp / MCTS-RAG
  ☆30Updated last month
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆158Updated this week
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆342Updated 2 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆76Updated last month
• cxcscmu / RAGViz
  Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]
  ☆82Updated 2 months ago