Alternatives and similar repositories for TurboRAG:

Users that are interested in TurboRAG are comparing it to the libraries listed below

• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆87Updated 3 months ago
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆107Updated 2 months ago
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆84Updated 4 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆68Updated this week
• IAAR-Shanghai / PGRAG
  PGRAG
  ☆47Updated 7 months ago
• jshuadvd / LongRoPE
  Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
  ☆125Updated 7 months ago
• bentoml / llm-bench
  ☆45Updated 3 months ago
• codefuse-ai / D2LLM
  ☆30Updated 6 months ago
• icip-cas / StructRAG
  StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurization
  ☆105Updated last month
• thunlp / LLMxMapReduce
  ☆168Updated 2 months ago
• cxcscmu / RAGViz
  Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]
  ☆77Updated last month
• GAIR-NLP / ProX
  Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
  ☆217Updated this week
• OpenBMB / RAGEval
  ☆125Updated 3 weeks ago
• thu-coai / SPaR
  ☆42Updated 2 months ago
• YaoJiayi / CacheBlend
  ☆77Updated last month
• RUC-GSAI / YuLan-Mini
  A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
  ☆152Updated this week
• thunlp / InfLLM
  The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Mem…
  ☆326Updated 10 months ago
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆304Updated last week
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆91Updated 3 weeks ago
• QwenLM / AutoIF
  ☆258Updated 6 months ago
• gomate-community / rageval
  Evaluation tools for Retrieval-augmented Generation (RAG) methods.
  ☆147Updated 3 months ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆29Updated 2 weeks ago
• Yangjiaxi / Sense
  [ACL24] Official repo for "Synthesizing Text-to-SQL Data from Weak and Strong LLMs"
  ☆64Updated 6 months ago
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆58Updated 5 months ago
• SkyworkAI / skywork-o1-prm-inference
  ☆57Updated 2 months ago
• GenseeAI / cognify
  The Multi-Faceted Optimizer for GenAI Workflows
  ☆186Updated this week
• IAAR-Shanghai / Meta-Chunking
  Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception
  ☆114Updated 3 weeks ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆35Updated 3 months ago
• FasterDecoding / SnapKV
  ☆220Updated 9 months ago