MooreThreads / TurboRAG

Related projects ⓘ

Alternatives and complementary repositories for TurboRAG

• Infini-AI-Lab / MagicDec
  Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆70Updated last week
• codefuse-ai / D2LLM
  ☆22Updated 3 months ago
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆73Updated 3 weeks ago
• declare-lab / trust-align
  Codes and datasets for the paper Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Ref…
  ☆23Updated last month
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆76Updated last month
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆77Updated 3 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆58Updated this week
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆42Updated 6 months ago
• AIR-Bench / AIR-Bench
  AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆105Updated 3 weeks ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆73Updated 9 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆29Updated 6 months ago
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆137Updated this week
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆110Updated 4 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆82Updated last week
• DunZhang / Stella
  ☆43Updated 3 months ago
• SalesforceAIResearch / SFR-RAG
  ☆64Updated last month
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆94Updated last month
• gomate-community / rageval
  Evaluation tools for Retrieval-augmented Generation (RAG) methods.
  ☆127Updated 3 weeks ago
• imagination-research / sot
  [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  ☆144Updated 8 months ago
• jshuadvd / LongRoPE
  Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
  ☆124Updated 3 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆128Updated this week
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆114Updated this week
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆72Updated last month
• weaviate / structured-rag
  Experimental Code for StructuredRAG: Structured Outputs in Retrieval-Augmented Generation
  ☆93Updated this week
• patronus-ai / Lynx-hallucination-detection
  ☆29Updated 4 months ago
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆86Updated 3 months ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆34Updated 8 months ago
• otriscon / llm-structured-output
  ☆62Updated last week
• pygongnlp / CoSearchAgent
  [SIGIR 2024 (Demo)] CoSearchAgent: A Lightweight Collborative Search Agent with Large Language Models
  ☆22Updated 8 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆55Updated 2 months ago