MooreThreads / TurboRAG

Related projects ⓘ

Alternatives and complementary repositories for TurboRAG

• codefuse-ai / D2LLM
  ☆22Updated 4 months ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆74Updated 10 months ago
• Infini-AI-Lab / MagicDec
  Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆79Updated last week
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆77Updated last month
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆94Updated last month
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆42Updated 6 months ago
• declare-lab / trust-align
  Codes and datasets for the paper Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Ref…
  ☆23Updated last month
• AIR-Bench / AIR-Bench
  AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆106Updated last month
• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆69Updated 2 weeks ago
• bentoml / llm-bench
  ☆36Updated this week
• gomate-community / rageval
  Evaluation tools for Retrieval-augmented Generation (RAG) methods.
  ☆136Updated this week
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆78Updated 3 months ago
• ModelCloud / GPTQModel
  Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.
  ☆128Updated this week
• OSU-NLP-Group / TableLlama
  [NAACL'24] Dataset, code and models for "TableLlama: Towards Open Large Generalist Models for Tables".
  ☆116Updated 6 months ago
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆74Updated last month
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆139Updated this week
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆29Updated 6 months ago
• GAIR-NLP / ProX
  Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
  ☆193Updated last month
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆57Updated 2 months ago
• DunZhang / Stella
  ☆43Updated 4 months ago
• QwenLM / AutoIF
  ☆222Updated 4 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆130Updated this week
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆168Updated 2 weeks ago
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆46Updated last month
• apple / ToolSandbox
  ☆130Updated 3 months ago
• deepseek-ai / ESFT
  Expert Specialized Fine-Tuning
  ☆148Updated 2 months ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆135Updated 5 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆105Updated 5 months ago
• HKUNLP / ChunkLlama
  [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"
  ☆360Updated last month
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆59Updated 3 months ago