Alternatives and similar repositories for RETRO-transformer

Users that are interested in RETRO-transformer are comparing it to the libraries listed below

• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆81Updated 2 years ago
• ielab / PromptReps
  Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval
  ☆51Updated last week
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆82Updated 3 years ago
• nyu-mll / quality
  ☆145Updated last year
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆49Updated last year
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆136Updated last year
• AI21Labs / Parallel-Context-Windows
  ☆105Updated 2 years ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆204Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆142Updated last year
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆324Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆132Updated last year
• OSU-NLP-Group / In-Context-Reranking
  [ICLR'25] "Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankers"
  ☆40Updated 9 months ago
• TobiasNorlund / retro
  Official repo to On the Generalization Ability of Retrieval-Enhanced Transformers
  ☆46Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆222Updated last month
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆23Updated last year
• awslabs / rag-qa-arena
  ☆51Updated last year
• kamalkraj / e5-mistral-7b-instruct
  Finetune mistral-7b-instruct for sentence embeddings
  ☆88Updated last year
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆157Updated 9 months ago
• voidism / EAR
  Code for the ACL 2023 long paper - Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering
  ☆37Updated 2 years ago
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆126Updated last year
• AlexTMallen / adaptive-retrieval
  ☆188Updated 6 months ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆190Updated 6 months ago
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆197Updated last month
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆165Updated 2 years ago
• hemingkx / SpecDec
  Codes for our paper "Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation" (EMNLP 2023 Findings)
  ☆46Updated 2 years ago
• DRSY / EasyKV
  Easy control for Key-Value Constrained Generative LLM Inference(https://arxiv.org/abs/2402.06262)
  ☆63Updated last year
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆145Updated last year
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆236Updated 4 months ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆105Updated 2 years ago
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆223Updated 7 months ago