Alternatives and similar repositories for nanoBackpackLM

Users that are interested in nanoBackpackLM are comparing it to the libraries listed below

• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆67Updated last year
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆30Updated last year
• nyu-mll / SQuALITY
  Query-focused summarization data
  ☆41Updated 2 years ago
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆48Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆21Updated 8 months ago
• princeton-nlp / ShortcutGrammar
  EMNLP 2022: Finding Dataset Shortcuts with Grammar Induction https://arxiv.org/abs/2210.11560
  ☆58Updated 2 months ago
• ndaheim / faithful-dialogue
  ☆24Updated 2 years ago
• allenai / Lila
  A unified benchmark for math reasoning
  ☆88Updated 2 years ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆78Updated last year
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆56Updated 2 years ago
• swj0419 / in-context-pretraining
  ☆50Updated last year
• yxuansu / Contrastive_Search_versus_Contrastive_Decoding
  An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation
  ☆27Updated 11 months ago
• allenai / bff
  ☆38Updated last year
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• mattf1n / basis-aware-threshold
  Code for the paper "Closing the Curious Case of Neural Text Degeneration"
  ☆10Updated last month
• uclnlp / EMAT
  Efficient Memory-Augmented Transformers
  ☆34Updated 2 years ago
• AlexWan0 / infini-gram
  An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)
  ☆32Updated 10 months ago
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆25Updated 8 months ago
• yxuansu / Contrastive_Search_Is_What_You_Need
  [TMLR'23] Contrastive Search Is What You Need For Neural Text Generation
  ☆119Updated 2 years ago
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆59Updated 3 months ago
• RUCAIBox / ELMER
  This repository is the official implementation of our EMNLP 2022 paper ELMER: A Non-Autoregressive Pre-trained Language Model for Efficie…
  ☆26Updated 2 years ago
• ghrua / NgramRes
  ☆21Updated 2 years ago
• Rojak-NLP / LLM-Code-Mixing
  Can LLMs generate code-mixed sentences through zero-shot prompting?
  ☆11Updated 2 years ago
• shayne-longpre / a-pretrainers-guide
  ☆72Updated last year
• google-deepmind / streamingqa
  ☆46Updated last year
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆18Updated 2 years ago
• lyutyuh / structured-span-selector
  A Structured Span Selector (NAACL 2022). A structured span selector with a WCFG for span selection tasks (coreference resolution, semanti…
  ☆21Updated 2 years ago
• ghomasHudson / muld
  The Multitask Long Document Benchmark
  ☆38Updated 2 years ago
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated 2 years ago