Alternatives and similar repositories for nanoBackpackLM

Users that are interested in nanoBackpackLM are comparing it to the libraries listed below

• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆69Updated 2 years ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated 2 years ago
• allenai / staged-training
  Staged Training for Transformer Language Models
  ☆32Updated 3 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆58Updated 2 years ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated 11 months ago
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆59Updated 6 months ago
• princeton-nlp / ShortcutGrammar
  EMNLP 2022: Finding Dataset Shortcuts with Grammar Induction https://arxiv.org/abs/2210.11560
  ☆58Updated 5 months ago
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 11 months ago
• ndaheim / faithful-dialogue
  ☆24Updated 2 years ago
• alisawuffles / wanli
  code associated with WANLI dataset in Liu et al., 2022
  ☆30Updated 2 years ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• nyu-mll / SQuALITY
  Query-focused summarization data
  ☆42Updated 2 years ago
• Tiiiger / templm
  Code release for "TempLM: Distilling Language Models into Template-Based Generators"
  ☆14Updated 3 years ago
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆81Updated last year
• kaistAI / InstructIR
  IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…
  ☆32Updated last year
• yxuansu / Contrastive_Search_versus_Contrastive_Decoding
  An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation
  ☆27Updated last year
• allenai / Lila
  A unified benchmark for math reasoning
  ☆88Updated 2 years ago
• MikeWangWZHL / Zemi
  Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findings
  ☆16Updated 2 years ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆94Updated 2 years ago
• google-deepmind / streamingqa
  ☆48Updated last year
• joeljang / ELM
  [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning
  ☆99Updated 2 years ago
• facebookresearch / mbr-exec
  code for "Natural Language to Code Translation with Execution"
  ☆41Updated 2 years ago
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆18Updated 2 years ago
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆33Updated last year
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆70Updated last year
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆107Updated last year
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆136Updated last year
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago