bigscience-workshop / architecture-objective

Related projects ⓘ

Alternatives and complementary repositories for architecture-objective

• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• facebookresearch / UNLU
  Code for the paper "UnNatural Language Inference" to appear at ACL 2021 (Long Paper)
  ☆36Updated 3 years ago
• martiansideofthemoon / rankgen
  Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…
  ☆136Updated last year
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated last year
• fuzihaofzh / repetition-problem-nlg
  Code for the paper "A Theoretical Analysis of the Repetition Problem in Text Generation" in AAAI 2021.
  ☆51Updated 2 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆56Updated last year
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆73Updated last year
• shayne-longpre / a-pretrainers-guide
  ☆73Updated last year
• jxhe / efficient-knnlm
  Pytorch implementation of paper "Efficient Nearest Neighbor Language Models" (EMNLP 2021)
  ☆71Updated 2 years ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated 10 months ago
• HanGuo97 / soft-Q-learning-for-text-generation
  ☆66Updated 2 years ago
• EleutherAI / pile_dedupe
  Pile Deduplication Code
  ☆15Updated last year
• allenai / data-efficient-finetuning
  Code for paper 'Data-Efficient FineTuning'
  ☆29Updated last year
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆69Updated last year
• machelreid / m2d2
  M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
  ☆55Updated 2 years ago
• nayeon7lee / FactualityPrompt
  ☆80Updated 2 years ago
• jzbjyb / lm-calibration
  ☆33Updated 3 years ago
• violet-zct / swarm-distillation-zero-shot
  ☆22Updated 2 years ago
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 2 months ago
• swj0419 / kNN_prompt
  TBC
  ☆26Updated 2 years ago
• allenai / flex
  Few-shot NLP benchmark for unified, rigorous eval
  ☆91Updated 2 years ago
• google-research / dialog-inpainting
  ☆97Updated 2 years ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆35Updated last year
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆18Updated 2 years ago
• swj0419 / in-context-pretraining
  ☆39Updated 7 months ago
• gmftbyGMFTBY / MomentumDecoding
  Momentum Decoding: Open-ended Text Generation as Graph Exploration
  ☆19Updated last year
• feyzaakyurek / rl4f
  Code for RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputs. ACL 2023.
  ☆62Updated 4 months ago
• xiamengzhou / training_trajectory_analysis
  [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf
  ☆22Updated last year
• XuezheMax / fairseq-apollo
  FairSeq repo with Apollo optimizer
  ☆107Updated 11 months ago
• rosewang2008 / language_modeling_via_stochastic_processes
  Language modeling via stochastic processes. Oral @ ICLR 2022.
  ☆136Updated last year