Alternatives and similar repositories for analyzing-redundancy-in-pretrained-transformer-models

Users that are interested in analyzing-redundancy-in-pretrained-transformer-models are comparing it to the libraries listed below

• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• da03 / criticize_text_generation
  A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …
  ☆11Updated 2 years ago
• Ankush7890 / ssfinetuning
  A package for fine tuning of pretrained NLP transformers using Semi Supervised Learning
  ☆14Updated 3 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆57Updated 2 years ago
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆23Updated last month
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 3 years ago
• kyegomez / Reka-Torch
  Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch
  ☆29Updated last week
• lucy3 / whos_filtered
  ☆14Updated 8 months ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆28Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• cooelf / CompassMTL
  Task Compass: Scaling Multi-task Pre-training with Task Prefix (EMNLP 2022: Findings) (stay tuned & more will be updated)
  ☆22Updated 2 years ago
• JeremyAlain / imitation_learning_from_language_feedback
  This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"
  ☆27Updated 2 years ago
• petezh / OpenD5
  Tasks for describing differences between text distributions.
  ☆16Updated 9 months ago
• openfeedback / superhf
  Open-source Human Feedback Library
  ☆11Updated last year
• NonvolatileMemory / flash_attn_gqa
  triton ver of gqa flash attn, based on the tutorial
  ☆11Updated 10 months ago
• SimengSun / ChapterBreak
  ☆11Updated 11 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 4 months ago
• EleutherAI / pile_dedupe
  Pile Deduplication Code
  ☆19Updated 2 years ago
• r-three / fib
  ☆25Updated 2 years ago
• allenai / bff
  ☆38Updated last year
• RUCAIBox / ELMER
  This repository is the official implementation of our EMNLP 2022 paper ELMER: A Non-Autoregressive Pre-trained Language Model for Efficie…
  ☆26Updated 2 years ago
• EleutherAI / semantic-memorization
  ☆44Updated 6 months ago
• allenai / sso
  Repository for Skill Set Optimization
  ☆13Updated 10 months ago
• jenni-ai / T2FW
  Fine-Tuning Pre-trained Transformers into Decaying Fast Weights
  ☆19Updated 2 years ago
• renll / SparseLT
  [EMNLP 2022] Language Model Pre-Training with Sparse Latent Typing
  ☆14Updated 2 years ago
• zhichaoxu-shufe / context-aware-decoding-qfs
  ☆12Updated last year
• pietrolesci / memorisation-profiles
  This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".
  ☆21Updated 2 months ago
• machelreid / editpro
  Learning to Model Editing Processes
  ☆26Updated 3 years ago
• allenai / staged-training
  Staged Training for Transformer Language Models
  ☆32Updated 3 years ago