Alternatives and similar repositories for analyzing-redundancy-in-pretrained-transformer-models

Users that are interested in analyzing-redundancy-in-pretrained-transformer-models are comparing it to the libraries listed below

• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• da03 / criticize_text_generation
  A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …
  ☆11Updated 2 years ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• kyegomez / Reka-Torch
  Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch
  ☆29Updated last week
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆57Updated 2 years ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• jenni-ai / T2FW
  Fine-Tuning Pre-trained Transformers into Decaying Fast Weights
  ☆19Updated 2 years ago
• yikangshen / megablocks
  ☆20Updated last year
• zhichaoxu-shufe / context-aware-decoding-qfs
  ☆12Updated last year
• Ankush7890 / ssfinetuning
  A package for fine tuning of pretrained NLP transformers using Semi Supervised Learning
  ☆14Updated 3 years ago
• lucy3 / whos_filtered
  ☆14Updated 8 months ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆28Updated last year
• odelliab / HowSumm
  Large-scale query-focused multi-document Summarization dataset
  ☆10Updated 3 years ago
• jungokasai / T2R
  ☆14Updated 2 years ago
• yxuansu / Contrastive_Search_versus_Contrastive_Decoding
  An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation
  ☆27Updated 11 months ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 3 years ago
• lyutyuh / structured-span-selector
  A Structured Span Selector (NAACL 2022). A structured span selector with a WCFG for span selection tasks (coreference resolution, semanti…
  ☆21Updated 2 years ago
• swarnaHub / SummarizationPrograms
  [ICLR 2023] PyTorch code of Summarization Programs: Interpretable Abstractive Summarization with Neural Modular Trees
  ☆24Updated last year
• stanfordnlp / multi-distribution-retrieval
  Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval
  ☆14Updated last year
• allenai / unifew
  Unifew: Unified Fewshot Learning Model
  ☆18Updated 3 years ago
• MikeWangWZHL / Zemi
  Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findings
  ☆16Updated 2 years ago
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆23Updated last month
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆20Updated 3 months ago
• cooelf / CompassMTL
  Task Compass: Scaling Multi-task Pre-training with Task Prefix (EMNLP 2022: Findings) (stay tuned & more will be updated)
  ☆22Updated 2 years ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 4 months ago
• srush / transformers-bet
  ☆12Updated 3 years ago
• Yuanhy1997 / HyPe
  HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]
  ☆14Updated last year
• allenai / sso
  Repository for Skill Set Optimization
  ☆13Updated 10 months ago
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆33Updated 4 months ago
• sustcsonglin / gated_linear_attention_layer
  ☆31Updated last year