Alternatives and similar repositories for principled-pre-training

Users that are interested in principled-pre-training are comparing it to the libraries listed below

• g8a9 / ear
  Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"
  ☆50Updated 3 years ago
• guy-dar / embedding-space
  ☆55Updated 2 years ago
• Kaleidophon / awesome-experimental-standards-deep-learning
  Repository collecting resources and best practices to improve experimental rigour in deep learning research.
  ☆27Updated 2 years ago
• nostalgebraist / transformer-utils
  Utilities for the HuggingFace transformers library
  ☆72Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago
• i-machine-think / diagNNose
  diagNNose is a Python library that facilitates a broad set of tools for analysing hidden activations of neural models.
  ☆82Updated 2 years ago
• AndreasMadsen / nlp-roar-interpretability
  Measuring if attention is explanation with ROAR
  ☆22Updated 2 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆75Updated 4 years ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆80Updated 3 years ago
• LuisaMaerz / KnowMAN
  KnowMAN: Weakly Supervised Multinomial Adversarial Networks
  ☆12Updated 4 years ago
• JoaoLages / RATransformers
  RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!
  ☆42Updated 2 years ago
• mega002 / lm-debugger
  The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.
  ☆180Updated 3 years ago
• davidheineman / thresh
  🌾 Universal, customizable and deployable fine-grained evaluation for text generation.
  ☆24Updated 2 years ago
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆29Updated 5 months ago
• fdalvi / NeuroX
  A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.
  ☆105Updated 2 years ago
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆43Updated 2 years ago
• nyu-mll / SQuALITY
  Query-focused summarization data
  ☆42Updated 2 years ago
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆53Updated 3 months ago
• jjzha / cartography-al
  Code base for the EMNLP 2021 Findings paper: Cartography Active Learning
  ☆14Updated 5 months ago
• TomFrederik / unseal
  Mechanistic Interpretability for Transformer Models
  ☆53Updated 3 years ago
• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆36Updated 2 months ago
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆44Updated last year
• HazyResearch / domino
  ☆139Updated 2 years ago
• terrierteam / pyterrier_doc2query
  ☆37Updated last month
• oriram / spider
  ☆54Updated 2 years ago
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 3 years ago
• machelreid / m2d2
  M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
  ☆54Updated 3 years ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 3 years ago
• keyonvafa / sequential-rationales
  Rationales for Sequential Predictions
  ☆40Updated 3 years ago
• PAIR-code / interpretability
  PAIR.withgoogle.com and friend's work on interpretability methods
  ☆214Updated this week