Alternatives and similar repositories for elc-bert

Users that are interested in elc-bert are comparing it to the libraries listed below

• zouharvi / tokenization-scorer
  Simple-to-use scoring function for arbitrarily tokenized texts.
  ☆46Updated 6 months ago
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆58Updated last year
• google-deepmind / transformer_grammars
  Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)
  ☆128Updated 2 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆135Updated 7 months ago
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆114Updated last year
• babylm / evaluation-pipeline-2024
  The evaluation pipeline for the 2024 BabyLM Challenge.
  ☆33Updated 9 months ago
• TristanThrush / i-am-a-strange-dataset
  Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"
  ☆44Updated last year
• bminixhofer / tokenkit
  A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.
  ☆45Updated last month
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆24Updated 9 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆232Updated 7 months ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆26Updated 9 months ago
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆247Updated last year
• epfl-dlab / GCD
  ☆42Updated 5 months ago
• AlexWan0 / infini-gram
  An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)
  ☆33Updated last year
• huggingface / that_is_good_data
  ☆66Updated 2 years ago
• babylm / evaluation-pipeline-2023
  Evaluation pipeline for the BabyLM Challenge 2023.
  ☆77Updated last year
• LAGoM-NLP / transtokenizer
  ☆51Updated 7 months ago
• viking-sudo-rm / rusty-dawg
  Rust library for indexing and quickly searching large pretraining corpora
  ☆28Updated last week
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆186Updated last month
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆66Updated 2 years ago
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆107Updated 5 months ago
• genlm / llamppl
  Probabilistic programming with large language models
  ☆134Updated last month
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆46Updated 9 months ago
• allenai / bff
  ☆39Updated last year
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆107Updated last year
• zphang / minimal-opt
  ☆67Updated 3 years ago
• KaiNylund / lm-weights-encode-time
  ☆69Updated last year
• fdalvi / NeuroX
  A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.
  ☆104Updated last year
• evandez / relations
  How do transformer LMs encode relations?
  ☆52Updated last year