Alternatives and similar repositories for PretrainingBERT:

Users that are interested in PretrainingBERT are comparing it to the libraries listed below

• zhjohnchan / awesome-few-shot-learning-in-nlp
  A curated list of few-shot learning in NLP. :-)
  ☆65Updated 3 years ago
• malteos / scincl
  Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings (EMNLP 2022 paper)
  ☆67Updated 2 years ago
• justinphan3110 / SciFive
  SciFive: a text-text transformer model for biomedical literature
  ☆92Updated 8 months ago
• Babelscape / crocodile
  cRocoDiLe is a dataset extraction tool for Relation Extraction using Wikipedia and Wikidata presented in REBEL (EMNLP 2021).
  ☆66Updated last year
• theblackcat102 / language-models-are-knowledge-graphs-pytorch
  Language models are open knowledge graphs ( non official implementation )
  ☆168Updated 4 years ago
• amazon-science / mintaka
  Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)
  ☆109Updated 2 years ago
• allenai / scifact
  Data and models for the SciFact verification task.
  ☆226Updated last year
• thevasudevgupta / bigbird
  Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers
  ☆48Updated last year
• karthiksoman / zebra-Llama
  ☆15Updated 3 months ago
• yumeng5 / TopClus
  [WWW 2022] Topic Discovery via Latent Space Clustering of Pretrained Language Model Representations
  ☆87Updated 3 years ago
• GanjinZero / KeBioLM
  Improving Biomedical Pretrained Language Models with Knowledge [BioNLP 2021]
  ☆65Updated 2 years ago
• YaserJaradeh / ThePlumber
  The Plumber framework for KG completion and structured triples extraction
  ☆21Updated last year
• amazon-science / efficient-longdoc-classification
  ☆44Updated 2 years ago
• GeorgeLuImmortal / Hierarchical-BERT-Model-with-Limited-Labelled-Data
  ☆41Updated 3 years ago
• epfl-dlab / GenIE
  The autoregressive information extraction system GenIE (Generative Information Extraction) implemented in PyTorch.
  ☆101Updated last year
• allenai / aspire
  Repo for Aspire - A scientific document similarity model based on matching fine-grained aspects of scientific papers.
  ☆51Updated last year
• yueyu1030 / COSINE
  [NAACL 2021] This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self…
  ☆201Updated 2 years ago
• fastforwardlabs / few-shot-text-classification
  ☆61Updated 4 years ago
• g8a9 / ferret
  A python package for benchmarking interpretability techniques on Transformers.
  ☆213Updated 4 months ago
• sebastian-hofstaetter / colberter
  ☆45Updated 2 years ago
• coastalcph / hierarchical-transformers
  Hierarchical Attention Transformers (HAT)
  ☆48Updated last year
• cambridgeltl / sapbert
  [NAACL'21 & ACL'21] SapBERT: Self-alignment pretraining for BERT & XL-BEL: Cross-Lingual Biomedical Entity Linking.
  ☆183Updated last year
• DFKI-NLP / thermostat
  Collection of NLP model explanations and accompanying analysis tools
  ☆145Updated last year
• MarkusSagen / Master-Thesis-Multilingual-Longformer
  Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre…
  ☆33Updated 3 years ago
• dmis-lab / BioLAMA
  EMNLP'2021: Can Language Models be Biomedical Knowledge Bases?
  ☆55Updated last year
• snap-stanford / GreaseLM
  [ICLR 2022 spotlight]GreaseLM: Graph REASoning Enhanced Language Models for Question Answering
  ☆232Updated 2 years ago
• osainz59 / Ask2Transformers
  A Framework for Textual Entailment based Zero Shot text classification
  ☆152Updated 11 months ago
• helmy-elrais / RoBERT_Recurrence_over_BERT
  pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …
  ☆80Updated 2 years ago
• michiyasunaga / LinkBERT
  [ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links
  ☆430Updated 2 years ago
• castorini / ragnarok
  Retrieval-Augmented Generation battle!
  ☆49Updated 2 months ago