nlpie-research / Compact-Biomedical-Transformers
This repository contains the code used for distillation and fine-tuning of compact biomedical transformers that have been introduced in the paper "On The Effectiveness of Compact Biomedical Transformers"
☆17Updated 10 months ago
Alternatives and similar repositories for Compact-Biomedical-Transformers:
Users that are interested in Compact-Biomedical-Transformers are comparing it to the libraries listed below
- BioM-Transformers: Building Large Biomedical Language Models with BERT, ALBERT and ELECTRA☆35Updated last year
- Code repository for BEEP (Biomedical Evidence Enhanced Predictions) clinical outcome prediction system☆26Updated last year
- ☆57Updated last year
- EMNLP'2021: Can Language Models be Biomedical Knowledge Bases?☆55Updated last year
- auto icd coding with prompt☆47Updated 8 months ago
- A project for developing transformer-based models for clinical relation extraction☆127Updated last year
- Implementation of the BLUE benchmark with Transformers.☆20Updated 11 months ago
- We evaluate many models used for biomedical and clinical nlp tasks, and train new models that perform much better.☆158Updated 3 years ago
- BioELECTRA☆51Updated 3 years ago
- a library for named entity recognition developed by UF HOBI NLP lab featuring SOTA algorithms☆146Updated last year
- Corpus of Online Medical EnTities: the cometA corpus☆50Updated 9 months ago
- ☆48Updated 3 years ago
- Dataset for the NLPMC @ NAACL 2021 Paper: Assertion Detection in Clinical Notes: Medical Language Models to the Rescue?☆14Updated 3 years ago
- Named Entity Recognition for biomedical entities☆47Updated 2 years ago
- A Python Natural Language Processing Toolkit for Medical Text Generation☆75Updated 3 months ago
- ☆25Updated last year
- ☆65Updated 2 years ago
- ☆96Updated 2 years ago
- Biomedical Data-to-Text Generation via Fine-Tuning Transformers☆29Updated 3 years ago
- MedDistant19: Towards an Accurate Benchmark for Broad-Coverage Biomedical Relation Extraction (COLING 2022)☆17Updated 2 years ago
- ☆38Updated 2 years ago
- Transformers for Clinical NLP☆23Updated last month
- Python library for converting between BioNLP formats☆20Updated last year
- SciFive: a text-text transformer model for biomedical literature☆91Updated 7 months ago
- Code for the EACL 2021 Paper: Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration☆89Updated 5 months ago
- Implementation and demo of explainable coding of clinical notes with Hierarchical Label-wise Attention Networks (HLAN)☆59Updated 2 years ago
- Bioformer: an efficient BERT model for biomedical text mining☆54Updated last year
- BioELMo is a biomedical version of embeddings from language model (ELMo), pre-trained on PubMed abstracts.☆33Updated 5 years ago
- Adversarial Learning of Knowledge Embeddings for the Unified Medical Language System☆40Updated 5 years ago
- A collection of annotated biomedical corpora, which can be used for training supervised machine learning methods for various tasks in bio…☆36Updated 6 years ago