mim-solutions / bert_for_longer_textsLinks
BERT classification model for processing texts longer than 512 tokens. Text is first divided into smaller chunks and after feeding them to BERT, intermediate results are pooled. The implementation allows fine-tuning.
☆147Updated last year
Alternatives and similar repositories for bert_for_longer_texts
Users that are interested in bert_for_longer_texts are comparing it to the libraries listed below
Sorting:
- ☆372Updated 2 years ago
- Clustering sentence embeddings to extract message intent☆174Updated 4 years ago
- Set of vectorizers that extract keyphrases with part-of-speech patterns from a collection of text documents and convert them into a docum…☆265Updated last year
- Efficient Attention for Long Sequence Processing☆98Updated 2 years ago
- A Simple but Powerful SOTA NER Model | Official Code For Label Supervised LLaMA Finetuning☆153Updated last year
- Language model fine-tuning on NER with an easy interface and cross-domain evaluation. "T-NER: An All-Round Python Library for Transformer…☆396Updated 2 years ago
- Text classification with Foundation Language Model LLaMA☆113Updated 2 years ago
- Zero and Few shot named entity & relationships recognition☆398Updated 3 months ago
- TopicGPT: A Prompt-Based Framework for Topic Modeling (NAACL'24)☆371Updated 9 months ago
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆82Updated 3 years ago
- Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …☆165Updated 6 months ago
- OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)☆793Updated this week
- Use Large Language Models like OpenAI's GPT-3.5 for data annotation and model enhancement. This framework combines human expertise with L…☆40Updated 2 years ago
- Guideline following Large Language Model for Information Extraction☆421Updated last year
- Instruct LLMs for flat and nested NER. Fine-tuning Llama and Mistral models for instruction named entity recognition. (Instruction NER)☆87Updated last year
- [ACL-IJCNLP 2021] Automated Concatenation of Embeddings for Structured Prediction☆311Updated 3 years ago
- Creating class-based TF-IDF matrices☆91Updated 3 years ago
- [ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links☆449Updated 3 years ago
- PatentSBERTa: A Deep NLP based Hybrid Model for Patent Distance and Classification using Augmented SBERT☆103Updated last year
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆337Updated 2 years ago
- ☆70Updated 4 years ago
- ☆46Updated 2 years ago
- Comparing the Performance of LLMs: A Deep Dive into Roberta, Llama, and Mistral for Disaster Tweets Analysis with Lora☆51Updated 2 years ago
- A collection of topic diversity measures for topic modeling☆48Updated 4 years ago
- Long Document Summarization Papers☆154Updated 2 years ago
- TweetNLP for all the NLP enthusiasts working on Twitter! The Python library tweetnlp provides a collection of useful tools to analyze/und…☆371Updated 9 months ago
- Multimodal model for text and tabular data with HuggingFace transformers as building block for text data☆614Updated last year
- A Framework for Textual Entailment based Zero Shot text classification☆153Updated last year
- ☆60Updated 4 years ago
- A repo to explore different NLP tasks which can be solved using T5☆173Updated 4 years ago