mim-solutions / bert_for_longer_textsLinks
BERT classification model for processing texts longer than 512 tokens. Text is first divided into smaller chunks and after feeding them to BERT, intermediate results are pooled. The implementation allows fine-tuning.
☆143Updated last year
Alternatives and similar repositories for bert_for_longer_texts
Users that are interested in bert_for_longer_texts are comparing it to the libraries listed below
Sorting:
- ☆366Updated last year
- Clustering sentence embeddings to extract message intent☆175Updated 3 years ago
- Set of vectorizers that extract keyphrases with part-of-speech patterns from a collection of text documents and convert them into a docum…☆265Updated 9 months ago
- OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)☆779Updated last year
- Code and experiments for *BERTopic: Neural topic modeling with a class-based TF-IDF procedure*☆77Updated last year
- Language model fine-tuning on NER with an easy interface and cross-domain evaluation. "T-NER: An All-Round Python Library for Transformer…☆389Updated 2 years ago
- Efficient Attention for Long Sequence Processing☆97Updated last year
- TweetNLP for all the NLP enthusiasts working on Twitter! The Python library tweetnlp provides a collection of useful tools to analyze/und…☆355Updated 4 months ago
- Guideline following Large Language Model for Information Extraction☆391Updated 9 months ago
- Zero and Few shot named entity & relationships recognition☆381Updated 3 months ago
- A Simple but Powerful SOTA NER Model | Official Code For Label Supervised LLaMA Finetuning☆155Updated last year
- ☆67Updated 4 years ago
- TopicGPT: A Prompt-Based Framework for Topic Modeling (NAACL'24)☆329Updated 4 months ago
- Use Large Language Models like OpenAI's GPT-3.5 for data annotation and model enhancement. This framework combines human expertise with L…☆37Updated last year
- Comparing the Performance of LLMs: A Deep Dive into Roberta, Llama, and Mistral for Disaster Tweets Analysis with Lora☆51Updated last year
- Multilingual/multidomain question generation datasets, models, and python library for question generation.☆360Updated 11 months ago
- simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.☆397Updated 2 years ago
- Datasets for Hate Speech Detection☆131Updated 2 years ago
- PatentSBERTa: A Deep NLP based Hybrid Model for Patent Distance and Classification using Augmented SBERT☆88Updated 9 months ago
- Instruct LLMs for flat and nested NER. Fine-tuning Llama and Mistral models for instruction named entity recognition. (Instruction NER)☆84Updated last year
- Text classification with Foundation Language Model LLaMA☆114Updated 2 years ago
- A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coher…☆1,240Updated 2 weeks ago
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆82Updated 2 years ago
- Active Learning for Text Classification in Python☆621Updated last week
- Repository for TweetEval☆381Updated 3 years ago
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆337Updated 2 years ago
- SpanMarker for Named Entity Recognition☆444Updated 7 months ago
- Multimodal model for text and tabular data with HuggingFace transformers as building block for text data☆604Updated 9 months ago
- Creating class-based TF-IDF matrices☆88Updated 2 years ago
- potato: portable text annotation tool☆345Updated 2 weeks ago