mim-solutions / bert_for_longer_textsLinks
BERT classification model for processing texts longer than 512 tokens. Text is first divided into smaller chunks and after feeding them to BERT, intermediate results are pooled. The implementation allows fine-tuning.
☆147Updated last year
Alternatives and similar repositories for bert_for_longer_texts
Users that are interested in bert_for_longer_texts are comparing it to the libraries listed below
Sorting:
- ☆371Updated 2 years ago
- Set of vectorizers that extract keyphrases with part-of-speech patterns from a collection of text documents and convert them into a docum…☆266Updated last year
- OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)☆793Updated 2 weeks ago
- A Simple but Powerful SOTA NER Model | Official Code For Label Supervised LLaMA Finetuning☆154Updated last year
- Efficient Attention for Long Sequence Processing☆98Updated last year
- Language model fine-tuning on NER with an easy interface and cross-domain evaluation. "T-NER: An All-Round Python Library for Transformer…☆395Updated 2 years ago
- A collection of topic diversity measures for topic modeling☆48Updated 4 years ago
- Code and experiments for *BERTopic: Neural topic modeling with a class-based TF-IDF procedure*☆83Updated 2 years ago
- Guideline following Large Language Model for Information Extraction☆416Updated last year
- Use Large Language Models like OpenAI's GPT-3.5 for data annotation and model enhancement. This framework combines human expertise with L…☆40Updated 2 years ago
- Zero and Few shot named entity & relationships recognition☆394Updated 2 months ago
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆338Updated 2 years ago
- ☆70Updated 4 years ago
- A curated list of resources on document similarity measures (papers, tutorials, code, ...)☆252Updated 3 years ago
- Instruct LLMs for flat and nested NER. Fine-tuning Llama and Mistral models for instruction named entity recognition. (Instruction NER)☆87Updated last year
- Clustering sentence embeddings to extract message intent☆174Updated 4 years ago
- A Topic Modeling System Toolkit (ACL 2024 Demo)☆276Updated last month
- TweetNLP for all the NLP enthusiasts working on Twitter! The Python library tweetnlp provides a collection of useful tools to analyze/und…☆367Updated 8 months ago
- [ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links☆448Updated 3 years ago
- Text classification with Foundation Language Model LLaMA☆113Updated 2 years ago
- Creating class-based TF-IDF matrices☆90Updated 3 years ago
- [ACL-IJCNLP 2021] Automated Concatenation of Embeddings for Structured Prediction☆311Updated 3 years ago
- Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …☆164Updated 5 months ago
- Comparing the Performance of LLMs: A Deep Dive into Roberta, Llama, and Mistral for Disaster Tweets Analysis with Lora☆51Updated 2 years ago
- A repo to explore different NLP tasks which can be solved using T5☆173Updated 4 years ago
- TopicGPT: A Prompt-Based Framework for Topic Modeling (NAACL'24)☆369Updated 8 months ago
- SpanMarker for Named Entity Recognition☆462Updated 11 months ago
- PatentSBERTa: A Deep NLP based Hybrid Model for Patent Distance and Classification using Augmented SBERT☆100Updated last year
- Applying BERT to named entity recognition in English and Russian.☆162Updated 3 years ago
- Long Document Summarization Papers☆154Updated 2 years ago