Ighina / DeepTiling
A TextTiling-based algorithm for text segmentation (aka topic segmentation) that uses neural sentence encoders, as well as extractive summarization and semantic search applications built on top of it.
☆45Updated 2 years ago
Alternatives and similar repositories for DeepTiling:
Users that are interested in DeepTiling are comparing it to the libraries listed below
- Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.☆96Updated last year
- ☆102Updated 3 years ago
- RaKUn 2.0 - A fast keyword detection algorithm☆66Updated last month
- A python library to classify dialogue tag.☆24Updated 3 years ago
- This repository contains an easy and intuitive approach to use SetFit in combination with spaCy.☆77Updated last year
- Using short models to classify long texts☆21Updated 2 years ago
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆86Updated last year
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- 🚀 Automatically convert unstructured data into a high-quality 'textbook' format, optimized for fine-tuning Large Language Models (LLMs)☆26Updated last year
- This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' pu…☆40Updated 3 years ago
- Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.☆49Updated 2 years ago
- Annotation meets Large Language Models (ChatGPT, GPT-3 and alike).☆56Updated last year
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆56Updated 7 months ago
- Efficient few-shot learning with cross-encoders.☆49Updated last year
- TextReducer - A Tool for Summarization and Information Extraction☆87Updated 10 months ago
- A unified versatile interface for dialogue datasets☆17Updated last year
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆31Updated last year
- Code for Stage-wise Fine-tuning for Graph-to-Text Generation☆26Updated 2 years ago
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Updated 2 years ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆58Updated last year
- ☆34Updated last year
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆46Updated last year
- Segment documents into coherent parts using word embeddings.☆149Updated 3 years ago
- Completion After Prompt Probability. Make your LLM make a choice☆74Updated 4 months ago
- Universal text classifier for generative models☆22Updated 7 months ago
- Zero-shot Audio Classification using Whisper☆80Updated 2 years ago
- Improving Unsupervised Dialogue Topic Segmentation with Utterance-Pair Coherence Scoring☆61Updated last year
- Seed Machine Translation Data☆30Updated 4 months ago
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- ☆32Updated last year