Ighina / DeepTiling
A TextTiling-based algorithm for text segmentation (aka topic segmentation) that uses neural sentence encoders, as well as extractive summarization and semantic search applications built on top of it.
☆44Updated last year
Alternatives and similar repositories for DeepTiling:
Users that are interested in DeepTiling are comparing it to the libraries listed below
- Using short models to classify long texts☆21Updated last year
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆86Updated 10 months ago
- Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.☆48Updated 2 years ago
- ☆102Updated 3 years ago
- Efficient few-shot learning with cross-encoders.☆42Updated 11 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆49Updated 10 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆45Updated last year
- Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.☆96Updated last year
- TextReducer - A Tool for Summarization and Information Extraction☆87Updated 8 months ago
- Consists of the largest (10K) human annotated code-switched semantic parsing dataset & 170K generated utterance using the CST5 augmentati…☆35Updated last year
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated last year
- Annotation meets Large Language Models (ChatGPT, GPT-3 and alike).☆55Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated 10 months ago
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval☆28Updated 2 years ago
- Improving Unsupervised Dialogue Topic Segmentation with Utterance-Pair Coherence Scoring☆60Updated 11 months ago
- Tool to apply Legal Matter Specification Standard (LMSS) to documents☆12Updated 5 months ago
- RaKUn 2.0 - A fast keyword detection algorithm☆64Updated last month
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆66Updated 2 months ago
- TVRecap: A Dataset for Generating Stories with Character Descriptions☆20Updated last year
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆56Updated 5 months ago
- Pre-train Static Word Embeddings☆34Updated this week
- ☆38Updated last year
- Source code for the GPT-2 story generation models in the EMNLP 2020 paper "STORIUM: A Dataset and Evaluation Platform for Human-in-the-Lo…☆39Updated last year
- ☆21Updated last year
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆70Updated 10 months ago
- A library for squeakily cleaning and filtering language datasets.☆45Updated last year
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- This repository contains an easy and intuitive approach to use SetFit in combination with spaCy.☆76Updated last year
- ☆153Updated 7 months ago