Ighina / DeepTilingLinks
A TextTiling-based algorithm for text segmentation (aka topic segmentation) that uses neural sentence encoders, as well as extractive summarization and semantic search applications built on top of it.
☆49Updated 2 years ago
Alternatives and similar repositories for DeepTiling
Users that are interested in DeepTiling are comparing it to the libraries listed below
Sorting:
- TextReducer - A Tool for Summarization and Information Extraction☆87Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆66Updated last year
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated 2 years ago
- Efficient few-shot learning with cross-encoders.☆59Updated last year
- Completion After Prompt Probability. Make your LLM make a choice☆80Updated 11 months ago
- Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.☆48Updated 3 years ago
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆89Updated last year
- Using short models to classify long texts☆21Updated 2 years ago
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆61Updated last year
- Universal text classifier for generative models☆25Updated last year
- RaKUn 2.0 - A fast keyword detection algorithm☆68Updated 2 months ago
- Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.☆97Updated 2 years ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆187Updated 3 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆49Updated last year
- ☆35Updated 2 years ago
- Entailment self-training☆25Updated 2 years ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- A dataset featuring diverse dialogues between two ChatGPT (gpt-3.5-turbo) instances with system messages written by GPT-4. Covering vario…☆164Updated 2 years ago
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval☆29Updated 3 years ago
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- The Synthetic-Persona-Chat dataset is a synthetically generated persona-based dialogue dataset. It extends the original Persona-Chat data…☆101Updated last year
- Consists of the largest (10K) human annotated code-switched semantic parsing dataset & 170K generated utterance using the CST5 augmentati…☆41Updated 2 years ago
- The official code repo for "Sub-Sentence Encoder: Contrastive Learning of Propositional Semantic Representations".☆83Updated last year
- Logical structure analysis for visually structured documents☆92Updated 3 years ago
- Track the progress of LLM context utilisation☆54Updated 5 months ago
- Get deterministic output in any format like json from any LLM.☆18Updated 2 years ago
- Hosting the JSON for the GPT4 Tokenizer☆64Updated 2 years ago
- ☆63Updated 5 months ago
- Multi-Domain Expert Learning☆66Updated last year
- A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs☆115Updated 2 years ago