Ighina / DeepTiling
A TextTiling-based algorithm for text segmentation (aka topic segmentation) that uses neural sentence encoders, as well as extractive summarization and semantic search applications built on top of it.
☆46Updated 2 years ago
Alternatives and similar repositories for DeepTiling:
Users that are interested in DeepTiling are comparing it to the libraries listed below
- Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.☆96Updated last year
- Using short models to classify long texts☆21Updated 2 years ago
- Tool to apply Legal Matter Specification Standard (LMSS) to documents☆13Updated 8 months ago
- Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.☆49Updated 2 years ago
- TextReducer - A Tool for Summarization and Information Extraction☆87Updated 11 months ago
- ☆102Updated 3 years ago
- StAtutory Reasoning Assessment☆13Updated 2 years ago
- Completion After Prompt Probability. Make your LLM make a choice☆76Updated 5 months ago
- Efficient few-shot learning with cross-encoders.☆51Updated last year
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆88Updated last year
- RaKUn 2.0 - A fast keyword detection algorithm☆67Updated this week
- Seed Machine Translation Data☆31Updated 5 months ago
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆31Updated last year
- Segment documents into coherent parts using word embeddings.☆149Updated 3 years ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- ☆23Updated 2 months ago
- YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training☆43Updated 4 years ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆74Updated 6 months ago
- This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' pu…☆40Updated 3 years ago
- 🧪Create domain-adapted language models by distilling from many pre-trained LMs☆10Updated 2 years ago
- utilities for loading and running text embeddings with onnx☆44Updated 8 months ago
- Vocabulary Trimming (VT) is a model compression technique, which reduces a multilingual LM vocabulary to a target language by deleting ir…☆36Updated 5 months ago
- ☆86Updated 2 weeks ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- Code for Stage-wise Fine-tuning for Graph-to-Text Generation☆26Updated 2 years ago
- ☆10Updated last year
- ☆158Updated 10 months ago
- ☆16Updated 3 years ago
- Semantically Structured Sentence Embeddings☆65Updated 6 months ago
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval☆29Updated 2 years ago