Ighina / DeepTilingLinks
A TextTiling-based algorithm for text segmentation (aka topic segmentation) that uses neural sentence encoders, as well as extractive summarization and semantic search applications built on top of it.
☆47Updated 2 years ago
Alternatives and similar repositories for DeepTiling
Users that are interested in DeepTiling are comparing it to the libraries listed below
Sorting:
- Using short models to classify long texts☆21Updated 2 years ago
- Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.☆97Updated last year
- ☆103Updated 3 years ago
- Efficient few-shot learning with cross-encoders.☆53Updated last year
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆59Updated 10 months ago
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated last year
- Tool to apply Legal Matter Specification Standard (LMSS) to documents☆13Updated 10 months ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆64Updated last year
- ☆10Updated last year
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Updated 2 years ago
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆27Updated 2 years ago
- StAtutory Reasoning Assessment☆13Updated 2 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆88Updated last year
- Vocabulary Trimming (VT) is a model compression technique, which reduces a multilingual LM vocabulary to a target language by deleting ir…☆40Updated 8 months ago
- Annotation meets Large Language Models (ChatGPT, GPT-3 and alike).☆56Updated 2 years ago
- ☆22Updated 4 months ago
- Code and models used in "MUSS Multilingual Unsupervised Sentence Simplification by Mining Paraphrases".☆98Updated 2 years ago
- Repository for "Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages"☆14Updated 8 months ago
- Improving Unsupervised Dialogue Topic Segmentation with Utterance-Pair Coherence Scoring☆64Updated last year
- This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' pu…☆40Updated 3 years ago
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval☆29Updated 2 years ago
- Universal text classifier for generative models☆24Updated 11 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆58Updated last month
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆51Updated this week
- Pre-train Static Word Embeddings☆79Updated 3 weeks ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆21Updated 4 months ago
- Semantically Structured Sentence Embeddings☆66Updated 8 months ago
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆22Updated 2 years ago