Ighina / DeepTiling
A TextTiling-based algorithm for text segmentation (aka topic segmentation) that uses neural sentence encoders, as well as extractive summarization and semantic search applications built on top of it.
☆44Updated last year
Alternatives and similar repositories for DeepTiling:
Users that are interested in DeepTiling are comparing it to the libraries listed below
- a tiny, exploitable chatbot that can use tools☆30Updated last year
- Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.☆48Updated 2 years ago
- Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.☆96Updated last year
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆86Updated 11 months ago
- TextReducer - A Tool for Summarization and Information Extraction☆87Updated 9 months ago
- ☆102Updated 3 years ago
- Using short models to classify long texts☆21Updated last year
- Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance☆27Updated last year
- GPU accelerated client-side embeddings for vector search, RAG etc.☆65Updated last year
- A unified versatile interface for dialogue datasets☆17Updated last year
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated last year
- RaKUn 2.0 - A fast keyword detection algorithm☆65Updated last week
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- Experiments for XLM-V Transformers Integeration☆13Updated 2 years ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆70Updated 11 months ago
- ☆37Updated last year
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval☆28Updated 2 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆45Updated last year
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆24Updated 2 years ago
- StAtutory Reasoning Assessment☆13Updated 2 years ago
- ☆155Updated 7 months ago
- Experimental sampler to make LLMs more creative☆30Updated last year
- ☆13Updated 6 months ago
- Vocabulary Trimming (VT) is a model compression technique, which reduces a multilingual LM vocabulary to a target language by deleting ir…☆33Updated 3 months ago
- Efficient few-shot learning with cross-encoders.☆48Updated last year
- Improving Unsupervised Dialogue Topic Segmentation with Utterance-Pair Coherence Scoring☆60Updated last year
- Annotation meets Large Language Models (ChatGPT, GPT-3 and alike).☆56Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text☆36Updated 4 years ago