Ighina / DeepTilingLinks
A TextTiling-based algorithm for text segmentation (aka topic segmentation) that uses neural sentence encoders, as well as extractive summarization and semantic search applications built on top of it.
☆50Updated 2 years ago
Alternatives and similar repositories for DeepTiling
Users that are interested in DeepTiling are comparing it to the libraries listed below
Sorting:
- Efficient few-shot learning with cross-encoders.☆59Updated last year
- TextReducer - A Tool for Summarization and Information Extraction☆85Updated last year
- Completion After Prompt Probability. Make your LLM make a choice☆81Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆69Updated last year
- Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.☆49Updated 3 years ago
- Universal text classifier for generative models☆25Updated last year
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- Fine-tuning 6-Billion GPT-J (& other models) with LoRA and 8-bit compression☆68Updated 3 years ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- A dataset for pretraining language models targeted for legal tasks.☆139Updated 3 years ago
- LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development☆20Updated 2 years ago
- Logical structure analysis for visually structured documents☆93Updated 3 years ago
- RaKUn 2.0 - A fast keyword detection algorithm☆68Updated 3 months ago
- ☆35Updated 2 years ago
- Using short models to classify long texts☆21Updated 2 years ago
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated 2 years ago
- Entailment self-training☆25Updated 2 years ago
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆89Updated last year
- This public GitHub repository contains code for a fully self-hosted, on-premise transcription solution.☆54Updated 11 months ago
- Hosting the JSON for the GPT4 Tokenizer☆64Updated 2 years ago
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.☆110Updated last year
- 🚀 Automatically convert unstructured data into a high-quality 'textbook' format, optimized for fine-tuning Large Language Models (LLMs)☆25Updated 2 years ago
- Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.☆98Updated 2 years ago
- This repo is for handling Question Answering, especially for Multi-hop Question Answering☆67Updated last year
- A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs☆115Updated 2 years ago
- Tool to apply Legal Matter Specification Standard (LMSS) to documents☆12Updated last year
- ☆33Updated 2 years ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆188Updated 4 months ago
- Simply, faster, sentence-transformers☆143Updated last year