Ighina / DeepTilingLinks
A TextTiling-based algorithm for text segmentation (aka topic segmentation) that uses neural sentence encoders, as well as extractive summarization and semantic search applications built on top of it.
☆47Updated 2 years ago
Alternatives and similar repositories for DeepTiling
Users that are interested in DeepTiling are comparing it to the libraries listed below
Sorting:
- Efficient few-shot learning with cross-encoders.☆54Updated last year
- Tool to apply Legal Matter Specification Standard (LMSS) to documents☆13Updated 11 months ago
- RaKUn 2.0 - A fast keyword detection algorithm☆67Updated 2 months ago
- Completion After Prompt Probability. Make your LLM make a choice☆79Updated 8 months ago
- Using short models to classify long texts☆21Updated 2 years ago
- TextReducer - A Tool for Summarization and Information Extraction☆87Updated last year
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆88Updated last year
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated last year
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.☆97Updated last year
- Universal text classifier for generative models☆24Updated 11 months ago
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆64Updated last year
- ☆86Updated 3 months ago
- Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.☆48Updated 2 years ago
- Annotation meets Large Language Models (ChatGPT, GPT-3 and alike).☆56Updated 2 years ago
- Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…☆18Updated last year
- Simply, faster, sentence-transformers☆143Updated 10 months ago
- Repository for deepdoctection tutorial notebooks☆45Updated 3 weeks ago
- Library for fast text representation and classification.☆30Updated last year
- Experimental sampler to make LLMs more creative☆31Updated last year
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆62Updated 2 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated 8 months ago
- Reimplementation of the task generation part from the Alpaca paper☆119Updated 2 years ago
- YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training☆43Updated 4 years ago
- Fine-tuning 6-Billion GPT-J (& other models) with LoRA and 8-bit compression☆66Updated 2 years ago
- A library for squeakily cleaning and filtering language datasets.☆47Updated 2 years ago
- ☆48Updated 5 months ago
- 🚀 Automatically convert unstructured data into a high-quality 'textbook' format, optimized for fine-tuning Large Language Models (LLMs)☆25Updated last year
- LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development☆20Updated last year