Ighina / DeepTilingLinks
A TextTiling-based algorithm for text segmentation (aka topic segmentation) that uses neural sentence encoders, as well as extractive summarization and semantic search applications built on top of it.
☆51Updated 2 years ago
Alternatives and similar repositories for DeepTiling
Users that are interested in DeepTiling are comparing it to the libraries listed below
Sorting:
- Efficient few-shot learning with cross-encoders.☆60Updated last year
- TextReducer - A Tool for Summarization and Information Extraction☆85Updated last year
- Universal text classifier for generative models☆25Updated last year
- RaKUn 2.0 - A fast keyword detection algorithm☆69Updated 4 months ago
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated 2 years ago
- Using short models to classify long texts☆21Updated 2 years ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆71Updated last year
- Completion After Prompt Probability. Make your LLM make a choice☆82Updated last year
- a tiny, exploitable chatbot that can use tools☆32Updated 2 years ago
- Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.☆49Updated 3 years ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated last year
- Entailment self-training☆25Updated 2 years ago
- ☆65Updated 7 months ago
- The official code repo for "Sub-Sentence Encoder: Contrastive Learning of Propositional Semantic Representations".☆85Updated last year
- LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development☆20Updated 2 years ago
- Fine-tuning 6-Billion GPT-J (& other models) with LoRA and 8-bit compression☆68Updated 3 years ago
- This repository contains an easy and intuitive approach to use SetFit in combination with spaCy.☆80Updated 2 years ago
- QLoRA with Enhanced Multi GPU Support☆37Updated 2 years ago
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Updated 2 years ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 4 years ago
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆63Updated last year
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆89Updated last year
- A unified versatile interface for dialogue datasets☆18Updated 2 years ago
- ☆87Updated 8 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆49Updated 2 years ago
- Tool to apply Legal Matter Specification Standard (LMSS) to documents☆12Updated last year
- A dataset featuring diverse dialogues between two ChatGPT (gpt-3.5-turbo) instances with system messages written by GPT-4. Covering vario…☆164Updated 2 years ago
- Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA☆104Updated 6 months ago
- Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…☆19Updated last year
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago