sdtblck / youtube_subtitle_datasetLinks
YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training
☆43Updated 4 years ago
Alternatives and similar repositories for youtube_subtitle_dataset
Users that are interested in youtube_subtitle_dataset are comparing it to the libraries listed below
Sorting:
- ☆90Updated 2 years ago
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆81Updated last year
- ☆78Updated last year
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆88Updated last year
- ☆33Updated 2 years ago
- Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)☆41Updated 3 years ago
- ☆111Updated 2 years ago
- Source codes for the paper "Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints"☆28Updated 2 years ago
- FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction☆24Updated 3 years ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- Documentation effort for the BookCorpus dataset☆34Updated 4 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆57Updated 2 years ago
- ☆27Updated 2 years ago
- TVRecap: A Dataset for Generating Stories with Character Descriptions☆20Updated 2 years ago
- Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.☆44Updated last year
- Pipeline for pulling and processing online language model pretraining data from the web☆178Updated last year
- A library for squeakily cleaning and filtering language datasets.☆47Updated last year
- Detecting gibberish as a type of sentiment analysis with GPT2☆24Updated 4 years ago
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆155Updated last year
- ☆86Updated 2 months ago
- ☆43Updated 2 years ago
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated last year
- ☆50Updated 2 years ago
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Updated 2 years ago
- A package for fine-tuning Transformers with TPUs, written in Tensorflow2.0+☆38Updated 4 years ago
- A dataset for pretraining language models targeted for legal tasks.☆133Updated 2 years ago
- Tools for managing datasets for governance and training.☆85Updated 3 weeks ago
- Helper scripts and notes that were used while porting various nlp models☆46Updated 3 years ago