sdtblck / youtube_subtitle_datasetLinks
YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training
☆43Updated 4 years ago
Alternatives and similar repositories for youtube_subtitle_dataset
Users that are interested in youtube_subtitle_dataset are comparing it to the libraries listed below
Sorting:
- ☆90Updated 3 years ago
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆83Updated last year
- Documentation effort for the BookCorpus dataset☆34Updated 4 years ago
- ☆79Updated last year
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆89Updated last year
- Evaluation suite for large-scale language models.☆127Updated 4 years ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- ☆33Updated 2 years ago
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- Developing tools to automatically analyze datasets☆74Updated 9 months ago
- Tools for managing datasets for governance and training.☆85Updated 2 weeks ago
- Pipeline for pulling and processing online language model pretraining data from the web☆177Updated 2 years ago
- ☆192Updated last year
- ☆154Updated 4 years ago
- Source codes for the paper "Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints"☆27Updated 2 years ago
- ☆44Updated last year
- Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)☆41Updated 4 years ago
- ☆127Updated 2 years ago
- For experiments involving instruct gpt. Currently used for documenting open research questions.☆71Updated 2 years ago
- Code for constructing TLDR corpus from Reddit dataset☆26Updated 3 years ago
- Open source library for few shot NLP☆79Updated 2 years ago
- Script for downloading GitHub.☆97Updated last year
- A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs☆116Updated 2 years ago
- One stop shop for all things carp☆59Updated 2 years ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆57Updated 2 years ago
- The pipeline for the OSCAR corpus☆171Updated last year
- Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.☆48Updated 2 years ago
- ☆253Updated 2 years ago
- A library for squeakily cleaning and filtering language datasets.☆47Updated 2 years ago
- Adversarial Training and SFT for Bot Safety Models☆40Updated 2 years ago