sdtblck / youtube_subtitle_datasetLinks
YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training
☆45Updated 5 years ago
Alternatives and similar repositories for youtube_subtitle_dataset
Users that are interested in youtube_subtitle_dataset are comparing it to the libraries listed below
Sorting:
- ☆92Updated 3 years ago
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆85Updated 2 years ago
- Code for constructing TLDR corpus from Reddit dataset☆27Updated 4 years ago
- ☆32Updated 2 years ago
- Evaluation suite for large-scale language models.☆128Updated 4 years ago
- ☆78Updated 2 years ago
- Documentation effort for the BookCorpus dataset☆34Updated 4 years ago
- Pipeline for pulling and processing online language model pretraining data from the web☆178Updated 2 years ago
- An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.☆86Updated 4 years ago
- Tools for managing datasets for governance and training.☆87Updated 2 weeks ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 4 years ago
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆157Updated last year
- GenieNLP: A versatile codebase for any NLP task☆88Updated last year
- ☆254Updated 2 years ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆57Updated 3 years ago
- Developing tools to automatically analyze datasets☆75Updated last year
- Adversarial Training and SFT for Bot Safety Models☆40Updated 2 years ago
- One stop shop for all things carp☆59Updated 3 years ago
- ☆50Updated 2 years ago
- Simple Python client for the Hugging Face Inference API☆75Updated 5 years ago
- ☆160Updated 4 years ago
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆67Updated 2 years ago
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆89Updated last year
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)☆40Updated 4 years ago
- Implementation of Z-BERT-A: a zero-shot pipeline for unknown intent detection.☆44Updated 2 years ago
- The pipeline for the OSCAR corpus☆174Updated last month
- FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction☆24Updated 3 years ago
- Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.☆49Updated 3 years ago
- LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development☆20Updated 2 years ago