sdtblck / youtube_subtitle_datasetLinks
YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training
☆45Updated 5 years ago
Alternatives and similar repositories for youtube_subtitle_dataset
Users that are interested in youtube_subtitle_dataset are comparing it to the libraries listed below
Sorting:
- ☆93Updated 3 years ago
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆86Updated 2 years ago
- ☆78Updated 2 years ago
- Evaluation suite for large-scale language models.☆129Updated 4 years ago
- ☆44Updated 3 years ago
- Documentation effort for the BookCorpus dataset☆34Updated 4 years ago
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- ☆32Updated 2 years ago
- ☆196Updated last year
- Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…☆89Updated last year
- Developing tools to automatically analyze datasets☆75Updated last year
- A library for squeakily cleaning and filtering language datasets.☆49Updated 2 years ago
- Helper scripts and notes that were used while porting various nlp models☆49Updated 3 years ago
- ☆131Updated 3 years ago
- For experiments involving instruct gpt. Currently used for documenting open research questions.☆71Updated 3 years ago
- Tools for managing datasets for governance and training.☆87Updated last week
- Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)☆40Updated 4 years ago
- Pipeline for pulling and processing online language model pretraining data from the web☆177Updated 2 years ago
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆32Updated 2 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- One stop shop for all things carp☆59Updated 3 years ago
- Code for Stage-wise Fine-tuning for Graph-to-Text Generation☆26Updated 2 years ago
- GenieNLP: A versatile codebase for any NLP task☆89Updated last year
- Multi-Domain Expert Learning☆67Updated 2 years ago
- An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.☆86Updated 4 years ago
- ☆128Updated 2 years ago
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆157Updated 2 years ago
- Hugging Face and Pyserini interoperability☆19Updated 2 years ago
- Smol but mighty language model☆65Updated 2 years ago
- A diff tool for language models☆44Updated 2 years ago