☆94Jul 16, 2022Updated 4 years ago
Alternatives and similar repositories for openwebtext2
Users that are interested in openwebtext2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Downloads 2020 English Wikipedia articles as plaintext☆27Mar 25, 2023Updated 3 years ago
- ☆78Dec 7, 2023Updated 2 years ago
- Adapting the "Radioactive Data" paper to work for text models☆12Dec 23, 2020Updated 5 years ago
- YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training☆47Sep 22, 2020Updated 6 years ago
- ☆15Oct 4, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The elegant integration of huggingface/nlp and fastai2 and handy transforms using pure huggingface/nlp☆19Oct 6, 2020Updated 6 years ago
- ☆10Jun 3, 2021Updated 5 years ago
- T5 model optimized with FlexAttention☆14Sep 30, 2024Updated 2 years ago
- Translation demonstrator☆37May 12, 2020Updated 6 years ago
- ☆13Jan 20, 2023Updated 3 years ago
- ☆10Aug 26, 2021Updated 5 years ago
- Python Research Framework☆107Nov 3, 2022Updated 4 years ago
- Scanner used in NTUSC election 106-1, written using PyGObject.☆12Jun 9, 2018Updated 8 years ago
- ☆22Oct 14, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [NAACL 2025] Representing Rule-based Chatbots with Transformers☆23Feb 9, 2025Updated last year
- code for "GLEN: General-Purpose Event Detection for Thousands of Types"☆14Nov 6, 2023Updated 3 years ago
- OpusFilter - Parallel corpus processing toolkit☆116Sep 30, 2026Updated last month
- A robust web archive analytics toolkit☆153Updated this week
- Anonymous ICLR Submission☆14Sep 25, 2019Updated 7 years ago
- ☆166Mar 5, 2021Updated 5 years ago
- ☆23Oct 30, 2023Updated 3 years ago
- Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.☆768Dec 8, 2022Updated 3 years ago
- A Language-consistent Open Relation Extraction Model.☆16Mar 24, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Script for downloading GitHub.☆99Jul 1, 2024Updated 2 years ago
- Contrastive Language-Image Pretraining☆148Sep 6, 2022Updated 4 years ago
- Character-level conversion between Hebrew text and Latin transliteration using deep learning - a demonstration of seq2seq training.☆16Jun 27, 2023Updated 3 years ago
- Open-AI's DALL-E for large scale training in mesh-tensorflow.☆428Feb 12, 2022Updated 4 years ago
- Multipack distributed sampler for fast padding-free training of LLMs☆207Aug 10, 2024Updated 2 years ago
- several algorithms for converting dependency structures into constituency structures.☆10Feb 7, 2022Updated 4 years ago
- Tools for managing datasets for governance and training.☆91Oct 12, 2026Updated 3 weeks ago
- [NAACL 2024] Vision language model that reduces hallucinations through self-feedback guided revision. Visualizes attentions on image feat…☆49Aug 21, 2024Updated 2 years ago
- ☆16Jul 20, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- This is an implementation of the audio source separation model as well as the evaluation metrics proposed in the paper "Weakly Informed A…☆12Nov 26, 2019Updated 6 years ago
- News crawling with StormCrawler - stores content as WARC☆383Updated this week
- This repository contains code to replicate the no-longer publicly available Toronto BookCorpus dataset☆49Apr 6, 2022Updated 4 years ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆145Jul 26, 2021Updated 5 years ago
- Simple migration engine for Peewee☆19Updated this week
- Automated Design of Agentic Systems☆10Sep 7, 2024Updated 2 years ago
- A python library to find differences between audio and transcriptions☆20Nov 14, 2023Updated 2 years ago