oscar-project / goclassy
An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.
☆86Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for goclassy
- As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)☆46Updated 3 years ago
- ☆73Updated 3 years ago
- A simple neural truecaser written in pytorch and allennlp.☆32Updated 5 months ago
- Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.☆126Updated 3 years ago
- Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP☆58Updated 2 years ago
- Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.☆101Updated 2 years ago
- BERT models for many languages created from Wikipedia texts☆34Updated 4 years ago
- ☆86Updated 2 years ago
- A tiny BERT for low-resource monolingual models☆29Updated last month
- ☆13Updated 4 years ago
- A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …☆49Updated 4 years ago
- A web interface to understand language-specific BERT-models☆17Updated 7 months ago
- LM Pretraining with PyTorch/TPU☆132Updated 5 years ago
- c++ mosestokenizer☆16Updated 8 months ago
- A python tool for building large scale Wikipedia-based Information Retrieval datasets☆45Updated 3 years ago
- Repository for the ACL 2020 virtual conference website (work in progress)☆38Updated 2 years ago
- Automatic extraction of edited sentences from text edition histories.☆81Updated 2 years ago
- Viewer for the 🤗 datasets library.☆83Updated 3 years ago
- Code and datasets of "Multilingual Extractive Reading Comprehension by Runtime Machine Translation"☆39Updated 5 years ago
- Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation☆12Updated 2 months ago
- Build a dialog dataset from online books in many languages☆72Updated 2 years ago
- codebase for the Text-based NP Enrichment (TNE) paper☆19Updated 8 months ago
- Code for the paper: Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries☆19Updated 2 years ago
- A Benchmark Dataset for Understanding Disfluencies in Question Answering☆60Updated 3 years ago
- Source code for the Apple reproduction☆31Updated 3 years ago
- numeric fused-head identification and resolution☆33Updated 5 years ago
- NTREX -- News Test References for MT Evaluation☆75Updated 5 months ago
- Assessing syntactic abilities of BERT☆39Updated 5 years ago
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆79Updated last week
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆153Updated 11 months ago