MiniXC / opensubtitles-dataloader
Loads OpenSubtitles v2018 dataset without having to load everything into memory at once. Works well with pytorch.
☆13Updated 4 years ago
Alternatives and similar repositories for opensubtitles-dataloader
Users that are interested in opensubtitles-dataloader are comparing it to the libraries listed below
Sorting:
- MILES is a multilingual text simplifier inspired by LSBert - A BERT-based lexical simplification approach proposed in 2018. Unlike LSBert…☆49Updated 4 years ago
- Grammar Induction using a Template Tree Approach☆46Updated last week
- A python module for word inflections designed for use with spaCy.☆92Updated 5 years ago
- Execute arbitrary SQL queries on 🤗 Datasets☆32Updated last year
- A slightly opinionated iPython profile for interactive development☆23Updated 3 years ago
- Python Finite-State Toolkit☆54Updated last week
- Put together a multilingual corpus from a variety of sources. Used for wordfreq and word embeddings.☆51Updated 3 years ago
- A corpus of Python programs annotated with contracts☆21Updated 2 years ago
- Fast Neural Machine Translation in C++ - development repository☆19Updated last year
- ☆70Updated 2 years ago
- Next-generation Punkt sentence boundary detection with zero dependencies☆17Updated last month
- A lightweight Python library for constructing, processing, and visualizing constituent trees.☆66Updated 4 months ago
- Library for fast text representation and classification.☆28Updated last year
- Generate a SQLite database from Wikipedia & Wikidata dumps.☆35Updated last year
- Measure the similarity of text corpora for 74 languages☆13Updated last year
- LTG-Bert☆32Updated last year
- Natural Language Inflection in English☆11Updated 3 years ago
- Automatic extraction of edited sentences from text edition histories.☆83Updated 3 years ago
- Test prompts for GPT-J-6B and the resulting AI-generated texts☆53Updated 3 years ago
- A sentence paraphraser based on dependency parsing and word embedding similarity.☆22Updated 3 years ago
- Simple library to work with pre-trained ELMo models in TensorFlow☆52Updated 2 years ago
- List of corpora annotated for coreference for different languages☆17Updated 9 months ago
- Build a dialog dataset from online books in many languages☆73Updated 2 years ago
- Question Generation - Question Answering for Automatic Flashcards☆64Updated 3 years ago
- A simple neural truecaser written in pytorch and allennlp.☆33Updated 10 months ago
- Podium: a framework agnostic Python NLP library for data loading and preprocessing☆60Updated 2 years ago
- 💫 SpaCy wrapper for ConceptNet 💫☆93Updated last year
- 🐍🍑 Python 3 library for managing, annotating, and converting natural language corpuses using popular formats (CoNLL, ELAN, Praat, CSV, …☆17Updated 10 months ago
- Finds linguistic patterns effortlessly☆36Updated last year
- ☆11Updated 2 years ago