stephantul / piecelearn
Learning BPE embeddings by first learning a segmentation model and then training word2vec
☆19Updated 2 years ago
Alternatives and similar repositories for piecelearn:
Users that are interested in piecelearn are comparing it to the libraries listed below
- A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …☆51Updated 3 months ago
- BERT models for many languages created from Wikipedia texts☆33Updated 4 years ago
- Word Sense Induction with BERT MLM☆28Updated last year
- This repository contains the code for the Form-Context Model and its Attentive Mimicking variant.☆31Updated 4 years ago
- ☆17Updated last year
- Combining encoder-based language models☆11Updated 3 years ago
- A simple neural truecaser written in pytorch and allennlp.☆33Updated 8 months ago
- Hyperparameter search for AllenNLP - powered by Ray TUNE☆28Updated last week
- Converter from UD-trees to BART representation☆36Updated last year
- ☆24Updated 5 years ago
- A small repository to test Captum Explainable AI with a trained Flair transformers-based text classifier.☆27Updated 3 years ago
- ☆33Updated 3 years ago
- Source code for our AAAI 2020 paper P-SIF: Document Embeddings using Partition Averaging☆34Updated 4 years ago
- KenLM extension for spaCy 2.0.☆16Updated 7 years ago
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆83Updated last week
- "Zero-Training Sentence Embedding via Orthogonal Basis" paper implementation☆19Updated 6 years ago
- Temporary remove unused tokens during training to save ram and speed.☆22Updated 8 months ago
- Tool for parsing and converting various span encoding schemes.☆22Updated last year
- SegEval Segmentation Evaluation Package☆56Updated last year
- A embed able annotation tool for end to end cross document co-reference☆41Updated 2 years ago
- A spaCy custom component that extracts and normalizes temporal expressions☆54Updated 2 years ago
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆22Updated 2 years ago
- Getting interpretable dimensions in word embedding spaces.☆14Updated last year
- Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Do…☆80Updated 8 months ago
- A set of methods for finding an appropriate number of topics in a text collection☆15Updated 7 months ago
- Efficient Sentence Embedding via Semantic Subspace Analysis☆14Updated 5 years ago
- Neural topic modeling☆29Updated 4 years ago
- Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.☆44Updated 10 months ago
- Generate BERT vocabularies and pretraining examples from Wikipedias☆18Updated 4 years ago
- numeric fused-head identification and resolution☆33Updated 5 years ago