Alternatives and similar repositories for unitoken

Users that are interested in unitoken are comparing it to the libraries listed below

• nlp-uoregon / famie
  FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction
  ☆24Updated 3 years ago
• MilaNLProc / language-invariant-properties
  ☆22Updated 3 years ago
• nyu-mll / pretraining-learning-curves
  The repository for the paper "When Do You Need Billions of Words of Pretraining Data?"
  ☆21Updated 4 years ago
• iaramer / dobbi
  An open-source NLP library: fast text cleaning and preprocessing
  ☆23Updated 3 years ago
• spyysalo / wiki-bert-pipeline
  Generate BERT vocabularies and pretraining examples from Wikipedias
  ☆17Updated 5 years ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• webis-de / summary-explorer
  Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.
  ☆44Updated last year
• pmbaumgartner / spacy-setfit-textcat
  ☆30Updated 2 years ago
• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆35Updated last month
• Kaleidophon / token2index
  A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …
  ☆51Updated 6 months ago
• orevaahia / magnet-tokenization
  ☆12Updated 6 months ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• MSR-LIT / XtremeDistil
  ☆16Updated 2 years ago
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆33Updated last year
• lukasgarbas / can-we-tune-together
  Combining encoder-based language models
  ☆11Updated 3 years ago
• huggingface / model_card
  ☆30Updated 3 years ago
• openredact / nerwhal
  This is a prototype of a multi-lingual suite for named-entity recognition in Python.
  ☆21Updated last year
• nelson-liu / lexical-semantic-recognition
  ☆17Updated 2 years ago
• domyounglee / TF-TrigramBlocking-transformer
  Transformer based Trigram Blocking implementation in Tensorflow
  ☆11Updated 5 years ago
• MilaNLProc / bertlang
  A web interface to understand language-specific BERT-models
  ☆18Updated last year
• UKPLab / eacl2024-lagonn
  Source code and data for Like a Good Nearest Neighbor
  ☆29Updated 5 months ago
• darrow-labs / LegalLens
  ☆8Updated 11 months ago
• megagonlabs / ruler
  Data Programming by Demonstration (DPBD) for Document Classification
  ☆35Updated 4 years ago
• facebookresearch / DataEfficientNLG
  NLG Best Practices for Data-Efficient Modeling How to Train Production-Ready Models with Little Data
  ☆10Updated 3 years ago
• lucy3 / whos_filtered
  ☆14Updated 8 months ago
• mayhewsw / pytorch-truecaser
  A simple neural truecaser written in pytorch and allennlp.
  ☆33Updated last year
• BramVanroy / spacy-extreme
  An example of how to use spaCy for extremely large files without running into memory issues
  ☆36Updated 2 years ago
• allenai / pybart
  Converter from UD-trees to BART representation
  ☆36Updated last year
• kpu / fasterText
  Library for fast text representation and classification.
  ☆30Updated last year
• facebookresearch / text_characterization_toolkit
  A library for computing diverse text characteristics and using them to analyze data sets and models with ease.
  ☆40Updated 2 years ago