Alternatives and similar repositories for curated-tokenizers:

Users that are interested in curated-tokenizers are comparing it to the libraries listed below

• kpu / fasterText
  Library for fast text representation and classification.
  ☆28Updated last year
• MantisAI / sieves
  NLP tasks with zero- and few-shot models.
  ☆14Updated this week
• KennethEnevoldsen / spacy-wrap
  spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your spaCy pipeline allowing you to i…
  ☆46Updated 11 months ago
• argilla-io / adept-augmentations
  A Python library aimed at dissecting and augmenting NER training data.
  ☆58Updated last year
• mariosasko / datasets_sql
  Execute arbitrary SQL queries on 🤗 Datasets
  ☆32Updated last year
• paulrinckens / timexy
  A spaCy custom component that extracts and normalizes temporal expressions
  ☆54Updated 2 years ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆24Updated 4 months ago
• dhfbk / KIND
  KIND: an Italian Multi-Domain Dataset for Named Entity Recognition
  ☆15Updated last year
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆18Updated last month
• tigerchen52 / GLADIS
  GLADIS: A General and Large Acronym Disambiguation Benchmark (EACL 23)
  ☆15Updated 9 months ago
• bltlab / mot
  Multilingual Open Text
  ☆25Updated 5 months ago
• nreimers / se-pytorch-xla
  ☆21Updated 3 years ago
• BramVanroy / astred
  An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…
  ☆22Updated 3 years ago
• machamp-nlp / machamp
  Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/
  ☆84Updated 3 weeks ago
• neulab / cmulab
  CMU Linguistic Annotation Backend
  ☆15Updated 11 months ago
• UniversalNER / UniversalNER
  ☆26Updated last month
• marian-nmt / sotastream
  A library for data streaming and augmentation
  ☆20Updated last year
• explosion / spacy-experimental
  🧪 Cutting-edge experimental spaCy components and features
  ☆98Updated 11 months ago
• malteos / clp-transfer
  Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning
  ☆30Updated 2 years ago
• gautierdag / tokenizer-bench
  Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"
  ☆16Updated last year
• explosion / spacy-curated-transformers
  spaCy entry points for Curated Transformers
  ☆27Updated 6 months ago
• KennethEnevoldsen / augmenty
  Augmenty is an augmentation library based on spaCy for augmenting texts.
  ☆151Updated 10 months ago
• salesforce / simplification
  ☆21Updated 2 months ago
• katzurik / NERetrieve
  ☆28Updated last year
• writer / replaCy
  spaCy match and replace, maintaining conjugation
  ☆35Updated 2 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 6 months ago
• MartinoMensio / spacy-sentence-bert
  Sentence transformers models for SpaCy
  ☆107Updated 2 years ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆51Updated 3 weeks ago
• flairNLP / CleanCoNLL
  The CleanCoNLL dataset from our EMNLP 2023 paper where we corrected annotation errors and inconsistencies in CoNLL-03.
  ☆23Updated 8 months ago