Alternatives and similar repositories for Twikenizer:

Users that are interested in Twikenizer are comparing it to the libraries listed below

• mayhewsw / multilingual-data-stats
  Statistics on multilingual datasets
  ☆17Updated 2 years ago
• flipz357 / S3BERT
  Semantically Structured Sentence Embeddings
  ☆65Updated 4 months ago
• danieldeutsch / qaeval
  ☆15Updated 3 years ago
• UKPLab / linspector
  ☆24Updated 5 years ago
• dykang / PASTEL
  Data and code for Kang et al., EMNLP 2019's paper titled "(Male, Bachelor) and (Female, Ph.D) have different connotations: Parallelly Ann…
  ☆29Updated 4 years ago
• timoschick / form-context-model
  This repository contains the code for the Form-Context Model and its Attentive Mimicking variant.
  ☆31Updated 4 years ago
• dmg-illc / JUDGE-BENCH
  ☆24Updated 2 months ago
• ethanachi / multilingual-probing-visualization
  Codebase for probing and visualizing multilingual models.
  ☆47Updated 4 years ago
• anthonywchen / MOCHA
  Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".
  ☆16Updated 2 years ago
• AkshitaJha / NLP_CSS_2017
  ☆10Updated 6 years ago
• adapter-hub / hgiyt
  Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"
  ☆26Updated 3 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆74Updated 3 years ago
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 2 years ago
• nelson-liu / lexical-semantic-recognition
  ☆17Updated last year
• MiuLab / GenDef
  Probing task; contextual embeddings -> textual definitions (EMNLP19)
  ☆11Updated 3 years ago
• wjko2 / INQUISITIVE
  ☆17Updated last year
• shrutirij / soft-gazetteers
  Code and data for the paper "Soft Gazetteers for Low-resource Named Entity Recognition"
  ☆19Updated 4 years ago
• martiansideofthemoon / longeval-summarization
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆43Updated 6 months ago
• aribornstein / CoRefi
  A embed able annotation tool for end to end cross document co-reference
  ☆41Updated last year
• MilaNLProc / language-invariant-properties
  ☆22Updated 2 years ago
• ahmetustun / udapter
  UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…
  ☆30Updated 2 years ago
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 2 years ago
• google-research-datasets / MultiReQA
  We are creating a challenging new benchmark MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Models. Retrieval quest…
  ☆31Updated 4 years ago
• alecervi / Coherence-models-for-dialogue
  This is the repository for the Interspeech 2018 paper "Coherence models for dialogue".
  ☆19Updated 5 years ago
• BinWang28 / Sentence-Embedding-S3E
  Efficient Sentence Embedding via Semantic Subspace Analysis
  ☆14Updated 5 years ago
• ivanmontero / autobot
  Implementation of the paper 'Sentence Bottleneck Autoencoders from Transformer Language Models'
  ☆17Updated 2 years ago
• nlp-stat-test / nlp-stat-test
  The NLPStatTest project
  ☆12Updated 2 years ago
• dykang / xslue
  ACL 2021 paper "Style is NOT a single variable: Case Studies for Cross-Style Language Understanding " by Dongyeop Kang and Eduard Hovy
  ☆13Updated 3 years ago
• GChrysostomou / ood_faith
  ☆13Updated last year
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 4 years ago