Alternatives and similar repositories for Twikenizer

Users that are interested in Twikenizer are comparing it to the libraries listed below

• mayhewsw / multilingual-data-stats
  Statistics on multilingual datasets
  ☆17Updated 2 years ago
• melsherief / hate_speech_icwsm18
  ☆16Updated 7 years ago
• dallascard / NLP-power-analysis
  ☆39Updated 4 years ago
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 3 years ago
• timoschick / form-context-model
  This repository contains the code for the Form-Context Model and its Attentive Mimicking variant.
  ☆31Updated 5 years ago
• anthonywchen / MOCHA
  Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".
  ☆16Updated 3 years ago
• GChrysostomou / ood_faith
  ☆13Updated last year
• jwieting / paraphrastic-representations-at-scale
  ☆76Updated 3 years ago
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆21Updated 2 years ago
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 3 years ago
• danieldeutsch / qaeval
  ☆15Updated 3 years ago
• MilaNLProc / language-invariant-properties
  ☆22Updated 3 years ago
• UKPLab / linspector
  ☆24Updated 5 years ago
• AkshitaJha / NLP_CSS_2017
  ☆10Updated 6 years ago
• yanaiela / TNE
  codebase for the Text-based NP Enrichment (TNE) paper
  ☆20Updated last year
• alexwarstadt / data_generation
  ☆29Updated last year
• alecervi / Coherence-models-for-dialogue
  This is the repository for the Interspeech 2018 paper "Coherence models for dialogue".
  ☆19Updated 5 years ago
• BinWang28 / Sentence-Embedding-S3E
  Efficient Sentence Embedding via Semantic Subspace Analysis
  ☆14Updated 5 years ago
• nlp-stat-test / nlp-stat-test
  The NLPStatTest project
  ☆12Updated 3 years ago
• allenai / tailor
  ☆31Updated last year
• sophiaalthammer / parm
  This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' pu…
  ☆40Updated 3 years ago
• wjko2 / INQUISITIVE
  ☆17Updated 2 years ago
• pdufter / staticlama
  ☆13Updated 4 years ago
• dykang / xslue
  ACL 2021 paper "Style is NOT a single variable: Case Studies for Cross-Style Language Understanding " by Dongyeop Kang and Eduard Hovy
  ☆14Updated 3 years ago
• adalmia96 / Cluster-Analysis
  ☆54Updated 3 years ago
• ahmetustun / udapter
  UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…
  ☆31Updated 2 years ago
• davidheineman / thresh
  🌾 Universal, customizable and deployable fine-grained evaluation for text generation.
  ☆23Updated last year
• ethanachi / multilingual-probing-visualization
  Codebase for probing and visualizing multilingual models.
  ☆48Updated 5 years ago
• hjian42 / CommunityLM
  [COLING 2022]: CommunityLM: Probing Partisan Worldviews from Language Models
  ☆14Updated 2 years ago
• adapter-hub / hgiyt
  Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"
  ☆27Updated 3 years ago