Alternatives and similar repositories for Twikenizer:

Users that are interested in Twikenizer are comparing it to the libraries listed below

• mayhewsw / multilingual-data-stats
  Statistics on multilingual datasets
  ☆17Updated 2 years ago
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 3 years ago
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 2 years ago
• ahmetustun / udapter
  UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…
  ☆30Updated 2 years ago
• BinWang28 / Sentence-Embedding-S3E
  Efficient Sentence Embedding via Semantic Subspace Analysis
  ☆14Updated 5 years ago
• martiansideofthemoon / longeval-summarization
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆43Updated 7 months ago
• langtech-bsc / mt-evaluation
  A framework for evaluating Machine Translation models.
  ☆9Updated 3 weeks ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 4 years ago
• AkshitaJha / NLP_CSS_2017
  ☆10Updated 6 years ago
• adapter-hub / hgiyt
  Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"
  ☆26Updated 3 years ago
• utahnlp / x-fact
  Official Code and Data repository of our ACL 2021 paper X-FACT: A New Benchmark Dataset for Multilingual Fact Checking.
  ☆24Updated 5 months ago
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆21Updated last year
• GChrysostomou / ood_faith
  ☆13Updated last year
• aribornstein / CoRefi
  A embed able annotation tool for end to end cross document co-reference
  ☆42Updated 2 years ago
• iesl / stance
  Learned string similarity for entity names using optimal transport.
  ☆35Updated 4 years ago
• deep-spin / qaware-decode
  A repository for experiments in quality-aware decoding
  ☆15Updated 2 years ago
• flipz357 / S3BERT
  Semantically Structured Sentence Embeddings
  ☆65Updated 5 months ago
• HKUST-KnowComp / MLMA_hate_speech
  Dataset and code of our EMNLP 2019 paper "Multilingual and Multi-Aspect Hate Speech Analysis"
  ☆56Updated 4 months ago
• dallascard / NLP-power-analysis
  ☆38Updated 4 years ago
• MiuLab / GenDef
  Probing task; contextual embeddings -> textual definitions (EMNLP19)
  ☆11Updated 3 years ago
• ahoho / SentiVAE
  ☆16Updated 5 years ago
• UKPLab / linspector
  ☆24Updated 5 years ago
• MilaNLProc / language-invariant-properties
  ☆22Updated 3 years ago
• jhlau / acceptability_prediction
  Scripts and tools for doing unsupervised acceptability prediction.
  ☆15Updated 2 years ago
• hjian42 / CommunityLM
  [COLING 2022]: CommunityLM: Probing Partisan Worldviews from Language Models
  ☆13Updated 2 years ago
• ariecattan / SciCo
  Code for the paper SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts (AKBC 2021). https://openreview.net/forum?id=OF…
  ☆29Updated 3 years ago
• ethanachi / multilingual-probing-visualization
  Codebase for probing and visualizing multilingual models.
  ☆47Updated 4 years ago
• melsherief / hate_speech_icwsm18
  ☆17Updated 6 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆75Updated 3 years ago
• ivanmontero / autobot
  Implementation of the paper 'Sentence Bottleneck Autoencoders from Transformer Language Models'
  ☆17Updated 3 years ago