Alternatives and similar repositories for tokenizers_intrinsic_benchmark

Users that are interested in tokenizers_intrinsic_benchmark are comparing it to the libraries listed below

• rtmdrr / testSignificanceNLP
  ☆230Updated 4 years ago
• antonisa / lang2vec
  A simple library for querying the URIEL typological database.
  ☆91Updated last year
• sileod / DiscSense
  Automated Semantic Analysis of Discourse Markers
  ☆10Updated 3 years ago
• feralvam / easse
  Easier Automatic Sentence Simplification Evaluation
  ☆162Updated 2 years ago
• neulab / awesome-align
  A neural word aligner based on multilingual BERT
  ☆358Updated 3 years ago
• disrpt / sharedtask2023
  Repository for DISRPT2023 shared task
  ☆17Updated last year
• jennhu / lm-pragmatics
  Code and data for "A fine-grained comparison of pragmatic language understanding in humans and language models"
  ☆11Updated 2 years ago
• alexwarstadt / blimp
  The Benchmark of Linguistic Minimal Pairs
  ☆155Updated 2 years ago
• UniversalAnaphora / UniversalAnaphora
  An initiative to collect and distribute resources for co-reference resolution in a unified standard.
  ☆25Updated last year
• shauryr / ACL-anthology-corpus
  This repository provides details and links to the ACL anthology corpus/collection including .bib, .pdf and grobid extractions of the pdfs
  ☆184Updated 2 years ago
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆379Updated last year
• aetting / lm-diagnostics
  Diagnostic tests for linguistic capacities in language models
  ☆65Updated 3 years ago
• gabrielStanovsky / mt_gender
  ☆55Updated 3 years ago
• kanishkamisra / minicons
  Utility for behavioral and representational analyses of Language Models
  ☆165Updated last month
• thompsonb / prism
  MT Evaluation in Many Languages via Zero-Shot Paraphrasing
  ☆102Updated last year
• AppraiseDev / Appraise
  Appraise code used as part of WMT21 human evaluation campaign
  ☆29Updated 3 weeks ago
• nschneid / nlp-in-ling
  Natural Language Processing Research in North American Linguistics Departments
  ☆20Updated 7 months ago
• chaojiang06 / wiki-auto
  Neural CRF Model for Sentence Alignment in Text Simplification
  ☆68Updated 9 months ago
• robertostling / eflomal
  Efficient Low-Memory Aligner
  ☆146Updated 9 months ago
• neulab / compare-mt
  A tool for holistic analysis of language generations systems
  ☆471Updated last month
• zouharvi / subset2evaluate
  Find informative examples to efficiently (human)-evaluate NLG models.
  ☆16Updated 3 weeks ago
• lena-voita / good-translation-wrong-in-context
  This is a repository with the data and code for the ACL 2019 paper "When a Good Translation is Wrong in Context: ..." and the EMNLP 2019 …
  ☆98Updated 5 years ago
• m-popovic / chrF
  a tool for calcualting character n-gram F score
  ☆74Updated 2 years ago
• rycolab / aclpub2
  ☆33Updated 2 months ago
• acl-org / ACLPUB
  The official tool for creating proceedings for conferences of the Association for Computational Linguistics (ACL).
  ☆239Updated 6 months ago
• goodmami / penman
  PENMAN notation (e.g. AMR) in Python
  ☆146Updated last year
• facebookresearch / Imppres
  This repository houses the IMPlicature and PRESupposition diagnostic dataset (IMPPRES), consisting of >25k semiautomatically generated se…
  ☆19Updated 4 years ago
• Samsung / LexSubGen
  Lexical Substitution Framework
  ☆46Updated 2 years ago
• neubig / util-scripts
  Various utility scripts useful for natural language processing, machine translation, etc.
  ☆49Updated 3 years ago
• thammegowda / mtdata
  A tool that locates, downloads, and extracts machine translation corpora
  ☆159Updated last month