Alternatives and similar repositories for web-languages:

Users that are interested in web-languages are comparing it to the libraries listed below

• laurieburchell / open-lid-dataset
  Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)
  ☆69Updated 8 months ago
• cisnlp / GlotLID
  Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆110Updated last month
• bigscience-workshop / lam
  Libraries, Archives and Museums (LAM)
  ☆82Updated 2 years ago
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆50Updated this week
• mbanon / fastspell
  Targetted language identifier, based on FastText and Hunspell.
  ☆33Updated 2 months ago
• timpal0l / ScandiSent
  Sentiment Corpus for Swedish 🇸🇪 Norwegian 🇳🇴 Danish 🇩🇰 Finnish 🇫🇮 (and English 🏴󠁧󠁢󠁥󠁮󠁧󠁿)
  ☆15Updated 3 years ago
• explosion / spacy-huggingface-pipelines
  💥 Use Hugging Face text and token classification pipelines directly in spaCy
  ☆63Updated 10 months ago
• bltlab / paranames
  ParaNames: A multilingual resource for parallel names
  ☆30Updated 8 months ago
• cisnlp / GlotScript
  Resource and Tool for Writing System Identification -- LREC 2024
  ☆13Updated 7 months ago
• opinionscience / BERTransfer
  A BERT-based application for reusable text classification at scale
  ☆37Updated last year
• vinid / cade
  Compass-aligned Distributional Embeddings. Align embeddings from different corpora
  ☆39Updated 2 years ago
• r-three / common-pile
  Repo to hold code and track issues for the collection of permissively licensed data
  ☆22Updated last month
• mhulden / pyfoma
  Python Finite-State Toolkit
  ☆47Updated last week
• UBC-NLP / afrolid
  AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.
  ☆30Updated last year
• johko / awesome-german-open-source-ml
  A list of awesome open source projects in the machine learning field, who's developers are mainly based in Germany
  ☆42Updated 4 months ago
• wjbmattingly / spacyex
  SpaCyEx allows the creation of spaCy Matcher patterns with RegEx like syntax.
  ☆58Updated 8 months ago
• MilaNLProc / simple-generation
  A python package to run inference with HuggingFace language and vision-language checkpoints wrapping many convenient features.
  ☆25Updated 4 months ago
• Lucaterre / spacyfishing
  A spaCy wrapper of Entity-Fishing (component) for named entity disambiguation and linking on Wikidata
  ☆156Updated 2 years ago
• divkakwani / awesome-newspapers
  A Directory of Online Newspaper Sources for 70+ Languages
  ☆32Updated 3 years ago
• virtualvinodh / aksharamukha-python
  Aksharamukha Python Library
  ☆44Updated 3 months ago
• UB-Mannheim / spacyopentapioca
  A spaCy wrapper of OpenTapioca for named entity linking on Wikidata
  ☆93Updated last year
• MilaNLProc / honest
  A Python package to compute HONEST, a score to measure hurtful sentence completions in language models. Published at NAACL 2021.
  ☆21Updated 2 years ago
• ScandEval / ScandEval
  Evaluation of language models on mono- or multilingual tasks.
  ☆76Updated this week
• KennethEnevoldsen / spacy-wrap
  spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your spaCy pipeline allowing you to i…
  ☆46Updated 9 months ago
• wjbmattingly / LeetTopic
  ☆54Updated last year
• Babelscape / wikineural
  Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2…
  ☆66Updated last year
• DavidNemeskey / cc_corpus
  Tools for compiling corpora from Common Crawl
  ☆13Updated last month
• mitramir55 / PassivePy
  PassivePy: A Tool to Automatically Identify Passive Voice in Big Text Data
  ☆18Updated 10 months ago
• flairNLP / CleanCoNLL
  The CleanCoNLL dataset from our EMNLP 2023 paper where we corrected annotation errors and inconsistencies in CoNLL-03.
  ☆22Updated 6 months ago