Alternatives and similar repositories for toxic-commons

Users that are interested in toxic-commons are comparing it to the libraries listed below

• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆25Updated last year
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆25Updated 8 months ago
• webis-de / lightning-ir
  One-stop shop for running and fine-tuning transformer-based language models for retrieval
  ☆57Updated this week
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆59Updated last year
• jfkback / hypencoder-paper
  Official Repository for "Hypencoder: Hypernetworks for Information Retrieval"
  ☆27Updated 5 months ago
• Pleias / marginalia
  ☆67Updated last year
• cisnlp / GlotWeb
  🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.
  ☆14Updated 4 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆85Updated 2 months ago
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆56Updated last year
• LAGoM-NLP / transtokenizer
  ☆51Updated 6 months ago
• neuml / staticvectors
  🔢 Work with static vector models
  ☆29Updated 3 months ago
• AmenRa / indxr
  A Python utility for indexing file lines. Best demo honourable mention at ECIR 2024.
  ☆23Updated last year
• flipz357 / S3BERT
  Semantically Structured Sentence Embeddings
  ☆66Updated 9 months ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆147Updated 2 months ago
• PyThaiNLP / MultiEL
  Multilingual Entity Linking model by BELA model
  ☆12Updated 2 years ago
• chandar-lab / NeoBERT
  ☆79Updated 2 months ago
• UniversalNER / UniversalNER
  ☆27Updated 5 months ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆31Updated last year
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆61Updated 3 months ago
• tigerchen52 / GLADIS
  GLADIS: A General and Large Acronym Disambiguation Benchmark (EACL 23)
  ☆17Updated last year
• bigscience-workshop / lam
  Libraries, Archives and Museums (LAM)
  ☆85Updated 2 years ago
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆82Updated 11 months ago
• salesforce / simplification
  ☆22Updated 6 months ago
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆21Updated last month
• bltlab / paranames
  ParaNames: A multilingual resource for parallel names
  ☆34Updated last year
• KennethEnevoldsen / augmenty
  Augmenty is an augmentation library based on spaCy for augmenting texts.
  ☆156Updated last year
• opinionscience / BERTransfer
  A BERT-based application for reusable text classification at scale
  ☆38Updated 2 years ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆63Updated 2 months ago
• Babelscape / multinerd
  Repository for the paper "MultiNERD: A Multilingual, Multi-Genre and Fine-Grained Dataset for Named Entity Recognition (and Disambiguatio…
  ☆44Updated last year