Alternatives and similar repositories for toxic-commons:

Users that are interested in toxic-commons are comparing it to the libraries listed below

• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆22Updated last month
• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆21Updated 10 months ago
• salesforce / simplification
  ☆21Updated last year
• ikergarcia1996 / T-Projection
  T-Projection is a method to perform high-quality Annotation Projection of Sequence Labeling datasets.
  ☆11Updated last year
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆34Updated this week
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆17Updated 3 months ago
• Knowledgator / utca
  Versatile framework designed to streamline the integration of your models, as well as those sourced from Hugging Face, into complex progr…
  ☆26Updated 3 weeks ago
• thakur-nandan / income
  INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.
  ☆22Updated last year
• flairNLP / CleanCoNLL
  The CleanCoNLL dataset from our EMNLP 2023 paper where we corrected annotation errors and inconsistencies in CoNLL-03.
  ☆22Updated 6 months ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆28Updated last year
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated last month
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆56Updated 5 months ago
• stefan-it / modern-bert-ner
  My NER Experiments with ModernBERT
  ☆15Updated last week
• paulrinckens / timexy
  A spaCy custom component that extracts and normalizes temporal expressions
  ☆52Updated last year
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆42Updated 11 months ago
• UKPLab / eacl2024-lagonn
  Source code and data for Like a Good Nearest Neighbor
  ☆28Updated last week
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆45Updated last year
• argilla-io / adept-augmentations
  A Python library aimed at dissecting and augmenting NER training data.
  ☆57Updated last year
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated last year
• bltlab / paranames
  ParaNames: A multilingual resource for parallel names
  ☆30Updated 7 months ago
• cisnlp / GlotCC
  GlotCC Dataset and Pipline -- NeurIPS 2024
  ☆17Updated 2 months ago
• lucy3 / whos_filtered
  ☆14Updated 3 months ago
• NorskRegnesentral / NeuralTextSanitizer
  Neural models for detecting and masking personal information from texts
  ☆15Updated 2 years ago
• wjbmattingly / hobbit-spacy
  ☆23Updated last year
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆24Updated 9 months ago
• Pleias / marginalia
  ☆67Updated 10 months ago
• opinionscience / BERTransfer
  A BERT-based application for reusable text classification at scale
  ☆37Updated last year
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated last year
• gautierdag / tokenizer-bench
  Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"
  ☆14Updated 11 months ago
• thakur-nandan / sprint
  SPRINT Toolkit helps you evaluate diverse neural sparse models easily using a single click on any IR dataset.
  ☆43Updated last year