Alternatives and similar repositories for toxic-commons

Users that are interested in toxic-commons are comparing it to the libraries listed below

• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆24Updated last year
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆25Updated 7 months ago
• Pleias / marginalia
  ☆67Updated last year
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆62Updated 2 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆84Updated last month
• salesforce / simplification
  ☆22Updated 5 months ago
• UniversalNER / UniversalNER
  ☆27Updated 4 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆63Updated 2 months ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆30Updated last year
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆24Updated 7 months ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆54Updated last year
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆58Updated 2 months ago
• stefan-it / modern-bert-ner
  My NER Experiments with ModernBERT
  ☆21Updated 2 months ago
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated last year
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆48Updated last year
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆21Updated 2 weeks ago
• krangelie / bias-in-german-nlg
  Master thesis: Exploring bias in German NLG (GPT-3 & GerPT-2). Applies regard classification and bias mitigation triggers.
  ☆16Updated 9 months ago
• illuin-tech / contextual-embeddings
  Model implementation for the contextual embeddings project
  ☆33Updated last month
• ikergarcia1996 / T-Projection
  T-Projection is a method to perform high-quality Annotation Projection of Sequence Labeling datasets.
  ☆12Updated last year
• flipz357 / S3BERT
  Semantically Structured Sentence Embeddings
  ☆66Updated 9 months ago
• orevaahia / magnet-tokenization
  ☆12Updated 7 months ago
• lucy3 / whos_filtered
  ☆14Updated 9 months ago
• webis-de / lightning-ir
  One-stop shop for running and fine-tuning transformer-based language models for retrieval
  ☆57Updated this week
• jfkback / hypencoder-paper
  Official Repository for "Hypencoder: Hypernetworks for Information Retrieval"
  ☆26Updated 4 months ago
• UKPLab / eacl2024-lagonn
  Source code and data for Like a Good Nearest Neighbor
  ☆29Updated 6 months ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• lightonai / ducksearch
  Efficient BM25 with DuckDB 🦆
  ☆52Updated 6 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆59Updated 11 months ago
• JulesBelveze / concepcy
  💫 SpaCy wrapper for ConceptNet 💫
  ☆94Updated last year