Alternatives and similar repositories for toxic-commons

Users that are interested in toxic-commons are comparing it to the libraries listed below

• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆25Updated last year
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆27Updated 11 months ago
• Pleias / marginalia
  ☆67Updated last year
• webis-de / lightning-ir
  One-stop shop for running and fine-tuning transformer-based language models for retrieval
  ☆59Updated this week
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆59Updated last year
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆22Updated 4 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆89Updated 2 months ago
• bigscience-workshop / lam
  Libraries, Archives and Museums (LAM)
  ☆87Updated 3 years ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆64Updated 6 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆62Updated last year
• stefan-it / modern-bert-ner
  My NER Experiments with ModernBERT and Ettin
  ☆22Updated 3 months ago
• salesforce / simplification
  ☆22Updated 9 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆65Updated 5 months ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• KennethEnevoldsen / augmenty
  Augmenty is an augmentation library based on spaCy for augmenting texts.
  ☆156Updated last year
• kpu / fasterText
  Library for fast text representation and classification.
  ☆31Updated last year
• neuml / staticvectors
  🔢 Work with static vector models
  ☆31Updated 6 months ago
• chandar-lab / NeoBERT
  ☆87Updated 5 months ago
• davidberenstein1957 / spacy-setfit
  This repository contains an easy and intuitive approach to use SetFit in combination with spaCy.
  ☆80Updated 2 years ago
• UKPLab / eacl2024-lagonn
  Source code and data for Like a Good Nearest Neighbor
  ☆30Updated 9 months ago
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated 11 months ago
• SkBlaz / rakun2
  RaKUn 2.0 - A fast keyword detection algorithm
  ☆68Updated 3 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆69Updated last year
• jfkback / hypencoder-paper
  Official Repository for "Hypencoder: Hypernetworks for Information Retrieval"
  ☆31Updated last month
• cisnlp / GlotWeb
  🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.
  ☆15Updated 2 months ago
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆53Updated 3 months ago
• opinionscience / BERTransfer
  A BERT-based application for reusable text classification at scale
  ☆38Updated 2 years ago
• illuin-tech / contextual-embeddings
  Model implementation for the contextual embeddings project
  ☆36Updated 5 months ago
• Babelscape / wikineural
  Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2…
  ☆69Updated 2 years ago
• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆86Updated 3 weeks ago