Alternatives and similar repositories for toxic-commons:

Users that are interested in toxic-commons are comparing it to the libraries listed below

• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆21Updated last year
• UniversalNER / UniversalNER
  ☆27Updated 2 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆59Updated 3 weeks ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆24Updated 5 months ago
• chandar-lab / NeoBERT
  ☆49Updated 2 months ago
• jfkback / hypencoder-paper
  Official Repository for "Hypencoder: Hypernetworks for Information Retrieval"
  ☆24Updated 2 months ago
• salesforce / simplification
  ☆22Updated 3 months ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆59Updated 9 months ago
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆19Updated 3 months ago
• Pleias / marginalia
  ☆67Updated last year
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated 5 months ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆28Updated last year
• opinionscience / BERTransfer
  A BERT-based application for reusable text classification at scale
  ☆38Updated last year
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆47Updated this week
• webis-de / summary-workbench
  Framework for unified summarisation and evaluation of English documents using state-of-the-art models and measures.
  ☆32Updated 11 months ago
• liujch1998 / infini-gram
  ☆37Updated this week
• thakur-nandan / income
  INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.
  ☆24Updated last year
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆31Updated last year
• PyThaiNLP / MultiEL
  Multilingual Entity Linking model by BELA model
  ☆12Updated last year
• x-tabdeveloping / turftopic
  Robust and fast topic models with sentence-transformers.
  ☆48Updated this week
• weaviate / biggraph-wikidata-search-with-weaviate
  Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine
  ☆31Updated 3 years ago
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆51Updated last year
• stefan-it / modern-bert-ner
  My NER Experiments with ModernBERT
  ☆21Updated 4 months ago
• argilla-io / adept-augmentations
  A Python library aimed at dissecting and augmenting NER training data.
  ☆58Updated 2 years ago
• LeonardoEmili / Wikifier
  Pytorch implementation of a BiLSTM model for the Wikification project.
  ☆19Updated 5 years ago
• Leukas / CUTE
  ☆13Updated 2 weeks ago
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated last year
• guilhermemr04 / scaling-zero-shot-retrieval
  No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval
  ☆29Updated 2 years ago
• UKPLab / eacl2024-lagonn
  Source code and data for Like a Good Nearest Neighbor
  ☆28Updated 3 months ago