Alternatives and similar repositories for GibberishDetector:

Users that are interested in GibberishDetector are comparing it to the libraries listed below

• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated 2 years ago
• krandiash / gpt3-nli
  Training a model without a dataset for natural language inference (NLI)
  ☆25Updated 4 years ago
• SkBlaz / rakun2
  RaKUn 2.0 - A fast keyword detection algorithm
  ☆66Updated 3 weeks ago
• darrow-labs / LegalLens
  ☆8Updated 7 months ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆46Updated last year
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆33Updated 3 years ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• bhavsarpratik / semantic-search
  [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy mod…
  ☆15Updated last year
• UKPLab / eacl2024-lagonn
  Source code and data for Like a Good Nearest Neighbor
  ☆28Updated 2 months ago
• philschmid / optimum-static-quantization
  ☆28Updated last year
• jbesomi / fastlaw
  Fastlaw's purpose is to replace generic word embeddings for work on supervised machine learning NLP-tasks with legal texts.
  ☆37Updated 5 years ago
• guilhermemr04 / scaling-zero-shot-retrieval
  No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval
  ☆28Updated 2 years ago
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated 11 months ago
• ConiferLabsWA / flan-ul2-dolly
  ☆34Updated last year
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆46Updated last year
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆19Updated 5 months ago
• Avmb / inverse_scaling_prize_code_identifier_swap
  Submission to the inverse scaling prize
  ☆23Updated last year
• PrithivirajDamodaran / Alt-ZSC
  Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP models…
  ☆37Updated 2 years ago
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆32Updated 9 months ago
• revuel / PatternOmatic
  Finds linguistic patterns effortlessly
  ☆35Updated last year
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆60Updated last year
• facebookresearch / DataEfficientNLG
  NLG Best Practices for Data-Efficient Modeling How to Train Production-Ready Models with Little Data
  ☆10Updated 3 years ago
• cicl-iscl / CyberWallE-propaganda-detection
  Code for "CyberWallE at SemEval-2020 Task 11: An Analysis of Feature Engineering for Ensemble Models for Propaganda Detection" (V. Blasch…
  ☆9Updated 4 years ago
• huggingface / disaggregators
  🤗 Disaggregators: Curated data labelers for in-depth analysis.
  ☆65Updated 2 years ago
• ConiferLabsWA / flan-ul2-alpaca
  ☆32Updated last year
• epfl-dlab / GPTurk
  ☆29Updated last year
• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆35Updated last year
• loretoparisi / hf-experiments
  Experiments with Hugging Face 🔬 🤗
  ☆44Updated 6 months ago
• qdrant / quaterion-models
  The collection of bulding blocks building fine-tunable metric learning models
  ☆32Updated 2 months ago
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆31Updated last year