Alternatives and similar repositories for tokka-bench

Users that are interested in tokka-bench are comparing it to the libraries listed below

• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆38Updated last year
• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated 2 years ago
• jxpress / setfit-pytorch-lightning
  ☆43Updated 2 years ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆65Updated 5 months ago
• alvarobartt / vertex-ai-huggingface-inference-toolkit
  🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)
  ☆17Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆102Updated last year
• hamelsmu / wandb-modal-webhook
  A webhook that integrates the W&B model registry with Modal Labs
  ☆15Updated last year
• stephantul / skeletoken
  Datamodels for hugging face tokenizers
  ☆77Updated 3 weeks ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆87Updated last month
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 8 months ago
• MayukaJ / LLM-Boost
  ☆16Updated 7 months ago
• perone / feste
  Feste is a free and open-source framework allowing scalable composition of NLP tasks using a graph execution model that is optimized and …
  ☆42Updated 2 years ago
• amazon-science / creating-and-correcting-novel-ml-model-errors
  ☆30Updated 3 years ago
• dm4ml / motion
  Framework for building and maintaining self-updating prompts for LLMs
  ☆64Updated last year
• koaning / scikit-partial
  Pipeline components that support partial_fit.
  ☆46Updated last year
• mrmps / ai-chunker
  Chunk your text using gpt4o-mini more accurately
  ☆44Updated last year
• rasbt / nn_plus_gzip
  Gzip and nearest neighbors for text classification
  ☆57Updated 2 years ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• maty-bohacek / xgboost-vs-gpt4
  Official Implementation of the 'When XGBoost Outperforms GPT-4 on Text Classification: A Case Study' NAACL-W 2024 paper
  ☆16Updated 10 months ago
• PyThaiNLP / MultiEL
  Multilingual Entity Linking model by BELA model
  ☆12Updated 2 years ago
• sametcopur / obliquetree
  obliquetree is an advanced decision tree implementation featuring oblique and axis-aligned splits, optimized performance.
  ☆21Updated 2 months ago
• CaglarAytekin / LEURN
  Official Repository for LEURN: Learning Explainable Univariate Rules with Neural Networks
  ☆34Updated last year
• MoritzLaurer / zeroshot-classifier
  Notebooks for training universal 0-shot classifiers on many different tasks
  ☆136Updated 9 months ago
• muellerzr / nbdistributed
  Seemless interface of using PyTOrch distributed with Jupyter notebooks
  ☆50Updated last month
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆61Updated 2 years ago
• AnswerDotAI / toolslm
  Tools to make language models a bit easier to use
  ☆54Updated 3 weeks ago
• pytest-visual / pytest-visual
  A pytest plugin to organize and track algorithm visualizations
  ☆17Updated 10 months ago
• PrithivirajDamodaran / Alt-ZSC
  Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP models…
  ☆37Updated 3 years ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆31Updated last year
• AnswerDotAI / playwrightnb
  Use sync mode Playwright interactively, inside a Jupyter notebook
  ☆15Updated 6 months ago