Alternatives and similar repositories for arena

Users that are interested in arena are comparing it to the libraries listed below

• bminixhofer / tokenkit
  A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.
  ☆59Updated 5 months ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆67Updated 3 months ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated 2 months ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆189Updated 5 months ago
• mungg / FABLES
  ☆59Updated last year
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆71Updated last year
• QuixiAI / spectrum
  ☆138Updated 4 months ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• mixedbread-ai / maxsim-cpu
  ☆46Updated 5 months ago
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆67Updated 7 months ago
• AnswerDotAI / fastkmeans
  ☆90Updated 5 months ago
• Weyaxi / scrape-open-llm-leaderboard
  Scrape and export data from the Open LLM Leaderboard.
  ☆48Updated last year
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆201Updated 7 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 10 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆267Updated last year
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated last year
• allenai / infinigram-api
  ☆90Updated last week
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆142Updated 11 months ago
• Nicolas-BZRD / EuroBERT
  Optimus is a flexible and scalable framework built to train language models efficiently across diverse hardware configurations, including…
  ☆67Updated 3 weeks ago
• writer / writing-in-the-margins
  ☆120Updated last year
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆94Updated 3 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated last year
• mixedbread-ai / mxbai-rerank
  Crispy reranking models by Mixedbread
  ☆42Updated 3 months ago
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆154Updated 5 months ago
• McGill-NLP / CHASE
  Synthetic Data Generation for Evaluation
  ☆13Updated 10 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆278Updated last year
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆46Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆222Updated last week
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆46Updated last year
• LAGoM-NLP / transtokenizer
  ☆56Updated 11 months ago