Alternatives and similar repositories for arena

Users that are interested in arena are comparing it to the libraries listed below

• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆270Updated last year
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆197Updated 3 months ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated last year
• mungg / FABLES
  ☆57Updated 11 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆135Updated 7 months ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆186Updated last month
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated 10 months ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆63Updated 3 weeks ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• QuixiAI / spectrum
  ☆134Updated last week
• Weyaxi / scrape-open-llm-leaderboard
  Scrape and export data from the Open LLM Leaderboard.
  ☆45Updated 8 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆214Updated last month
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆65Updated last year
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 8 months ago
• AnswerDotAI / fastkmeans
  ☆68Updated last month
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆96Updated 9 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 6 months ago
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆143Updated last month
• IBM / unitxt
  🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …
  ☆206Updated last week
• mixedbread-ai / maxsim-cpu
  ☆39Updated last month
• SALT-NLP / demonstrated-feedback
  ☆127Updated 11 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆210Updated 3 months ago
• bminixhofer / tokenkit
  A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.
  ☆44Updated last month
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆24Updated 9 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆85Updated 3 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆262Updated 8 months ago
• DunZhang / Stella
  ☆62Updated last year
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆132Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆160Updated last year