Alternatives and similar repositories for arena

Users that are interested in arena are comparing it to the libraries listed below

• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆71Updated last year
• bminixhofer / tokenkit
  A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.
  ☆58Updated 5 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆278Updated last year
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆189Updated 5 months ago
• mungg / FABLES
  ☆58Updated last year
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated last month
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 10 months ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆67Updated 2 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆102Updated last year
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆64Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆265Updated last year
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆201Updated 7 months ago
• AnswerDotAI / fastkmeans
  ☆89Updated 5 months ago
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆154Updated 5 months ago
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆46Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆221Updated this week
• writer / writing-in-the-margins
  ☆120Updated last year
• QuixiAI / spectrum
  ☆138Updated 4 months ago
• McGill-NLP / CHASE
  Synthetic Data Generation for Evaluation
  ☆13Updated 10 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆142Updated 11 months ago
• mixedbread-ai / mxbai-rerank
  Crispy reranking models by Mixedbread
  ☆42Updated 3 months ago
• marzenakrp / nocha
  ☆53Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated last year
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆89Updated 7 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• Weyaxi / scrape-open-llm-leaderboard
  Scrape and export data from the Open LLM Leaderboard.
  ☆48Updated last year
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆230Updated 3 months ago
• huggingface / fineweb-2
  ☆212Updated last month