Alternatives and similar repositories for arena

Users that are interested in arena are comparing it to the libraries listed below

• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated last year
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆186Updated last month
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆268Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆135Updated 6 months ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆196Updated 2 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆209Updated last week
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆24Updated 8 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆260Updated 7 months ago
• mixedbread-ai / mxbai-rerank
  Crispy reranking models by Mixedbread
  ☆34Updated 3 weeks ago
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆107Updated 4 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆59Updated last year
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆142Updated 3 weeks ago
• mixedbread-ai / maxsim-cpu
  ☆36Updated last month
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated 9 months ago
• IBM / unitxt
  🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …
  ☆206Updated this week
• oceanumeric / EnteRAG
  A RAG that can scale 🧑🏻‍💻
  ☆11Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 6 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆93Updated 8 months ago
• castorini / ragnarok
  Retrieval-Augmented Generation battle!
  ☆57Updated last week
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 7 months ago
• mungg / FABLES
  ☆57Updated 10 months ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆63Updated 2 months ago
• QuixiAI / spectrum
  ☆129Updated 4 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆131Updated last year
• chandar-lab / NeoBERT
  ☆79Updated 2 months ago
• unicamp-dl / InRanker
  ☆48Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• AnswerDotAI / fastkmeans
  ☆64Updated last month
• bminixhofer / tokenkit
  A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.
  ☆41Updated last month