Alternatives and similar repositories for eval-framework

Users that are interested in eval-framework are comparing it to the libraries listed below

• mt-upc / transformer-contributions
  Measuring the Mixing of Contextual Information in the Transformer
  ☆34Updated 2 years ago
• Cohere-Labs-Community / m-rewardbench
  Official Code for M-RᴇᴡᴀʀᴅBᴇɴᴄʜ: Evaluating Reward Models in Multilingual Settings (ACL 2025 Main)
  ☆40Updated 8 months ago
• konstantinjdobler / focus
  [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"
  ☆36Updated 8 months ago
• lukemelas / mtob
  ☆45Updated last year
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆60Updated last year
• simran-khanuja / awesome-cultural-nlp
  Resources for cultural NLP research
  ☆113Updated 4 months ago
• bjoernpl / GermanBenchmark
  A repository containing the code for translating popular LLM benchmarks to German.
  ☆31Updated 2 years ago
• kernelmachine / demix-data
  Benchmark API for Multidomain Language Modeling
  ☆25Updated 3 years ago
• esalesky / visrep
  This repository contains an extension of fairseq for pixel / visual representations of text for machine translation.
  ☆37Updated 2 years ago
• alexa / ramen
  A software for transferring pre-trained English models to foreign languages
  ☆19Updated 2 years ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆142Updated last year
• dadelani / sib-200
  SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects
  ☆23Updated last year
• masakhane-io / lafand-mt
  MAFAND-MT
  ☆60Updated last year
• cambridgeltl / composable-sft
  A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.
  ☆75Updated last year
• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆125Updated 3 months ago
• kojima-takeshi188 / lang_neuron
  ☆20Updated last year
• google-research / url-nlp
  ☆263Updated 6 months ago
• dadelani / africanlp-resources
  List of all the resources I developed in collaboration with LSV and Masakhane during my doctoral studies and beyond
  ☆12Updated 3 years ago
• mohsenfayyaz / GlobEnc
  [NAACL 2022] GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformers
  ☆21Updated 2 years ago
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆67Updated 3 years ago
• faridlazuarda / cultural-llm-papers
  A curated list of research papers and resources on Cultural LLM.
  ☆53Updated last year
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆87Updated last year
• ARBORproject / arborproject.github.io
  ☆83Updated 11 months ago
• gorokoba560 / norm-analysis-of-transformer
  ☆87Updated last year
• ThomasScialom / QuestEval
  ☆103Updated last year
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆107Updated last year
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆61Updated 6 months ago
• john-hewitt / truncation-sampling
  Codebase describing experiments in Truncation Sampling as Language Model Desmoothing
  ☆13Updated 3 years ago
• zouharvi / tokenization-scorer
  Simple-to-use scoring function for arbitrarily tokenized texts.
  ☆47Updated 11 months ago
• google-research / metricx
  ☆132Updated 2 weeks ago