Alternatives and similar repositories for ludwig-benchmarking-toolkit

Users that are interested in ludwig-benchmarking-toolkit are comparing it to the libraries listed below

• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆35Updated last year
• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆36Updated 2 months ago
• benbo / interactive-weak-supervision
  Interactive Weak Supervision: Learning Useful Heuristics for Data Labeling
  ☆31Updated 4 years ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆79Updated 3 years ago
• CarperAI / CodeReviewSE
  Stuff related to scraping the Code Review StackExchange
  ☆12Updated 2 years ago
• r2llab / wrangl
  Parallel data preprocessing for NLP and ML.
  ☆34Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆49Updated 2 years ago
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆49Updated 2 years ago
• AI21Labs / lm-evaluation
  Evaluation suite for large-scale language models.
  ☆128Updated 4 years ago
• rajammanabrolu / Q-BERT
  Agents that build knowledge graphs and explore textual worlds by asking questions
  ☆79Updated 2 years ago
• petuum / tuun
  Hyperparameter tuning via uncertainty modeling
  ☆48Updated last year
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆44Updated last year
• JoaoLages / RATransformers
  RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!
  ☆42Updated 2 years ago
• facebookresearch / dynalab
  The Python library with command line tools to interact with Dynabench(https://dynabench.org/), such as uploading models.
  ☆55Updated 3 years ago
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 3 years ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• spyysalo / wiki-bert-pipeline
  Generate BERT vocabularies and pretraining examples from Wikipedias
  ☆17Updated 5 years ago
• HazyResearch / mandoline
  (ICML 2021) Mandoline: Model Evaluation under Distribution Shift
  ☆30Updated 4 years ago
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆33Updated 10 months ago
• RewardReports / reward-reports
  Documentation for dynamic machine learning systems.
  ☆29Updated last year
• huggingface / model_card
  ☆30Updated 4 years ago
• YilunZhou / ExSum
  Code repository for the NAACL 2022 paper "ExSum: From Local Explanations to Model Understanding"
  ☆64Updated 3 years ago
• EleutherAGI / summarisation
  The Intermediate Goal of the project is to train a GPT like architecture to learn to summarise reddit posts from human preferences, as th…
  ☆12Updated 4 years ago
• openreview / openreview-expertise
  Expertise modeling for the OpenReview matching system
  ☆41Updated this week
• CarperAI / InstructGPT
  For experiments involving instruct gpt. Currently used for documenting open research questions.
  ☆71Updated 3 years ago
• neubig / coderx
  A highly sophisticated sequence-to-sequence model for code generation
  ☆40Updated 4 years ago
• EleutherAI / semantic-memorization
  ☆44Updated last year
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 3 years ago
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆60Updated 3 years ago
• jxbz / entropix
  📰 Computing the information content of trained neural networks
  ☆22Updated 4 years ago