Alternatives and similar repositories for fms-dgt:

Users that are interested in fms-dgt are comparing it to the libraries listed below

• IBM / unitxt
  🦄 Unitxt: a python library for getting data fired up and set for training and evaluation
  ☆182Updated this week
• IBM / TDD-Bench-Verified
  TDD-Bench-Verified is a new benchmark for generating test cases for test-driven development (TDD)
  ☆14Updated last month
• Zhiyuan-Zeng / EvalTree
  [arXiv] EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Trees
  ☆13Updated 3 weeks ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆65Updated 4 months ago
• foundation-model-stack / fms-hf-tuning
  🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
  ☆38Updated last week
• snap-stanford / MLAgentBench
  ☆284Updated 9 months ago
• VectorInstitute / vector-inference
  Efficient LLM inference on Slurm clusters using vLLM.
  ☆53Updated this week
• asaparov / prontoqa
  Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
  ☆141Updated 5 months ago
• vinid / NegotiationArena
  ☆68Updated last year
• primeqa / primeqa
  The prime repository for state-of-the-art Multilingual Question Answering research and development.
  ☆733Updated 2 months ago
• joshuacnf / paradox-learning2reason
  ☆33Updated 3 months ago
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆39Updated 5 months ago
• berlino / grammar-prompting
  Grammar Prompting for Domain-Specific Language Generation with Large Language Models
  ☆65Updated last year
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆103Updated last year
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆157Updated 10 months ago
• amazon-science / street-reasoning
  STREET: a multi-task and multi-step reasoning dataset
  ☆22Updated last year
• tatsu-lab / opinions_qa
  ☆104Updated 11 months ago
• Tiiiger / benchmark_llm_summarization
  ☆39Updated 2 years ago
• IBM / commonsense-rl
  Knowledge-Aware RL agents with Commonsense Reasoning
  ☆77Updated 3 years ago
• allenai / discoveryworld
  A virtual environment for developing and evaluating automated scientific discovery agents.
  ☆140Updated 3 weeks ago
• ronentk / dbca-splitter
  Independent implementation of DBCA method from http://arxiv.org/abs/1912.09713
  ☆11Updated 4 years ago
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆47Updated last year
• spike-imperial / FastLAS
  ☆19Updated last month
• balevinstein / Probes
  ☆47Updated last year
• epfl-dlab / GCD
  ☆33Updated 3 weeks ago
• DeepGraphLearning / InductiveQE
  Official implementation of Inductive Logical Query Answering in Knowledge Graphs (NeurIPS 2022)
  ☆48Updated 2 years ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆111Updated last week
• linlu-qiu / lm-inductive-reasoning
  ☆34Updated last year
• IBM / kgi-slot-filling
  This is the code for our KILT leaderboard submissions (KGI + Re2G models).
  ☆153Updated last year
• nyu-mll / quality
  ☆129Updated 2 months ago