Alternatives and similar repositories for fms-dgt

Users that are interested in fms-dgt are comparing it to the libraries listed below

• IBM / unitxt
  🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …
  ☆212Updated 2 weeks ago
• IBM / ACPBench
  ACPBench: Reasoning about Action, Change, and Planning
  ☆32Updated 2 months ago
• IBM / AISteer360
  The AI Steerability 360 toolkit is an extensible library for general purpose steering of LLMs.
  ☆76Updated 2 weeks ago
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆357Updated this week
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆140Updated 9 months ago
• snap-stanford / MLAgentBench
  ☆328Updated last year
• gblackout / LogicLLaMA
  Large language model and dataset for natural language to first-order logic translation
  ☆74Updated 2 years ago
• Saibo-creator / Awesome-LLM-Constrained-Decoding
  A curated list of papers related to constrained decoding of LLM, along with their relevant code and resources.
  ☆318Updated 2 weeks ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆169Updated last week
• IBM / TDD-Bench-Verified
  TDD-Bench-Verified is a new benchmark for generating test cases for test-driven development (TDD)
  ☆27Updated 4 months ago
• tatsu-lab / opinions_qa
  ☆117Updated last year
• allenai / asta-bench
  ☆69Updated 3 weeks ago
• princeton-nlp / intercode
  [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
  ☆240Updated last year
• berlino / grammar-prompting
  Grammar Prompting for Domain-Specific Language Generation with Large Language Models
  ☆75Updated 2 years ago
• Leolty / repobench
  ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024
  ☆186Updated last year
• IBM / eval-assist
  EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other la…
  ☆94Updated 2 months ago
• Tiiiger / benchmark_llm_summarization
  ☆44Updated 2 years ago
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆52Updated 10 months ago
• amazon-science / cceval
  CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)
  ☆170Updated 5 months ago
• foundation-model-stack / fms-hf-tuning
  🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
  ☆56Updated this week
• IINemo / lm-polygraph
  ☆432Updated this week
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆130Updated 4 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆224Updated last month
• gso-bench / gso
  [NeurIPS '25] GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents
  ☆63Updated this week
• Shangyint / langProBe
  ☆26Updated last week
• primeqa / primeqa
  The prime repository for state-of-the-art Multilingual Question Answering research and development.
  ☆740Updated 4 months ago
• epfl-dlab / transformers-CFG
  🤗 A specialized library for integrating context-free grammars (CFG) in EBNF with the Hugging Face Transformers
  ☆132Updated 3 weeks ago
• neubig / research-career-tools
  ☆165Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆227Updated last year
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆124Updated last year