Alternatives and similar repositories for COBOLEval

Users that are interested in COBOLEval are comparing it to the libraries listed below

• FSoft-AI4Code / XMainframe
  Language Model for Mainframe Modernization
  ☆65Updated last year
• mkuchnik / relm
  ReLM is a Regular Expression engine for Language Models
  ☆107Updated 2 years ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆183Updated last week
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆76Updated last year
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆80Updated last year
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆47Updated 2 years ago
• FSoft-AI4Code / RepoHyper
  [FORGE 2025] Graph-based method for end-to-end code completion with context awareness on repository
  ☆71Updated last year
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆82Updated last year
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆78Updated last year
• asappresearch / webagents-step
  ☆41Updated last year
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆66Updated 2 years ago
• rhyang2021 / SELFGOAL
  Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".
  ☆69Updated last year
• microsoft / CodePlan
  Data and evaluation scripts for "CodePlan: Repository-level Coding using LLMs and Planning", FSE 2024
  ☆80Updated last year
• luohongyin / LangCode
  LangCode - Improving alignment and reasoning of large language models (LLMs) with natural language embedded program (NLEP).
  ☆48Updated 2 years ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆129Updated 2 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆114Updated 9 months ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆103Updated 5 months ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆90Updated last month
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆127Updated 3 months ago
• gangiswag / cornstack
  ☆44Updated 7 months ago
• guidance-ai / jsonschemabench
  ☆75Updated 7 months ago
• CarperAI / Code-Pile
  This repository contains all the code for collecting large scale amounts of code from GitHub.
  ☆110Updated 2 years ago
• grounded-ai / grounded_ai
  ☆13Updated 3 weeks ago
• vaughanlove / PromptBreeder
  Google Deepmind's PromptBreeder for automated prompt engineering implemented in langchain expression language.
  ☆163Updated last year
• axolotl-ai-cloud / axolotl-cookbook
  ☆38Updated 5 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆94Updated 4 months ago
• IsaacRe / Syntactically-Constrained-Sampling
  LLM sampling method for enforcing syntax adherence in generated output
  ☆25Updated 2 years ago
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆57Updated last year
• NL2Code / CodeM
  ☆44Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago