Alternatives and similar repositories for COBOLEval

Users that are interested in COBOLEval are comparing it to the libraries listed below

• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆129Updated 7 months ago
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆76Updated 11 months ago
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆46Updated last year
• NL2Code / CodeM
  ☆44Updated last year
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆125Updated last week
• mkuchnik / relm
  ReLM is a Regular Expression engine for Language Models
  ☆107Updated 2 years ago
• FSoft-AI4Code / RepoHyper
  [FORGE 2025] Graph-based method for end-to-end code completion with context awareness on repository
  ☆66Updated last year
• microsoft / eureka-ml-insights
  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
  ☆171Updated last week
• ibm-granite / granite-3.0-language-models
  ☆268Updated 4 months ago
• LAION-AI / AIW
  Alice in Wonderland code base for experiments and raw experiments data
  ☆131Updated 2 months ago
• rhyang2021 / SELFGOAL
  Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".
  ☆70Updated last year
• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆79Updated 10 months ago
• microsoft / EvoPrompt
  Automatic Prompt Optimization
  ☆46Updated last year
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆43Updated 2 years ago
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆213Updated this week
• lancedb / ragged
  ☆21Updated last year
• gangiswag / cornstack
  ☆41Updated 4 months ago
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆66Updated 2 years ago
• FSoft-AI4Code / XMainframe
  Language Model for Mainframe Modernization
  ☆60Updated last year
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆55Updated last year
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆62Updated 2 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆105Updated 7 months ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated last year
• axolotl-ai-cloud / axolotl-cookbook
  ☆36Updated 3 months ago
• SalesforceAIResearch / perfcodegen
  ☆43Updated last week
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆120Updated last month
• zeno-ml / zeno-hub
  AI Evaluation Platform
  ☆46Updated 5 months ago
• llmco / llamaapi-python
  ☆93Updated 2 years ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆113Updated 7 months ago
• guidance-ai / jsonschemabench
  ☆67Updated 5 months ago