Alternatives and similar repositories for COBOLEval

Users that are interested in COBOLEval are comparing it to the libraries listed below

• katsumiok / pyaskit
  AskIt: Unified programming interface for programming with LLMs (GPT-3.5, GPT-4, Gemini, Claude, Cohere, Llama 2)
  ☆79Updated 11 months ago
• mkuchnik / relm
  ReLM is a Regular Expression engine for Language Models
  ☆107Updated 2 years ago
• FSoft-AI4Code / XMainframe
  Language Model for Mainframe Modernization
  ☆62Updated last year
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆46Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆143Updated 8 months ago
• normal-computing / extended-mind-transformers
  ☆124Updated last year
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆76Updated last year
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆66Updated 2 years ago
• lancedb / ragged
  ☆21Updated last year
• microsoft / EvoPrompt
  Automatic Prompt Optimization
  ☆48Updated last year
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆43Updated 2 years ago
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆81Updated 11 months ago
• vl2g / floco
  Flow Chart Image-to-Code Generation
  ☆35Updated 2 years ago
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆122Updated 2 months ago
• parkervg / blendsql
  Query language for blending SQL and LLMs across structured + unstructured data, with type constraints.
  ☆121Updated this week
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆173Updated 7 months ago
• MinhxLe / subliminal-learning
  ☆104Updated 4 months ago
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆47Updated 2 years ago
• FSoft-AI4Code / RepoHyper
  [FORGE 2025] Graph-based method for end-to-end code completion with context awareness on repository
  ☆68Updated last year
• llmco / llamaapi-python
  ☆93Updated 2 years ago
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆81Updated 9 months ago
• guidance-ai / jsonschemabench
  ☆67Updated 5 months ago
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆223Updated 3 weeks ago
• ibm-granite / granite-3.0-language-models
  ☆266Updated 5 months ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆126Updated last month
• davidberenstein1957 / dataset-viber
  Dataset Viber is your chill repo for data collection, annotation and vibe checks.
  ☆45Updated last year
• grounded-ai / grounded_ai
  ☆12Updated 2 months ago
• ThrunGroup / maptree
  ☆40Updated 2 years ago
• ruvnet / symbolic-scribe
  ☆80Updated last year