Alternatives and similar repositories for COBOLEval

Users that are interested in COBOLEval are comparing it to the libraries listed below

• mkuchnik / relm
  ReLM is a Regular Expression engine for Language Models
  ☆106Updated 2 years ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆118Updated 3 months ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆61Updated 2 weeks ago
• FSoft-AI4Code / XMainframe
  Language Model for Mainframe Modernization
  ☆58Updated last year
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆166Updated 5 months ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆115Updated 6 months ago
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆75Updated 11 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆110Updated 9 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆111Updated 5 months ago
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆47Updated last year
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆86Updated 3 weeks ago
• FSoft-AI4Code / RepoHyper
  [FORGE 2025] Graph-based method for end-to-end code completion with context awareness on repository
  ☆66Updated last year
• guidance-ai / jsonschemabench
  ☆61Updated 3 months ago
• epoch-research / training-cost-trends
  ☆19Updated last month
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆55Updated last year
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆118Updated 2 weeks ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 8 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆86Updated 3 weeks ago
• IBM / unitxt
  🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …
  ☆210Updated this week
• muellerzr / nbdistributed
  Seemless interface of using PyTOrch distributed with Jupyter notebooks
  ☆50Updated 3 weeks ago
• gangiswag / cornstack
  ☆40Updated 3 months ago
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆75Updated 10 months ago
• vaughanlove / PromptBreeder
  Google Deepmind's PromptBreeder for automated prompt engineering implemented in langchain expression language.
  ☆147Updated last year
• parkervg / blendsql
  Query language for blending SQL and LLMs across structured + unstructured data, with type constraints.
  ☆114Updated this week
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆50Updated last year
• jmanhype / Golden-Retriever
  A framework for high-fidelity retrieval augmented generation in industrial knowledge bases. Integrates jargon identification, context rec…
  ☆35Updated last year
• javyduck / KnowHalu
  ☆48Updated last year
• microsoft / EvoPrompt
  Automatic Prompt Optimization
  ☆45Updated last year
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• qrdlgit / graph-of-thoughts
  Based on the tree of thoughts paper
  ☆48Updated 2 years ago