Alternatives and similar repositories for ecosystem-graphs:

Users that are interested in ecosystem-graphs are comparing it to the libraries listed below

• kaistAI / FLASK
  [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  ☆213Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆253Updated last year
• Shark-NLP / OpenICL
  OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.
  ☆543Updated last year
• snap-stanford / MLAgentBench
  ☆264Updated 6 months ago
• zeno-ml / zeno-build
  Build, evaluate, understand, and fix LLM-based apps
  ☆484Updated last year
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆206Updated last week
• anthropics / evals
  ☆247Updated 6 months ago
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆262Updated 6 months ago
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆215Updated this week
• huggingface / cosmopedia
  ☆484Updated last month
• Gentopia-AI / Gentopia
  Build Hierarchical Autonomous Agents through Config. Collaborative Growth of Specialized Agents.
  ☆307Updated last year
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆324Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆330Updated 3 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• ruiqi-zhong / D5
  The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions
  ☆68Updated last year
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆297Updated last year
• lukasberglund / reversal_curse
  ☆277Updated last year
• neulab / gemini-benchmark
  ☆150Updated last year
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆221Updated last year
• HazyResearch / ama_prompting
  Ask Me Anything language model prompting
  ☆544Updated last year
• LudwigStumpp / llm-leaderboard
  A joint community effort to create one central leaderboard for LLMs.
  ☆288Updated 4 months ago
• EleutherAI / elk
  Keeping language models honest by directly eliciting knowledge encoded in their activations.
  ☆192Updated this week
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆217Updated last year
• Giskard-AI / awesome-ai-safety
  📚 A curated list of papers & technical articles on AI Quality & Safety
  ☆166Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆233Updated 2 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆247Updated 6 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆141Updated 9 months ago
• HazyResearch / TART
  TART: A plug-and-play Transformer module for task-agnostic reasoning
  ☆193Updated last year
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆222Updated last year
• shuyanzhou / docprompting
  Data and code for "DocPrompting: Generating Code by Retrieving the Docs" @ICLR 2023
  ☆236Updated last year