SAILResearch / awesome-foundation-model-leaderboards
A curated list of awesome leaderboard-oriented resources for foundation models
☆192Updated this week
Related projects ⓘ
Alternatives and complementary repositories for awesome-foundation-model-leaderboards
- AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning (NeurIPS 2024)☆169Updated this week
- The Official Repo of ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://a…☆355Updated this week
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆161Updated this week
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆184Updated 3 weeks ago
- Grimoire is All You Need for Enhancing Large Language Models☆116Updated 8 months ago
- The official implementation of our pre-print paper "AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMs".☆145Updated this week
- 使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力☆155Updated 4 months ago
- LLM Benchmark for Code☆33Updated 3 months ago
- The official implementation of Self-Play Preference Optimization (SPPO)☆498Updated 3 months ago
- This includes the original implementation of CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control.☆66Updated last month
- A Comprehensive Benchmark for Code Information Retrieval.☆63Updated last month
- Pytorch Library for Relational Table Learning with LLMs.☆283Updated this week
- [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.☆184Updated last week
- TxBKG - Knowledge Graph Generation for Any PDFs☆223Updated last month
- An Extensible Framework for Retrieval-Augmented LLM Applications: Learning Relevance Beyond Simple Similarity.☆42Updated 3 weeks ago
- An interpretable large language model (LLM) for medical diagnosis.☆90Updated 2 months ago
- Support mixed-precsion inference with vllm☆97Updated 2 weeks ago
- This tool(enhance_long) aims to enhance the LlaMa2 long context extrapolation capability in the lowest-cost approach, preferably without …☆47Updated 11 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆129Updated 2 weeks ago
- We leverage 14 datasets as OOD test data and conduct evaluations on 8 NLU tasks over 21 popularly used models. Our findings confirm that …☆117Updated last year
- [ACL 2024] CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and …☆111Updated 3 months ago
- ☆57Updated 4 months ago
- A deployment, monitoring and autoscaling service towards serverless LLM serving.☆162Updated last week
- STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Bases (NeurIPS D&B 2024)☆306Updated 3 weeks ago
- Benchmarking LLMs via Uncertainty Quantification☆221Updated 9 months ago
- [NeurIPS 2024] EffiBench: Benchmarking the Efficiency of Automatically Generated Code☆58Updated last month
- This is the official code repository of MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tas…☆63Updated 2 months ago
- Config files for my GitHub profile.☆55Updated 8 months ago
- "AnyGraph: Graph Foundation Model in the Wild"☆185Updated 2 months ago
- Code for paper "GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators"☆225Updated 3 months ago