OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
☆19Jun 25, 2024Updated 2 years ago
Alternatives and similar repositories for opencompass
Users that are interested in opencompass are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The contrastive token loss function for reducing generative repetition of autoregressive neural language models.☆13May 11, 2022Updated 4 years ago
- ☆17Apr 17, 2025Updated last year
- Toolkit for building prompt templates for language models☆11Sep 30, 2022Updated 4 years ago
- ☆20Jan 9, 2024Updated 2 years ago
- The implementation of the IEEE S&P 2024 paper MM-BD: Post-Training Detection of Backdoor Attacks with Arbitrary Backdoor Pattern Types Us…☆16May 12, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [ACL 2026 Main] MCP-Flow: Facilitating LLM Agents to Master Real-World, Diverse and Scaling MCP Tools.☆26Apr 8, 2026Updated 6 months ago
- CoTA++: Understanding the Repeat Curse in dMLLMs from an Information Flow Perspective☆38Oct 8, 2026Updated last week
- Code for "ConsistentChat: Building Skeleton-Guided Consistent Multi-Turn Dialogues for Large Language Models from Scratch", where dataset…☆17Sep 8, 2025Updated last year
- A curated list of Neuro-Symbolic Visual Reasoning☆17Jul 23, 2021Updated 5 years ago
- This is a niche collection of research papers which are proven to be gradients pushing the field of Natural Language Processing, Deep Lea…☆25Nov 19, 2024Updated last year
- ☆19Nov 15, 2025Updated 11 months ago
- (ACM MM24) This is the offical repository of GIST: Improving Parameter Efficient Fine Tuning via Knowledge Interaction.☆10Jan 28, 2024Updated 2 years ago
- Ladder Side-Tuning在CLUE上的简单尝试☆23Jun 20, 2022Updated 4 years ago
- Code for the paper "Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering" (AAAI 2021)☆30Feb 19, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆29Jun 17, 2024Updated 2 years ago
- [ICLR 2026🔥] SHIELD: Suppressing Hallucinations In LVLM Encoders via Bias and Vulnerability Defense☆21Mar 24, 2026Updated 6 months ago
- DialCoT Meets PPO: Decomposing and Exploring Reasoning Paths in Smaller Language Models☆13Nov 2, 2023Updated 2 years ago
- ☆15Sep 6, 2022Updated 4 years ago
- Run Deekseek LLM model locally with Ollama, deepseek-r1:1.5b, and React☆11Jan 29, 2025Updated last year
- EMNLP 2022: Analyzing and Evaluating Faithfulness in Dialogue Summarization☆13Mar 20, 2025Updated last year
- MetricEval: A framework that conceptualizes and operationalizes four main components of metric evaluation, in terms of reliability and va…☆13Nov 6, 2023Updated 2 years ago
- The code for paper "ProQA: Structural Prompt-based Pre-training for Unified Question Answering"☆11Feb 7, 2023Updated 3 years ago
- Foursquare User Dataset - Pulled offline, so letting it live here; currently only data.☆16Oct 31, 2013Updated 12 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A curated list of personalized Language model / Large language model (continually updated)☆10Nov 17, 2023Updated 2 years ago
- [ICLR 2026] Evaluating Text Creativity across Diverse Domains: A Dataset and a Large Language Model Evaluator☆18Feb 28, 2026Updated 7 months ago
- LBSN based on foursquare dataset☆14Apr 26, 2019Updated 7 years ago
- The pytorch implementation of KBGNN☆16Jan 30, 2023Updated 3 years ago
- Code for ACL2022 publication Transkimmer: Transformer Learns to Layer-wise Skim☆22Aug 21, 2022Updated 4 years ago
- Codes for "Benchmarking the Generation of Fact Checking Explanations"☆11Aug 16, 2024Updated 2 years ago
- Official Repository for our paper: PlanBench-XL: Evaluating Long-Horizon Planning of LLM Tool-Use Agents in Large-Scale Tool Ecosystems☆42Sep 19, 2026Updated 3 weeks ago
- (ICME24) This is the offical repository of iDAT: inverse Distillation Adapter-Tuning.☆12Apr 3, 2024Updated 2 years ago
- ☆17Aug 6, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Implementation for PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs☆24Jun 6, 2024Updated 2 years ago
- Uncertainty-Aware Curriculum Learning for Neural Machine Translation (ACL 2020)☆11Jun 12, 2020Updated 6 years ago
- code for promptCSE, emnlp 2022☆11Apr 10, 2023Updated 3 years ago
- BackTime: Backdoor Attacks on Multivariate Time Series Forecasting☆33Apr 14, 2025Updated last year
- ☆12Feb 18, 2020Updated 6 years ago
- ConvBench: A Multi-Turn Conversation Evaluation Benchmark with Hierarchical Ablation Capability for Large Vision-Language Models☆18Sep 27, 2024Updated 2 years ago
- 🧪 A unified benchmark to evaluate & compare Explainable AI methods (SHAP, LIME, ...) via functional tests. Live results + paper (arXiv:2…☆14Jul 3, 2026Updated 3 months ago