[NeurIPS '24 Spotlight] PertEval: Unveiling Real Knowledge Capacity of LLMs via Knowledge-invariant Perturbations
☆14Oct 30, 2024Updated last year
Alternatives and similar repositories for PertEval
Users that are interested in PertEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI swarm framework. Spawn agents, connect them however you want, let them talk. That's it. Pure chaos.☆12Oct 3, 2025Updated last year
- Official Repository for our paper: AdaPlanBench: Evaluating Adaptive Planning in Large Language Model Agents under World and User Constra…☆28Sep 19, 2026Updated last month
- This is an AAAI-2026 conference paper repo.☆17Mar 1, 2026Updated 7 months ago
- ☆12Oct 19, 2023Updated 3 years ago
- Official PyTorch code for UAI 2023 paper "Concurrent Misclassification and Out-of-Distribution Detection for Semantic Segmentation via En…☆12Nov 10, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Beagle is designed to be the unified platform for the broader Recursive Self-Improvement (RSI) ecosystem. Think of it as Hugging Face Tr…☆100Updated this week
- Flash-GMM, a memory-efficient GPU kernel that unlocks GMM soft clustering at billion-scale☆25Sep 30, 2026Updated 3 weeks ago
- ☆12Oct 14, 2024Updated 2 years ago
- Experiments on using ChatGPT for failure mode classification☆12Sep 20, 2023Updated 3 years ago
- A research framework for studying how multi-agent LLM teams complete software tasks given different team structures and sizes.☆16Apr 16, 2026Updated 6 months ago
- Self-hosted social media scheduling. Deploy on Cloudflare in under a minute. Free forever.☆18Jul 5, 2026Updated 3 months ago
- 📖Curated list about reasoning abilitiy of MLLM, including OpenAI o1, OpenAI o3-mini, and Slow-Thinking.☆14Feb 7, 2025Updated last year
- [CVPR 2025] VISCO: Benchmarking Fine-Grained Critique and Correction Towards Self-Improvement in Visual Reasoning☆13Jun 7, 2025Updated last year
- ☆12Nov 5, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official code of HierCDF @ SIGKDD2022☆13Aug 14, 2022Updated 4 years ago
- Example for a Monty-enabled RLM in DSPy☆20Feb 16, 2026Updated 8 months ago
- ☆10Oct 22, 2024Updated 2 years ago
- Official PyTorch implementation of our paper "Dispersing Prompt Expansion for Class-Agnostic Object Detection" (NeurIPS 2024)☆14Jan 19, 2025Updated last year
- Counter Strike: Global Offensive FPGA Version (LOL)☆15Mar 11, 2017Updated 9 years ago
- Code for EMNLP2023 paper "MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter".☆13Dec 27, 2023Updated 2 years ago
- Official GitHub repo for Scaling Physical Reasoning with the PHYSICS Dataset (NeurIPS25).☆16Sep 20, 2025Updated last year
- Reverse engineering and technical documentation of Flock Safety camera hardware, firmware, networking, and embedded systems.☆20Jul 7, 2026Updated 3 months ago
- Code implementation for paper AbsenceBench: Language Models Can't Tell What's Missing☆19Oct 23, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- In-Situ Evaluator: Real-Time Subsample Analysis☆17Jan 25, 2026Updated 8 months ago
- MLflow deployment plugin For IBM-cloud-watson-ml☆15May 7, 2025Updated last year
- A repository for models generated with https://github.com/argosopentech/onmt-models and used by LibreTranslate☆26Jul 5, 2021Updated 5 years ago
- A Robust Matching Network for Gradually Estimating Geometric Transformation on Remote Sensing Imagery☆33Oct 7, 2025Updated last year
- [NeurIPS 2026] "CausalCompass: Evaluating the Robustness of Time-Series Causal Discovery in Misspecified Scenarios"☆37Sep 29, 2026Updated 3 weeks ago
- The official repo for DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph☆19Oct 13, 2024Updated 2 years ago
- ☆15May 1, 2025Updated last year
- This is the official code for our paper "Simple and Scalable Nearest Neighbor Machine Translation" (ICLR 2023).☆15Nov 22, 2023Updated 2 years ago
- Official Spring AI support for latest watsonx.ai services☆27Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Python client library for the Galileo platform 🔭☆22Oct 16, 2026Updated last week
- ☆16Feb 2, 2025Updated last year
- Course resource for the optimization algorithm course in spring 2021. The course is lectured by prof. Zhouwang Yang.☆16Jan 26, 2022Updated 4 years ago
- ZMeta v1.0: A transport-agnostic, event-based metadata standard for resilient ISR, supporting degraded and denied environments, multi-sen…☆21Oct 16, 2026Updated last week
- One interface for your whole data stack, with built-in safeguards and a simpler workflow for your team. Written in Rust. Docker not neede…☆17Jul 30, 2026Updated 2 months ago
- InDSL - Industrial Data Science Library by Cognite☆24Updated this week
- [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections☆22Oct 15, 2024Updated 2 years ago