[NeurIPS '24 Spotlight] PertEval: Unveiling Real Knowledge Capacity of LLMs via Knowledge-invariant Perturbations
☆14Oct 30, 2024Updated 2 years ago
Alternatives and similar repositories for PertEval
Users that are interested in PertEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Codes for paper "An Embedding Approach to Anomaly Detection."☆13Dec 13, 2018Updated 7 years ago
- AI swarm framework. Spawn agents, connect them however you want, let them talk. That's it. Pure chaos.☆12Oct 3, 2025Updated last year
- The AMFormer algorithm, accepted at AAAI-2024, for deep tabular learning☆43Jul 3, 2024Updated 2 years ago
- Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.☆12Oct 20, 2026Updated 3 weeks ago
- The Maximo MCP Server is a Model Context Protocol server that connects AI assistants (like Antigravity, Cursor, or VS Code Copilot) direc…☆11Sep 17, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official PyTorch code for UAI 2023 paper "Concurrent Misclassification and Out-of-Distribution Detection for Semantic Segmentation via En…☆12Nov 10, 2023Updated 3 years ago
- Experiments on using ChatGPT for failure mode classification☆12Sep 20, 2023Updated 3 years ago
- ☆12Oct 19, 2023Updated 3 years ago
- Deploy MLOps architecture on an EKS cluster using AWS cloud☆10Feb 2, 2022Updated 4 years ago
- 「NeurIPS 2024」To Err like Human: Affective Bias-Inspired Measures for Visual Emotion Recognition Evaluation☆10Dec 2, 2024Updated last year
- This is an AAAI-2026 conference paper repo.☆18Mar 1, 2026Updated 8 months ago
- [CVPR 2025] VISCO: Benchmarking Fine-Grained Critique and Correction Towards Self-Improvement in Visual Reasoning☆13Jun 7, 2025Updated last year
- ☆12Nov 5, 2024Updated 2 years ago
- Code Execution MCP Server for Binary Ninja☆13Sep 22, 2026Updated last month
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- 📖Curated list about reasoning abilitiy of MLLM, including OpenAI o1, OpenAI o3-mini, and Slow-Thinking.☆14Feb 7, 2025Updated last year
- NeurIPS'24 MLforSys Workshop: LLMSteer☆10May 6, 2025Updated last year
- ☆12Oct 14, 2024Updated 2 years ago
- Defensive research PoC: a benign open model + a LoRA that exfiltrates proprietary data on a semantic trigger. Companion to the Origin pos…☆11Jun 18, 2026Updated 4 months ago
- Text-to-SQL Evaluation Toolkit: A modular framework for evaluating natural language to SQL systems☆19Nov 5, 2026Updated last week
- Agentic approach to predicting RUL, cost while adhering to safety standards.☆17May 3, 2026Updated 6 months ago
- Example for a Monty-enabled RLM in DSPy☆20Feb 16, 2026Updated 8 months ago
- ☆10Oct 22, 2024Updated 2 years ago
- ☆23Aug 27, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Counter Strike: Global Offensive FPGA Version (LOL)☆15Mar 11, 2017Updated 9 years ago
- Official PyTorch implementation of our paper "Dispersing Prompt Expansion for Class-Agnostic Object Detection" (NeurIPS 2024)☆14Jan 19, 2025Updated last year
- Official code of HierCDF @ SIGKDD2022☆13Aug 14, 2022Updated 4 years ago
- A research framework for studying how multi-agent LLM teams complete software tasks given different team structures and sizes.☆16Apr 16, 2026Updated 6 months ago
- Code for EMNLP2023 paper "MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter".☆13Dec 27, 2023Updated 2 years ago
- Official GitHub repo for Scaling Physical Reasoning with the PHYSICS Dataset (NeurIPS25).☆18Sep 20, 2025Updated last year
- A Robust Matching Network for Gradually Estimating Geometric Transformation on Remote Sensing Imagery☆33Oct 7, 2025Updated last year
- Code implementation for paper AbsenceBench: Language Models Can't Tell What's Missing☆19Oct 23, 2025Updated last year
- MLflow deployment plugin For IBM-cloud-watson-ml☆15May 7, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Test-time optimization of query embedding representations for zero-shot classification and retrieval☆15Oct 7, 2026Updated last month
- This is the official code for our paper "Simple and Scalable Nearest Neighbor Machine Translation" (ICLR 2023).☆15Nov 22, 2023Updated 2 years ago
- A repository for models generated with https://github.com/argosopentech/onmt-models and used by LibreTranslate☆26Jul 5, 2021Updated 5 years ago
- Course resource for the optimization algorithm course in spring 2021. The course is lectured by prof. Zhouwang Yang.☆16Jan 26, 2022Updated 4 years ago
- Python client library for the Galileo platform 🔭☆22Oct 16, 2026Updated 3 weeks ago
- ☆16Feb 2, 2025Updated last year
- CellPolaris☆14Jan 11, 2026Updated 10 months ago
Are these results useful?