SPUQ: Perturbation-Based Uncertainty Quantification for Large Language Models
☆17Jun 24, 2024Updated 2 years ago
Alternatives and similar repositories for SPUQ
Users that are interested in SPUQ are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DCR-Consistency: Divide-Conquer-Reasoning for Consistency Evaluation and Improvement of Large Language Models☆27May 23, 2024Updated 2 years ago
- ☆106Jun 30, 2024Updated 2 years ago
- An MCP server that extracts claims from a text☆19Nov 3, 2025Updated 11 months ago
- Website for Applied-LLMs work☆29May 5, 2026Updated 5 months ago
- Benchmarking LLMs via Uncertainty Quantification☆263Jan 30, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This is the official repo for Towards Uncertainty-Aware Language Agent.☆31Aug 15, 2024Updated 2 years ago
- ☆43Feb 2, 2024Updated 2 years ago
- [EMNLP 2024] A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models.☆25Sep 23, 2024Updated 2 years ago
- a suite of finetuned LLMs for atomically precise function calling 🧪☆16Oct 9, 2026Updated last week
- ☆11Sep 25, 2025Updated last year
- JS/TS SDK for handling (extensible) events in Matrix☆10Jan 13, 2023Updated 3 years ago
- Python client library for Cleanlab Trustworthy Language Model☆24Dec 9, 2025Updated 10 months ago
- Code for the paper: Prompts have evil twins (EMNLP 2024)☆26Feb 10, 2025Updated last year
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆29Jun 4, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Source code for "Olfactory Label Prediction on Aroma-Chemical Pairs"☆17Oct 1, 2025Updated last year
- A codebase for ACL 2023 paper: Mitigating Label Biases for In-context Learning☆10Aug 4, 2023Updated 3 years ago
- ☆19Jun 30, 2025Updated last year
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆31Mar 5, 2024Updated 2 years ago
- Filipino multi-modal NLP dataset. Consists of 350k+ Filipino news articles and associated images☆14Mar 11, 2025Updated last year
- ☆29Apr 19, 2026Updated 5 months ago
- [ICML'24] Conformal Prediction for Deep Classifier via Label Ranking☆14Jun 14, 2024Updated 2 years ago
- On-device real-time RAG App built using Jina Reader, Mediapipe, Gemma 2b IT LLM.☆15Apr 15, 2024Updated 2 years ago
- Repository for the paper: Aligning LLMs to Ask Good Questions A Case Study in Clinical Reasoning☆18Feb 21, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆13Jul 24, 2024Updated 2 years ago
- Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Mo…☆16Nov 11, 2024Updated last year
- Some Thoughts on AI Alignment: Using AI to Control AI☆16Feb 25, 2025Updated last year
- [ACL 2025] "CoT-UQ: Improving Response-wise Uncertainty Quantification in LLMs with Chain-of-Thought"☆17Apr 3, 2025Updated last year
- ☆19Jun 3, 2023Updated 3 years ago
- Hercules: Attributable and Scalable Opinion Summarization (ACL 2023)☆20Nov 8, 2023Updated 2 years ago
- Official PyTorch implementation for Training Unbiased Diffusion Models From Biased Dataset in ICLR 2024.☆15Apr 30, 2024Updated 2 years ago
- A demo instance of mage for pulling sample data from a public Google pub/sub topic and transforming with dbt.☆12Jan 5, 2024Updated 2 years ago
- Multi-Modal Content Moderation Systems for Social Media Platforms with Dialogue Summarization and Argument Graphs☆11Jun 27, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Heterogeneous Scientific Foundation Model Collaboration☆23May 1, 2026Updated 5 months ago
- Cog wrapper for FalconsAi / nsfw_image_detection☆19Aug 6, 2025Updated last year
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆20Nov 19, 2024Updated last year
- ☆15Jun 10, 2025Updated last year
- Official implementation of "Principal Uncertainty Quantification with Spatial Correlation for Image Restoration Problems" paper.☆23Dec 16, 2023Updated 2 years ago
- ☆18Dec 18, 2023Updated 2 years ago
- ☆47Jul 10, 2024Updated 2 years ago