Probabilistic LLM evaluations. [CogSci2023; ACL2023]
☆73Jul 27, 2024Updated 2 years ago
Alternatives and similar repositories for probsem
Users that are interested in probsem are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance backend for language model probabilistic programs☆17Aug 31, 2026Updated last week
- Translation of the databricks-dolly-15k dataset to Chinese for commercial use.☆19Apr 17, 2023Updated 3 years ago
- A scalable abstraction learning library☆100Sep 10, 2025Updated 11 months ago
- Measuring if attention is explanation with ROAR☆22Mar 3, 2023Updated 3 years ago
- [ICLR 2024] COLLIE: Systematic Construction of Constrained Text Generation Tasks☆64Aug 2, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆13Apr 17, 2025Updated last year
- Implementation of MixCE method described in ACL 2023 paper by Zhang et al.☆20May 29, 2023Updated 3 years ago
- Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".☆169May 7, 2024Updated 2 years ago
- An R package for implementing and evaluating Maximum Entropy Optimality Theory models☆10Aug 14, 2026Updated 3 weeks ago
- Official codes for COLING 2024 paper "Robust and Scalable Model Editing for Large Language Models": https://arxiv.org/abs/2403.17431v1☆14Mar 27, 2024Updated 2 years ago
- Code to reproduce experiments in the paper "Constrained Language Models Yield Few-Shot Semantic Parsers" (EMNLP 2021).☆67May 31, 2024Updated 2 years ago
- Official repository for "DEnsity: Open-domain Dialogue Evaluation Metric using Density Estimation (ACL2023 Findings)"☆11May 23, 2023Updated 3 years ago
- This is the repository for the paper Static Prediction of Runtime Errors by Learning to Execute Programs with External Resource Descripti…☆25Nov 18, 2022Updated 3 years ago
- Using self-play to augment multi-turn text-to-SQL datasets☆13Oct 20, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code and Data for Evaluation WG☆42May 4, 2022Updated 4 years ago
- Logical inference system based on event semantics and degree semantics in formal semantics☆10Jan 22, 2023Updated 3 years ago
- Official code and dataset for our NAACL 2024 paper: DialogCC: An Automated Pipeline for Creating High-Quality Multi-modal Dialogue Datase…☆13Jun 24, 2024Updated 2 years ago
- A tool for cross-checking Verilog compilers☆15Apr 16, 2025Updated last year
- structured attention encoder☆13Jun 6, 2018Updated 8 years ago
- Embedding Recycling for Language models☆38Jul 11, 2023Updated 3 years ago
- An offical implementation of EHRDiff [TMLR]☆33Jun 25, 2024Updated 2 years ago
- codesearch.ai semantic code search engine☆43Mar 24, 2023Updated 3 years ago
- Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…☆44May 23, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆26Apr 15, 2023Updated 3 years ago
- Accelerate pretraining by pre-pretraining on formal languages!☆22Feb 13, 2026Updated 6 months ago
- Particle filtering in JAX☆17Aug 27, 2026Updated last week
- Make triton easier☆49Updated this week
- Interactive Composition Explorer: a debugger for compositional language model programs☆568Jul 6, 2026Updated 2 months ago
- 基于Metropolis修改的北大风格Beamer主题☆29May 29, 2022Updated 4 years ago
- ☆22Jun 25, 2026Updated 2 months ago
- ☆44Jun 24, 2025Updated last year
- PANiC - PAraphrasing Noun-Compounds☆15Apr 6, 2018Updated 8 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- This repo contains code for our NeurIPS 2023 spotlight paper: Evaluating and Inducing Personality in Pre-trained Language Models☆59Dec 7, 2023Updated 2 years ago
- Comprehensive LLM evaluation framework: GPQA Diamond to Chatbot Arena. Tests all major models equally, easily extensible.☆17Aug 22, 2024Updated 2 years ago
- Official code for "Algorithmic Capabilities of Random Transformers" (NeurIPS 2024)☆16Sep 28, 2024Updated last year
- Data and all☆14Sep 30, 2019Updated 6 years ago
- Composable inference algorithms with LLMs and programmable logic☆69Dec 4, 2024Updated last year
- A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research …☆1,015Dec 16, 2024Updated last year
- ☆36Mar 27, 2025Updated last year