MTTM: Metamorphic Testing for Textual Content Moderation Software
☆32Feb 10, 2023Updated 3 years ago
Alternatives and similar repositories for MTTM
Users that are interested in MTTM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Multilingual safety benchmark for Large Language Models☆53Sep 1, 2024Updated last year
- ☆35Mar 11, 2025Updated last year
- ☆41Jan 9, 2025Updated last year
- Code and data for the paper: Competing Large Language Models in Multi-Agent Gaming Environments☆97Jan 26, 2026Updated 3 months ago
- Code and data for the paper: Apathetic or Empathetic? Evaluating LLMs' Emotional Alignments with Humans☆121Jan 25, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SpyGame: An interactive multi-agent framework to evaluate intelligence with large language models :D☆15Nov 9, 2023Updated 2 years ago
- Recent papers on (1) Psychology of LLMs; (2) Biases in LLMs.☆50Nov 3, 2023Updated 2 years ago
- Code and data for the paper: AI Sees Your Location—But With A Bias Toward The Wealthy World☆19Dec 15, 2025Updated 4 months ago
- A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.☆72May 22, 2025Updated 11 months ago
- A collection of instruction data and scripts for machine translation.☆20Sep 23, 2023Updated 2 years ago
- The repository for "MedChain: Bridging the Gap Between LLM Agents and Real-World Clinical Decision Making"☆50Apr 8, 2026Updated 3 weeks ago
- ☆11Jan 19, 2025Updated last year
- Official implementation of our IWSLT 2023 paper "The MineTrans Systems for IWSLT 2023 Offline Speech Translation and Speech-to-Speech Tra…☆16Jul 14, 2023Updated 2 years ago
- A toolkit for testing and improving named entity recognition [ESEC/FSE'23]☆11Aug 31, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆30Mar 5, 2024Updated 2 years ago
- [CVPR 2025] FaceBench: A Multi-View Multi-Level Facial Attribute VQA Dataset for Benchmarking Face Perception MLLMs☆47Dec 12, 2025Updated 4 months ago
- The ParroT framework to enhance and regulate the Translation Abilities during Chat based on open-sourced LLMs (e.g., LLaMA-7b, Bloomz-7b1…☆177Dec 31, 2024Updated last year
- [TACL 2024] MAPS enables LLMs🤖 to mimic the human😁 translation process.☆144Jun 7, 2024Updated last year
- A toolkit for testing machine translation [ICSE'20, '21, ESEC/FSE'20]☆33Nov 15, 2021Updated 4 years ago
- ☆13Dec 17, 2024Updated last year
- [ACL'25] UTBoost: Rigorous Evaluation of Coding Agents on SWE-Bench☆36Aug 12, 2025Updated 8 months ago
- [NeurIPS'25] EndoBench: A Comprehensive Evaluation of Multi-Modal Large Language Models for Endoscopy Analysis☆61Mar 19, 2026Updated last month
- Improving Machine Translation Systems via Isotopic Replacement☆12Apr 14, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆32Jul 8, 2024Updated last year
- Code and data for the paper: On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agents☆45Dec 15, 2025Updated 4 months ago
- NLRB data scraper by LexPredict☆12Dec 8, 2022Updated 3 years ago
- 🐳 PyLoader: An asynchronous Python dataloader for loading big datasets, supporting PyTorch and TensorFlow 2.x.☆11Aug 29, 2021Updated 4 years ago
- FineMotion: A Dataset and Benchmark with both Spatial and Temporal Annotation for Fine-grained Motion Generation and Editing☆17Mar 4, 2025Updated last year
- [ACL 2023] Are Pre-trained Language Models Useful for Model Ensemble in Chinese Grammatical Error Correction?☆10Dec 15, 2025Updated 4 months ago
- 💵 Code for Less is More for Long Document Summary Evaluation by LLMs (Wu*, Iso* et al; EACL 2024)☆11Feb 22, 2024Updated 2 years ago
- A framework to evaluate the generalization capability of safety alignment for LLMs☆627Oct 9, 2025Updated 6 months ago
- Implementation of our paper "Scaling Back-Translation with Domain Text Generation for Sign Language Gloss Translation". Accepted in EACL …☆11May 22, 2023Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- TDD-Bench-Verified is a new benchmark for generating test cases for test-driven development (TDD)☆29Updated this week
- [CVPR 2022] CLIMS: Cross Language Image Matching for Weakly Supervised Semantic Segmentation☆139Jun 7, 2024Updated last year
- Your finetuned model's back to its original safety standards faster than you can say "SafetyLock"!☆11Oct 16, 2024Updated last year
- Comparaison of adversarial training algorithms (FreeLB, FreeAT and K-PGD) on natural language tasks☆13Feb 14, 2020Updated 6 years ago
- ☆15Jul 16, 2021Updated 4 years ago
- From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning.☆25Oct 7, 2025Updated 6 months ago
- Official implementation of the ACL Findings 2023 paper: Interpretable Automatic Fine-grained Inconsistency Detection in Text Summarizatio…☆14Jan 25, 2024Updated 2 years ago