PurCL / ASTRALinks
π₯ Amazon Nova AI Challenge Winner - ASTRA emerged victorious as the top attacking team in Amazon's global AI safety competition, defeating elite defending teams from universities worldwide in live adversarial evaluation.
β68Updated 5 months ago
Alternatives and similar repositories for ASTRA
Users that are interested in ASTRA are comparing it to the libraries listed below
Sorting:
- An autonomous LLM-agent for large-scale, repository-level code auditingβ314Updated last month
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents onβ¦β101Updated this week
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)β91Updated 11 months ago
- [USENIX Security 25] PatchAgent is a LLM-based practical program repair agent that mimics human expertise.β117Updated last month
- Official repo for FSE'24 paper "CodeArt: Better Code Models by Attention Regularization When Symbols Are Lacking"β18Updated 10 months ago
- β25Updated last year
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and reaβ¦β63Updated 8 months ago
- β38Updated 6 months ago
- π₯π₯π₯ Detecting hidden backdoors in Large Language Models with only black-box accessβ51Updated 7 months ago
- CVE-Bench: A Benchmark for AI Agentsβ Ability to Exploit Real-World Web Application Vulnerabilitiesβ136Updated this week
- [CCS'24] An LLM-based, fully automated fuzzing tool for option combination testing.β93Updated 9 months ago
- Parsing-based Analyzerβ67Updated 7 months ago
- β17Updated last year
- β126Updated last year
- β34Updated last year
- TensorFlow API analysis tool and malicious model detection toolβ38Updated 7 months ago
- [USENIX Security'24] Official repository of "Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise aβ¦β111Updated last year
- [SOSP'25] Automatic checker synthesis for system-level static analysisβ157Updated 2 months ago
- [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agaiβ¦β56Updated 9 months ago
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Benchβ116Updated 2 months ago
- β31Updated last year
- This is a benchmark for evaluating the vulnerability discovery ability of automated approaches including Large Language Models (LLMs), deβ¦β75Updated last year
- A collection of security papers on top-tier publicationsβ60Updated last week
- The official repository of "GraphSPD: Graph-Based Security Patch Detection with Enriched Code Semantics". The paper will appear in the IEβ¦β48Updated 2 years ago
- β55Updated last year
- Source code for LLMxCPG paperβ104Updated 3 weeks ago
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publisβ¦β82Updated 2 years ago
- Binary Code Summarizationβ14Updated 9 months ago
- Assisting Static Analysis with Large Language Models: A ChatGPT Experimentβ36Updated 2 years ago
- Binary Code Summarization: Benchmarking ChatGPT/GPT-4 and Other Large Language Modelsβ20Updated 2 years ago