adversarial-machine-learning

ChatGPT Jailbreaks, GPT Assistants Prompt Leaks, GPTs Prompt Injection, LLM Prompt Security, Super Prompts, Prompt Hack, Prompt Security, Ai Prompt Engineering, Adversarial Machine Learning.

agent ai jailbreak hacking assistant gpt leaks prompts adversarial-machine-learning gpt-3 gpt-4 llm prompt-engineering chatgpt prompt-injection prompt-security system-prompt

UpdatedJun 9, 2025

protectai /llm-guard

Star1.8k

The Security Toolkit for LLM Interactions

transformers security-tools adversarial-machine-learning large-language-models llm prompt-engineering chatgpt llmops prompt-injection llm-security

UpdatedJul 8, 2025
Python

BorealisAI /advertorch

Star1.3k

A Toolbox for Adversarial Robustness Research

security benchmarking machine-learning pytorch toolbox robustness adversarial-learning adversarial-machine-learning adversarial-example adversarial-examples adversarial-attacks adversarial-perturbations

UpdatedSep 14, 2023
Jupyter Notebook

jiep /offensive-ai-compilation

Star1.3k

A curated list of useful resources that cover Offensive AI.

artificial-intelligence compilation adversarial-machine-learning ai-security offensive-ai

UpdatedJun 15, 2025
HTML

safe-graph /graph-adversarial-learning-literature

Star855

A curated list of adversarial attacks and defenses papers on graph-structured data.

security machine-learning data-mining deep-learning graph-algorithms survey awesome-list graph-data graph-attack literature-review adversarial-machine-learning adversarial-attacks

UpdatedDec 15, 2023

RobustBench /robustbench

Star726

RobustBench: a standardized adversarial robustness benchmark [NeurIPS 2021 Benchmarks and Datasets Track]

benchmark model-zoo adversarial-machine-learning adversarial-robustness

UpdatedMar 31, 2025
Python

akanimax /T2F

Star548

T2F: text to face generation using Deep Learning

generative-adversarial-network gan text-to-image adversarial-machine-learning progressively-growing-gan

UpdatedMay 14, 2022
Python

akanimax /pro_gan_pytorch

Star541

Unofficial PyTorch implementation of the paper titled "Progressive growing of GANs for improved Quality, Stability, and Variation"

pytorch gan convolutional-neural-network adversarial-machine-learning progressive-growing-of-gans

UpdatedOct 3, 2023
Python

chawins /llm-sp

Star517

Papers and resources related to the security and privacy of LLMs 🤖

security privacy awesome-list adversarial-machine-learning llm llm-security llm-privacy

UpdatedJun 8, 2025
Python

thu-ml /ares

Star510

A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.

nes pca bim benchmark-framework evolutionary spsa boundary adversarial-machine-learning distillation fgsm adversarial-attacks deepfool adversarial-robustness mi-fgsm mmlda hgd

UpdatedOct 15, 2023
Python

EdisonLeeeee /GraphGallery

Star470

GraphGallery is a gallery for benchmarking Graph Neural Networks

graph models pytorch adversarial-machine-learning pyg geometric-deep-learning graph-neural-networks dgl graphgallery

UpdatedAug 14, 2023
Python

deadbits /vigil-llm

Star396

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs

security-tools adversarial-machine-learning adversarial-attacks yara-scanner large-language-models llmops prompt-injection llm-security

UpdatedJan 31, 2024
Python

Koukyosyumei /AIJack

Sponsor

Star394

Security and Privacy Risk Simulator for Machine Learning (arXiv:2312.17667)

security machine-learning privacy deep-learning dbms paillier homomorphic-encryption differential-privacy adversarial-machine-learning adversarial-examples paillier-cryptosystem adversarial-attacks federated-learning k-anonymity model-inversion-attacks membership-inference evasion-attack poisoning-attacks

UpdatedJun 15, 2025
C++

locuslab /smoothing

Star391

Provable adversarial robustness at ImageNet scale

adversarial-machine-learning

UpdatedMay 20, 2019
Python

Trustworthy-AI-Group /TransferAttack

Star375

TransferAttack is a pytorch framework to boost the adversarial transferability for image classification.

adversarial-machine-learning adversarial-attack transfer-attack adversarial-transferability blackbox-attack

UpdatedJun 21, 2025
Python

MinghuiChen43 /awesome-trustworthy-deep-learning

Star370

A curated list of trustworthy deep learning papers. Daily updating...

security privacy deep-learning backdoor uncertainty ownership causality fairness watermarking poisoning robustness adversarial-machine-learning machine-unlearning interpretable-deep-learning ai-alignment green-ai membership-inference-attack hallucinations gradient-leakage out-of-distribution-generalization

UpdatedJul 8, 2025

ebagdasa /backdoors101

Star367

Backdoors Framework for Deep Learning and Federated Learning. A light-weight tool to conduct your research on backdoors.

security machine-learning research pytorch adversarial backdoors adversarial-machine-learning federated-learning backdoor-attacks neural-trojan deep-learning-security ml-backdoors deep-learning-backdoors

UpdatedFeb 5, 2023
Python

Improve this page

Add a description, image, and links to theadversarial-machine-learning topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with theadversarial-machine-learning topic, visit your repo's landing page and select "manage topics."

Learn more

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

adversarial-machine-learning

Here are 507 public repositories matching this topic...

Trusted-AI /adversarial-robustness-toolbox

Shawn-Shan /fawkes

QData /TextAttack

CyberAlbSecOP /Awesome_GPT_Super_Prompting

protectai /llm-guard

BorealisAI /advertorch

jiep /offensive-ai-compilation

safe-graph /graph-adversarial-learning-literature

RobustBench /robustbench

akanimax /T2F

akanimax /pro_gan_pytorch

chawins /llm-sp

thu-ml /ares

EdisonLeeeee /GraphGallery

deadbits /vigil-llm

Koukyosyumei /AIJack

locuslab /smoothing

Trustworthy-AI-Group /TransferAttack

MinghuiChen43 /awesome-trustworthy-deep-learning

ebagdasa /backdoors101

Improve this page

Add this topic to your repo