AI Red Teaming playground labs to run AI Red Teaming trainings including infrastructure.
- Updated
- TypeScript
#
ai-red-teaming
Here are 40 public repositories matching this topic...
A security scanner for your LLM agentic workflows
cli security ai mcp security-tools devsecops red-teaming ai-security llm generative-ai llm-security agentic-framework agentic-workflow agentic-ai mcp-server ai-red-teaming
- Updated
- Python
A collection of servers which are deliberately vulnerable to learn Pentesting MCP Servers.
mcp hacking pentesting bugbounty ai-research mcp-server mcp-client vulnerable-labs ai-red-teaming appsecco learning-pentesting
- Updated
- JavaScript
Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and folks who want to know what's going on inside the LLM-based app they use daily
hacktoberfest ai-security prompt-engineering hacktoberfest2025 llm-security jailbreaks prompt-injection-llm-security ai-red-teaming
- Updated
- Python
AspGoat is an intentionally vulnerable ASP.NET Core application for learning and practicing web application security.
docker open-source csharp dotnet penetration-testing bug-bounty asp-net-core appsec hacktoberfest owasp-top-10 contributions-welcome webapplicationhacking good-first-issue ai-security applicationsecurity productsecurity ai-red-team prompt-injection llm-security ai-red-teaming
- Updated
- JavaScript
Code scanner to check for issues in prompts and LLM calls
cli security ai linter evaluation code-scanning red-teaming ai-security hallucination ai-evaluation llm prompt-injection llm-security ai-code-review llm-evaluation owasp-llm-top-10 ai-performance ai-red-teaming llm-performance
- Updated
- Python
A comprehensive guide to adversarial testing and security evaluation of AI systems, helping organizations identify vulnerabilities before attackers exploit them.
ai redteaming redteam-tools ai-red-team redteaming-tools security-red-team ai-red-teaming llm-red-teaming redteam-guide readteaming-guide
- Updated
Open-source LLM Prompt-Injection and Jailbreaking Playground
machine-learning artificial-intelligence large-language-models llm prompt-engineering generative-ai prompt-injection llm-security ai-red-teaming
- Updated
- Python
AI security and prompt injection payload toolkit
- Updated
- TypeScript
A diagnostic methodology for bypassing LLM defense layers — from input filters to persistent memory exploitation.
awesome-list jailbreaking offensive-security ai-safety ai-research chatgpt prompt-injection llm-security ai-red-teaming aatmf
- Updated
AI red teaming, jailbreaking, and all forms of adversarial attacks for security purposes
- Updated
- Python
The ultimate OWASP MCP Top 10 security checklist and pentesting framework for Model Context Protocol (MCP), AI agents, and LLM-powered systems.
owasp cybersecurity pentesting offensive-security security-checklist owasp-top-10 security-framework zero-trust ai-security llm-security prompt-injection-llm-security model-context-protocol agent-security ai-red-teaming mcp-security owasp-mcp ai-pentesting
- Updated
Basilisk — Open-source AI red teaming framework with genetic prompt evolution. Automated LLM security testing for GPT-4, Claude, Grok, Gemini. OWASP LLM Top 10 coverage. 32 attack modules.
security ai jailbreak genetic-algorithm owasp pentesting offensive-security red-team vulnerability-scanner red-teaming ai-security basilisk llm prompt-injection llm-security owasp-llm-top-10 ai-red-teaming adversarial-ai llm-security-compliance-prompt-injection chatgpt-security
- Updated
- Python
Comprehensive taxonomy of AI security vulnerabilities, LLM adversarial attacks, prompt injection techniques, and machine learning security research. Covers 71+ attack vectors including model poisoning, agentic AI exploits, and privacy breaches.
machine-learning ai-security ai-privacy open-source-security adversarial-ml prompt-injection ai-red-teaming model-poisoning llm-attacks ai-vulnerabilities security-taxonomy
- Updated
A repository for your Garak runs, as well as a modern visualizer.
- Updated
- TypeScript
Awesome LLM security tools, research, and documents
- Updated
🛡️ Safe AI Agents through Action Classifier
python agent ai mcp agents ai-safety ai-agents tool-use ai-agent ai-evaluation llms generative-ai ai-red-team gen-ai llm-benchmarking agentic-ai ai-red-teaming llm-red-teaming agent-safety tool-orchestration
- Updated
- Python
Projet issu du codelab Devfest Nantes 2025 “La guerre des prompts” : atelier de 2h pour apprendre à pirater des IA et comment les protéger via des frameworks open source
- Updated
- Python
Agentic AI Security Bootcamp is a hands-on, research-driven training environment for analysing, attacking, and securing autonomous AI systems. The repository provides structured labs, adversarial evaluation frameworks, and red-teaming exercises covering multi-agent observability, prompt injection..
multi-agent-systems autonomous-agents ai-security ai-red-teaming agentic-ai-security ai-supply-chain-security
- Updated
- Python
LLM Attack Testing Toolkit is a structured methodology and mindset framework for testing Large Language Model (LLM) applications against logic abuse, prompt injection, jailbreaks, and workflow manipulation.
offensive-security security-research prompt-injection llm-security agent-security ai-red-teaming adversarial-ai rag-security llm-pentesting tool-injection jailbreak-testing logic-abuse ai-workflow-testing context-leakage ai-application-security
- Updated
Improve this page
Add a description, image, and links to the ai-red-teaming topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ai-red-teaming topic, visit your repo's landing page and select "manage topics."