AI in Cybersecurity

tip

Learn & practice AWS Hacking:HackTricks Training AWS Red Team Expert (ARTE)
Learn & practice GCP Hacking: HackTricks Training GCP Red Team Expert (GRTE)
Learn & practice Az Hacking: HackTricks Training Azure Red Team Expert (AzRTE)

Support HackTricks

Main Machine Learning Algorithms

The best starting point to learn about AI is to understand how the main machine learning algorithms work. This will help you to understand how AI works, how to use it and how to attack it:

{{#ref}} ./AI-Supervised-Learning-Algorithms.md {{#endref}}

{{#ref}} ./AI-Unsupervised-Learning-Algorithms.md {{#endref}}

{{#ref}} ./AI-Reinforcement-Learning-Algorithms.md {{#endref}}

{{#ref}} ./AI-Deep-Learning.md {{#endref}}

LLMs Architecture

In the following page you will find the basics of each component to build a basic LLM using transformers:

{{#ref}} AI-llm-architecture/README.md {{#endref}}

AI Security

AI Risk Frameworks

At this moment, the main 2 frameworks to assess the risks of AI systems are the OWASP ML Top 10 and the Google SAIF:

{{#ref}} AI-Risk-Frameworks.md {{#endref}}

AI Prompts Security

LLMs have made the use of AI explode in the last years, but they are not perfect and can be tricked by adversarial prompts. This is a very important topic to understand how to use AI safely and how to attack it:

{{#ref}} AI-Prompts.md {{#endref}}

AI Models RCE

It's very common to developers and companies to run models downloaded from the Internet, however just loading a model might be enough to execute arbitrary code on the system. This is a very important topic to understand how to use AI safely and how to attack it:

{{#ref}} AI-Models-RCE.md {{#endref}}

AI Model Context Protocol

MCP (Model Context Protocol) is a protocol that allows AI agent clients to connect with external tools and data sources in a plug-and-play fashion. This enables complex workflows and interactions between AI models and external systems:

{{#ref}} AI-MCP-Servers.md {{#endref}}

AI-Assisted Fuzzing & Automated Vulnerability Discovery

{{#ref}} AI-Assisted-Fuzzing-and-Vulnerability-Discovery.md {{#endref}}

tip

Learn & practice AWS Hacking:HackTricks Training AWS Red Team Expert (ARTE)
Learn & practice GCP Hacking: HackTricks Training GCP Red Team Expert (GRTE)
Learn & practice Az Hacking: HackTricks Training Azure Red Team Expert (AzRTE)

Support HackTricks