SEC536: Adversarial AI - Penetration Testing AI Systems


Experience SANS training through course previews.
Learn MoreLet us help.
Contact usBecome a member for instant access to our free resources.
Sign UpWe're here to help.
Contact Us
Lena had recently started using an AI chatbot to help manage her busy life. Between family, bills, and planning for the future, she loved how easy it was to ask questions and get instant answers. One evening, feeling stressed about her finances, she asked the AI for help with investing. It quickly suggested a strategy. However, the AI did not have the full context of Lena’s financial situation, risk tolerance, or tax implications specific to her circumstances. The chatbot recommended moving money into a mix of trending stocks and short-term trades that promised better returns. It even explained how to handle taxes on her investments.
The advice sounded confident and well-thought-out, so Lena followed it. At first, she was excited. But within months, the market shifted and her investments lost value. Worse, when tax season arrived, she discovered she had misunderstood key rules. Because she had followed the AI’s guidance without verifying it, she made tax mistakes that led to penalties and additional costs.
In the end, Lena lost money by trusting advice that wasn’t accurate for her situation. AI can be a helpful tool, but it’s important to remember that AI can make mistakes. When you rely on it without double-checking, small mistakes can quickly turn into costly ones.
Artificial Intelligence (AI) is technology designed to simulate how humans think, process information, and make decisions. This can include generating language, recognizing images, making decisions, creating content, or solving problems. In general, there are three types of AI you can use.
Of the three types of AI, we will focus on Generative AI (GenAI), as it is the type of AI you are most likely using.
GenAI is a powerful tool that can help you complete tasks more efficiently and learn new skills and ideas, if you
use it safely. Here are some things to consider:
AI is one of the most powerful tools available today. It can help you work faster, learn more, and be more productive. But like any powerful tool, it must be used carefully. Do not blindly trust it. Do not overshare with it. Do not give it more control than necessary. Use AI as a tool to assist your decisions, not to replace your judgment.


Portia Jefferson is a cybersecurity professional focused on AI security, risk awareness, and practical guidancefor everyday users. With a background in fintech and tax, she helps individuals safely navigate emerging technologies at work and at home.
Learn more