SEC536: Adversarial AI - Penetration Testing AI Systems


Experience SANS training through course previews.
Learn MoreLet us help.
Contact usBecome a member for instant access to our free resources.
Sign UpWe're here to help.
Contact UsEnterprise third-party tools increasingly embed AI capabilities as default-enabled vendor updates. Organizations often adopt these tools before governance controls take hold, without fully recognizing the risk. These new capabilities send sensitive data to external vendor endpoints through unanticipated workflows. Current DLP techniques commonly fail against encoded and fragmented payloads, making DLP alone an inadequate control. However, few published baselines exist for how network microsegmentation performs as a compensating control against AI-specific exfiltration. This research evaluated the effectiveness of DLP and network microsegmentation in a containerized lab simulating enterprise AI third-party integrations. The findings demonstrate that relying on traditional DLP inspection alone leaves significant residual risk, particularly against encoded, fragmented, and semantic payloads. Microsegmentation blocks unauthorized destinations but not content-based evasion. Decode-capable inspection recovers encoded payloads but not fragmented or semantic ones. Effective protection against AI-assisted data exfiltration requires a combination of advanced content-aware defenses and application-independent network-layer enforcement.




















