SEC536: Adversarial AI - Penetration Testing AI Systems


Experience SANS training through course previews.
Learn MoreLet us help.
Contact usBecome a member for instant access to our free resources.
Sign UpWe're here to help.
Contact UsAs recent stories covered in NewsBites have shown, AI has changed the vulnerability management landscape, with frontier models now finding software vulnerabilities at enormous velocity and scale. This week, I will be hosting a 30-minute webcast for CISOs and security leaders about the new concepts underlying a VulnOps operating model that continuously reduces exploitability before attackers can pounce. You will leave this webcast with practical strategies for adapting your vulnerability management operations into a business-driven VulnOps capability to help handle the AI-driven vulnerability deluge.
VulnOps: A CISO’s Guide to Starting Implementation | Wednesday, August 12, 2026 | 1:00 pm ET
—Ed Skoudis, President, SANS Technology Institute
Research from 1Password's Off-By-1 Labs found that large language models (LLMs) prompted to generate patches for "recently disclosed, complex vulnerabilities" produced patches that failed to remediate the flaw, added a new flaw, or both, more than half the time. The researchers used two cyber-capable frontier models to each produce 540 patches under varying conditions for each of six CVEs, for a total of 6,080 patches. The vulnerabilities were: privilege escalation in Linux (“Copy Fail,” CVE-2026-31431), remote code execution in ActiveMQ (CVE-2026-34197), use-after-free in Chrome file system access API on macOS (CVE-2026-8512), unauthenticated remote code execution in EXIM (CVE-2026-45185), remote code execution inSpringAI SpEL (CVE-2026-22738), and remote code execution in Gemini CLI (GHSA-wpqr-6v78-jr5g). These flaws were chosen because of their need for complex patch implementations and their recency, as "[the vulnerabilities] and their associated patches were unlikely to be included as part of current models’ training data." 26% of the patches produced a complete fix; 20.1% fixed the vulnerability but altered application behavior; 49.3% did not fix the vulnerability; 2.3% fixed the vulnerability but added a new vulnerability; and 2.1% added a new vulnerability without fixing the original vulnerability. The researchers call the 53.9% of failed patches “Fix-Like Artifacts with Embedded Defects (FLAWED).” The report notes that while both models' average cost of each patch and validation cycle "might seem trivial" at less than $3, "the likely outcome of producing such a patch without altering application behavior was nearly 1 in 4. In other words, LLM-produced patches still require review from a skilled engineer with domain expertise to ensure they actually achieve the desired mitigation(s) without altering application behavior." 1Password concludes by assessing that "LLMs that excel at discovering a wide range of vulnerabilities today are only currently effective at patching a narrow subset of them." The researchers have published the full paper, the generated patches, and the evaluation software, in an effort to help defenders focus on worthwhile uses of AI while avoiding situations that might introduce new flaws.

AI is rapidly becoming astonishingly good at finding vulnerabilities, but this research shows that fixing them is a very different problem. Our team has actually had excellent results using AI to generate patches, but there's an important catch: You need the skills to evaluate whether the proposed fix really works, recognize when it doesn't, and then push the AI to analyze the shortcomings and make it better. In that iterative loop, our results have been remarkably good. That’s where I think we're headed with VulnOps against internally developed software: AI-assisted discovery, AI remediation fix development, human review of the fix, testing, and verification, with skilled humans providing the judgment and repeatedly steering the AI toward a robust fix. Don't expect one-shot AI patching to work reliably. Instead, iterate, test, challenge, improve, and verify. AI can be an extraordinary patching partner, but today it still needs a skilled human at the keyboard.

We are just not there yet when it comes to these LLMs and code. I will however say that if you consider that this time last year agentic AI was just something people discussed a bit, the speed at which this is moving is fairly impressive. I suspect that there will be a point in the near future where the ability to write better software improves dramatically. If you consider that GitHub copilot was 'amazing' in 2018/2019, consider what it looks like today.

I think the bumper sticker version is “AI-generated *.* requires skilled human review.” Tools that allow those skilled humans to more quickly and accurately remediate vulnerabilities are needed and achievable. FIX ALL buttons are neither.

With so much of flaw discovery and remediation being driven through the use of AI, it's really tempting to follow suit with your chosen LLM, because if they can do it, so can you, right? The trick is, just like that new intern, you need to review the work to make sure it's right. It is super tempting, particularly with complex solutions, to forgo that. You know the cliché — work smarter, not harder. Start by having it create an implementation plan with checkpoints, and then consciously decide what you're going to do and where you're checking its work. Have it cite sources for its work. Make sure the fix doesn't modify application behavior or introduce a new flaw.

One hope is that LLMs can patch the vulnerabilities they find. The problem with developing a patch is that verification is more difficult. For a vulnerability, there tend to be better-defined indicators that a vulnerability was found. Some vulnerabilities may be missed, but that is “ok” when looking for vulnerabilities. For a patch, verifying that it fixes the vulnerability completely and does not introduce new problems is more difficult.
Interesting analysis from 1Password. Much like junior engineers learning from past patching mistakes, AI models will refine their capabilities as they are exposed to these flaws. We've seen this evolutionary curve in other AI applications, which is precisely why maintaining a human in the loop remains essential for oversight and validation.

There are several ways to look at this. I don’t mean this in a humorous way, though it may sound it! Since our LLMs are generating probabilistic results, it makes you wonder if flawed code is more likely than not. More seriously, while LLMs are incredible, and while it is amazing how many tasks can be solved at some measure of success by applying a sophisticated attention mechanism to predicting the next most likely token based on context, these systems are not yet close to approximating critical thinking and problem solving. Will bigger be better? Will some of the recent advances in attention and newer models improve this? Probably. In the end, this all remains a math exercise.

Like natural intelligence, we can expect, and have seen, that artificial intelligence gets better over time. It struggles with similar, though different, limitations. It benefits from education and experience. It is best applied to hard problems with easily tested solutions. Said another way, "Trust but verify."
The US National Rural Water Association (NRWA) and DEF CON Franklin have launched the Water Watch Center (WWC), which provides small water utilities with threat intelligence and support to better protect their systems from cyberattacks. Five managed detection and response providers — Rapid7, Defendify, Legato Security, L1 Secure, and Sentinel Technologies — will work with DEF CON Franklin and NRWA to provide cybersecurity services to water utilities serving fewer than 10,000 people, which account for more than 90 percent of the country's water systems. The providers will share threat and vulnerability intelligence with NRWA, which will serve as an information hub for the utilities. The announcement follows a string of cyberattacks at water utilities in at least 12 US states, including Minnesota, Michigan, Georgia, South Dakota, New Jersey, and Alabama. DEF CON Franklin is an organization launched at DEF CON 2024 by the Cyber Policy Initiative at the University of Chicago to pair volunteer cybersecurity experts with US water utilities in need.

The Water Watch Center is a welcome addition to the resources already available through the WaterISAC, MS-ISAC, and federal programs. Better threat intelligence and managed detection can help small utilities understand when they are at risk, yet information alone does not mitigate that risk. Many small water systems simply do not have the trained technical staff or resources to act on what they are being told. The larger challenge is building shared, scalable capabilities that can turn that information into action across thousands of small utilities and begin addressing the systemic risk facing the sector.

I really like this initiative, and am thankful for the great work by NRWA and DEF CON Franklin behind it. Telling a small water utility serving a few thousand people that it needs a world-class SOC, a threat intelligence program, a vulnerability management team, and 24x7 incident response capability isn't particularly helpful when it has neither the people nor the budget to build them. Shared expertise and services can change that equation dramatically. Cybersecurity has spent decades developing sophisticated capabilities for large enterprises; figuring out how to deliver those capabilities economically to thousands of smaller critical infrastructure operators may be every bit as important.

Water utilities are being targeted and compromised, notably via PLCs exposed to the Internet. If you're a small water system, typically serving fewer than 10,000 people, you need to leverage resources such as the WWC from NRWA. NRWA has multiple initiatives and partnerships, including the WaterISAC, SANS, Microsoft, and DEFCON Franklin, along with a bunch of resources you can leverage to help raise the bar on your utility.
Nextgov/FCW
The Register
SecurityWeek
DEF CON Franklin
The US Coast Guard and other authorities are investigating a cyberattack that temporarily disrupted operations at the North Carolina Ports Authority, which comprises Port of Wilmington, the Port of Morehead City, and Charlotte Inland Port North Carolina. The North Carolina Ports Authority confirmed that it detected the incident on Tuesday, August 4, also notifying the media that the attack was the work of an outside threat actor and that the Ports' IT team implemented its cybersecurity contingency plan. As of Wednesday, August 5, the incident was reportedly contained and recovery is now underway. As of late last week, the North Carolina Ports Authority said it had resumed normal schedules, but that operations were "still being processed manually," and delays should be expected. The North Carolina Department of Transportation, the North Carolina Department of Information Technology, and the US Coast Guard have been notified and are aiding the Ports' recovery from the attack.

This incident has something in common with several of the recent attacks against water utilities. The systems and circumstances are different, yet the operational response is familiar. Digital systems become unavailable and operators fall back to manual processes to keep essential services running. That is exactly why manual operations need to be exercised and engineered as part of the resilience plan, not simply documented as an emergency procedure. It's good to know you can operate manually for a few hours, but how long you can sustain it safely and effectively before people, processes, and supply chains begin to break down?

North Carolina serves as a trade hub along the southeastern US. Agricultural exports, retail goods, and raw materials predominantly flow through the port of Wilmington, and when you consider the volume of the three ports, this could have been a fairly disruptive supply chain attack. While the details are getting sorted, it's important to note that their incident response and contingency plan both appear to be working as planned, to include minimal schedule disruptions. Make sure you're set to do this well when it's your turn in the barrel.

One of the most interesting words in this story is "manually." We spend enormous amounts of effort trying to prevent cyberattacks, as we should, but organizations operating critical infrastructure also need to ask a powerful old-fashioned question: "What happens when the computers don't work?" The ability to fall back to well-practiced manual processes can turn a potentially catastrophic cyberattack into a painful but manageable operational disruption. Resilience isn't just automation, backups, and redundant systems. Sometimes it's people who know how to keep the real-world process running without the computers. Humans are a VITAL aspect of resilient operations. Let's never lose sight of that.
While details on the intrusion remain limited, the takeaway is clear that any organization utilizing Operational Technology (OT) must regularly train for manual operations. Cyber risks to OT systems should be formally documented and routinely reviewed in the corporate risk register.
CyberScoop
The Record
BleepingComputer
Maritime Executive
WECT
Apple has released out-of-cycle security patches to fix a high-severity flaw in the Screen Sharing service for macOS Sonoma, Sequoia, and Tahoe. CVE-2026-65400, CVSS score 7.1, allows an attacker on the network to authenticate to Screen Sharing without valid credentials, by exploiting a flaw in the implementation of Secure Remote Password. According to Huntress, this "ultimately allows pre-authenticated remote code execution on all supported macOS versions," and while the Screen Sharing service is not enabled by default on most machines, the service is often enabled for "hosted bare-metal Apple devices, such as the Mac mini available for on-demand workloads," which may not incorporate the newest updates into their base provisioning image and could account for tens of thousands of vulnerable hosts. Users must update to macOS Sonoma 14.8.9, Sequoia 15.7.9, or Tahoe 26.6.1 to fix this flaw.

It's easy to look at the security update and note only one flaw is fixed. Rather than second guessing where screen sharing is and isn't used, push the update to your macOS 26 (Tahoe), 15 (Sequoia) & 14 (Sonoma) systems. Then get moving on updating those macOS 14 systems — Apple is getting ready to release macOS 27 (Golden Gate), ending support for Sonoma. Plan on a three-year lifecycle for any given macOS version, ideally updating yearly to stay on the latest release.

This is the second time in a few weeks that Apple patched screen sharing flaws. macOS 26.6 was released at the end of July, addressing several screen-sharing flaws, but missed this one. These vulnerabilities are logic errors; all an attacker needs is a valid user's username on the system. Exploits exist for these vulnerabilities, but have not been made public so far.
Huntress
Forbes
ZDNET
Calif
Reverse
Bynar
The US Cybersecurity and Infrastructure Security Agency (CISA) has added a critical flaw in Progress Kemp LoadMaster to its Known Exploited Vulnerabilities (KEV) catalog, and has also updated the existing KEV entries for exploited flaws in SonicWall SMA1000 devices. LoadMaster is a load balancer made by Progress Kemp, and CVE-2026-8037, CVSS score 9.6, allows an unauthenticated attacker to execute arbitrary commands on the LoadMaster appliance by exploiting unsanitized input in command endpoints. Progress Kemp patched this flaw alongside a high-severity flaw not known to be exploited, which allows an attacker to upload files with dangerous extensions by exploiting a lack of whitespace normalization in the OWASP Core Rule Set. These flaws affect Kemp LoadMaster GA v7.2.63.1 and older, and LTSF v7.2.54.17 and older; users should consult the table in the Progress Kemp advisory to update to the appropriate fixed version. Two flaws in SonicWall SMA1000 that were added to the KEV and fixed in mid-July 2026 — a server-side request forgery allowing requests to an unintended location (CVE-2026-15409, CVSS score 10.0) and a code injection vulnerability allowing arbitrary OS commands as administrator (CVE-2026-15410, CVSS score 7.2) — have now been observed in use in ransomware campaigns. These flaws affect SMA1000 models 6210, 7210, and 8200v, and users are urged to apply the appropriate hotfix, perform forensic analysis of the system, and take additional actions if indicators of compromise are present: re-image hardware or re-deploy virtual appliances, rotate all passwords, and reset TOTP tokens.

LoadMaster is another case of unvalidated input, to include whitespace in filenames. Not throwing them under the bus here, it's imperative that you sanitize ALL input, regardless of how hard you think it is to supply invalid input. That can be hard and tedious, but you really need to find and fix this before your adversaries leverage it. Apply the update, and make sure that you're on their security alert mailing list. When you apply the SonicWall hotfix, don't skip the check for IoCs; you need to know if you've got additional work or not.
Progress
SecurityWeek
BleepingComputer
SonicWall
CISA KEV
CISA KEV
CISA KEV
CEVA Logistics, a global shipping and logistics firm based in Marseille, France, has suffered a cybersecurity incident, disrupting the company's operations. The incident has affected at least eight of the company's warehouses in Europe. Some companies that use CEVA's services have reported that the breach has affected their operations and compromised their customers' personal information. Dutch online retailer Bol says that the incident has impacted the company's ability "to receive goods from suppliers and sales partners" at one of the affected warehouses, leading to order delays and cancellations, and that some Bol customer data may have been compromised. Other affected companies include Dutch luxury department store chain De Bijenkorf, which reported order delays and customer data compromise, as well as Amsterdam's Ajax football club, banking firm ING, and eyeglasses manufacturer Ace & Tate, which have all reported that customer data were compromised. Video game company Valve has notified customers who recently purchased Steam hardware that their personal data were compromised. CEVA retains customer order data for 90 days. CEVA has not released a statement about the incident, which reportedly began on July 29, 2026. The Dutch Data Protection Authority is investigating.

CEVA is a fully owned subsidiary of the CMA CGM group, the world's third-largest shipping company, which operates 1,000 warehouses and handled 15 million shipments last year. CEVA has been notifying retailers of the breach, who are in turn notifying affected customers. Nobody is taking credit for the attack yet. The data includes the information relating to shipments from May through July: name, address, phone, email, and item purchased. Note that CEVA does have an information retention policy and is only collecting the information needed to deliver the shipment, which is a best practice for third-party integration. That said, this data is a boon for a targeted social engineering attack or other scams, so be on the alert for such activity if you're affected.

Computers really do improve our efficiency, and today most enterprises use them. However, they are also fragile and vulnerable. They should always be used in a manner that does not sacrifice enterprise resilience.
TechCrunch
Help Net Security
BleepingComputer
FreightWaves
Bol
Metabase has released a security update to address a critical SQL injection vulnerability that could lead to administrative access. While Metabase Cloud instances have received the update, users running self-hosted instances need to upgrade to a fixed version. Users whose Metabase instance endpoints are publicly accessible are urged to take the following steps after upgrading to a fixed version: "1) Revoke all active user sessions by accessing the Metabase application database and deleting all rows in core_session table; 2) Review API keys and delete any unrecognized keys; 3) Review administrator accounts for any unexpected changes: 4) Rotate credentials for any of the connected databases; 5) Review data warehouse logs for any sign of unauthorized access; 5) Review Metabase activity and query history for unexpected or unauthorized activity." Users who are unable to upgrade immediately can block the /api/session/reset_password endpoint as a temporary workaround. The flaw has been actively exploited. San Francisco-based laptop company Framework has notified its customers that their names, phone numbers, and email, physical, and login IP addresses have been compromised. Framework learned of the breach from Metabase.

Beyond the update to Metabase, the added steps are critical to invalidate all existing sessions and connections which could then return regardless of the fix. Don't cut corners, as you don't want to repeat this exercise because you missed something. Framework computers are popular as they are modular and repairable/upgradable. While the attack path to Framework was via the Metabase flaw, the attackers only accessed customers’ personal data, not payment information. Hopefully their customers already have credit/ID monitoring in place.

Ouch! SQLi remains a major problem today, sadly. Pay close attention to Metabase's instructions here. They aren't simply saying "patch." Because this vulnerability has been actively exploited, they're telling exposed customers to invalidate sessions, inspect API keys and administrator accounts, rotate database credentials, and hunt through logs for evidence of compromise. That's an important distinction: Once exploitation is occurring in the wild, patching closes the door but doesn't evict attackers who may already have walked through that door. For exploited vulnerabilities, remediation should increasingly mean patch + hunt + credential rotation + clean-up + verification = eradication.

Yes, it is 2026, and we are still worrying about SQL injection. Software like Metabase takes the nitty-gritty details of writing SQL commands away from you and hides them behind a slick UI. But in the end, you are creating SQL, and the systems allow essentially arbitrary SQL queries, making it more difficult to prevent SQL injection with standard techniques like prepared statements. You should always use database permissions to restrict access by frontend tools like Metabase. This will at least reduce the impact of any SQL injection vulnerability.
TechCrunch
The Register
Metabase
GitHub
Help Net Security
Dark Reading
The Hacker News
SecurityWeek
BleepingComputer
On Wednesday, August 5, data analytics company LexisNexis took some of its services offline after the company detected suspicious activity on servers hosted and managed by an as-yet unnamed third-party. LexisNexis is conducting an ongoing investigation with the help of a cyber forensics company, and is rebuilding the affected systems in a new environment to ensure their safety. The Diligence service was reportedly restored over the weekend; the Metabase API and Newsdesk services were expected to be restored on Monday, August 10. A spokesperson for the company clarified that "Nexis Solutions is not a Metabase Cloud customer, and the Nexis Metabase API product has no connection to Metabase Cloud or the reported vulnerability."

Don't get confused connecting Nexis Metabase API to Metabase Cloud: not the same company/product. In this case, anomalous activity was detected on third-party hosted services, and LexisNexis elected to disconnect those services rather than wait and see what happened. The takeaway here is to drill down on your monitoring of your third-party services, and on your response plan in the case that unexpected activity is detected. That's probably a long conversation, but one you need to nail down before you need it.
In a filing with the US Securities and Exchange Commission (SEC), San Francisco-based Levi Strauss & Co. revealed that a cybersecurity breach took place via social engineering, allowing threat actors to access to three company-issued computers. Levi Strauss "initiated response protocols, implemented containment measures, launched an investigation, which remains ongoing and engaged the services of third-party cybersecurity experts." Initial findings from an ongoing investigation indicate that corporate data were exfiltrated, but operations were not disrupted. IEH Corporation, a Brooklyn-based manufacturer of products used in space, commercial aerospace, medical, and defense equipment, has also notified the SEC of "a cybersecurity incident whereby a threat actor using an alias gained unauthorized access to the Microsoft 365 mailbox of an employee of the Company." The initial vector of entry into IEH systems was a phishing attack. The threat actor appears to have gained access top "email messages, attachments, customer communications, purchase orders, engineering-related documentation, and potentially export-controlled technical information.”

Reusable credentials need to go the way of the Dodo bird. And you need to move not just to MFA, but to phishing-resistant MFA. Coincidentally, I saw an announcement from Microsoft that they are moving to phishing-resistant authentication. Specifically they are making passkeys the default authenticator on September 1 for users currently enabled for SMS or phone, prior to retiring SMS and phone validation next February 1.

The IEH breach was enabled by use of reusable passwords; the Levi Strauss incident may have involved some level of MFA bypass, but that is not clear. Both are good reminders to continue to prioritize migration to phishing resistant strong authentication, and to make sure awareness campaigns are reminding everyone not to trust voice messages.
A clear reminder from these filings: cybercriminals love using social media activity to make their phishing and smishing attacks look authentic. Before responding to an urgent or convincing message — whether it's an email, text, or call — always stop and verify the source first.

This really is 2026, and any use of reusable credentials really is reckless.
The Register
The Record
SecurityWeek
SEC
The Register
The Record
Cloudfront
SANS Internet Storm Center StormCast Tuesday, August 11, 2026
Solana Attacks; AI Generated Patches; Gunra Ransomware; Neo4J/GraphQL Patch
https://isc.sans.edu/podcastdetail/10046
Scans for Solana (Surfpool?) Endpoints
https://isc.sans.edu/diary/Scans+for+Solana+Surfpool+Endpoints/33230
Why AI-generated vulnerability patches still require expert human review
Gunra Ransomware
https://www.cisa.gov/sites/default/files/2026-08/aa26-222a-stopransomware-gunra-ransomware_508c.pdf
Neo4J/GraphQL Vulnerability CVE-2026-5423
https://github.com/neo4j/graphql/security/advisories/GHSA-fcpg-3fw5-vc65
SANS Internet Storm Center StormCast Monday, August 10, 2026
Linux Shell Forensics; Critical MacOS Patch; More N-Central Hotfixes; Exploited Metabase Vuln
https://isc.sans.edu/podcastdetail/10044
Linux Shell Forensic: Let’s Dive Into Atuin!
https://isc.sans.edu/diary/Linux+Shell+Forensic+Lets+Dive+Into+Atuin/33226
Apple Patches macOS Screen Sharing Vulnerability
https://support.apple.com/en-us/148170
More N-Able N-Central Issues
https://www.n-able.com/blog/n-central-security-update-august-6-2026
Metabase Unauthenticated SQL injection
https://github.com/metabase/metabase/security/advisories/GHSA-vwf4-m7j8-wcjf
My Upcoming Classes
Catch up on recent editions of NewsBites or browse our full archive of expert-curated cybersecurity news.
Frontier AI is accelerating vulnerability discovery, adaptive attack chains, and attack volume at unprecedented scale. A new era of attacks demands a new model of prevention. Join Cato Networks for the launch of Cato Agentic Threat Prevention and see how specialized defensive agents predict attack paths, personalize protections, and adapt enforcement as threats evolve.
Survey | The Shift from Automation to Agency: A 2026 SANS Survey | Your insights are critical to helping the community understand how organizations are navigating the shift from rule-based automation to AI systems capable of acting independently.
Survey | The State of Cybersecurity at the Human Edge: A 2026 SANS/Sidekick Survey | Share your perspective in this short survey and help shape the insights the community relies on.
Webinar | SANS 2026 Cloud Security Exchange | Monday, August 17 | Explore expert-led sessions led by AWS, Google & Microsoft. Register to attend live or watch on demand.