SEC536: Adversarial AI - Penetration Testing AI Systems


Experience SANS training through course previews.
Learn MoreLet us help.
Contact usBecome a member for instant access to our free resources.
Sign UpWe're here to help.
Contact UsGoogle has paused its Open Source Software Vulnerability Rewards Program (OSS VRP) in response to a "significant rise" in AI submissions. In announcements on the program's website and on X, Google says that the program is halted as of October 1, 2026; the company will provide "an update" in the first few months of 2027. According to Tom's Hardware, "Google engineers and open-source maintainers were reportedly being overwhelmed by thousands of these poorly written reports that claimed to find bugs but were actually completely invalid or unexploitable hallucinations." Google urges researchers to submit reports through the company's other VRP programs or through the Patch Rewards Program.

We've talked about AI Slop before — if you are submitting bug reports, make sure that you've reviewed the submission, ensuring it's truly accurate and verifiable. If you're accepting submissions, make sure that your policy clearly states that badly written and bogus reports will be discarded, then use logic to filter these out. If possible, summarize the reported issue to mitigate risks of ignoring a legitimate flaw. Human governance of AI created content is critical, both for credibility and to ensure that you first do no harm.

AI can make people more productive, but unfortunately that also includes making people more productive at producing rubbish. Vulnerability disclosure programmes rely on researchers submitting useful, accurate, and actionable information. Flooding maintainers with thousands of AI-generated reports that somebody has not bothered to validate does not improve security, it simply consumes the time of people who could otherwise be fixing genuine vulnerabilities. AI should help researchers do better work, not simply help them generate more of it.

This is one of the less glamorous ways AI is changing vulnerability discovery and disclosure: it can create findings faster than humans can validate them. When the marginal cost of generating a plausible vulnerability report approaches zero, the cost of proving that report is real does not. Google says the rise in AI submissions became significant enough that it paused its Open Source Software Vulnerability Rewards Program. Programs like this are going to need stronger quality gates, reproducibility requirements, and ways to protect scarce reviewer attention. AI can help us find more real vulnerabilities. We cannot let it bury them in noise.

I know Google is big on using AI to do the full "Find, Fix, Patch, etc." cycle, but it seems they are now seeing that not all AI submissions are valid. I am wondering how they will solve this; it would be interesting to see whether they add hooks or something similar to make it "easier" for AI models to find, fix, and triage bugs. I'm not sure whether that would be through a skill or a set of instructions, but I’m curious to see how this shakes out.
Bug bounty programs have earned their keep over the years, but AI is completely scrambling the vulnerability-finding playbook. Google pressing pause on its program is a clear reaction to the downside. Bottom line: thanks to frontier models, anyone with an account now fancies themselves a security researcher ready to cash in.

Hard not to snicker when AI “slop” impacts the major AI players, but the companies that offer managed bug bounty services have run into the same issue — vetting of participants and adherence to stricter rules of engagement is going to be needed.
X
TechCrunch
Tom's Hardware
SecurityWeek
Help Net Security
SCWorld
Apple is adjusting the controls that manage an app API's use of Full Disk Access, adding measures to ensure that users are aware of the level of permission afforded by this access when choosing whether or not to grant it. Apple contends that it is critical to have "very explicit user action" to allow an app to have the "extraordinary" privileges of Full Disk Access, which bypasses the API's built-in controls that protect users' private data, primarily so backup apps can function properly. The Hacker News notes that Full Disk Access permission settings have been available since the release of macOS Mojave 10.14 in 2018. Apple explains that "some developers are using Full Disk Access in ways that could put users at risk, exposing everything on their systems — including files, mail, messages, and even browsing history — without users’ full knowledge and understanding," specifically emphasizing the risks of AI agents holding this privilege and of messaging apps compromising the privacy of anyone communicated with. News outlets note that this October 2 announcement from Apple follows the September 19 publication of an article describing Jason Aten's experience with Meta Muse, in which he claimed the agent with Full Disk Access read his Apple Messages even though he had never enabled the "Messages connector" feature. TechCrunch notes that Apple's announced change to make Full Disk Access permissions more explicit "reflects informed consent, but is not a new limit."

Last issue, we were talking about accountability for autonomous agents. This story gets closer to the engineering problem. A consent dialog is not a sandbox. Full Disk Access is intentionally broad, while an agent may take many actions after the user clicks Allow, some of which the user would never anticipate. Apple is right to make the risk more explicit, but the longer-term answer is more fine-grained capabilities, shorter-lived grants, and strong audit trails around what an agent actually accessed. Human consent matters. So does limiting what software can do after consent.

As we give AI agents greater access to our devices and data, we need to remember one of the oldest principles in cybersecurity, the principle of least privilege. An AI agent should only have access to the information and systems it actually needs to perform the task we have given it. We also need to ensure users properly understand what permissions they are granting. Clicking "Allow" should represent informed consent rather than simply being the quickest way to make the annoying pop-up disappear.

This is more of a clarification to make it easier to see what access you're granting. Not a whole lot of things need full disk access, but instead only the files they need, if any. Right now, go into your settings and see what applications have full disk access. That should probably only be your EDR, backup and network file sync apps (OneDrive, iCloud Drive, etc.). Most other things only need specific folders. You can usually have more than one folder, so you don't have to give broad access that includes stuff that should not be accessible.

This is a great move by Apple to make it more deterministic to understand what portions of the filesystem are being accessed by an application. I think Apple needs to do more work compartmentalizing the system and maybe help developers use containers better to put a handle on systems like OpenClaw. Windows is already starting to do this with WSLC, and you have to imagine that now that Apple supports native containers, it will also be advancing that feature.
AI is forcing organizations to rigorously overhaul their Identity and Access Management (IAM) frameworks. This move by Apple represents an explicit acknowledgment of risk and a proactive step to limit liability against unpredictable agent behaviors. Anyone deploying agentic AI must carefully evaluate both the direct and indirect access permissions granted to these applications.
Apple
Ars Technica
Help Net Security
The Hacker News
TechCrunch
Inc
Three days after Kiteworks was warned of an imminent cyberattack — prompting the company on September 25 to urge users to shut down all Kiteworks servers between 2:00 and 8:00 UTC on September 26 (described in NewsBites 28.71) — the company released a follow-up press release noting that the threat window had "passed without incident" and that a critical vulnerability had been remediated. During the shutdown period, investigation by internal teams and federal intelligence authorities revealed "a previously unknown critical vulnerability confined to a capability that is enabled for less than 1% of the customer base," which allowed the company to develop and deploy a fix and an "additional protective layer" before systems were restored. No CVE nor details have yet been shared about this critical vulnerability. No abnormal activity was observed during the anticipated threat window. Kiteworks's CISO, Frank Balonis, stated that "when the choice is between certainty and convenience, customer data is not something we are willing to gamble with," and Kiteworks's CEO and Chairman, Jonathan Yaron, stated that "[Kiteworks] would rather be proactive on credible warning than wait for certainty and be too late." CyberScoop notes that Kiteworks is the rebranded name of a company formerly known as Accellion, whose File Transfer Appliance was compromised with zero-day exploits in late 2020 and early 2021 to breach Accellion clients, including major retail companies, law firms, government offices, and universities. Kiteworks users should ensure they have updated to the latest available release to fix the unnamed flaw and other critical flaws discovered recently.

Make sure you're on Kiteworks 9.4.1 or higher. Their Email Protection Gateway (EPG) is a component in the Kiteworks Private Content Network (CPN). There were 11 critical authentication bypass, admin account takeover, XSS, improper access control and authentication flaws in the Kiteworks Core and EPG components. The most critical is tracked as CVE-2026-54154, but there are other flaws which are addressed which don't yet have CVE identifiers. Don't wait for that — apply the update and verify you're following security best practices and leveraging layered defenses. Attackers are searching for unpatched instances, so don't be their success story.

Last week I wrote that this is what threat intelligence is supposed to do: change defensive behavior before an attack happens. This follow-up is about as good an outcome as you could hope for. Kiteworks acted on a credible warning, took systems offline, found a previously unknown critical vulnerability during the shutdown, fixed it, added another protective layer, and the anticipated threat window passed without incident. A quiet outcome can be easy to second-guess because the bad thing never happened. But sometimes that is exactly what successful prevention looks like. Let's not fall into the "boy who cried wolf" syndrome on this kind of thing going forward. Kudos to Kiteworks and to the federal partners who got the warning to them.
Whether this was a narrow escape or manufactured fearmongering from a malicious actor, the CEO made the right call by prioritizing user data protection above all else. At this stage, formalizing the vulnerability as a CVE is likely redundant now that the fix is already available.

I applaud Kiteworks for making what cannot have been an easy decision. Taking customer systems offline based on credible threat intelligence, before having absolute certainty that an attack will happen, requires strong leadership and a clear understanding of risk. It is much easier to explain why you temporarily disrupted a service to protect customer data than to explain after a breach why you had credible intelligence of an imminent attack and decided to do nothing.
Kiteworks
Kiteworks
CyberScoop
Dark Reading
BleepingComputer
The Hacker News
BleepingComputer
Fortinet has published a security advisory urging users to apply immediate workarounds for a critical flaw in FortiMail that is known to be exploited in the wild. CVE-2026-104286, CVSS score 9.8, allows an unauthenticated attacker to write arbitrary files on the underlying system by exploiting a path traversal flaw with crafted HTTP or HTTPS requests. Fortinet's recommended workaround is to disable IBE feature support in the GUI — under "Encryption," select "IBE" and set IBE Service to "Off" — or by using a CLI command provided in the advisory. Users can also disable access to the FortiMail webmail interface from the internet or restrict access to only a trusted private network, and use a Web Application Firewall in front of FortiMail to block specific POST requests to /ibe. The advisory also provides IPs, system event logs, and encryption logs to look for as indicators of compromise (IoCs). The US Cybersecurity and Infrastructure Security Agency (CISA) added CVE-2026-104286 to its Known Exploited Vulnerabilities (KEV) catalog on October 1, with a three-day mitigation deadline for Federal Civilian Executive Branch (FCEB) agencies, including required forensic triage per BOD 26-04. Updated FortiMail releases have not been published yet at the time of this writing, but as soon as they are available, FortiMail versions 8.0.0 through 8.0.1 should upgrade to 8.0.2 or above; 7.6.0 through 7.6.6 should upgrade to 7.6.7 or above; and both 7.2.0 through 7.2.9 and 7.4.0 through 7.4.8 should upgrade to 7.4.9 or above.
It's been a brutal year for Fortinet. What is this, the fourth or fifth major vuln cycle? We’ve seen a steady stream of zero-days, active exploitation, and massive credential harvesting hitting their network gear. Here's hoping they are fundamentally rethinking their approach to secure-by-design software development. Taking a hard look at the CIS Secure by Design guide wouldn't hurt.
Fortinet
CISA
The Hacker News
The Register
Help Net Security
SecurityWeek
On Sunday, October 4, Citrix published a security bulletin addressing a high severity memory overflow vulnerability leading to denial of service (CVE-2026-88779, CVSS score 8.7) in Citrix NetScaler ADC (formerly Citrix ADC) and Citrix NetScaler Gateway (formerly Citrix Gateway). According to a blog post published by NetScaler Cyber Threat Intelligence, "Citrix has observed targeted attacks [exploiting the vulnerability] on unmitigated NetScaler deployments." The post also notes that "exposure depends on how the NetScaler deployment is configured." Citrix has published signatures that can be used with the Global Deny List feature as a mitigation until organizations are able to update to a fixed version. Citrix credits researchers at Bishop Fox and watchTowr for working with Citrix regarding the vulnerability; watchTowr has also published an FAQ about CVE-2026-88779. The US Cybersecurity and Infrastructure Security Agency (CISA) has added the flaw to the Known Exploited Vulnerabilities (KEV) catalog, making this the third Citrix NetScaler vulnerability added to the database in eight days.

At this point, if you're a NetScaler shop and you wish to stay with NetScaler, it'd be a good idea to see if their cloud managed service would be a less risky option for you. While you launch folks at running that to ground, have another team make sure that you're on the latest ADC/Gateway release, regardless of whether you're in a vulnerable configuration. Prioritize updating deployments using SAML authentication for Gateway or AAA virtual servers, and don't stop until everything is updated. The watchTowr FAQ includes information you can leverage when explaining to others and also includes steps to take. Don't overlook running down IoCs; remember you want at check at least 30 days of logs.

At this point, if you are running NetScaler at the perimeter, you must be wondering when this will end. If I were at Citrix, I would have been putting a lot of testing and vulnerability analysis cycles through the NetScaler product. It definitely appears that adversaries are either doing that or have been sitting on critical zero-days for a long time, and we are just seeing a flood of them now, week after week. I’m not sure if this is causing companies to re-evaluate their NetScaler offering, but it just feels like putting this box on the edge of your network is currently a red flag.

The risk here is application and configuration dependent. However, NetScaler includes security functionality and is often relied upon in systems of layered defense (defense in depth). If you use it at all, consider the recommendations with the same urgency as KEVs.
Help Net Security
The Hacker News
watchTowr
Citrix
Citrix
KEV
Over the weekend, Microsoft released unexpected updates for Exchange Server to address a high severity privilege elevation vulnerability (CVE-2026-96940, CVSS scores 8.8 / 7.7) that could be exploited to gain access to other users' mailboxes within an organization; Microsoft notes that "the vulnerability does not allow access across tenant boundaries." Microsoft has also deployed a server-side fix to Exchange Online late last week. The vulnerability was found by internal researchers. While there is presently no indication that it is being actively exploited, the vulnerability has low attack complexity with no user interaction, and Microsoft has assigned it an exploitability assessment of "more likely." Users are urged to ensure they are running the most current version of Exchange Server.

You know those locally hosted Exchange servers I keep bugging you about? Yeah, get them patched right away. If you're running Exchange Server 2016 or 2019, updates are only available if you're under the Period 2 Extended Security Update (ESU) program. Beyond verifying the ongoing need for hosting this service, make sure that there is a trackable plan to update these to Exchange SE RTM with the latest Security Updates, in this case the 9/2026 V2 update.

If Microsoft consider this urgent enough to release "unexpected" updates, then we should act accordingly.
Help Net Security
Heise
The Hacker News
Microsoft
Microsoft
The US Cybersecurity and Infrastructure Security Agency (CISA) has sent a final rule under the Cyber Incident Reporting for Critical Infrastructure Act (CIRCIA) to the Office of Management and Budget (OMB) for review. The terms of CIRCIA, which was enacted in 2022, require CISA to establish and oversee rules for critical infrastructure entities regarding the reporting of cybersecurity incidents and ransomware payments. The final rule was developed with input from Sector Risk Management Agencies of 16 critical infrastructure sectors, the Justice Department, and other government agencies. The covered entities will be required to report "substantial" cyber incidents to CISA within 72 hours of discovery; if a ransom is paid, that must be disclosed to CISA within 24 hours of payment. The reporting thresholds depend on the size and annual revenue of the critical infrastructure organizations, and each sector has its own set of thresholds. The entities will also be required to submit follow-up reports and to retain two years of incident data.

This has taken time, as the direction also included cutting overlap with existing regulations. The proposed version of the rule dates from 2024, and initially was hoped to be complete in October of 2025, but due diligence and funding gaps pushed it out to last week, and with luck it'll be finalized by the end of 2026. If you're an affected agency, make sure you have the capability to report in the required interval, to include identifying who is accountable and what is actually involved in making those reports. You really don't want to tell the regulator/auditor you didn't know; those are not fun conversations.

Organisations operating critical infrastructure are increasingly facing mandatory incident reporting requirements on both sides of the Atlantic. Whether it is CIRCIA in the US or NIS2 in the EU, organisations need processes that enable them to quickly determine whether an incident meets the relevant reporting threshold, identify who must be notified, and gather the information needed to make that report. Trying to work those things out for the first time while responding to a major cyberattack is not a good incident response strategy.
HIPAA Journal
Gov Infosecurity
Denmark's Central Population Register (CPR) has disclosed a cybersecurity incident that compromised names, addresses, and CPR numbers of roughly 8.8 million individuals. The CPR administration learned on October 2, 2026, of anomalous activity in the CPR system during the preceding month. The CPR system contains information pertaining to roughly 11 million Danish citizens, including those living in Denmark, those who have moved to other countries, and those who are deceased. CPR numbers are used to access healthcare, banking, and government services in Denmark. The intruders gained access to the information "by abusing a Danish company's legal access to search for information in the CPR system." The compromised company's access has been halted; the incident has been reported to the Danish Data Protection Authority and is being investigated.

Yet another breach highlighting that vendor risk management remains a discipline cyber security teams need to get on top of. Remember: Once you outsource access to another company, you are relying on that company's security team to protect you. What steps have you taken to ensure you can have confidence in that company's security team? The EU Agency for Cyber Security has published a very good guide on how to manage supply chain risk. https://www.enisa.europa.eu/publications/good-practices-for-supply-chain-cybersecurity

Considering that the population of Denmark is just over six million, this is a pretty comprehensive breach. Called a population scale breach, these were previously seen in Argentina (2021), Turkey (2016), India (2018), and Israel (2026). Danish 10-digit CPR numbers, used for banking, healthcare, and government services, begin with a person's date of birth and are intended to last a lifetime. In that context, this is as significant as grabbing an entire country's database of SSNs. The breach leveraged a third party’s access to the database and involved brute-forcing to enumerate CPR numbers. We all have interfaces for accessing our data rather than providing the entire data set to a partner or customer. The question is: Did we implement monitoring and use detection to catch and stop anomalous behavior? We still need to watch for low and slow, and a lot of new tools are loud and fast for now. Model and verify normal behavior, then catch the exceptions. Rate and data size limits should be in the conversation.
A textbook exploitation of a trusted relationship. This incident serves as a vital reminder that granting third-party access carries two critical responsibilities: thoroughly evaluating the vendor's security posture and actively integrating them into your own risk management framework. Regrettably, it is a lesson we seem destined to keep learning.

Not a lot of details, but it sounds like a supply chain trusted partner was breached or had an employee go bad. No info on how this was detected, which would lead to "why wasn’t it detected more quickly?"

Denmark has many names that are very common; the applications and environment in which the CPR number is used makes the association between the number, which includes the six digit DoB, and the name, much more than simply a tie-breaker. Disclosure of this database will result in an increase in fraud.
Researchers at the Symantec Threat Hunter Team say that Warlock ransomware is being used in attacks against critical infrastructure organizations in Portuguese-speaking and Spanish-speaking countries. The threat actors are exploiting known vulnerabilities in Microsoft SharePoint. In late August 2026, the US Cybersecurity and Infrastructure Security Agency (CISA) updated an alert originally released in July 2026 warning that threat actors were exploiting six SharePoint vulnerabilities; the document urges users to harden their SharePoint instances. On October 1, the mayor of Vicksburg, Mississippi disclosed that the city's IT systems had suffered a ransomware attack. The city made the decision to shut down a portion of its internet services; the incident has affected utility payment services, but emergency services are operational. The city is investigating the incident along with the Department of Homeland Security (DHS) and the FBI. Investigation has not yet determined whether the attackers compromised personal information.

Before you breathe easy that Warlock is targeting SharePoint sites someplace else, make sure that you've applied the updates from Microsoft as well as the hardening guidance from CISA. The city of Vicksburg is doing a great job of letting the news media know what's going on, however, looking at their website, it appears to be business as usual — no mention of the incident and impacts on services. Make sure that you're putting notices on your regular websites; don't assume all your users will catch the news. If you're interacting with the city, be kind, as they are probably overwhelmed from all sides and need all the support they can get.

While there is not much one can do to protect oneself after others compromise one’s personal information, Vicksburg citizens should join those of us who act as though our PII is public. We lock our credit bureau data and verify activity on a timely (daily?) basis. We prefer to do business with those who offer strong authentication and out of band confirmation of all activity.
The Record
SecurityWeek
Security
CISA
The Record
Vicksburg Post
SANS Internet Storm Center StormCast Tuesday, October 6, 2026
cowrie tty Logs; Another NetScaler 0-Day; Exchange Patch
https://isc.sans.edu/podcastdetail/10124
TTY Logs and the Data it Captures
https://isc.sans.edu/diary/TTY+Logs+and+the+Data+it+Captures/33396
Citrix NetScaler SAML Vulnerability (0-Day) CVE-2026-88779
https://support.citrix.com/support-home/kbsearch/article?articleNumber=CTX697174
Microsoft Exchange September 2026 V2 Update CVE-2026-96940
SANS Internet Storm Center StormCast Monday, October 5, 2026
Funny User-Agents; FortiMail 0-Day; GitLab Patch; macOS Full Disk Access
https://isc.sans.edu/podcastdetail/10122
User Agent Strings Curiosities
https://isc.sans.edu/diary/User+Agent+Strings+Curiosities/33394
FortiMail Improper limitation of a pathname to a restricted directory CVE-2026-104286
https://fortiguard.fortinet.com/psirt/FG-IR-26-175
Critical GitLab Vulnerability CVE-2026-90970
Updates to Full Disk Access in macOS
https://developer.apple.com/news/?id=p6zjojqw
My Upcoming Classes
Catch up on recent editions of NewsBites or browse our full archive of expert-curated cybersecurity news.
When an AI agent does something unexpected, where do you look? Agents work on your machines with your credentials and report to no one. Origin finds every agent and reconstructs each session from endpoint evidence, from the request through every action and change. See a trace investigation in a 30-minute walkthrough.
Webinar | SANS 2026 Exposure Management Survey Insights: Cyber Exposure at a Crossroads | Wednesday, October 7 | Benchmark your program and get concrete steps to close the gap.
Webinar | How Predictive AI Is Rewriting the Attacker Timeline | Monday, November 9 | What if your SOC could see the next move before the attacker makes it?
Webinar | SANS 2026 State of ICS/OT Security Survey Insights: Industrial Cybersecurity at a Crossroads | Tuesday, November 10 | Learn benchmarks and insights you need to make informed decisions in 2026 and beyond.