homepage
Menu
Open menu
  • Training
    Go one level top Back

    Training

    • Courses

      Build cyber prowess with training from renowned experts

    • Hands-On Simulations

      Hands-on learning exercises keep you at the top of your cyber game

    • Certifications

      Demonstrate cybersecurity expertise with GIAC certifications

    • Ways to Train

      Multiple training options to best fit your schedule and preferred learning style

    • Training Events & Summits

      Expert-led training at locations around the world

    • Free Training Events

      Upcoming workshops, webinars and local events

    • Security Awareness

      Harden enterprise security with end-user and role-based training

    Featured

    Get a Free Hour of SANS Training

    Free Course Demos

    Can't find what you are looking for?

    Let us help.
    Contact us
  • Learning Paths
    Go one level top Back

    Learning Paths

    • By Focus Area

      Chart your path to job-specific training courses

    • By NICE Framework

      Navigate cybersecurity training through NICE framework roles

    • DoDD 8140 Work Roles

      US DoD 8140 Directive Frameworks

    • By European Skills Framework

      Align your enterprise cyber skills with ECSF profiles

    • By Skills Roadmap

      Find the right training path based on critical skills

    • New to Cyber

      Give your cybersecurity career the right foundation for success

    • Leadership

      Training designed to help security leaders reduce organizational risk

    • Degree and Certificate Programs

      Gain the skills, certifications, and confidence to launch or advance your cybersecurity career.

    Featured: Solutions for Emerging Risks

    New to Cyber resources

    Start your career
  • Community Resources
    Go one level top Back

    Community Resources

    Watch & Listen

    • Webinars
    • Live Streams
    • Podcasts

    Read

    • Blog
    • Newsletters
    • White Papers
    • Internet Storm Center

    Download

    • Open Source Tools
    • Posters & Cheat Sheets
    • Policy Templates
    • Summit Presentations
    • SANS Community Benefits

      Connect, learn, and share with other cybersecurity professionals

    • CISO Network

      Engage, challenge, and network with fellow CISOs in this exclusive community of security leaders

  • For Organizations
    Go one level top Back

    For Organizations

    Team Development

    • Why Partner with SANS
    • Group Purchasing
    • Skills & Talent Assessments
    • Private & Custom Training

    Leadership Development

    • Leadership Courses & Accreditation
    • Executive Cybersecurity Exercises
    • CISO Network

    Security Awareness

    • End-User Training
    • Phishing Simulation
    • Specialized Role-Based Training
    • Risk Assessments
    • Public Sector Partnerships

      Explore industry-specific programming and customized training solutions

    • Sponsorship Opportunities

      Sponsor a SANS event or research paper

    Interested in developing a training plan to fit your organization’s needs?

    We're here to help.
    Contact us
  • Talk with an expert
  • Log In
  • Join - it's free
  • Account
    • Account Dashboard
    • Log Out
  1. Home >
  2. Blog >
  3. Shining some light on Solarwinds and ICS
370x370_Tim-Conway.jpg
Tim Conway

Shining some light on Solarwinds and ICS

February 15, 2021

Should OT professionals care about Solarwinds?

_.png

As the details of the Solarwinds events continue to emerge and the realities of this campaign are fully understood by the cybersecurity community, there have been some amazing discussions and acknowledgments of interdependency risks across complex enterprise networks and what lessons can be learned from these attacks (see the SANS Solarwinds lightning summit). Meanwhile, in other parts of the organization, there are also discussions around a rising concern within the Operations Technology environments, where practitioners working in the Industrial Control System space find themselves asking what does this mean for us? There is definitely an understanding that this is not just an “IT” problem, but there is also a bit of a question around how big of an “OT” problem is this? I believe the answer is, this is likely a big OT problem.

What SPF are you?

UV.png

It is important to shift our focus away from Solarwinds specifically for a couple of reasons; first, there has been a lot of great analysis on the “how” and “what” behind this complex attack and it is certainly important to understand what is known with a particular event, but we seem to have entered into the phase of this analysis where there is a lot of finger-pointing in regards to who is the weakest link that allowed this whole access operation to be conducted successfully. The reality is much of the cybersecurity world already knows the real answer: there are multiple weak links everywhere.

This is the second reason we need to move past Solarwinds in our thinking and discussions – there are so many other “Solarwinds” scenarios waiting to be uncovered. From an adversary perspective, if the goal of these campaigns was to gain broad access to a target organization with strong security practices – what better indirect target than attacking a targeted organization's security vendors. Consider a targeted organization with strong security controls or possibly a target that is subject to regulation, they would likely have fairly well-documented policies and procedures in relation to the security controls required throughout their environment. Which could mean that the frequency of security updates performed or the need for network monitoring, logging, and alerting may be a predictable known technology anticipated and leveraged by the adversary. For example; prior to a sector being regulated if an adversary wanted to target multiple utilities in a region and demonstrate a foothold as a deterrent or if needed cause an impact, they would really need to work through the vast variations of each organization's approach to cybersecurity. Now an advanced adversary would likely look to the requirements of a regulation in effect and understand which assets fall under what level of protection, and then understand how those assets are interconnected. This would help focus access operations toward the assets with the lowest security controls in place and would help inform the adversary on what trusted communications paths are in place to allow movement within the environment.

It is important to acknowledge that strong security controls programs and regulations are essential, but it is also important to understand that they do inform adversaries as well. Understanding that a particular target has remote access requirements, encryption, malicious communications detection, endpoint antivirus, security patching, change management capabilities, monitoring, logging, alerting, and routine vulnerability assessment requirements will certainly set the security bar higher and inform adversaries of what they will encounter and what they can take advantage of. For a high criticality site with anticipated security controls, an adversary’s concept of operations may pivot and indirectly target the remote clients wherever they connect securely via remote access, target security vendors to manipulate signatures and engine updates that are necessary for the security detection platforms, target the vendors that provide a hub and spoke trusted connections to endpoints in higher criticality network segments for patch testing repositories and deployments, as well as targeting security monitoring solutions or external managed service providers. With an understanding of what actions a target is required to perform and a deeper understanding of how they perform it, an adversary can also ensure that they operate on the protocols necessary for a specific category of security solution that would be allowed in an environment. As our nation continues to struggle with finding the right balance of regulations and incentives to move critical infrastructure entities to stronger levels of cybersecurity and we consider vendor allow lists or block lists to ensure only certain technologies are deployed, we are also providing a map of controls and technology our adversaries will encounter and need to interact with to achieve their objectives.

Living on an island with plenty of shade

island.png

Long ago an ICS cybersecurity professional could talk about their facilities and use the terms “air gapped” or “islanded” with the intent of describing an operational communications path that was isolated and defined. With the level of interconnectedness, interdependence, ravenous data hunger, and the speed at which data is moved; it is hard to mention the word air gapped without being laughed at or at a minimum having everyone assume the individual doesn’t know what they don’t know. Yet even with an enlightened ICS cybersecurity community there is still a gut reaction to quickly move to certainty when events occur that we really need to learn from. Examples of lessons observed and not learned:

Ukraine 2015 – “that is a problem for that country, we are way over here and no one would do that to us” “that was an electric sector attack, we are in natural gas we are different”

Ukraine 2016 – “we don’t use that technology vendor or those devices” “we don’t use those protocols”

NotPetya – “we don’t have those kind of connections to external infrastructure”

Trisis – “our safety systems are isolated and can only be directly accessed”

Oldsmar’s water – “the alarm system would have prevented any impact even if the operator did not”

With the growing concerns of work from home, connections from anywhere, cloud connectivity, transient cyber devices moving from one asset to the next, existence of force multiplier ICS modular attack frameworks, adversary demonstrated capabilities to modify a control systems protections, and the rapid implementation of digital cyber to physical devices at all levels of entity architectures; we need to ensure we are not just asking: Do you use Solarwinds – “we don’t use that product” “IT uses it but we don’t use it in our facilities” “we have it, but we were not on the affected version” “we were on the affected version, but we did not have any indicators”. These are all a throwback response similar to the comfortable “we are air gapped” perspective that allows for a rapid comfortable level of certainty. Even if the organization has high levels of confidence that all is well, it is worth conducting an evaluation exercise with operations and technology support personnel side by side walking through an analysis of what their “Solarwinds” would be and what could be an operational effect from a successful attack.

Supply chain mis-operations

Mis-operation.png

When attacks have affected the ICS environment it is likely that the adversary was living in the environment for some time to test and validate a capability. Those single test events may look like equipment failures or mis-operations due to weather or power fluctuations or some other unidentifiable cause. For critical infrastructure-related operational events, it is important to perform some level of additional analysis when possible to consider a malicious actor as a potential contributing factor. In similar ways, we need to learn from recent events and ensure appropriate analysis is being performed when a supply chain-related attack occurs that is the corollary to a supply chain mis-operation. Looking at corrupt AV signature updates, or invalid detection rules, a failed vendor patch that had to be backed out, or security products needing large exception lists to function without alarms – examining these types of events with a cybersecurity lens that is asking “could this security product be an attack vector” “can I comfortably say this was a legitimate supply chain mis-operation due to a demonstratable issue or is this an unexplainable event of possible significance that needs further analysis.

Rises in the East and sets in the West

Rise.png

While many critical infrastructure asset owners and operators looked to the impacts of the attacks and the initial risks considered by most to be within the Level 4 environment and various East to West segments that allowed connectivity, there is a need to also examine the North to South trusted paths down to Level 2 and possibly even Level 1.

Consider a path created by many security tools or service providers; internet to reverse proxy on corporate, or repository on corporate, or jump host on corporate, or some architected solution within a network segment designed to prevent direct access to higher criticality assets. If the access is trusted and allowed then a path is potentially provided to local site or facility-specific business networks closer to the process environment and of more concern, the final step –there may be a path provided to OT assets in Level 3 and Level 2 for patching, AV, signature updates for security technology, remote access, and numerous other needs. While there may not have traditionally been a need for trusted communications to exist from Level 3 down to Level 1, there are now a number of industrial switches, controllers, and other ICS devices deployed that support log collection, authentication models, network management and host configuration enforcement. At a single facility with operational zones and conduits or multiple network segments or more commonly a flat operational environment, it may be common to find hub and spoke security-related connections broadly from Level 3 down to Level 1 devices (Figure 1).

Figure_1.png

How do we prepare for the next SunnyBreeze attack?

umbrella.png

Understanding that this could have been any number of organizations across numerous security-related implementations, let's consider and prepare for the next attack against a fictitious representative product “SunnyBreeze”. Do not just ask – do we use it in our company, or in a business unit, or in a facility. Rather consider all connections and assume one of your trusted connections did utilize the targeted product or service. Then consider:

  • How did you or a trusted connection use the service or product – describe the trusted communications paths and data flow
  • What type of controls existed on the established communications paths
  • How far back can you demonstrate the absence of any confirming indications and what collection scope is being analyzed
  • What operational effects and impacts could an adversary have achieved
  • How would you have mitigated those effects to ensure safety, integrity, and reliability of operations
  • Are you a trusted communications path to other entities
  • Did you have any unexplained operational mis-operations or supply chain-related unexplained failures in the last 4 – 6 months
  • Pursue participation in programs that can make a difference for your entity and the larger community:
    • Neighborhood Keeper
    • CyTRICS - DOE's Cyber Testing for Resilient Industrial Control System
    • CYOTE - Cybersecurity for the Operational Technology Environment
    • CCE - Consequence-driven Cyber-informed Engineering

Understanding the interconnectedness and interdependence of our critical infrastructure, and the communications throughout those entities is complicated, however, there are industry trends that are making the environments more predictable, easier to navigate, and anticipate. From a longer-term strategic lessons learned perspective there should be less concern around what specific path or vulnerability the adversary leveraged in this campaign to achieve an objective and more of an understanding of what actions can be taken to limit the next successful attack. As a community, we need to help each other whenever we can and ask for help more than we do. If you have any questions or if I can help in any way please let me know what we can do.

Join the SANS ICS Community Forum to share tips, ask questions and help secure ICS environments. https://ics-community.sans.org/signup

Share:
TwitterLinkedInFacebook
Copy url Url was copied to clipboard
Subscribe to SANS Newsletters
Receive curated news, vulnerabilities, & security awareness tips
United States
Canada
United Kingdom
Spain
Belgium
Denmark
Norway
Netherlands
Australia
India
Japan
Singapore
Afghanistan
Aland Islands
Albania
Algeria
American Samoa
Andorra
Angola
Anguilla
Antarctica
Antigua and Barbuda
Argentina
Armenia
Aruba
Austria
Azerbaijan
Bahamas
Bahrain
Bangladesh
Barbados
Belarus
Belize
Benin
Bermuda
Bhutan
Bolivia
Bonaire, Sint Eustatius, and Saba
Bosnia And Herzegovina
Botswana
Bouvet Island
Brazil
British Indian Ocean Territory
Brunei Darussalam
Bulgaria
Burkina Faso
Burundi
Cambodia
Cameroon
Cape Verde
Cayman Islands
Central African Republic
Chad
Chile
China
Christmas Island
Cocos (Keeling) Islands
Colombia
Comoros
Cook Islands
Costa Rica
Cote D'ivoire
Croatia (Local Name: Hrvatska)
Curacao
Cyprus
Czech Republic
Democratic Republic of the Congo
Djibouti
Dominica
Dominican Republic
East Timor
Ecuador
Egypt
El Salvador
Equatorial Guinea
Eritrea
Estonia
Eswatini
Ethiopia
Falkland Islands (Malvinas)
Faroe Islands
Fiji
Finland
France
French Guiana
French Polynesia
French Southern Territories
Gabon
Gambia
Georgia
Germany
Ghana
Gibraltar
Greece
Greenland
Grenada
Guadeloupe
Guam
Guatemala
Guernsey
Guinea
Guinea-Bissau
Guyana
Haiti
Heard And McDonald Islands
Honduras
Hong Kong
Hungary
Iceland
Indonesia
Iraq
Ireland
Isle of Man
Israel
Italy
Jamaica
Jersey
Jordan
Kazakhstan
Kenya
Kiribati
Korea, Republic Of
Kosovo
Kuwait
Kyrgyzstan
Lao People's Democratic Republic
Latvia
Lebanon
Lesotho
Liberia
Liechtenstein
Lithuania
Luxembourg
Macau
Madagascar
Malawi
Malaysia
Maldives
Mali
Malta
Marshall Islands
Martinique
Mauritania
Mauritius
Mayotte
Mexico
Micronesia, Federated States Of
Moldova, Republic Of
Monaco
Mongolia
Montenegro
Montserrat
Morocco
Mozambique
Myanmar
Namibia
Nauru
Nepal
Netherlands Antilles
New Caledonia
New Zealand
Nicaragua
Niger
Nigeria
Niue
Norfolk Island
North Macedonia
Northern Mariana Islands
Oman
Pakistan
Palau
Palestine
Panama
Papua New Guinea
Paraguay
Peru
Philippines
Pitcairn
Poland
Portugal
Puerto Rico
Qatar
Reunion
Romania
Russian Federation
Rwanda
Saint Bartholemy
Saint Kitts And Nevis
Saint Lucia
Saint Martin
Saint Vincent And The Grenadines
Samoa
San Marino
Sao Tome And Principe
Saudi Arabia
Senegal
Serbia
Seychelles
Sierra Leone
Sint Maarten
Slovakia
Slovenia
Solomon Islands
South Africa
South Georgia and the South Sandwich Islands
South Sudan
Sri Lanka
St. Helena
St. Pierre And Miquelon
Suriname
Svalbard And Jan Mayen Islands
Sweden
Switzerland
Taiwan
Tajikistan
Tanzania, United Republic Of
Thailand
Togo
Tokelau
Tonga
Trinidad And Tobago
Tunisia
Turkey
Turkmenistan
Turks And Caicos Islands
Tuvalu
Uganda
Ukraine
United Arab Emirates
United States Minor Outlying Islands
Uruguay
Uzbekistan
Vanuatu
Vatican City State
Venezuela
Vietnam
Virgin Islands (British)
Virgin Islands (U.S.)
Wallis And Futuna Islands
Western Sahara
Yemen
Zambia
Zimbabwe

By providing this information, you agree to the processing of your personal data by SANS as described in our Privacy Policy.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Tags:
  • Industrial Control Systems Security

Related Content

Blog
ICS_Blog_Building a Better OT Ransomware Response Plan_340 x 340(1).jpg
Industrial Control Systems Security
April 17, 2025
Building a Better OT Ransomware Response Plan: A Simple Framework for ICS Environments
Ransomware isn’t going away in 2025, in fact, it’s getting more efficient, targeted, and disruptive, especially for OT environments.
ICS_Icon_Blue.png
SANS ICS Security
read more
Blog
ICS - Blog - Blog - Cyber Defense Foundations for Pharma & Healthcare_340 x 340.jpg
Industrial Control Systems Security
March 20, 2025
Cyber Defense Foundations for Pharma & Healthcare: Securing ICS/OT in Pharmaceutical Manufacturing & IoT in Healthcare (Part 1)
The pharmaceutical and healthcare industries are undergoing rapid digital transformation.
DeanParsons_340x340.png
Dean Parsons
read more
Blog
Security Awareness, Artificial Intelligence (AI), Digital Forensics, Incident Response & Threat Hunting, Cloud Security, Cyber Defense, Offensive Operations, Pen Testing, and Red Teaming, Industrial Control Systems Security, Open-Source Intelligence (OSINT)
December 10, 2024
Top SANS Summit Talks of 2024
This year, SANS hosted 13 Summits from OSINT, ICS, Ransomware, DFIR to HackFest. Here were the top-rated talks of the year.
No Headshot Available
Alison Kim
read more
  • Company
  • Mission
  • Instructors
  • About
  • FAQ
  • Press
  • Contact Us
  • Careers
  • Policies
  • Training Programs
  • Work Study
  • Academies & Scholarships
  • Public Sector Partnerships
  • Law Enforcement
  • SkillsFuture Singapore
  • Degree Programs
  • Get Involved
  • Join the Community
  • Become an Instructor
  • Become a Sponsor
  • Speak at a Summit
  • Join the CISO Network
  • Award Programs
  • Partner Portal
Subscribe to SANS Newsletters
Receive curated news, vulnerabilities, & security awareness tips
United States
Canada
United Kingdom
Spain
Belgium
Denmark
Norway
Netherlands
Australia
India
Japan
Singapore
Afghanistan
Aland Islands
Albania
Algeria
American Samoa
Andorra
Angola
Anguilla
Antarctica
Antigua and Barbuda
Argentina
Armenia
Aruba
Austria
Azerbaijan
Bahamas
Bahrain
Bangladesh
Barbados
Belarus
Belize
Benin
Bermuda
Bhutan
Bolivia
Bonaire, Sint Eustatius, and Saba
Bosnia And Herzegovina
Botswana
Bouvet Island
Brazil
British Indian Ocean Territory
Brunei Darussalam
Bulgaria
Burkina Faso
Burundi
Cambodia
Cameroon
Cape Verde
Cayman Islands
Central African Republic
Chad
Chile
China
Christmas Island
Cocos (Keeling) Islands
Colombia
Comoros
Cook Islands
Costa Rica
Cote D'ivoire
Croatia (Local Name: Hrvatska)
Curacao
Cyprus
Czech Republic
Democratic Republic of the Congo
Djibouti
Dominica
Dominican Republic
East Timor
Ecuador
Egypt
El Salvador
Equatorial Guinea
Eritrea
Estonia
Eswatini
Ethiopia
Falkland Islands (Malvinas)
Faroe Islands
Fiji
Finland
France
French Guiana
French Polynesia
French Southern Territories
Gabon
Gambia
Georgia
Germany
Ghana
Gibraltar
Greece
Greenland
Grenada
Guadeloupe
Guam
Guatemala
Guernsey
Guinea
Guinea-Bissau
Guyana
Haiti
Heard And McDonald Islands
Honduras
Hong Kong
Hungary
Iceland
Indonesia
Iraq
Ireland
Isle of Man
Israel
Italy
Jamaica
Jersey
Jordan
Kazakhstan
Kenya
Kiribati
Korea, Republic Of
Kosovo
Kuwait
Kyrgyzstan
Lao People's Democratic Republic
Latvia
Lebanon
Lesotho
Liberia
Liechtenstein
Lithuania
Luxembourg
Macau
Madagascar
Malawi
Malaysia
Maldives
Mali
Malta
Marshall Islands
Martinique
Mauritania
Mauritius
Mayotte
Mexico
Micronesia, Federated States Of
Moldova, Republic Of
Monaco
Mongolia
Montenegro
Montserrat
Morocco
Mozambique
Myanmar
Namibia
Nauru
Nepal
Netherlands Antilles
New Caledonia
New Zealand
Nicaragua
Niger
Nigeria
Niue
Norfolk Island
North Macedonia
Northern Mariana Islands
Oman
Pakistan
Palau
Palestine
Panama
Papua New Guinea
Paraguay
Peru
Philippines
Pitcairn
Poland
Portugal
Puerto Rico
Qatar
Reunion
Romania
Russian Federation
Rwanda
Saint Bartholemy
Saint Kitts And Nevis
Saint Lucia
Saint Martin
Saint Vincent And The Grenadines
Samoa
San Marino
Sao Tome And Principe
Saudi Arabia
Senegal
Serbia
Seychelles
Sierra Leone
Sint Maarten
Slovakia
Slovenia
Solomon Islands
South Africa
South Georgia and the South Sandwich Islands
South Sudan
Sri Lanka
St. Helena
St. Pierre And Miquelon
Suriname
Svalbard And Jan Mayen Islands
Sweden
Switzerland
Taiwan
Tajikistan
Tanzania, United Republic Of
Thailand
Togo
Tokelau
Tonga
Trinidad And Tobago
Tunisia
Turkey
Turkmenistan
Turks And Caicos Islands
Tuvalu
Uganda
Ukraine
United Arab Emirates
United States Minor Outlying Islands
Uruguay
Uzbekistan
Vanuatu
Vatican City State
Venezuela
Vietnam
Virgin Islands (British)
Virgin Islands (U.S.)
Wallis And Futuna Islands
Western Sahara
Yemen
Zambia
Zimbabwe

By providing this information, you agree to the processing of your personal data by SANS as described in our Privacy Policy.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
  • Privacy Policy
  • Terms and Conditions
  • Do Not Sell/Share My Personal Information
  • Contact
  • Careers
© 2025 The Escal Institute of Advanced Technologies, Inc. d/b/a SANS Institute. Our Terms and Conditions detail our trademark and copyright rights. Any unauthorized use is expressly prohibited.
  • Twitter
  • Facebook
  • Youtube
  • LinkedIn