A risk-based formula for security testing

Issue 8 2021 Editor's Choice

The tools and processes used in modern system design and development are exponentially increasing the number of assets organisations must identify, manage and secure. This is an opportunity to rethink the formula for security testing so that it addresses the real risk and impact of an attack, while being regulation-compliant. In this article, we’ll break down the process involved, explaining how to harden your operations and improve resilience by aligning security spend with real risk.

Risk-based prioritisation is an alternative means to decide if and how to test assets. The approach contemplates which assets require scrutiny, based on specific, real-world threats, especially those that would threaten business continuity. As a result, security testing becomes more goal-oriented and shows tangible results.

Risk-based prioritisation in practice

Organisations that are conscious of shortcomings in their system and vulnerability management are likely to see the most tangible benefits. The three goals of the exercise are:

1. Gather context on the assets in your estate by answering specific questions about them, via stakeholder workshops or through hands-on exploration.

2. Apply a risk rating to each asset to help you prioritise them for testing.

3. Identify the best approach for testing based on that prioritisation.


Phase 1: Discovery and enumeration

Asset investigation

The exercise begins by identifying a number of critically important assets in your estate, as well as the employees who act as their stakeholders. A critically important asset can be understood as any asset that, if impacted in a cyber-attack, would significantly disrupt business continuity. There are two routes to assess each asset or assets — via a workshop or hands-on exploration.

Route 1: Workshop. The aim of a workshop is to understand each asset, the context it operates in and how an attacker may target it. This is done through discussion and iteration. Observations are documented so they can be used to assign an importance rating and a plan for testing each asset.

Route 2: Hands-on exploration. A hands-on approach requires available resources in your technical team to experiment with apps or infrastructure, scope the same information covered in the workshops and ask additional questions if necessary. It’s an effective solution for teams unable to collaborate in person, i.e., if they are operating remotely, or where asset stakeholders are unavailable or uncooperative.

Scoring and rating

Once all assets have been documented, they are each scored and rated according to the risk and potential impact they pose.

The scoring system is defined by the risk and impact factors specific to your organisation and should include 'effect if compromised' and 'likelihood of being targeted'.

More metrics can be added as per the needs and interests of your organisation. Banks, for example, would likely emphasise loss of financial or client data. For telecommunications providers, it may be service disruption and control of their operational technology (OT) environment. Essentially, the risk matrix needs to synchronise with your internal risk register.

This risk assignment is most effective if it can respond to the business’s needs dynamically. Even if stakeholders’ opinions of an asset’s importance contradict the levels proposed by the risk matrix, these should still be fed into the process.

Based on the results from the scoring exercise, an importance rating from critical to low can be assigned to each asset. With the assets listed in order of risk, security tests may now be tactically scoped. The list can be mapped to strategic security and business goals for the buy-in of other stakeholders, as well as to show the increasing maturity/resilience of assets over time.

Threat identification

The information gathered from workshops/hands-on exploration and rating exercises can be used to create models of your organisation’s environment. These provide the security team with a visual reference showing how assets are connected, i.e., how the risk of one asset affects the others around it.


Phase 2: Goal-oriented testing

Discovery and enumeration complete, you can now start to design tests around how your assets may be targeted by threat actors harbouring specific malicious goals.

Step 1 of the exercise is to build a test case for each asset, starting with the most critical. Each case forms the basis of a test to uncover potential threats/goals (why an attacker would target an asset), such as ‘We can bypass MFA to steal PII from customers’. The ultimate objective is to define the most contextually relevant way to test assets against each goal.

Review test hypotheses and replan

A test case proven incorrect is evidence of controls working effectively, which demonstrates successful work performed by development and security teams. Contrasting the often negative, defect-focused approach of standard pen-testing, it recognises where things are working, so the same measures may be applied elsewhere. It also quantifies prevention budget spent wisely.

These incorrect test cases are one output of risk-prioritised testing and can be used as the starting point for other testing. What this testing is and where it’s focused will be unique to your organisation. Fundamentally though, risk-prioritisation is the foundation needed to deliver a testing programme that is efficient and effective overall by instilling the risk/threat mindset.

Long-term gains

A risk-prioritised approach to security testing enables organisations to focus on the assets most in need of attention. Over a longer period, it does even more to make your security testing work harder. These long-term gains include:

1. Focus objectively on the threats that matter most. Reviewed from an attacker’s perspective, high-risk assets are prioritised and subjected to more testing than assets that pose little risk. Testing can then focus on key attacker goals for each of those assets rather than just performing generic pen-testing and achieving generic results. Resources and time can be scoped for maximum investment.

2. Overcome the static nature of point-in-time testing. Delivered iteratively, prioritisation takes care of assets that would otherwise go untouched for months between engagements and be exposed to threats in that time. By exploring your assets iteratively, reviewing findings and investigating further, there’s a greater chance emerging vulnerabilities will be flagged and assets get tested before they can be exploited.

3. Put past testing to use. You can optimise your risk-prioritised testing over time by consuming information from previous security assessments and threat analysis exercises. This data may be used to tailor and adjust future tests so you don’t duplicate the effort, thus adding another layer of efficiency and improving resilience.

Summary

Risk-based prioritisation reveals your most critical assets and the top risks they face. This enables you to focus on prevention in these areas specifically. You will know which assets matter most, which threats are of greatest concern, and have evidence of your ability to prevent them. You can then start to consider the detection of attempts to utilise those key threats, increasing your overall confidence in those assets.

This works towards operational resilience – organisations can move away from traditional approaches that no longer suit the scale and complexity of their environments. Build a resilient approach to security testing and you’ve got solid foundations for making further intelligent, targeted investments elsewhere.




Share this article:
Share via emailShare via LinkedInPrint this page



Further reading:

What is your ‘real’ security posture?
BlueVision Editor's Choice Information Security Infrastructure AI & Data Analytics
Many businesses operate under the illusion that their security controls, policies, and incident response plans will hold firm when tested by cybercriminals, but does this mean you are really safe?

Read more...
What is your ‘real’ security posture? (Part 2)
BlueVision Editor's Choice Information Security Infrastructure
In the second part of this series of articles from BlueVision, we explore the human element: social engineering and insider threats and how red teaming can expose and remedy them.

Read more...
IQ and AI
Leaderware Editor's Choice Surveillance AI & Data Analytics
Following his presentation at the Estate Security Conference in October, Craig Donald delves into the challenge of balancing human operator ‘IQ’ and AI system detection within CCTV control rooms.

Read more...
Onsite AI avoids cloud challenges
SMART Security Solutions Technews Publishing Editor's Choice Infrastructure AI & Data Analytics
Most AI programs today depend on constant cloud connections, which can be a liability for companies operating in secure or high-risk environments. That reliance exposes sensitive data to external networks, but also creates a single point of failure if connectivity drops.

Read more...
Toxic combinations
Editor's Choice
According to Panaseer’s latest research, 70% of major breaches are caused by toxic combinations: overlapping risks that compound and amplify each other, forming a critical vulnerability to be exploited.

Read more...
Continuum launches centralised access and identity management
Editor's Choice Access Control & Identity Management Integrated Solutions Facilities & Building Management
Continuum Identity is a newly launched company in the identity management and access control sector, targeting the complexity of managing various Access and Identity Management (AIM) systems.

Read more...
Making drone security more accessible
Editor's Choice Integrated Solutions Residential Estate (Industry) AI & Data Analytics IoT & Automation
Michael Lever discusses advances in drone technology, focusing on cost reductions and the implementation of automated services, including beyond line of sight capabilities, for residential estates with SMART Security Solutions.

Read more...
Private fire services becoming the norm?
Technews Publishing SMART Security Solutions Editor's Choice
As the infrastructure and service delivery in many of South Africa’s major cities decline, with a few, limited exceptions, more of the work that should be done by the state has fallen to private companies.

Read more...
View from the trenches
Technews Publishing SMART Security Solutions Editor's Choice Integrated Solutions Security Services & Risk Management Residential Estate (Industry)
There are many great options available to estates for effectively managing their security and operations, but those in the trenches are often limited by body corporate/HOA budget restrictions and misunderstandings.

Read more...
SMART Estate Security Conference KZN 2025
Arteco Global Africa OneSpace Technologies SMART Security Solutions Technews Publishing Editor's Choice Integrated Solutions Security Services & Risk Management Residential Estate (Industry)
May 2025 saw the SMART Security Solutions team heading off to Durban for our annual Estate Security Conference, once again hosted at the Mount Edgecombe Country Club.

Read more...










While every effort has been made to ensure the accuracy of the information contained herein, the publisher and its agents cannot be held responsible for any errors contained, or any loss incurred as a result. Articles published do not necessarily reflect the views of the publishers. The editor reserves the right to alter or cut copy. Articles submitted are deemed to have been cleared for publication. Advertisements and company contact details are published as provided by the advertiser. Technews Publishing (Pty) Ltd cannot be held responsible for the accuracy or veracity of supplied material.




© Technews Publishing (Pty) Ltd. | All Rights Reserved.