A recent article in Network World by ESG's Jon Oltsik correctly called out the fact that Incident Response (IR) automation is becoming a very hot topic in the infosec world. In it, Oltsik calls out the multiple factors that are driving demand for IR automation and orchestration, including the manual nature of IR work, the cyber skills shortage, and the difficulty of coordinating activity between secops and devops.
We agree wholeheartedly with Oltsik's conclusions, but we would like to push the logic even further, and argue that while automation is important for IR, it is even more important in threat detection (TD) by several orders of magnitude.
The Scale of the Threat Detection Problem
IR automation kicks in when an intrusion has been discovered. The volume of instances where it can be applied is a tiny fraction of the total workload of any secops team. As an example, take a financial institution whose SIEM system was kicking out 750 alerts for a single SIEM rule each month. Of those, manual investigations by human analysts resulted in only 2 verified threats that merited an IR.
Automating the resulting IR would save some time, it is true, but the massive bulk of that team's human bandwidth was devoted to triage on those 750 alerts. And, to be clear, their SIEM system had several tens of rules generating comparable volume.
That investigation activity, much of it manual and repetitive in a way similar to IR, is an order of magnitude larger opportunity to save resources through automation.
When you combine the scale of TD work with the cybersecurity skills shortage called out in the article, you have an extremely compelling case for TD automation.
Causality in the Secops Flow
There is linear causality between TD processes and IR processes. When TD is not effective at scale (currently the case for many organizations), then it yields to too many false positives, which can cripple IR efforts downstream.
At the same time, a major challenge today is with too many false negatives, ones that should have been remediated but never got detected. Automating TD will help discover more of these hidden breaches, hence creating a greater need for faster IR.
Because of this, automation at the TD stage has a greater impact on downstream results and directly impacts IR automation.
TD Automation - Cognitive Automation vs Robotic Process Automation
A Harvard Business Review article describes 3 types of automation:
- Robotic process automation: Routine tasks, low complexity, wide application scope.
- Cognitive automation: Nonroutine tasks, decision-supporting, exploratory, hybrid AI/human training, targeted at specific data sets.
- Social robotics: training based on human to human interaction, wide application scope.
Automating IR falls into the category of low complexity and tends to be rules-based, which puts it in the robotic process automation group.
Conversely, TD automation falls into the cognitive automation category. It is solving a more complex problem, that supports key decision making by exploring a targeted data set. It requires machine learning and humans working together. At first glance, this may seem impossible.
Quite the contrary. Not only is TD automation possible, it is currently being done. And even though it has a slightly higher upfront cost in terms of setting up the automation, the payoffs are much greater because of the first two drivers we discussed - scale and causality.
As a result, we expect to see TD automation grow in prominence and importance in the very near future, just as IR automation has.
