Comment: Shining a light on dark data
Water companies already have the data to solve many of their most problematic issues - they just have to know where to look, writes Alexander Mahon
by Alexander Mahon, dark data specialist, PA Consulting
The water sector has always collected large amounts of data on every aspect of their operations. But there’s a problem. All of this measuring is no longer driving the improvements in performance the sector wants to see and which Ofwat is demanding as part of PR19.
The crux of the sector’s struggle to use data for decision-making is that water companies’ internal reporting doesn’t provide a clear analysis of what is causing the problems. Nor do they indicate what action should be taken to ensure it doesn’t happen in the future. This means managers don’t have the insights they need to make the business decisions they want to.
It sounds so easy - use data to deliver business insights, management information and, ultimately, a better understanding of how your organisation is running. There are plenty of technology providers in the market who offer these silver-bullet solutions. But there’s more to this than meets the eye.
You already have what you need
In short, the answer is often hiding deep in the data that you already possess. “Dark Data” is the information companies’ hold which was collected for one reason but can be used in a different way to derive new value.
We have found our clients always have a hunch or a hypothesis as to why, for example, leakage remains stubbornly high. Or why sewers keep flooding in a particular area. But the facts to backup those hunches, or manage the resources needed to fix the issues, are hard to pin down.
Yet the good news is that the data is there. It just needs to be accessed and combined in a different way to uncover those performance enhancing insights. How to do this requires some consideration:
1) Ask the right question. You need to ask the right question of your data. Like any oracle, Dark Data will only reveal what you ask of it. Getting that question right, and in line with new performance objectives is possibly more complicated than you might think.
2) Ensure actions are only taken based on the evidence, not gut instinct. Use the abundant data you already have access to derive the insights you need to be able to make evidence based decisions.
3) Industrialise the solution to produce a Line of Sight. Taking these insights as a starting point, change your reporting from interesting things to know to those few key metrics which really enable you to drive value within your organisation.
These tips cover the fundamentals of a methodology to help organisations become more data driven and to gain evidence based insights into how to improve performance. At the moment, water companies don’t necessarily need additional resources or technologies. What they need is to leverage the data they already hold by asking the right questions and applying the right methodology. Given the more rigorous performance requirements placed on companies by PR19, it’s vital they seize the opportunity Dark Data offers to help them succeed in this more demanding environment.
-Alexander Mahon will be speaking on the subject of dark data at WWT's Smart Water Networks conference on March 20. Details: http://events.wwtonline.co.uk/smart/
- Comment: The Rise of the Digital Engineer As data gathering and analytics tools proliferate across water companies' operations, systems integration -... Read More >
- Digging Deeper: Monitoring Water Quality in Real Time As the introduction of the revised Bathing Water Directive approaches like the incoming tide, Radio Data Networks (RDN)... Read More >
- Good cheer on boom and bust The Treasury's report on investment cycles in the water industry is good news, says Sam Ibbott of the Environmental... Read More >
- Opinion: Improving Resilience in AMP7 Getting the right data to measure asset health and support resilience will be crucial for water companies in meeting their... Read More >
- Focusing on what matters to customers Neil Croxton, Stantec's technical director - water distribution, on why it's not enough just to adopt new smart... Read More >
- Interview: Black and Veatch's Mark Kaney Black and Veatch's new director of asset management for Europe, Mark Kaney, tells Robin Hackett how the company hopes to... Read More >
- Can smart systems really make the industry more efficient? Smart water systems are gaining popularity, but the introduction of technology is only the first stage in a necessary change... Read More >
- Anglian's VR programme: Finding real virtues in virtual reality Anglian Water's Steve Havvas tells Robin Hackett why the company's new VR training programme is attracting widespread... Read More >