How to Unleash the Value of Sensors and Big Data

16 February 2018

In the past couple of years, we have written a lot of commentary about how the world of IT and the world of Energy are converging. As more and more companies are choosing not to own and operate their IT, the role of IT departments is fast moving away from just technical support towards strategic thinking informed by data analysis. The same can be said for Energy as companies gain access to wireless energy monitoring via cloud-based analytics, CIO’s and IT managers have equal interest as COO’s and plant managers as the Internet of Things is rolled out.

monitoring sensors powers big data and IoT technologyThe convergence of data across all areas of a business is quickly growing and how this data is used to inform executive as well as operational level decision making and planning. In the last 12 months, Total Utilities has installed several hundred wireless energy sensors around New Zealand. Data from these energy sensors are being used across numerous areas from cost allocation, performance and product benchmarking, energy efficiency, sustainability reporting, preventative maintenance and tenant rebilling.

The following article was written by Jon Rabinowitz and underlines the need for cross-section planning and acceptance to ensure IoT success. Total Utilities can help your business through this planning process to ensure that key stakeholders are part of your IoT journey.


The most effective way to derive value from sensor technology and big data is to ensure you can analyze and act on the information gathered.

When sensors are deployed as data capture/communication instruments and paired with best-in-class Big Data analytics, the result is the life breath of value-driven Internet of Things technology. Unfortunately, more often than not, IoT systems are rolled out without proper planning, and simply so some manager can check a box and say that he or she undertook an IoT initiative.

When organizations are driven by hype, that value-generating substance generally falls by the wayside. Too often this is the case with IoT projects pursued for their buzz-worthiness, without due attention paid to the smart sensor and Big Data nuts and bolts of the thing.

Indeed, IoT for IoT’s sake can only get you so far. Ganesh Ramamoorthy, a principal research analyst at Gartner, told The Economic Times that “8 out of 10 IoT projects fail even before they’re launched.” If we’re to believe that figure, it begs the question, what are companies doing wrong?

Why Companies Fail In Putting Sensors and Big Data to Work

Compelled by topical hype, there’s often a sense of urgency associated with IoT projects. According to Mark Lochmann, a senior consultant at Qittitut Consulting, that self-imposed urgency gets the best of organizations. In an interview with IndustryWeek, Lochmann explains that many enterprises “dive headfirst” into Internet of Things projects without really understanding how the technology affects their operations.

Too often decision-makers get themselves drunk on buzz and embark on technology rollouts, without really understanding what needs to happen and how that tech needs to tie back into business operations in order to derive value. They simply neglected to consider how installing hundreds, possibly thousands of sensors across their business is supposed to portend an improved bottom line.

To avoid missteps, be sure to consider the following practical factors:

  • Where the sensors will process the data (point of creation, edge devices, in the Cloud, etc.)
  • Which tools analysts need to visualize and interpret data.
  • How the company will validate and cleanse sensor information. 
  • The data governance policies which will protect data.
  • The infrastructure necessary to support analysis (data warehousing, data mart, extract transport load servers, etc.).

Lacking wherewithal on these basic project components, research from PricewaterhouseCoopers and Iron Mountain reveals that only 4% of enterprises “extract full value” from the data they own. However, it’s not just planning that’s holding companies back either. The same study found that an additional 36% of businesses were hamstrung – regardless of how thoroughly they’d thought through the project – due to system and resource limitations.

That paints a rather bleak picture, but there’s no reason to despair. The above statistics notwithstanding, there remains plenty that conscientious managers can do to ensure the success and of their integrated sensor and Big Data initiatives.

Start With Specific Use Cases, Then Dig Deeper

Many organizations don’t know how sensors and big data will impact their data centres.

Managers leading sensor and Big Data projects need to outline specific use cases before even thinking about implementation.

A smart manager will have a firm handle on how such technology is likely to impact operations on a day-to-day level – not based on intuition or imagination but on data. Better yet, that manager will set very specific expectations, delivery processes and timelines for what he or she wants to achieve on the back of sensor and big data technology.

For example, let’s say you want to install advanced wireless sensors in your facility. The person leading the project should explicate his or her intention to leverage collected data in order to:

  • Diagnose problems with equipment to predict failures.
  • Analyze the production efficiency of each asset.
  • Determine how many tons of material you process on an hourly basis.
  • Monitor worker health and locations across the facility. 

Of course, not all data is equal and the lion’s share of that discrepancy will depend on the data type. Data pertaining to equipment functionality, it should be understood, is among the most important and time-sensitive. Such data should be processed immediately given that it can tell the story, in real time, of costly malfunctions.

Some of your data will demand review in real-time, some every half hour and some every other month. Most will find itself living between those poles. Regardless of the data type though, you’ll need to be sure that when you consult it, it conveys something that is actually meaningful and actionable. For this, you’ll need to plan out and gain relative mastery over your processing system.

This means carefully choosing an analytics solution or a combination of complementary solutions. It may also mean hiring an in-house data scientist or simply bringing in outside help for training purposes. In some cases, it will even mean building out an on-site information network. In every case, it will mean instilling a data- and value-driven culture, where employees not only have access to tools but know when and how to properly use them.

Remember, there’s no such thing as too much research and that hype can be as dangerous as it is enticing. Bearing that in mind, the world of IoT is big and wide and waiting for you!