Western Power, Perfekt and the Australian National University (ANU) recently conducted a pilot project to demonstrate the effect of rooftop Solar PV on Substation Load at the Waikiki zone substation south of Perth.
The project required the blending of large volumes of time series data from disparate sources including:
ANU’s ARENA project solar forecasting data
Western Power’s SCADA data
Climate data from Weather Zone
Perfekt’s Data Engineering and Analytics Platform is based on Hortonworks Data Platform with Hitachi Pentaho Data Integration delivering unparalleled data engineering capability that put the data to work efficiently and accurately.
Perfekt’s solution proved to be highly flexible and scalable, ensuring quick time to value in what could otherwise have been a complex environment to work in.
A video describing the project and the results may be found here.
The in-memory processing power of Apache Spark running machine learning languages like R and Python enables data scientists to thrive and operational teams to deliver real business value in near-real time. The platform can also be delivered using an “as a service” model to minimise the up-front investment required to establish big data analytics in your organisation.