Wednesday, 26 February 2014

Big Data and Demand Response

Utilities are collecting unprecedented amounts of information from millions of smart meters installed in recent years, but the capacity to collect data seems largely to have overwhelmed companies and regulators. Processes designed for a world run on paper billing and planned excess capacity are of diminishing effectiveness in one defined by interactive usage and distributed generation.
This opened door for data scientists and data startups to compete with some of the established business service providers themselves rushing to better understand, analyze and use the insights raw data can provide.  Most of the vendors advice and analytics for power bills the old fashioned way – door-to-door – and is taking the insight it has into customer priorities and matching that to generator priorities as market rules and operating realities shift.
power tariffs enable customers to save money by limiting use during certain peak energy use “events,” the kind of program that has been in place around the country for years, but adoption has been limited in part because “the conversation about tariffs at commissions and in utilities is very divorced from the reality on the ground, which is focused 
The installation of smart meters is set to accelerate and provide ever more detailed information to a wide variety of firms and customers in energy and beyond, and companies  will be providing the next level of analysis and engagement based on that data to help companies and regulators move forward with segmenting, prioritizing and putting into action their plans and objectives based on data-driven insights.

Thursday, 14 November 2013

Digital transformation in Utilities through Analytics


Analytics in Utilites will impact  the Operational and business models over the next few years

More and more data will be generated by Grid and Customer applications,Analytics play a vital role in deriving the efficiency by various tools.

1.       Long term analytic strategy : All the current systems in Utilities are project based  . Long term strategy would be to concentrate on the fusion of Opertationlal  technology with Information Technoglogy by leveraging analytics . Implemetation of Analytic tools will improve the business value
2.       Customer Engagement Models and services : The current model of communication should be changed to advanced Customer communication  with Multiple channels . Enablement of Social networking channels like facebook, twitter via mobile integration in utilities will have better insights and satisfcation results . Example Outages
3.       Optimize The Grid : Utilities must evaluate the Grid and Optimize for better efficiency. Advanced Analytics strategies and tools will stream line the data for better results.

Smart Grid Data Analytics – Players in the market

1.       IBM
2.       SAS
3.       Teradata
4.       EMC
5.       SAP
6.       ORACLE
All the players are promising to transform the way utilities mangaze with the huge flood of data which is big data coming through Smart Meters, sensors, relays ,substation control systems and any other grid technologies. Also there are some untapped resources like customer information data, Work force data with Mobile integration, social networking, business process data
Challenges and capabilities
Theft detection, outage restoration, Mobile workforce for utility field workers
Load balancing , line loss, volt/VAR Management and prective modeling for grid operators

Friday, 25 October 2013

"Big Data" in Green Building ,design, construction, and operation of the built environment.


The building industry often enters the “Big Data” conversation through energy efficiency, and Smart Grid and the proliferation of sensors and sub-meters. These provide unprecedented information about energy use over time and across spatial scales. This also reflects the long-standing, foundational importance of energy efficiency to the green buildingmovement. “Big Data” refers to mixtures of volume (scale of data), velocity (analysis of streaming data), variety (difference in forms of data), and veracity (uncertainty associated data). Relatively speaking, energy efficiency alone is modest by these measures. Green building changes things and brings true Big Data into play. Green building encompasses energy efficiency and adds many more dimensions of performance. LEED offers a definition of green building which includes location and transportation, energy and atmosphere, water efficiency, materials and resources, and indoor environmentalquality. This breaks out into hundreds of individual LEED credits and thousands of specific metrics. A Big Data story starts to emerge when tens of thousands of green buildings projects using thousands of metrics, generate data from tens or hundreds of thousands of automated “points”, and provide daily experiences for millions of occupants. Now, we’re talking Big Data: huge data volumes, streaming at different rates, taking a wide variety of forms, and varying dramatically in their accuracy, precision, and reliability.

Monday, 21 October 2013

Big Data Analytics in Utilities - Indian Perspective

India the world’s fifth-largest electricity generation capacity and faces acute power shortage due to the with outdated power infrastructure to meet the growing demand from residential as well as the Commercial/industries. India has suffered consistent grid failures and power black outs since independence. In 2012, the  failure of northern, eastern and north-eastern grids left many parts of the country in the dark. The country remains energy deficient despite 15 percent or more of federal funds being allocated to the power sector. what can be the reasons  the answer is according to industry experts, bankrupt state-run electricity boards, an acute shortage of coal, skewed subsidies which end up benefiting rich farmers, power theft, and under-performing private distribution agencies are to blame. The Aggregate Technical & Commercial (AT&C) losses are expected to be around 33 percent. In fact, it is estimated that the AT&C loss levels in some states are as high as 70 percent because of antiquated grids, power theft and faulty meters.

The problem of power shortage in India is persistent though we have all kinds of resources In July last year, the country faced the largest power outage in the country affecting 22 states and 620 million people. The outage was a wakeup call to modernize the power infrastructure in the country.

With huge losses of ATC , leakages and theft there is strong push for the deployment of smart meters and smart grid technologies to plug this gap. The Ministry of Power recently approved pilots for smart grids in the country and private players like Tata Power, Reliance Infrastructure are already running smart meter and smart grid led project. Recently State Pondicherry is successful in pilot implementation of Smart Grid .

The resulting transformation is generating tremendous volumes of data. The frequency and volume of data that is emerging from smart meters, grid devices and other network controls and sensors is pushing the sector to deploy analytics to accommodate the emerging opportunities around customer demand ,Distributed Generation,

Around the world, utilities are under pressure.
Financial stakeholders look for operational efficiency at a time when aging workforces and infrastructure
Regulators require compliance and detailed reporting on operations.
Operators seek action on smart grid and smart metering initiatives that add intelligence to infrastructure.
 Customers seek choice and convenience—at affordable costs.

TO overcome all the difficulties today’s utilities to re-examine every aspect of their business process, Meter to Bill and Meter to Cash scenarios.

Big Data Analytics Benefits

Utilities are rolling out smart grid and smart metering projects to address some of these challenges. These deployments are underway in India are at a nascent stage and mature in due course of time. They are creating exponentially more data for distribution companies and giving them access to information they’ve never had before. Accessing, analyzing, managing, and delivering this information can help them optimize business operations and enhance customer relationships.

They can perform continuous analytics against this data to look for anomalies, patterns and trends that might indicate an opportunity for them to make actionable decisions on both supply and demand. Integration into outage and distribution management applications allows for further development of business capabilities such as distribution, load management switching, etc. Protocols can be established to move customers to alternate feeders during times of over capacity.


Analytical information also allows utilities to look at granular use and consumption patterns for neighborhoods, districts, or cities to facilitate better supply planning and load forecasting in these service territories.

Big Data can also help distribution companies achieve and maintain the levels of satisfaction desired by customers and by regulators. For instance, by integrating advanced metering, grid devices and network management systems, they can address more proactively outages and other system conditions that exist within their territories. This allows them to be much more proactive in the provision of network condition information to customers and other stakeholders.

Big Data and Analytics can help the companies move away from “one size fits all” services. For example, at the customer premise level, they can analyze usage patterns at the meter level and provide this usage information back to consumers with the intent of developing market driven and customized pricing offers that reflect individual consumption characteristics.

Many companies also have geo-spatial data available from their equipment, diagrams and vehicles. This data can be used to deliver real-time analytics to pin-point the need for a maintenance person, when a network is down, overloaded or reaching capacity.

In mature markets like North america and Europe, Big Data solutions is also helping utility companies determine competitor strengths and weakness, enabling them to exploit competitive strongholds and target marketing programs towards specific customers or segments of customers.

Big Data and analytics can also give an impetus to the adoption of renewable sources of energy. Traditional power generation investments involve large amounts of property to build a large plant on, but newer renewable sources like wind and solar energy can be located closer to demand sources. Big Data solutions can look at all of factors of a city, from standard utility ones like load profiles and capacity to more unstructured ones from city demographics.

Traditional utility data, demographic information and new sensor data can therefore be combined to provide the optimal investment scenarios necessary to meet growing renewable energy portfolio requirements. This can then be used to make smarter investment decisions.

Scenario where data on wealth distribution in office spaces, commuter congestion and electric vehicle population history combined with current load profiles and capacity is combined to predict which buildings will have the highest growth in electric vehicles over the next two decades. This data can feed portfolio planning decisions like deciding where to invest in solar panels – to help source cheaper and cleaner local energy to charge those vehicles instead of transporting it in from a remote fossil plant at high cost.

Predictive Analytics in Big Data will Forecast customer revenue, energy consumption, maintenance costs, outages, reliability, energy procurement costs

Conclusion

An optimized power generation and distribution system with Big Data analytics can complement new additions to power generation to meet the power deficit in the country.

Sunday, 20 October 2013

SAP Smart Grid and Meter Analytics

Today’s electrical distribution systems continue to evolve as new smart devices are added to the network. With each installation comes the capability to better monitor and report important data related to energy usage, outages and changes in demand. This mass influx of raw data has led to a major void that must be addressed—data is currently being generated exponentially faster than it can be analyzed. To fill this void, utility companies often find themselves in search of software solutions to help break down data from sensors and smart devices to find value hidden in a sea of raw data.

SAP Smart Grid and smart meter analytics software Insight provides utilities with advanced analytic capabilities to meet their business needs and create a stronger connection to the machines that power the grid. It applies proven analytics to make sense of big data collected from intelligent machines to better predict, manage, model and forecast potential problems that a utility’s electrical grid may face. The software strategically monitors influential data—such as electrical usage, grid performance and weather history—creating an interconnected “ecosystem” of people and machines to better equip utilities with the information and tools needed to optimize their electrical distribution systems. Utilities can then apply the information and knowledge gained through advanced analytics and visualization to ensure a more efficient and reliable energy supply to their end users.

Monday, 14 October 2013

Big Data Classifcation


Analysis type -  Real time  and Batch
Processing Methodology - Predictive Analysis, Analytics, Query and Reporting  which are used in processing of
Social Network Analysis, Location based analysis,Feature recognition,Text analytics, speech analytics etc
Data Frequency - On demand feeds, Continuous feeds, Real time feeds, Time series
Data type - Meta data, master data, Historical, Transactional
Content Format - Structured, un structured and semi structured
Data Sources - Web and social media , machine generated, human generated, internal data sources, Transaction data , Bio metric data,Data Providers
Data consumers -Human , Business process, Enterprise Applications
Hardware and Software 

Sunday, 13 October 2013

Application and Data Management in Utilities – Cloud Computing


 “Cloud computing,” class of services refers to computing  resources (software or hardware) delivered as a service via the Internet. Cloud services  include the use of remote servers hosted on the Internet for accessing applications and/or storing, managing and processing data. Cloud computing offers a number of benefits. Foremost among these is the avoidance of big capital expenditures. There is no need to buy software, or the servers, racks and other hardware required to support it.

 The utility simply pays a “subscription” fee out of its operating budget. Plus, the vendor’s staff manages the solution, so you are guaranteed expert monitoring and support without additional labor costs. Early adoption of cloud computing confers other advantages, too. Many of the applications needed for integrating renewables and managing bi-directional energy flow are largely cloud based.

 As distributed generation becomes more common, utilities that adopt cloud computing will be ahead of the curve. They can also work with smart grid vendors to develop custom, cloud-based applications that address an array of needs –– from improving grid reliability to load forecasting.

Cloud computing can raise concerns over service integrity and reliability, data protection, and privacy. However, focusing on expert vendors will mitigate risks, and enable you to reap potential benefits. Seek vendors who deliver:
Visibility into their processes and controls
 Plans for disaster recovery and business continuity
 Physical security controls that are clear and auditable

Standards-compliant cyber security