Cloud Computing - Big Data needs

Business related owners are not technology or data geeks, but sometimes it feels like it would be beneficial to be one. Storing and analyzing data, keeping track o licenses and dealing with other technological hang ups can quickly leave the average businessperson feeling overwhelmed. Throw big data into the mix and the process becomes even more complex.Cloud computing technologies  can be a lifesaver when it comes to simplifying data storage and analysis.

Cloud Storage

Building up a reliable storage center is expensive and requires at least some level of expertise in that area, and small businesses are in short supply of both. Professional cloud storage, on the other hand, is highly affordable and offers a much more sophisticated option with no expertise required. Amazon’s SE storage service, for example, promises 99.9 percent monthly availability and even higher durability, meaning the service is rarely down, and there is an even smaller chance of data being lost. A small business could never hope to match that with their own resources.

Cloud Computing

Cloud resources are not limited to storage, however. It can also solve the majority of our computing needs. Depending on what your business’s needs are, cloud providers offer anything from the basic hardware to put your whole operating system on to ready-to-use applications. Big Data as a Service provides the tools to start collecting and analyzing big data without investing in Hadoop or learning how to code. Essentially, the cloud outsources your IT functions, so you no longer have to deal with setting systems up or making repairs. The cloud does all of this for you.

Scalability

A common problem business owners face is figuring out exactly how much data storage to use. After all, we don’t want to run out of space during a critical time, but it is a waste of resources to have servers sitting empty. Luckily, cloud providers offer scalability. They offer horizontal scaling, which replaces a small computing resource with a bigger one when demand requires it, as well as vertical scaling, which adds additional instances with each meeting part of the demand. This means that we no longer have to worry about resource planning or leave servers sitting empty, as the cloud service can automatically scale up or down depending on what is needed at the time.

Machine learning: analytics

Machine learning algorithms can help utilities address with a broad range of practical and strategic switch providers
meters problems, grid operations to accommodate fluctuating levels of renewable resources


MACHINE LEARNING EXAMPLE
 For instance,  some instances of energy theft identified, then you can feed into your analytics system data from those cases and have it look for similar patterns in current customer data. The system will return possible hits and offer a confidence rating for each. That confidence rating can help you decide whether you need to roll a truck to check out a certain instance of possible theft. Then, when you investigate the situation and feed the results back into your system, you fine-tune the algorithm."

Machine learning algorithms can also reveal new useful patterns in AMI data. That is, energy data can start to speak for itself, in ways that help utilities plan better.

For instance,  unnoticed patterns of momentary outages or other grid issues might help a utility better predict maintenance needs for transmission and distribution assets. "If you want to figure out which transformers will fail, you can feed in data about which ones have failed already, and the parts of the network they function within -- and then let the system reveal correlations,"

Utilities can start to capitalize on machine learning-enhanced analytics even if they haven't yet deployed smart meters or meter data management technology. 

Smart Grid in Street Lights

Street lighting is an important community service, it can consume as much as 40 percent of a city’s energy budget.  street lights are prone and costly to manage, which add to lighting costs. Consequently, street lighting has emerged as a leading smart city application.

By replacing existing street lights with LED-based lamps, utilities and other street light operators can cut energy and operations costs by 50 percent or more.

Networking those LEDs delivers an even faster return on investment (ROI), taking the payback period down to 6 vs. 8 years, as a result of features such as remote management and faster outage response.

In addition to near-term savings, a network-based lighting solution provides an ideal platform for multiple smart city services, including smart parking meters, traffic lights and traffic management systems. Municipal utilities also have the opportunity to leverage smart city infrastructure for smart grid applications such as advanced metering infrastructure (AMI), demand response (DR) and distribution automation (DA).

Understanding the operational details of networked LEDs and comparing those benefits and costs to traditional  lighting lays the foundation for building a business case to upgrade street lights. The hard dollar savings in energy and operational costs make the case for replacement, and networked LEDs provide additional community value as well.

 

 

The Advantages of Networked LEDs

Legacy high-pressure sodium and mercury street lamps are not energy efficient and typically operate 12 hours a day at full intensity,; so their energy cost is high. These lamps also have a short life span (around 5 years), resulting in unpredictable and expensive operations. Operators must replace roughly 20 percent of these lamps each year.

Currently, operators detect light outages either when a community member calls to report it or when mobile crews detect outages during periodic checks. Consequently, the time to replace a lamp can vary considerably, impacting public safety and an operator’s liability.

 New energy efficient LED-based street lights have a life span of up to 20 years, enabling lower energy and operations costs. . In order to take full advantage of this new LED technology, these street lights must be networked. Operators benefit from lower energy and operations costs, which can be reduced even further when street lights are connected to a network.

Networking gives operators remote access and advanced functionality, including the ability to dim street lights  and control their runtime by scheduling them to switch on/off as conditions (such as shorter/longer days) warrant. This network-based control yields an additional 10 to 20 percent energy savings beyond just LED replacement, along with greater operations and management savings.

For example, since LEDs burn brighter than conventional street lamps, operators can dim them to 50 percent brightness for additional energy savings with minimal compromise in light output. And, by controlling street light runtime remotely, operators also have the option to eliminate photocells for further cost reduction.

 

Benefits

Energy Savings

Low wattage , Dimming and Reduced Burn Time

Operational Savings

Long life time, Remote Monitoring and  Management , Automatic Outage detection, Proactive Maintanence

SAP Big data in Utilities

SAP Big data in Utilities

 

 

1. SAP Big Data = SAP HANA + Hadoop +..... =  Transactions + Analytics

 

SAP HANA is the key ingredient for SAP's big data solution, aided by other software like Hadoop. All the innovations in utilities relates to Real time data for Operations , Meter Data Management  and so on of HANA, together with all the benefits of technologies like Hadoop and Sybase IQ. When rest of the world thinks of big data - it is mostly along the lines of analytical applications. But SAP big data is positioned for analytical AND transactional applications.

 

2. SAP Big Data = Big Value + Big Easy

 

That is essentially the "big deal" about big data. SAP will make it easy for customers to handle Volume, velocity , variety etc of data, and give very sophisticated analytics via our SAP Hana data platform. The value of big data is the quality of insights you get from it - and that needs more sophistication than conventional BI. And we will make it easy to use - easy to administer, easy to consume, easy to extend and so on. You choose the deployment model that is right for you - keep it inhouse, or move it to Hana Enterprise Cloud.

 

3. SAP Big Data = Big Precision + Big Context

Historically, BI was focused on precision, with probably an assumption that context is provided elsewhere for the user. Big data will change that. Now you can have the great precision that our BI platform provides, and put it in a context that is useful for the people consuming the insights. Not only will you know exactlyhow much to collect from your customers for their purchases, you will also know what else is happening with that customer within your company, and in the external world.

 

4.SAP  Big Data = Right Time + Infinite growth

 

Quality of insights lead to actions only when it is delivered at the right time. In many cases, right time is real time. By combining the power of SAP Hana for lightning fast responses ( with deep predictive abilities etc), and the almost limitless ability of hadoop to store and process data - you get the best of both worlds. And it is not just Hana and Hadoop - there are other rock solid , highly scalable systemslike Sybase IQ that you can tap into using our platform.

 

5.SAP  Big Data = Real time Data

 

Conventional applications are built on predefined requirements. You figure out the queries, the data model , the ETL and so on in great detail before an app gets built. The downside of this process is that it takes a long time , and it works only for predefined questions. With big data, SAP brings the IP of the hundreds of data science projects (including things cool stuff like machine learning) that gives you a jump start on getting value out of big data initiatives

 

6. SAP Big Data = Platform + Applications + Data Science + Deployment

 

SAP provides a platform that is easy to develop on (with plenty of educational materials available) , solid integration from Hana to other big data solutions like Hadoop and IQ, top of the line prebuilt applications (which can be extended as needed ) , a large pool of the best data scientists you can find anywhere, and a choice of deployment options. And not only that - we are making all of these better in a continuous process.

 

 

Supervisory Control and Data Acquisition Systems(SCADA) with Energy Management Systems (EMS) and Distribution Management Systems (DMS)

What is SCADA/EMS/GMS and SCADA/DMS?
SCADA/EMS/GMS (supervisory control and data acquisition/Energy Management SyestemsGeneration Management System) supervises, controls, optimizes and manages generation and transmission systems. SCADA/DMS Distribution Management systems performs the same functions for power distribution networks.

Both systems enable utilities to collect, store and analyze data from hundreds of thousands of data points in national or regional networks, perform network modeling, simulate power operation, pinpoint faults, preempt outages, and participate in energy trading markets.


1960’s  SCADA/EMS/GMS systems at that time were designed exclusively for a single customer. Power systems were vulnerable, and there was a need to develop applications and tools for preventing faults from developing into large-scale outages. 

In the 1980s it became possible to model large-scale distribution networks in a standardized way. The deregulation and privatization of the power industry that began in the 1990s was the biggest structural change in the industry’s history. Specialization became increasingly common, with many utilities focusing on either generation, transmission or distribution. 

 Smart Metering and Smart Grid technologies impacts ,Network management is a prerequisite and vital for any smart grid of the future. These grids will have to incorporate and manage centralized and distributed power generation, intermittent sources of renewable energy like wind and solar power, allow consumers to become producers and export their excess power, enable multi-directional power flow from many different sources, and integrate real-time pricing and load management data. 

Digital transformation in Utilities through Analytics

Analytics in Utilites will impact  the Operational and business models over the next few years

More and more data will be generated by Grid and Customer applications,Analytics play a vital role in deriving the efficiency by various tools.

1.       Long term analytic strategy : All the current systems in Utilities are project based  . Long term strategy would be to concentrate on the fusion of Operational  technology with Information Technology by leveraging analytics . Implemetation of Analytic tools will improve the business value

2.       Customer Engagement Models and services : The current model of communication should be changed to advanced Customer communication  with Multiple channels . Enablement of Social networking channels like facebook, twitter via mobile integration in utilities will have better insights and satisfaction results . Example Outages

3.       Optimize The Grid : Utilities must evaluate the Grid and Optimize for better efficiency. Advanced Analytics strategies and tools will stream line the data for better results.

Smart Grid Enablement in India

The enablers for a smart grid in India include:

·         Supervisory Control and Data Acquisition Systems(SCADA) with Energy Management Systems (EMS)

·          Distribution Management Systems (DMS) Enterprise IT network covering all substations and field offices with reliable communication systems

·         Enterprise Resource Planning(ERP)/Asset Management Systems

·         Geographic Information Systems (GIS) – mapping of electrical network assets and consumers on geospatial maps 

·         Modernization of the substations with modern switchgear and numerical relays

·         Advanced Metering Infrastructure (AMI) with two way communication and Meter Data Management Systems(MDMS)

·         Electronic Billing Systems and Customer Care Systems

·         Distribution Automation (DA) and Substation Automation Systems

·         Outage Management Systems (OMS)

·         Mobile Crew Management Systems/Mobile Workforce Management

·         Wide Area Measurement and Control Systems

·         Forecasting, Dispatch and Settlement Tools

·         Enterprise Application Integration – SAP , Cloud Computing

·         Analytics (converting data into business intelligence)  -Big Data and Analytics