May, 2012 Harnessing the Power of Big Data to Transform Your Business Anjul Bhambhri VP, Big Data, Information Management, IBM
12+ TBs of tweet data every day 30 billion RFID tags today (1.3B in 2005) 4.6 billion camera phones world wide data every day Where is big data coming from?? TBs of 100s of millions of GPS enabled devices sold annually 25+ TBs of log data every day 76 million smart meters in 2009 200M by 2014 2+ billion people on the Web by end 2011
New era of computing requires Information from Everywhere Radical Flexibility Extreme Scalability Volume 12 terabytes of Tweets created daily Velocity 5 million trade events per second Variety 100 s video feeds from surveillance cameras
New analytic applications require a big data platform Advanced Analytic Applications Customer churn Risk management Location-based marketing Smart meter analytics Big Data Platform Process and analyze any type of data Accelerators Integrate and manage the full variety, velocity and volume of data Apply advanced analytics to information in its native form Visualize all available data for ad-hoc analysis Development environment for building new analytic applications Analyze data in motion Non-relational data analytics MapReduce / nosql Machine Learning Text analytics Visualization and exploration Scalability for large data volumes Hardware-based query acceleration Stream computing Workload optimization and scheduling Security and Governance
Big Data platform: Bring Together a Large Volume and Variety of Data to Find New Insights Analyzing a variety of data at enormous volumes Insights on streaming data Large volume structured, semi-structure and unstructured data analysis T-Mobile Multi-channel customer experience analysis UOIT Detect life-threatening conditions in time to intervene Vestas Predict weather patterns to plan optimal wind turbine usage Big Data Platform Variety Velocity Volume Dublin City Council Optimization and monitoring of public transportations Brocade Identify network security intrusions
Big Data enabled doctors from University of Ontario to apply neonatal infant monitoring to predict infection in ICU 24 hours in advance IBM Data Baby youtube.com 6 2011 IBM Corporation
Vestas models weather to optimize placement of turbines, maximizing power generation and longetivity based on 2.5 Petabytes of information. Public wind data is available on 284km x 284 km grids (2.5o LAT/LONG) Perspective: The Vestas Wind library, as HD TV would take 70 years to watch More data means more accurate and richer models (adding hundreds of variables) Granularity 27km x 27km grids: driving to 9x9, 3x3 to 10m x 10m simulations Reduce time required to identify placement of turbine from weeks to hours. 7
Entertainment - to-the-minute and historical product insight Jan 1 Monitoring Period Feb 5th Super Bowl 5pm 6pm 7pm 8pm 9pm 10pm 11pm Data Set 1.1B tweets 5.7M blog and forum posts 3.5M relevant messages 97K referencing Product_A 18K referencing Product B Information extracted Buzz and sentiment Gender, Location and Occupation Fans Intent to in purchase Specific attributes of products
Asian telco reduces billing costs and improves customer satisfaction. Capabilities: Stream Computing Analytic Accelerators Real-time mediation and analysis of 6B CDRs per day Data processing time reduced from 12 hrs to 1 sec Hardware cost reduced to 1/8 th 9 Proactively address issues (e.g. dropped calls) impacting customer satisfaction.
Cisco turns to IBM big data for intelligent infrastructure management. 10 Optimize building energy consumption with centralized monitoring and control of building monitoring system. Automates preventive and corrective maintenance of building systems. Uses Streams, InfoSphere BigInsights and Cognos Log Analytics Energy Bill Forecasting Energy consumption optimization Detection of anomalous usage Presence-aware energy mgt. Policy enforcement
The Big Data Approach: Information Sources Drive Creative Discovery Business and IT Identify Information Sources Available New insights drive integration to traditional technology IT Delivers a Platform that enables creative exploration of all available data and content Business determines what questions to ask by exploring the data and relationships
IBM Big Data Platform Analytic Applications BI / Reporting Exploration / Visualization Functional App Industry App Predictive Analytics Content BI / Analytics Reporting IBM Big Data Platform Cost-effectively analyze petabytes of structured and unstructured information Hadoop System
IBM Big Data Platform Analytic Applications BI / Reporting Exploration / Visualization Functional App Industry App Predictive Analytics Content BI / Analytics Reporting IBM Big Data Platform Hadoop System Stream Computing Analyze streaming data and large data bursts for realtime insights
IBM Big Data Platform Analytic Applications BI / Reporting Exploration / Visualization Functional App Industry App Predictive Analytics Content BI / Analytics Reporting IBM Big Data Platform Hadoop System Stream Computing Data Warehouse Deliver deep insight with advanced in-database analytics and operational analytics
IBM Big Data Platform Analytic Applications BI / Reporting Exploration / Visualization Functional App Industry App Predictive Analytics Content BI / Analytics Reporting IBM Big Data Platform Hadoop System Stream Computing Data Warehouse Govern data quality and manage information lifecycle Information Integration & Governance
IBM Big Data Platform Analytic Applications Gather, extract and explore data using best of breed visualization BI / Reporting Exploration / Visualization Visualization & Discovery Functional App Industry App Predictive Analytics IBM Big Data Platform Application Development Content BI / Analytics Reporting Systems Management Speed time to value with analytic and application accelerators Accelerators Hadoop System Stream Computing Data Warehouse Information Integration & Governance Cloud Mobile Security
Accelerators Improve Time to Value Telecommunications CDR streaming analytics Deep Network Analytics Finance Streaming options trading Insurance and banking DW models Public transportation Real-time monitoring and routing optimization Retail Customer Intelligence Customer Behavior and Lifetime Value Analysis Social Media Analytics Sentiment Analytics, Intent to purchase Data mining Streaming statistical analysis Over 100 sample applications User Defined Toolkits Standard Toolkits Industry Data Models Banking, Insurance, Telco, Healthcare, Retail
Cloud Services Making Learning Hadoop Easy and Fun Flexible on-line delivery allows learning @your place and @your pace Courses and material at no cost Cloud-based sandbox for exercises zero setup 14000+ registered students Hadoop Programming Challenge, 3 students winners sent to IBM Information On-Demand Conference 2011
IBM s big data business partner ecosystem 100 CC&G Partners Big Data Business Partner Signed 19
February 2012 The Forrester Wave : Enterprise Hadoop Solutions, Q1 2012 Forrester Wave : Enterprise Hadoop Solutions, Q1 12 20 2012, Forrester Research, Inc. Reproduction Prohibited
THINK