Ensuring Trust in Big Data with SAP EIM Solutions. Scott Barrett Senior Director, Information Management Database & Technology Centre of Excellence

Ensuring Trust in Big Data with SAP EIM Solutions Scott Barrett Senior Director, Information Management Database & Technology Centre of Excellence

Big Data in Context Who owns an iwhatever? How many songs? <100? 100 1000? 1000 10000? 10000+? 100000+? At what point does it become a Big Music problem? Which type is it? Operational or Analytic? Both 2013 SAP AG. All rights reserved. 6

Discussion Is this.a Mobility problem?.an Analytics problem?.a Big Data problem?.an icloud problem? It s actually an Operational Data problem in the source application (itunes) 2013 SAP AG. All rights reserved. 14

How has Information Governance Changed in the Big Data Era?

What is Big Data? How is impacting your business?

What is Big Data? Volume, variety, and velocity Volume Explosion in the amount of data Variety Multiple data formats; non-structured data boom Velocity Fast collection, processing and consumption Data Volume in Whole World 1.8 Zettabytes Mobile Click Stream Automobiles Social Network Structured Data! 7.9 Zettabytes RFID Smart Meter Locationbased Data Customer Data Machine Data IMHO, it s great! Text Data Point of Sale 2011 2015 Future 2013 SAP AG. All rights reserved. 20

SAP Solutions for Information Management Key Themes Enable big data, information governance, and simple use Big Data Information Governance Simple Volume n Variety n Velocity Quality Data n Across Processes n For Analytics Unified n Intuitive n Flexible 2013 SAP AG. All rights reserved. 21

Big Data versus Small Data Discover more patterns & anomalies in large volumes of data Smaller Structured Data Sets Run queries to for insight Know what you re looking for Large Volumes of Unstructured Data Mine data Detect nuggets of relevant data while disregarding unimportant data 2013 SAP AG. All rights reserved. 22

Example: What s Important Data in a Web Log? Find relevant insight in unstructured data, extract, & structure Visitor A views 1 st product Visitor A - irrelevant data [Skip 2 seconds (12,600 record entries) for next meaningful action from this user] Visitor A views 2 nd product User Product Product etc 43.251.164.128 B003ZX8B3W B00365F6EG etc EDW 2013 SAP AG. All rights reserved. 23

Technology Blueprint in Information Governance Business SAP Information Metrics Steward Rules Governance Workflow Metadata SAP Master Data Governance & Master Master Data Management Data Management Data Profiling Data SAP Data Services Quality Data Integration 2013 SAP AG. All rights reserved. 24

Feeding the Knowledge Worker with Accurate, Relevant Data

Leverage Information to Accelerate Your Growth An emerging middle class growing to 5B Data doubling every 18 months More mobile devices than people 1 billion people on Facebook 15 billion web-enabled devices in 2013 DATA CLOUD MOBILE 2013 SAP AG. All rights reserved. 26

The Struggle to Empower Knowledge Workers 46% of organizations cited the need for better access and analysis of real-time data as one of the top data management objectives in next 12 months $8,200,000 is the annual average estimated loss due to data quality issues Computerworld, Data Management Wish List: IT Is Open to Big Changes, 2012 Gartner, Inc., Measuring the Business Value of Data Quality, October 2011 2013 SAP AG. All rights reserved. 27

An Information Management Strategy Helps Business Run Better Maximize Operational Efficiencies Smoother business processes Standardized and high quality information Reduced IT costs Make Better Decisions Enhanced customer service Increased marketing effectivness Increased revenue growth Reduce Risk Improved accountability Better accuracy and consistency Compliance with internal and external regulations 2013 SAP AG. All rights reserved. 28

SAP Solutions for Information Management Before After Data Quality Management Data Integration GOVERN Master Data Management Enterprise Modeling Content Management Information Lifecycle Management 2013 SAP AG. All rights reserved. 30

Vendor Market Share Total Worldwide DI and DQ Tools Market Rank 2012 1 Data Integration and Data Quality Tools Worldwide Market 2 SAP Vendor Metric 2011 2012 SAS Ins(tute Revenue 637.3 667.7 MS % pt. 18.4% 18.0% Revenue 579.9 643.1 MS % pt. 16.8% 17.4% YoY Rev Growth 11-12 Share % pt + 4.8% - 0.4 + 10.9% + 0.6 Key Highlights Combined DI and DQ Tools market is $3.7 billion 3 IBM Revenue 558.7 608.9 MS % pt. 16.2% 16.4% + 9.0% + 0.2 SAP is 2 nd largest vendor 4 Informa(ca 5 Oracle Revenue 528.2 532.0 MS % pt. 15.3% 14.4% Revenue 200.3 217.9 MS% pt. 5.8% 5.9% + 0.7% - 0.9 + 8.8% + 0.1 Growing faster than the overall market Others Revenue 953.5 1,034.4 MS % pt. 27.6% 27.9% + 8.5% + 0.3 Total Revenue 3,458.1 3,703.9 MS % pt. 100% 100% + 7.1% NA Source: Gartner Market Share All Software Markets Worldwide: Data Integration Tools and Data Quality Tools March 2013 Note: Revenue in $ millions and consists of licenses, subscriptions and maintenance. 2013 SAP AG. All rights reserved. 31

SAP Focus Is To Turn Information Into a Strategic Asset Empower key decision makers with accurate analytics for Big Data Ensure information governance at every step of the business process Unleash the business value of unstructured information 2013 SAP AG. All rights reserved. 32

Information for Accurate Analytics Deliver complete, insightful, and trusted information from any data source Gain a complete view of information Get unprecedented insight from big data Ensure trust in information Data integration to access and move data from any source Real-time replication to ensure high availability of data Text data processing to extract useful intelligence from unstructured data Hadoop access without programming Data modeling & metadata visualization to streamline communication Data quality management to correct data issues Data profiling to know when data is fit for use 2013 SAP AG. All rights reserved. 33

Information Management Is A Key Part of the Real-Time Data Platform ERP Business Warehouse Business Intelligence SAP Real-time Data Platform Mobile & Embedded SAP Has Everything to Architect Common programming APIs Integrate SAP Sybase PowerDesigner modeling SAP Sybase ASE transactions SAP Sybase ESP streams In-memory/real-time SAP HANA Hadoop Big Data SAP Sybase IQ EDW SAP Sybase SQL Anywhere mobile and embedded SAP Sybase Control Center monitoring Monitor Cleanse Govern Big Data-ize Archive Information Management Replication Server, Data Services, emdm, ILM, OpenText. Any Data Source 2013 SAP AG. All rights reserved. 34

In-Memory Innovation From SAP HANA A common database approach for analytical and transactional processing using an in-memory column database Hasso Plattner, SAPPHIRE 2010 VS Transact Analyze Accelerate Transactions + Analysis directly in-memory 2013 SAP AG. All rights reserved. 35

Information Management for SAP HANA Delivers high performance data movement HANA Data Transfer Pipe Up to 50% FASTER data transfer from file and database to HANA Parallelized SAP BW Data Extract More than 10x FASTER 2013 SAP AG. All rights reserved. 36

SAP HANA Smart Data Access n Access, execute, analyze, and optimize without source system n limitations or boundaries Capabilities Real-time virtualized data access to SAP HANA, Hadoop (Hive), SAP Sybase ASE, SAP Sybase IQ, and Teradata Highly optimized query access to enterprise, cloud, and big data sources Powerful Scenarios and Use Cases Developing Analytics Applications regardless of data source Virtualization of data in Hadoop (Hive) IQ as storage for SAP HANA archived data BW IQ as NLS for BW and Teradata as remote source for BW on SAP HANA Benefits Compliments and leverages existing enterprise investments Leverages advanced native SAP HANA capabilities to build applications Optimized performance and reduces objections to start in-memory journey Lower development costs by using data directly from its source system 2013 SAP AG. All rights reserved. 37

Unique Big Data Solution Leverage all data to enable real-time business Applications Open APIs and Protocols Federated Access SAP HANA (in-memory) SAP BusinessObjects BI SAP HANA Real-time analysis on massive amounts of structured and unstructured data answering complex questions inmemory, lightening fast Built for extreme transactional, analytical and application logic processing in ONE database SAP Data Services (information management) Intel Distribution for Apache Hadoop Intel Manager for Apache Hadoop Intel Distribution for Apache Hadoop 1st distribution of Apache Hadoop software built from silicon up for enhanced performance & security Intel Manager for Apache Hadoop Simplified management and configuration of Apache Hadoop SAP Data Services Integrated solution for ETL, text data processing, and data quality Push down processing to Hadoop without coding to mine relevant data that is rapidly loaded into SAP HANA for contextual analysis with structured data Load or retrieve data from HDFS or Hive SAP BusinessObjects BI Platform Integrated end-to-end BI platform, with tools for reporting, dashboards, analytics, data exploration, predictive analysis, and visual intelligence 2013 SAP AG. All rights reserved. 38

Information Management for the Cloud Build, deploy, and monitor with SAP HANA Cloud Integration Cloud Applications Cloud-based technology Real-time, bi-directional process integration Data integration Real-Time Process Integration SAP HANA Cloud Integration Data Integration iflows (Packaged Integrations) Community and Marketplace Graphical flows & mappings Centralized monitoring and administration Pre-built adapters Community marketplace Compatible with SAP NetWeaver PI content (e.g. mappings) and SAP Data Services SAP On-Premise 3 rd Party On-Premise 3 rd Party Cloud Solutions Lower cost of change over time 2013 SAP AG. All rights reserved. 39

Data Quality Business Value Analysis First and only innovation available Calculate the financial ROI of data quality and information governance initiatives Understand how bad data affects business Identify potential savings using what-if analysis of quality level and costs Track metrics of financial impact per failure 2013 SAP AG. All rights reserved. 40

SAP IM Solutions: Proven and Trusted Powering the world s leading global organizations with trusted information 11,000+ SAP IM customers worldwide Winner Swiss Re, Kraft Foods Inc. and Lexmark Intl. are winners of Gartner MDM Excellence Awards 90% customer satisfaction rating Leader Data Quality, Data Integration, Enterprise Content Management Gartner Magic Quadrants 2012 #2 market share for data integration and data quality 2013 SAP AG. All rights reserved. 41

We wrote the book on it! Understand the big picture of SAP s enterprise information management offerings Reviews are in! Explore step-by-step instructions for working with SAP solutions for Information Management Learn how to perform the most important tasks with SAP Information Steward, Data Services, Master Data Governance, NetWeaver Information Lifecycle Management, and more Review 12 customer implementation projects A consistent Top 10 Best-seller with SAP Press! Order at http://www.sappress.com 2013 SAP AG. All rights reserved. 42

Thank you! Scott Barrett sc.barrett@sap.com +44 7827 859 428