BIG DATA TRANSFORMS BUSINESS

Transcription

1 BIG DATA TRANSFORMS BUSINESS Johannes Fellner November 7 th,

2 IN 2000 THE WORLD GENERATED TWO EXABYTES OF NEW INFORMATION Sources: How Much Information? Peter Lyman and Hal Varian, UC Berkeley, IDC Digital Universe Study. 2

3 IN 2000 THE WORLD GENERATED TWO EXABYTES OF NEW INFORMATION EVERY DAY Sources: How Much Information? Peter Lyman and Hal Varian, UC Berkeley, IDC Digital Universe Study. 3

4 Common Misconception I I don t have PBs, so Big Data is not for me! 4

5 Common Misconception II Big Data is just a new name for Business Intelligence BIG DATA ANALYTICS Experimental, Ad Hoc Mostly Semi- Structured External + Operational 10s of TB to Pb s TRADITIONAL BI Repetitive Structured Operational GBs to 10s of TBs 5

6 What s Driving The Data Deluge? FACEBOOK UPLOADS 250 MILLION PHOTOS EACH DAY Mobile Sensors Social Media Video Surveillance Video Rendering READING SMART METERS EVERY 15 MINUTES IS 3000X MORE DATA INTENSIVE OIL RIGS GENERATE DATA POINTS PER SECOND COST TO SEQUENCE ONE GENOME HAS FALLEN FROM $100M IN 2001 TO $10K IN 2011 Smart Grids Oil Exploration Medical Imaging Gene Sequencing 6

7 How Companies Are Using Big Data Functional Areas Where Companies Are Using Big Data Customer Intimacy Budgeting & Planning Operations & Supply Chain Customer Service Performance Management New Product Strategy Pricing 49% 39% 37% 33% 30% 28% 21% McKinsey Global Survey of 1,469 C-level executive respondents at a range of industries and company sizes, Minding Your Digital Business,

8 BIG DATA TRANSFORMS BUSINESS 8

9 New Business Models Based On Data 1,000,000,000 Queries / Day 250,000,000 New Photos / Day 290,000,000 Updates / Day 4,000,000 Claims / Day 2,800,000,000 Trades / Day 31,000,000,000 Interactions / Day 9

10 Shopping The Old Way! 10

11 Shopping The New Way! Welcome back to Star Grocers Jeremy! Great Britain won their first gold medals today! Welcome back to Star Grocers Jeremy! Today is British Day. We have specials on all items from the U.K. We have specials on all items from the U.K. 11

12 British Biscuits For British Shoppers A new coupon has arrived! 12

13 Your Favorite Salty Snacks Nearby! A new coupon has arrived! 13

14 Salty Snacks Make A Shopper Thirsty! A new coupon has arrived! 14

15 The Journey To Big Data 1 Petabytes Scale-Out All Data CLOUD 15

16 Gene Sequencing App Contains 1 Trillion Images. Support Data Growth Of 1PB to 12PB. Collaborate On Groundbreaking Research. 16

17 Isilon: Scale-Out Storage for Big Data Massive Scalability 15 PB in a single file system Unmatched Performance Industry-leading throughput and IOPS Management Simplicity Manage PBs just like you would TBs 17

18 Greenplum Becomes the Foundation of EMC s Big Data Analytics (July 2010) EMC ACQUIRES GREENPLUM For three years, Gartner has identified Greenplum as the most advanced vendor in the Visionary quadrant of its data warehouse DBMS Magic Quadrant. Gartner 18

19 Big Data Analytics Is In Every Industry Financial Telecom Retail Energy Insurance Government Healthcare Cyber Security Advertising Gaming 19

20 Predict Buyer Behavior to Increase Revenue Big Data Analytics Enables Increased Per-Customer-Profit HIGH Customer Profit Legacy System Greenplum Database BI Reporting Greenplum In-Database Analytics Greenplum Big Data Analytics LOW Agent Best Guess Branch Level Reporting Enabling Profit-based Recommendations Market Basket Analysis & Customer Lifetime Value Computations Enabling User-based Recommendations Data Enriched with Unstructured Activity Logs To Enable Staffing Efficiency TRADITIONAL DATA LEVERAGED BIG DATA LEVERAGED 20

21 Cut Data Loading From 24 Hours to 30 Sec. Reduced Churn, Profitability Up 10% - 50%. Staff Branches Based On Who Banks Where. 21

22 MPP Architecture for Data Analysis Interconnect Data Loading Interconnect Data Loading Add Nodes for Linear Scalability & Performance Automated Parallelization & Tuning Supports Structured & Unstructured Data (Hadoop) 22

23 Hadoop Solution with Greenplum and Isilon Greenplum Greenplum Command Center Greenplum Chorus Hadoop Tools MapReduce Layer Pluggable Storage Layer (HDFS API) Isilon HDFS Protocol lsilon OneFS 23

24 DATA SCIENCE THE NEW TEAM DRIVING BIG DATA 24

25 Big Data Analytics Require Data Science High BUSINESS VALUE Low Business Intelligence Data Science Data Science Predictive analysis What if..? Business Intelligence Standard reporting What happened? Past TIME Future 25

26 The Journey To Big Data 1 Petabytes Scale-Out All Data 2 Self-Service Collaboration Data Science CLOUD SOCIAL 26

27 Chorus: The Platform for Data Science Explore the Data Project Workspaces Publish and Iterate Collaboration Data Analysis 27

28 Self-Service And Collaborative Analytics 28

29 Greenplum Unified Analytics Platform 29

30 How Do We Deliver Insight to the Business? Packaged Apps Custom Apps Automation Efficiency & Cost Requires Defined Model Innovation Growth & Revenue Hard, Expensive, Slow 30

31 The Journey To Big Data 1 Petabytes Scale-Out All Data 2 Self-Service Collaboration Data Science 3 Rapid Development Optimize Processes Actionable Insight CLOUD SOCIAL AGILE 31

32 Documentum xcp: Enable Business Efficiency Automate Content Intensive Processes Easy To Build A Tool For Non-Programmers! Drag & Drop Process Modeling Better, Faster Decisions Deliver The Latest Data Enable Contextual Decisions 32

33 Agile, Rapid Application Development Proven methodology to reduce risk and accelerate results Build Better Software Deploy in Production Faster 33

34 Big Data And EMC Data Science 3 Petabyte Scale Storage Infrastructure 1 4 New 2 Unified Applications Analytics Platform 34

35 HOW TO GET STARTED 35

36 EMC Analytics Vision Workshop How to Leverage Big Data Analytics for Competitive Advantage Envisioning exercises with Line of Business and IT stakeholders Focus on an organization s key business initiative Brainstorming to identify and group key big data analytics opportunities 36

37 Enabling Today s Talent EMC Data Science Training & Certification COURSE OVERVIEW DETAILS 1. Open curriculum 2. Practitioner s approach 3. Enables immediate participation on analytics projects 4. Prepares for EMC Proven Professional Data Science Associate (EMCDSA) Certification 37

38 Summary Big Data is transforming business The approach to Big Data is different EMC can help you start your journey to Big Data Community Industry 38

39 THANK YOU 39

40