Analytics Platform System

Size: px
Start display at page:

Download "Analytics Platform System"

Transcription

1 Analytics Platform System Big data. Small data. All data. Audie Wright, DW & Big Data Specialist Ofc , Cell Sean Mikha, DW & Big Data Architect Cell ,

2 Unlock Insights on Any Data Taking an End-to- End Approach to BI and Analytics Modernizing Your Data Warehouse for Hadoop

3 The traditional data warehouse data warehousing has reached the most significant tipping point since its inception. The biggest, possibly most elaborate data management system in IT is changing. Gartner, The State of Data Warehousing in 2012

4 The traditional data warehouse 2 Real time data 1 Increasing 1data Increasing data 3 New data sources volumes volumes and types 4 Cloud-born data

5 The modern data warehouse

6 Microsoft s modern data warehouse SQL Server 2014 Analytics Platform System Microsoft Azure HDInsight Data Platform

7

8

9 Scale out relational data to petabytes From terabytes to multi-petabytes Scale out technologies in Analytics Platform System APS / HDInsight APS / HDInsight APS / HDInsight APS / HDInsight APS / HDInsight APS / HDInsight APS 0TB 6PB

10 Scale Out non-relational data Scale out big data Scale out non-relational data in HDInsight (for Microsoft Azure or APS)

11

12

13

14 In-memory performance In-memory Columnstore for next-generation performance Columnstore index representation

15 Concurrency and mixed workloads Great performance for mixed workloads Query Results

16 Near real-time insights Real-time with complex event processing Event Sources Event Targets

17

18

19

20

21 What is big data? Petabytes Data complexity: variety and velocity

22 What is Hadoop? Distributed, scalable system on commodity HW Operational services Data services AMBARI OOZIE FALCON FLUME SQOOP HBASE PIG HIVE & HCATALOG Core Services LOAD & EXTRACT NFS WebHDFS MAP REDUCE YARN HDFS Hadoop Cluster Hadoop clusters provide scale-out storage and distributed data processing on commodity hardware compute & storage compute & storage

23 IT infrastructure optimization Legal discovery Social network analysis Traffic flow optimization Web app optimization Churn analysis Natural resource exploration Weather forecasting Healthcare outcomes Fraud detection Life sciences research Advertising analysis Equipment monitoring Smart meter monitoring

24 Hadoop offerings on-premise and cloud Real-time with complex event processing Microsoft Azure

25

26 Integrate relational data and Hadoop Integrated query with PolyBase in SQL APS Select Result set Microsoft Azure HDInsight Analytics Platform System PolyBase Hortonworks (Windows, Linux), Cloudera Microsoft HDInsight

27

28

29 Microsoft s modern data warehouse SQL Server 2014 Analytics Platform System Microsoft Azure HDInsight Data Platform

30 Freedom of deployment options and hybrid solutions

31 Appliance vs. Reference Architecture Buying an appliance Order SKU from a list of configuration options Order hardware from a BOM Factory Customer builds builds & tests& configures Hardware vendor installs & connects Buying a Reference Architecture Microsoft Installs software, validates function drivers, & performance firmware, etc. Hands over the keys to the customer Microsoft is the single point of contact for support Customer manages multiple support channels

32 Sign up for a free architectural design session for APS with your Microsoft rep Visit Analytics Platform System at Try HDInsight at Try SQL Server for data warehousing in Microsoft Azure VMs at Try Hortonworks Data Platform for Windows at products/hdp-windows/ Try SQL Server 2014 at sql-server-2014.aspx

33

34 Growth Topology PDW Region Only Base Unit Scale Extension UnitBase Unit

35 Growth Topologies Hadoop Region Extend Min

36

37

38

39

40

41

42

43

44

45

46 .