Analytics Platform System
|
|
- Marilynn Harrington
- 5 years ago
- Views:
Transcription
1 Analytics Platform System Big data. Small data. All data. Audie Wright, DW & Big Data Specialist Ofc , Cell Sean Mikha, DW & Big Data Architect Cell ,
2 Unlock Insights on Any Data Taking an End-to- End Approach to BI and Analytics Modernizing Your Data Warehouse for Hadoop
3 The traditional data warehouse data warehousing has reached the most significant tipping point since its inception. The biggest, possibly most elaborate data management system in IT is changing. Gartner, The State of Data Warehousing in 2012
4 The traditional data warehouse 2 Real time data 1 Increasing 1data Increasing data 3 New data sources volumes volumes and types 4 Cloud-born data
5 The modern data warehouse
6 Microsoft s modern data warehouse SQL Server 2014 Analytics Platform System Microsoft Azure HDInsight Data Platform
7
8
9 Scale out relational data to petabytes From terabytes to multi-petabytes Scale out technologies in Analytics Platform System APS / HDInsight APS / HDInsight APS / HDInsight APS / HDInsight APS / HDInsight APS / HDInsight APS 0TB 6PB
10 Scale Out non-relational data Scale out big data Scale out non-relational data in HDInsight (for Microsoft Azure or APS)
11
12
13
14 In-memory performance In-memory Columnstore for next-generation performance Columnstore index representation
15 Concurrency and mixed workloads Great performance for mixed workloads Query Results
16 Near real-time insights Real-time with complex event processing Event Sources Event Targets
17
18
19
20
21 What is big data? Petabytes Data complexity: variety and velocity
22 What is Hadoop? Distributed, scalable system on commodity HW Operational services Data services AMBARI OOZIE FALCON FLUME SQOOP HBASE PIG HIVE & HCATALOG Core Services LOAD & EXTRACT NFS WebHDFS MAP REDUCE YARN HDFS Hadoop Cluster Hadoop clusters provide scale-out storage and distributed data processing on commodity hardware compute & storage compute & storage
23 IT infrastructure optimization Legal discovery Social network analysis Traffic flow optimization Web app optimization Churn analysis Natural resource exploration Weather forecasting Healthcare outcomes Fraud detection Life sciences research Advertising analysis Equipment monitoring Smart meter monitoring
24 Hadoop offerings on-premise and cloud Real-time with complex event processing Microsoft Azure
25
26 Integrate relational data and Hadoop Integrated query with PolyBase in SQL APS Select Result set Microsoft Azure HDInsight Analytics Platform System PolyBase Hortonworks (Windows, Linux), Cloudera Microsoft HDInsight
27
28
29 Microsoft s modern data warehouse SQL Server 2014 Analytics Platform System Microsoft Azure HDInsight Data Platform
30 Freedom of deployment options and hybrid solutions
31 Appliance vs. Reference Architecture Buying an appliance Order SKU from a list of configuration options Order hardware from a BOM Factory Customer builds builds & tests& configures Hardware vendor installs & connects Buying a Reference Architecture Microsoft Installs software, validates function drivers, & performance firmware, etc. Hands over the keys to the customer Microsoft is the single point of contact for support Customer manages multiple support channels
32 Sign up for a free architectural design session for APS with your Microsoft rep Visit Analytics Platform System at Try HDInsight at Try SQL Server for data warehousing in Microsoft Azure VMs at Try Hortonworks Data Platform for Windows at products/hdp-windows/ Try SQL Server 2014 at sql-server-2014.aspx
33
34 Growth Topology PDW Region Only Base Unit Scale Extension UnitBase Unit
35 Growth Topologies Hadoop Region Extend Min
36
37
38
39
40
41
42
43
44
45
46 .