Infrastructure. Self Build Reference Architecture or Appliance? René Witteveen Consultant HP

Transcription

1 Infrastructure for BIG DATA Self Build Reference Architecture or Appliance? René Witteveen Consultant HP

2 BIG DATA BIG BROTHER What s Obama saying?

3 Psssssst what s BIG DATA? amount complexity structured, unstructured personal data VALUE

4 It s about value Not about storage Not about cpu. Not about memory nor parallelism. It s about TCO and ROI

5 And the decisions you make based on the information..

6 What you don t want. Worry about the infrastructure

7 HP Infra for BIG DATA

8

9 HP for BIG DATA initiative: HAVEN Fastest Time to Value; Purpose Built for Big Data Scale and Performance HP solutions deliver more choice to meet specific workloads, data volumes and variety versus our competitors one-size-fits-all approach AppSystem for Apache Hadoop AppSystem for SAP HANA AppSystem for Vertica AppSystem for Autonomy AppSystem for Microsoft PDW

10 HADOOP Use cases Risk modeling Fraud detection Customer retention Sentiment analysis Web mining Financial Services Government Telecom Retail Entertainment Energy Healthcare M

11 Hadoop challenges Hadoop is complex Deployment and management Who knows about HADOOP? From business problem to HADOOP. Data integration Pilot okay. How to get to production?

12 Core HP Hadoop solutions architecture System management HP Insight CMU Provisioning Monitoring Management Hadoop distribution Analytics Database Linux OS HP Networking Top of Rack switches HP Gen8 ProLiant Servers

13

14 INFRA choices (for HADOOP) AppSystem Pretested, preconfigured, factory-integrated solution One PO all HW, SW, & services Ready to use on day of delivery Easy to deploy, manage, & scale Reference Architecture (HP resells Hadoop software) One purchase order Resell Cloudera Enterprise better price for the customer HP on-site installation, configuration, and support Reference Architecture (Partner sells Hadoop software) PO for HP components only Customer buys Hadoop from partner HP on-site installation, configuration, and support HP SKU BD822A BD824A DL380e HP Insight CMU & Vertica Integrated with Cloudera DL380 SL4540 DL380 SL4540

15 HP AppSystem for Apache Hadoop Cloudera Full rack (18 worker nodes) and Half rack (9 worker nodes) configurations HPN A5830 1u HPN A5830 1u DL 360p Gen8 1u DL 360p Gen8 1u DL 360p Gen8 1u DL 380e Gen8 2u DL 380e Gen8 2u 2 x TOR Switch(es) 1 x Management Node HP Insight CMU Cloudera Manager Enterprise 1 x Head Node Job Tracker 1 x Head Node Name Node 18 or 9 x Worker Nodes Task Tracker Data Node Software stack : Red Hat Enterprise Linux v6.4 HP Insight CMU v7.2 Hadoop Cloudera CDH Enterprise Core Vertica Community Edition v6.1 (Evaluation Only) Management Node HP ProLiant DL360p Gen8 Dual 6-Core Intel E GHz ( 24 virtual CPUs ) 64 GB RAM 7.2 TB Disks Head Nodes HP ProLiant DL360p Gen8 Dual 6-Core Intel E GHz ( 24 virtual CPUs ) 64 GB RAM 3.6 TB Disks Worker Nodes HP ProLiant DL380e Gen8 Dual 6-Core Intel E GHz (12 cores - 24 virtual CPUs ) 48 GB RAM 24 TB raw storage ( 2TB x 12 ) 500GB usable for the OS ( 500GB x 2 in RAID-1 ) Top of Rack Switch HP 5830AF 48 x 1GbE with 4 x 10GbE IRF bonding, sflow and 1GB Packet Buffer Depth

16

17

18 In Memory computing HP/SAP HANA appliances Hardware en software pre-integrated Factory Installed HANA not only for BW Also for SAP BUSINESS SUITE

19 Scalable HANA solution for BW What are we doing? Refresh SAP HANA Scale Out offering Replace current Scale Out EVA/IBRIX Solution, with 3PAR, the world s most advanced storage platform Why are we doing this? Offers 50% Reduction in footprint Average 3x (up to 7x) performance vs. EVA/IBRIX configuration Fulfills customer demand of scalability and improved performance Closes competitive gap with higher performance, reduced footprint, and superior design Driven by customer need, and competitive landscape Superior solution, at a lower TCO 8 node/4tb configuration

20 HP/Microsoft Parallel Data Warehouse Onsite deployment services Microsoft Windows 2012 and Microsoft SQL Server 2012 Parallel Data Warehouse software* Hadoop integration HP management tools and utilities HP Converged Infrastructure: servers, storage and networking Collaborative support services from HP and Microsoft** HP and partner assessment, design, and planning services * Priced separately ** HP Proactive Care. Microsoft support priced and purchased separately

21 Scalable FDR InfiniBand 2 x HP 5120 EI switches InfiniBand (data network) and Ethernet (management network) connectivity Passive Server Block Passive Server Block (2) Optional passive server (#3) Virtualized control and management node; failover node for HA Base Scale Unit Active Server Block (2) and Storage Block (1)

22

23 HP is a One Stop Shop for BIG DATA Server Storage HW/OS Management Mobility devices Software End-to-end Enterprise Security suite Services

24 More information: or Tel: