IBM zenterprise System

Size: px

Start display at page:

Download "IBM zenterprise System"

Thomasina Bailey
5 years ago
Views:

1 IBM zenterprise System June, 2012 Jeffrey Frey IBM Fellow, System z Architecture and Design CTO, System z Platform

zenterprise: Integrated IT Infrastructure for Optimized Service Delivery zenterprise zenterprise Unified Unified Resource Resource Manager Manager Integrated, dynamic, intelligent resource management

2 zenterprise: Integrated IT Infrastructure for Optimized Service Delivery zenterprise zenterprise Unified Unified Resource Resource Manager Manager Integrated, dynamic, intelligent resource management Workload-Aware Resource IBM IBM zenterprise zenterprise (z196) (z196) Optimization Enabled for Infrastructure as a zenterprise zenterprise BladeCenter BladeCenter Extension Extension (zbx) (zbx) Service Optimized to host large scale database, transaction, and mission critical applications The Most efficient platform for Large-scale consolidation Capable of massive scale up Selected IBM POWER7 blades and IBM System x Blades* for,, and Windows applications High performance optimizers and appliances to accelerate time to insight and reduce cost Integrated high performance private network 2

Compiler Query Plan Optimize Admin Processor & streaming DB logic

3 The Netezza TwinFin Appliance Disk Enclosures SMP Hosts Snippet Blades (S-Blades ) Slice of User Data Swap and Mirror partitions High speed data streaming SQL Compiler Query Plan Optimize Admin Processor & streaming DB logic High-performance database engine streaming joins, aggregations, sorts, etc IBM Corporation

4 The Netezza AMPP Architecture FPGA CPU Advanced Advanced Analytics Analytics Memory BI BI FPGA CPU Host Hosts Memory FPGA CPU ETL ETL Loader Loader Memory Disk Enclosures S-Blades Network Fabric Applications Netezza Appliance 2011 IBM Corporation

5 Now expandable to 960 cores and 1.28 petabytes TF3 TF6 TF12 TF24 TF36 TF48 TF72 TF96 TF120 Cabinets 1/4 1/ Processing Units Capacity (TB) Effective Capacity (TB)* Accelerator Platforms Predictable, Linear Scalability throughout entire family Capacity = User Data space Effective Capacity = User Data Space with compression Low Latency, High Capacity Update *: 4X compression assumed 2011 IBM Corporation

DB2 Analytics Accelerator Accelerating decisions to the speed of

unparalleled, mixed workload performance for complex analytic business

Low Latency, High Capacity Update Get more insight from your data Fast,

query response times Improve price/performance for analytic workloads

6 DB2 Analytics Accelerator Accelerating decisions to the speed of business Blending System z and Netezza technologies to deliver unparalleled, mixed workload performance for complex analytic business needs. Low Latency, High Capacity Update Get more insight from your data Fast, predictable response times for right-time analysis Accelerate analytic query response times Improve price/performance for analytic workloads Minimize the need to create data marts for performance Highly secure environment for sensitive data analysis Transparent to the application 2011 IBM Corporation

Performance & Savings Query Query 1 Query 2 Query 3 Query 4 Query 5 Query 6 Query 7 Query 8 Query 9 Total Total Rows Rows Reviewed Returned 2,813,571 853,320 2,813,571 585,780 8,260,214 274 2,813,571

7 Performance & Savings Query Query 1 Query 2 Query 3 Query 4 Query 5 Query 6 Query 7 Query 8 Query 9 Total Total Rows Rows Reviewed Returned 2,813, ,320 2,813, ,780 8,260, ,813, ,197 3,422, ,290, ,521 58,236 3, ,130, DB2 Only DB2 with IDAA Hours Sec(s) 2:39 9,540 2:16 8,220 1:16 4,560 1:08 4,080 0:57 4,080 0:53 3,180 0:51 3,120 0:44 2,640 0:42 2,520 Hours Sec(s) Times Faster Queries run faster Save CPU resources 1,908 1, , People time Business opportunities Actual customer results, October 2011 DB2 Analytics Accelerator: we had this up and running in days with queries that ran over 1000 times faster DB2 Analytics Accelerator: we expect ROI in less than 4 months Advance to 32 minute mark for DB2 Analytics Accelerator section of keynote Accelerating decisions to the speed of business IBM Corporation

Fit The Solution To The Workload Access to all Data Business Analytics / ODS Complex queries against a data warehouse Read only Star schema design often used to speed up queries Different modes of

8 Fit The Solution To The Workload Access to all Data Business Analytics / ODS Complex queries against a data warehouse Read only Star schema design often used to speed up queries Different modes of operation OLTP Transactions against operational data Reads and writes Normalized schema design to eliminate redundancy Multiple user throughput operation Tightly integrated solution optimized for workloads Simplification Single entry point to the true data High fidelity data Performance IBM DB2 Analytics Accelerator (IDAA) DB2 for z/os ODS members DB2 for z/os OLTP members 2011 IBM Corporation

Cloud Computing Flexible Service Delivery and Consumption Delivers select set of standardized business

Service Providers and Service Consumers Access by subscription Drives efficiency, Cloud Computing Model.

practices while retaining greater customization and control Formal Service Lifecycle approach Cloud Services.

9 Cloud Computing Flexible Service Delivery and Consumption Delivers select set of standardized business process, application, software platform, and/or infrastructure services on a flexible price per use basis Service Providers and Service Consumers Access by subscription Drives efficiency, Cloud Computing Model. Standardization, capital preservation, flexibility and time to deploy ORGANIZATION standardization and best practices while retaining greater customization and control Formal Service Lifecycle approach Cloud Services. Customization, efficiency, availability, resiliency, security and privacy CULTURE GOVERNANCE...service sourcing and service value 9

10 Service Lifecycle Subscribe to Service Request a service SLA Negotiation Service Personalization Sign Contract Offer Service Register Services Add to Service Catalog Service Design & Creation Service Composition Resource Modeling Tools Service Level Choices Topologies, Best Practices, Management Templates 10 Deploy Service Request Driven Provisioning Management Agents and Best Practices Application / Service On Boarding Self-service interface Manage Operation of Service Service Composition and Context Monitoring, Reporting and Optimization Operational Control Change Management Security Management Event handling Process Management Metering and Billing Terminate Service Controlled Clean-up

Taxonomy Service Management & Orchestration Self Service Portal

Placement Advice Middleware Service Service Management Management

Billing PaaS z/os, z, x86 Monitoring SLA Management Virtual Servers,

Infrastructure Management Virtualization Management Management

11 Taxonomy Service Management & Orchestration Self Service Portal Subscriber Mgmt Application Management APP APP APP SaaS APP APP APP Placement Advice Middleware Service Service Management Management Resource Provisioning OS and Middleware Management Image Management Billing PaaS z/os, z, x86 Monitoring SLA Management Virtual Servers, Storage, Network Service Catalog Workload-Aware Optimization Infrastructure Management Virtualization Management Management Hardware Management 11 IaaS Firmware and Hypervisors Server, Storage, Network, Accelerators, Appliances

12 12 Z CPU, Memory and IO x86 Data Power Windows zhyp PR/SM HMC (with Unified Resource Management) zenterprise System Workload Resource Groups: SLA Mgmt and Reporting (Deployment, Performance, Availability, Security, Energy) Power

13 What is a zenterprise Ensemble? A zenterprise Node is a single zcec with 0..4 racks with up to 1..2 blade centers per rack Power Z CPU, Memory and IO Power HPC Z CPU, Memory and IO x86 HPC z/vm PR/SM x86 z/vm HPC PR/SM 13 Power Virtual Resource Management and Optimization Z CPU, Memory and IO Implements well-defined external interface to Data Center Service Management functions z/vm PR/SM Integrated Advanced Virtualization Management x86 zhmc - Ensemble Manager zenterprise nodes are deployed within synchronous distances on L2 Network Z CPU, Memory and IO HPC z/vm PR/SM Ensemble defines the scope of a zmanager management domain Power A zenterprise Ensemble is a collection of 1..8 zenterprise Nodes managed as a single virtualized pool of server resources x86

14 Customer Managed Management Network TOR Switches z Frame zbx Frames Intra-Node Management Network Mgt Interfaces Intra-Ensemble Data Network zenterprise Node Customer managed Data Networks 14 OSM & OSX OSAs BC Chassis OSD OSAs

RDMA Aimed at providing very low latency/minimal CPU overhead interconnect between virtual servers within zenterprise Utilizes RoCE (RDMA over Converged Ethernet) New protocol

15 RDMA Aimed at providing very low latency/minimal CPU overhead interconnect between virtual servers within zenterprise Utilizes RoCE (RDMA over Converged Ethernet) New protocol that allows existing TCP applications to transparently benefit from RDMA for transferring data Builds upon reliable write access to a remote host s memory in a controlled manner 15

16 Dynamic Provisioning Deploy a Image Capture a Image Image Library The Image meta-data is used to create VM container, allocating the required server, storage, and network resources The bootable disk image is copied into SW SW OS SW OS SW meta-data OS OS meta-data meta-data meta-data The bootable image is copied to the selected virtual host system. the image library. Image meta-data describing the Virtual Infrastructure is captured and included as part of the image. The virtual machine is started from the bootable disk image. SW OS meta-data Compute 16 Memory IO / Network SW SW OS SW OS

17 Virtual Resource Optimizations SW SW SW OS OS OS Virtualization Virtualization Compute Memory Compute IO / Network SW OS SW OS Memory IO / Network SW OS Dynamically adjust virtual machines resource allocations. Allowing unallocated resources to be used by a virtual machine. Allowing resource allocation adjustments to be made between virtual machines Virtual server mobility between host systems. Allocate resources on the target host. Move the virtual machine in-memory state to target host. De-allocating resources on the source host. 17

18 Placement Intelligence What is the most appropriate virtual host within the ensemble to run a given virtual machine image? Mobility When deploying When moving When restarting Need to consider Constraints (Configuration, Licensing..) Optimizations (Performance, Availability, Energy, Isolation) Placement Advisors help to provide optimized placement for the virtual machines within the Ensemble 18 Optimized for. Availability Performance Energy

19 zmanager Interface Resource Discovery Monitoring and Events Resource Provisioning Automation zmanager Interfaces zhmc - Ensemble Manager z/vm x86 Power HPC Power x86 HPC Power Power x86 x86 Placement Advice Service Level Policy PR/SM Z CPU, Memory and IO z/vm z/vm z/vm HPC PR/SM Z CPU, Memory and IO PR/SM Z CPU, Memory and IO PR/SM Z CPU, Memory and IO 19 Security Deployment and Mobility HPC

20 zmanager Interface API is a new implementation in the HMC New API includes existing SNMP/CIM function plus new Unified Resource Manager capabilities HMC SNMP and CIM interfaces not being extended with Unified Resource Manager function Existing SNMP and CIM capabilities remain in place and supported Architecture/design based on current industry design practices Requests and responses structured as RESTful web services Status and property change notifications delivered via JMS HMC provides an embedded JMS broker configured to support API-specific use only JSON Payloads Modern scripting languages (e.g., Java, Perl, Python) have HTTP support libraries TCP/IP Sockets/HTTP is underlying network transport with SSL for connection security Fully documented and supported for customer and third-party use 20

21 Linked Pages 21

IBM System x Blade Support HX5 with Westmere processor Intel 8-core Processor 2 Processor sockets 2.

Fibre Channel 10 GbE Ethernet Hypervisor is KVM Kernel-based Implemented as device driver Requires a hosting

22 IBM System x Blade Support HX5 with Westmere processor Intel 8-core Processor 2 Processor sockets W 16 DIMM 1066 Mhz memory Different memory configurations up to 256GB Two internal 50GB SSDs 8Gb Fibre Channel 10 GbE Ethernet Hypervisor is KVM Kernel-based Implemented as device driver Requires a hosting system/distribution (Selected RHEV-H) Operating System certifications: (RHEL and SLES) and Windows OS Support (64 bit only): RHEL 5.5, SLES 11 (SP1), Additional versions to follow Windows Server 2008 (SP2) for Data Center Windows Server 2008 R2 for Data Center Provide KVM virtio drivers from RedHat for all supported versions/editions 22

23 Encrypted and Signed SOAP/HTTP In-the-clear SOAP/HTTP DataPower Integration SOAP z/vm SOAP PR/SM SOAP Cobol/ MQ Appl Clients Z CPU, Memory and IO 23 HPC PR/SM Power x86 z/vm Malicious SOAP/HTTP Deep-content routing and data aggregation SOA Stack Acceleration Application-layer security and threat protection Protocol and message bridging Blade Hardware Management Energy Monitoring and Management of Blades Firmware Load and Update HMC Console Integration PPM Assisted Dynamic Load Balancing (Future) IEDN Virtual Network Provisioning Monitoring and Reporting Failure Recovery and Restart

IBM zenterprise System The Value begins at the heart of z196.

24 IBM zenterprise System The Value begins at the heart of z % Improvement for traditional z/os workloads 30% Improvement in CPU intensive workloads via compiler enhancements 60% Total capacity improvement zenterprise 196 (z196) Machine Type: 2817 Models: M15, M32, M49, M66, M80 Technology and Performance Enhanced Availability and Serviceability 1 to 80 configurable for client use Workload Optimized Simplified Management IFL, ziip, zaap, ICFs and optional SAPs Dynamic Energy optimized Up to 3 TB RAIM memory 15 subcapacity settings Cryptographic enhancements Optional water cooling and/or HV DC Power Upgradeable from z10 EC and z9 EC 24 IBM Confidential

IBM zenterprise System and the value extends to heterogeneous workloads IBM zenterprise BladeCenter Extension (zbx) Machine Type: 2458 Model 002 Integrated IBM Certified Components driven by System z

Analytics Optimizer IBM WebSphere DataPower (XI50z for zenterprise) Select IBM Blades IBM BladeCenter PS701 Express IBM BladeCenter HX5 7873 Expanding operating system support for z196 on POWER,, and

25 IBM zenterprise System and the value extends to heterogeneous workloads IBM zenterprise BladeCenter Extension (zbx) Machine Type: 2458 Model 002 Integrated IBM Certified Components driven by System z order Standard parts TOR switch, BladeCenter Chassis, Power Distribution Units, Optional Acoustic Panels System z support Problem reporting, hardware and firmware updates Optimizers IBM Smart Analytics Optimizer IBM WebSphere DataPower (XI50z for zenterprise) Select IBM Blades IBM BladeCenter PS701 Express IBM BladeCenter HX Expanding operating system support for z196 on POWER,, and Windows on System x One to four 42u racks capacity for 112 blades Simplified management Improved time to implement new applications Central point of management for heterogeneous workloads No change to applications No MIPS/MSU rating managed by the Configured for high availability Integrated 10Gbe data network Optional rear door heat exchanger zenterprise Unified Resource Manager 25

zenterprise technology designed for small and mid-sized businesses The Value Begins At the Heart with the z114 Up to zenterprise 114 (z114) Machine Type: 2818 2 Models: M05 & M10 New technology in a

26 zenterprise technology designed for small and mid-sized businesses The Value Begins At the Heart with the z114 Up to zenterprise 114 (z114) Machine Type: Models: M05 & M10 New technology in a new package 26 25% Up to Scales From Additional Scale for consolidation and growth Improved data center efficiency Up to Improvement for traditional z/os workloads 1 Improvement in CPU intensive workloads via compiler enhancements2 12% Total capacity improvement MIPS 130 available capacity settings Same Qualities of Service as the z196 Hybrid enabled to drive workload expansion and integration Improved Platform Economics Up to an ADDITIONAL Modular 2 drawer design for lower cost of entry Granularity for right-sizing your system 18% From 1-10 configurable cores for client use includes CPs, IFL, ziip, zaap, and ICFs From 0-2 IBM provided spare cores New Software Curve Lower Hardware Maintenance Lower specialty engine and memory prices Upgradeability for investment protection Up to 256 GB RAIM fault tolerant memory Fully Upgradeable from the IBM System z10 Business Class (z10 BC) & IBM System z9 Business Class (z9 BC); and to the z196 M IBM Corporation

IBM PureData System for Analytics Overview

IBM PureData System for Analytics Overview Chris Jackson Technical Sales Specialist chrisjackson@us.ibm.com Traditional Data Warehouses are just too complex They do NOT meet the demands of advanced analytics