A DB2 DBA s Guide to DB2 in the Cloud

Transcription

1 A DB2 DBA s Guide to DB2 in the Cloud St. Louis DB2 Users Group (STLDUG) Tuesday, March 7 th, 2017 Kelly Schlamb Executive IT Specialist, IBM Canada Ltd. kschlamb@ca.ibm.com, 2017 IBM Corporation

2 Safe Harbor Statement Copyright IBM Corporation All rights reserved. U.S. Government Users Restricted Rights - Use, duplication, or disclosure restricted by GSA ADP Schedule Contract with IBM Corporation THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES ONLY. WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED AS IS WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. IN ADDITION, THIS INFORMATION IS BASED ON CURRENT THINKING REGARDING TRENDS AND DIRECTIONS, WHICH ARE SUBJECT TO CHANGE BY IBM WITHOUT NOTICE. FUNCTION DESCRIBED HEREIN MY NEVER BE DELIVERED BY I BM. IBM SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION. NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, NOR SHALL HAVE THE EFFECT OF, CREATING ANY WARRANTIES OR REPRESENTATIONS FROM IBM (OR ITS SUPPLIERS OR LICENSORS), OR ALTERING THE TERMS AND CONDITIONS OF ANY AGREEMENT OR LICENSE GOVERNING THE USE OF IBM PRODUCTS AND/OR SOFTWARE. IBM, the IBM logo, ibm.com and DB2 are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol ( or ), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at Copyright and trademark information at IBM Corporation

3 Agenda Getting to know the cloud IBM SoftLayer and Bluemix DB2 V11.1 IBM Cloud Data Services DB2 on Cloud dashdb for Analytics dashdb for Transactions dashdb Local Getting started Further reading IBM Corporation 3

4 Getting to Know the Cloud 2016 IBM Corporation

5 Computing as a Service Cloud Computing ( The Cloud ) is the delivery of on-demand computing resources. Everything from applications to data centers, over a private or public network, or on a pay-for-use basis IBM Corporation

6 Its not about Cloud or On-Premises its about Cloud AND On-Premises It s About Hybrid Through 2020, the most common use of Cloud services will be a hybrid model combining on-premises and external Cloud services. Gartner, Cloud Computing Innovation Key Initiative Overview IBM Corporation

7 Clients Are Aggressively Moving Workloads to Cloud DevOps Disaster Recovery Archive Database Workloads Collaboration Risk & Compliance Mature Workloads Web Applications Big Data & Analytics e-commerce Isolated Workloads Moving to Cloud Applications with Complex Processes & Transactions Not Ready for Cloud Applications with Sensitive Data Highly Customized Applications Not yet virtualized applications May be ready for Cloud Customer Service Regulation Intensive Applications Information Intensive Applications Front Office / Desktop Batch Processing Mobile 3 rd Party Applications ERP / CRM Social Business High Performance Computing Development & Test Workloads Compute Workloads Business Processes (e.g. Expense Reporting) Storage Workloads IBM Corporation

8 Public and Private Cloud Drives Better Business Economics Agility is the #1 reason to adopt the Cloud NOT cost savings. Cloud enables businesses to compete faster. And speed kills, a chess grandmaster would lose to a beginner that got four moves every turn. 2 Business Scalability Provides limitless, cost-effective computing capacity to support growth 1 Cost Agility Shifts fixed to variable cost Pay as and when needed CAPEX vs. OPEX 3 Market Adaptability Faster time to market Supports experimentation 4 Masked Complexity Expands product sophistication Simpler for customers and users 6 Ecosystem Connectivity New value nets potential new business 5 Context-Driven Variability User defined experiences Increases relevance Source: 8 IBV Analysis 2017 IBM Corporation

9 Speaking in Cloud On-Premises Off-Premises IaaS SaaS Public Cloud Virtualized Cloud PaaS Private Cloud Hybrid Cloud Multi-tenancy Noisy Neighbors Bare Metal Burst Capacity Pay-As-You-Go Point of Presence IBM Corporation

10 Cloud Glossary Burst Capacity Leveraging the real-time provisioning of a Cloud to rapidly add new capacity in order to satisfy a spike in workload. In a Hybrid Cloud approach, an on-premises workload can leverage a Public Cloud for Burst Capacity. Multi-tenancy A single instance of a software application that serves multiple customers. Each customer is called a tenant. Noisy Neighbors In a virtualized Cloud, the effect of other VMs on the same physical server stealing your resources and slowing you down. On-Premises Clients current data centers. Off-Premises IBM Bluemix or other third party data centers. Pay-As-You-Go Clients pay only for their actual usage of the Cloud. Point of Presence A Cloud provider installing a high speed endpoint of their network in a peering station, allowing other network providers to provide fast / private connections into the Cloud s network. Bare Metal Not virtualized. These are Cloud servers that are actual physical servers that are dedicated to a specific client. Virtualized Clouds Clouds that only rent virtual machines, no bare metal IBM Corporation

11 Cloud Deployment Models 1. Private Cloud A Cloud dedicated for sole use and resides either on-premises or off-premises that is Client-managed or IBM managed. 2. Public Cloud When the Cloud is off-premises and resources may be shared between clients. Hundreds to thousands of clients with controls to enforce isolation between client s data and resources. Most new ISVs are purely Public. 3. Hybrid Cloud A combination of Public and Private Clouds. Most enterprise clients are Hybrid. Enterprise Private Managed Private Hosted Private Public Enterprise Data Center Enterprise Data Center Enterprise Data Center Enterprise Client Managed Client Managed IBM Managed IBM Managed IBM Managed Hybrid Cloud Integration and Governance IBM Corporation

12 Hardware Middleware Applications Cloud Service Models 1. IaaS Infrastructure as a Service 2. PaaS Platform as a Service 3. SaaS Software as a Service Payments Procurement Business Process-as-a-Service Software-as-a-Service Platform-as-a-Service Infrastructure-as-a-Service Applications Commerce Analytics Databases Hadoop Integration Other Middleware Servers Storage Networking IBM Corporation

13 "As-a-Service" Explained Managed by CUSTOMER Applications Data Managed by CUSTOMER Applications Data Applications Data Runtime Runtime Runtime Middleware Middleware Middleware Operating System Operating System Operating System Virtualization Virtualization Virtualization Servers Servers Servers Storage Storage Storage Networking Networking Networking Infrastructure as a Service (IaaS) Platform as a Service (PaaS) Software as a Service (SaaS) IBM Corporation

14 IBM SoftLayer & Bluemix 2016 IBM Corporation

15 IaaS Infrastructure-as-a-Service SoftLayer is IBM s Infrastructure-as-a-Service (IaaS) IaaS lets clients rent hardware, storage and networking without needing to know anything about the underlying data center facilities Servers come with operating systems to allow initial access but are not patched or managed from the default install by the IaaS IaaS lets you to pick where your server will be located PaaS Platform-as-a-Service Bluemix is IBM s Platform-as-a-Service (PaaS) PaaS lets clients rent middleware services (databases, app servers, storage, Hadoop) without needing to know anything about the underlying hardware, storage and networking they are housed on PaaS still needs to know how much data you have to store Bluemix runs on top of SoftLayer The services in Bluemix (the PaaS) are consumers of the storage, compute and network resources provided by SoftLayer (the IaaS) Applications run on top of Bluemix The applications (SaaS) are consumers of the middleware services provided by the PaaS IBM Corporation

16 What is Bluemix? Bluemix is an open-standard, cloud-based platform for building, managing, and running applications of all types (web, mobile, big data, new smart devices, and so on ) Go Live in Seconds Zero to running in one click. Development plans deploy in seconds. Enterprise plans deploy in 1-2 days. APIs and Services A catalog of IBM, third party, and open source API services allow the developer to stitch an application together in minutes. On-Premise Integration Build hybrid environments. Connect to on-premise assets plus other public and private clouds. DevOps Development, monitoring, deployment, and logging tools allow the developer to run the entire application. Layered Security IBM secures the platform and infrastructure and provides you with the tools to secure your apps. Flexible Pricing Sign up in minutes. Pay as you go and subscription models offer choice and flexibility IBM Corporation

17 Bluemix: Public, Dedicated, & Hybrid Public Dedicated Bluemix functionality can be accessed in a cost-effective public cloud or an enterprise class managed private environment hosted on SoftLayer. Public Bluemix Zero cost entry point No commitment, PAYG and freemium pricing models Wide array of IBM and 3rd party services Backed by IBM s enterprise caliber security Deployed in Dallas, London and Sydney. Additional data centers coming. Dedicated Bluemix Fully redundant, dedicated Bluemix environment, deployed to any SoftLayer data center VPN for private network access Data Cache and Cloudant part of every environment Additional Cloud Data Services like dashdb available as optional purchases Services Integration Portability Flexible Deployment Models IBM Corporation

18 Bluemix is the Platform for Cloud Development Database services Cloud Integration Services Web and Application services Mobile Services Security Services Watson Services IBM, Open Source and Third Party APIs Internet of Things Services Big Data services DevOps Services Choose give developers the freedom to use open source and a mixture of for-free and for-fee services Scale with differentiated IBM middleware services Integrate allow developers to compose entire applications with minimal glue code between services IBM Corporation

19 DB2 V11.1 Your Bridge to the Cloud 2016 IBM Corporation

20 DB2 Version 11.1 Highlights Core Mission Critical Workloads : Extending DB2 Leadership Comprehensive Enterprise Security Enterprise Encryption Centralized Key Managers (KMIP) Availability 2 nd only to DB2 for zos Warehousing Workloads : Most Consumable, Most Scalable In-Memory Warehousing Platform Massive Scale Warehousing at In-Memory Performance MPP BLU Scalability PB scale in-memory warehousing Simple Fast Deployment Up and running in hours Even Greater Availability Zero data loss DR with HADR More online management More Platforms Supported Power Linux (LE) Virtualization for RDMA (x86) Significant Core Database Advances Very Large Database Performance Higher user throughput Next Gen In-Memory Performance, Function & Workloads Faster ELT/ETL performance More Query Workloads Optimised More Function supported Generated Columns RCAC OLAP + BLU Perf Enhanced Compatibility Multi-Lingual SQL Advances PostgresSQL Support for European Languages Codepage 819 Simpler, Faster, More Online Upgrades Faster, no need for offline backup Streamlined HADR upgrade 20 DB2 Version 9.7 direct to IBM Corporation

21 DB Highlights Comprehensive Enterprise Security Enterprise Encryption PKCS#11 HSM support SSL Encryption for HADR Initially only on Linux/x86 Higher Availability and Core Capabilities Even Greater Availability Seamless HADR purescale upgrades ADMIN_MOVE_TABLE new FORCE_ALL Asynchronous UNDO (technical preview) Additional Core Function Workload Manager (WLM) enhancements Federation simplification and integration Improved DECIMAL and DECFLOAT perf More Compatibility and Serviceability Even Greater SQL Compatibility Column support for BOOLEAN data type Common table expression (DB2for z/os) WITH and SELECT INTO support Increased Serviceability Client info in db2diag for lock and lock errors Backup image size in event monitor history Raise maximum log file size to 64 GB Column-Organized (BLU) Tables Performance Improvements Synopsis table enhancements (HTAP) Additional SIMD exploitation Aggregation enhancements, sort elimination INSERT from sub-select performance improvements Additional advantages for SAP Added Function Removing Limitations Automatic Dictionary Creation on uncommitted data ALTER VARCHAR/VARGRAPHIC length support Additional Operating System Support PureScale SLES 12, RHEL 6.8 on x86 Ubuntu on z Systems Non-pureScale on Ubuntu Text Search support Windows Support for Windows Server IBM Corporation

22 DB2 V11.1 Your Bridge to the Cloud Foundation of IBM s Common Analytic Engine strategy DB2 makes data simple so developers and DBAs can focus on Building new apps that manage born in the cloud data Moving data workloads from data centers to the cloud Delivering short-term database projects Creating off-premises disaster recovery fail-safes Pushing data to data centers across the globe to facilitate geographic reach and regulatory compliance DB released in December 2016 Continued focus on cloud, including SSL/TLS encrypted HADR flows IBM Corporation

23 DB2 Direct Editions (New to V11.1) New Delivery Mechanism for DB2 licenses New license metrics to facilitate hybrid cloud deployments Acquire the product directly online (Passport Advantage) Option to deploy either on-premises or on cloud Two Versions depending on Requirements DB2 Direct Standard Edition 11.1 Has database features of DB2 Workgroup Server Edition DB2 Direct Advanced Edition 11.1 Has database features of DB2 Advanced Enterprise Server Edition Metric Standard Advanced VPC Monthly $135 $354 Prices are in US dollars and are subject to change. Simplified license metric, the Virtual Processor Core (VPC) sold as a monthly license charge 1 VPC for every VPC available to a virtual server s operating system, or 1 VPC for each physical core of a non-partitioned physical server If the number of VPCs is greater than the physical cores, then you only need to license the number of physical cores on the machine Minimum of 2 VPCs per deployment (1 VPC for idle/warm standby) IBM Corporation

24 Remote Storage Access for DB2 Utilities DB2 utilities can directly access cloud-based storage SoftLayer Object Storage (Swift) Amazon Simple Storage Service (S3) Remote storage accessible from INGEST, LOAD, BACKUP and RESTORE using storage access aliases Remote storage credentials safely stored in an encrypted keystore db2 "catalog storage access alias sl-dallas vendor softlayer \ server \ user SLOS :SL password 61316dfa821fac78fabf2decda94875 \ container DB2CloudCont" db2 "load from db2remote://sl-dallas//datafiles/namesage.csv of del \ insert into name_age" db2 "backup database mydb to db2remote://sl-dallas//backups" IBM Corporation

25 Encrypted HADR Traffic with SSL (new in DB ) Log data shipped between HADR primary and standby servers gets encrypted HADR SSL-encrypted communication Configured via HADR_SSL_LABEL configuration parameter Specifies label of the SSL certificate All sync modes supported Multiple standbys supported Initial support is for Linux on Intel only (non-purescale) IBM Corporation

26 DB2 purescale in the Cloud Sample Configuration purescale s scale-out architecture is a natural fit to exploit typical cloud infrastructure Powerful, commodity bare-metal servers e.g. 12 cores, 128 GB RAM 10 Gb TCP sockets member interconnect High-performance shared storage Three systems provide tie-breaking for HA For cases where tie-breaker disks aren t available Bare metal servers for performance and HA With VMs, two members / CFs etc. might end up in the same physical machine App App App App SoftLayer Performance network-attached storage Capacity and IOPS for data and transaction logs shared across the systems M0 CFp M1 CFs M2 SoftLayer Performance Storage IBM Corporation

27 Orders per hour Example: DB2 purescale + IBM Commerce in the Cloud Scale-out Capacity Growth App App App App App App App App M0 CFp App App M1 CFs App App M2 M0 CFp App App App M1 CFs App App App M2 M0 CFp M1 CFs M2 M3 purescale HA allows high throughput to continue even when one member is down for maintenance Normal operating range 3 or more members Configuration here used two 16c app servers per member IBM Corporation

28 IBM Cloud Data Services 2016 IBM Corporation

29 Cloud Data Services Span a Variety of Needs Customer Data Center (On-Premise) Cloud Data Center (Off Premise) Software Select, purchase, provision and operate hardware & software Complete control of every operating parameter Appliance Expertly engineered hardware & software Customer responsible for operation Fixed configuration = less control Cloud Image Expertly engineered cloud configurations IaaS manages hardware Customer has full control over software & operation Managed Service IBM operates service and controls everything IBM delivers on SLA Customer concerns only with data control simplicity IBM Corporation

30 How to Get to Hybrid? IBM data warehouse will offer clients choice in selecting the best (combination of) data stores to satisfy their hybrid data warehouse solution needs dashdb dashdb Local PDA Appliance DB2 BigSQL IBM DB2 Managed Public Cloud Service Software-defined Appliance Custom Deployable Software Hadoop/Spark Environment IBM Corporation

31 IBM Cloud Data Services Analytics and Transactional IBM solutions combine workloads and data types for true hybrid services ANALYTICAL TRANSACTIONAL BigInsights on Cloud Spark for in-memory Hadoop Built on IBM Open Platform Bare metal performance BigInsights enterprise features UNSTRUCTURED STRUCTURED dashdb for Analytics SQL interface, ACID compliant Columnar, in-memory performance BLU augmented with Netezza in-db analytics Built for Systems of Insight MPP Available for on-premises or private cloud via dashdb Local Watson Analytics Analytics & Visualization Services Cloudant Database as a Service (DBaaS) Massively scalable for global data distribution Eventually consistent data model Built for mobile, Systems of Engagement Bluemix Data Connect Data Refinery Services dashdb for Transactions SQL interface, ACID compliant Optimized for transactional workloads Built for Systems of Record Oracle Compatibility DB2 on Cloud Hosted DB2 service Flexible deployments for analytics or OLTP IBM Corporation

32 Think DB2 and dashdb for Hybrid Cloud Solutions On-premises or Private Cloud Public Cloud DB2 Software dashdb Local DB2 on Cloud dashdb Fully customizable On-premises or BYOL to cloud Customer managed Deploy on own infrastructure or private cloud Utilizes Docker container technology for fast and simple deployment Optimized for analytic workloads Scalable, elastic Customer managed Hosted database-asa-service Pre-defined hardware configurations Fully customizable Available on SoftLayer and AWS Customer managed Fully managed database-as-a-service Pre-defined hardware configurations optimized for analytics or transactional workloads Available on SoftLayer and AWS Common database engine for application compatibility and portability Write once, run anywhere IBM Corporation

33 DB2 and dashdb Who Does What? Activity Provision hardware infrastructure Manage hardware infrastructure Database manger software installation Database manager instance creation DB2 Software (on-premises) DB2 Software (BYOL on IaaS) DB2 on Cloud Customer IaaS Vendor IBM Customer IaaS Vendor IBM dashdb Local Customer or IaaS Vendor Customer or IaaS Vendor dashdb for Analytics Customer IBM IBM * IBM Customer IBM IBM * IBM Database creation Customer Customer IBM * IBM Database configuration Manage database environment Database manager software maintenance Customer Customer IBM * IBM Customer Customer Customer IBM Customer Customer IBM * IBM OS maintenance Customer Customer Customer IBM Setup encryption Customer Customer IBM IBM Database backup and restore Customer Customer Customer IBM Control and Flexibility IBM IBM dashdb for Transactions Simplicity * For initial setup or subsequent updates of dashdb Local, customer simply deploys an IBMprovided Docker image with all software (including the database environment) pre-configured IBM Corporation

34 Cloud Data Services Availability at SoftLayer Data Centers Oslo Amsterdam London Frankfurt Paris Milan India China (coming soon) Hong Kong Seoul Tokyo Seattle San Jose Los Angeles Houston Montreal Toronto Chicago Denver New York City Dallas Washington D.C. Atlanta Miami Mexico City Singapore Perth Melbourne Sydney Acquired in 2013 IBM Invests Over 1B 29 Data Centers Worldwide 14 Countries across 5 Continents DATA CENTER & NETWORK POINT OF PRESENCE NETWORK POINT OF PRESENCE Brazil 100,000+ Physical Nodes Millions of Virtual Machines 23K+ Customers in 140 Countries IBM Corporation

35 IBM Bluemix Lift makes it easy to quickly, securely and reliably migrate your database from your private, on-premises data center to an IBM Bluemix cloud data property A use case involving dashdb, Lift, Data Connect and Watson Analytics Lift Migrate your data to the cloud dashdb Persist your data in a data warehouse Data Connect Shape and prepare your data set Watson Analytics Explore, predict and visualize your data Netezza DB2 LUW CSV Files Your on-premises data stores IBM Corporation

36 IBM Bluemix Data Connect A simple and intuitive self-service user interface to visually interact with your data to Access, Combine and Transform it with ease and confidence Access data from multiple relevant cloud or on-premises data sources Automatically analyzes, profiles and classifies the data upon ingestion Delivers quality scores and metrics to understand and trust the content Easily refine, enrich and cleanse the data using a robust catalog of transformation operations Save, edit, run and schedule activities to deliver the data to a diverse set of targets IBM Corporation

37 IBM Database Conversion Workbench (DCW) Helps you migrate your databases to dashdb and DB2 Two options DCW (full version) free of charge plugin for Data Studio Database Harmony Profiler standalone application (specifically for dashdb and DB2 on Cloud as targets) Formerly known as DCW Lite Supported migration paths into dashdb: Oracle Database PureData System for Analytics (PDA / Netezza) Compatibility Evaluation reports on the estimated compatibility ratio of customer s PDA or Oracle Database code with dashdb Outlines conversion issues, code that can be converted, and code that must be refactored manually Code Conversion converts SQL statements to dashdb-compatible syntax Substantially cuts down on the time spent by customers refactoring their code Additional reading: DCW developerworks page: PDA to dashdb conversion guide: IBM Corporation

38 DB2 on Cloud A Hosted Cloud Data Service 2016 IBM Corporation

39 IBM DB2 on Cloud Provides a hosted DB2 environment that is Deployed on IBM SoftLayer (virtual private nodes/bare metal) or AWS (virtual private nodes) cloud platform Administered by your organization's DBAs (all software including OS & database) Available via pay-as-you-go or subscription model (support included) Benefits include Convenience without the loss of control on cost effective infrastructure Five high performance hardware configurations and two database software tiers to match capability and affordability needs BLU Acceleration Native encryption support included in all configurations ensuring data remains secure in the cloud HADR for high availability and disaster recovery Unlimited ability to create databases to fully utilize the cloud infrastructure Deployment options Choice of cloud provider: SoftLayer or AWS Five t-shirt sized configurations: Small, Medium, Large, X-Large, 2X-Large Two versions of DB2 available: Workgroup Server Edition (Standard) and Advanced Enterprise Server Edition (Advanced) IBM Corporation

40 Common DB2 on Cloud Use Cases Cloud-based production environments Test, development, prototyping, and proofs-of-concept Disaster recovery Primary Server HADR Standby Server Consolidation of smaller, on-premises databases IBM Corporation

41 DB2 on Cloud Configurations (SoftLayer) 5 T-Shirt sized configurations: Small, Medium, Large, X-Large, 2X-Large 2 versions of DB2: Workgroup (Standard), Advanced Enterprise (Advanced) Single part number for each size and version combination All configurations include native encryption Now ships by default with DB DB2 Plan Size Small Medium Large X-Large 2X-Large Standard $1,030 $1,750 $3,090 $6,180 - Advanced $1,290 $2,270 $4,120 $8,240 $18,000 Nodes Virtual Private Virtual Private Virtual Private Bare Metal Bare Metal Cores 2 x 2.0 GHz 4 x 2.0 GHz 8 x 2.0 GHz 12 x 2.4GHz 32 x 2.7 GHz Memory 8 GB 16GB 32GB 128GB 1TB Storage 100GB, 500GB SAN 500 IOPS 100GB & 1TB SAN 1,200 IOPS 100GB & 2TB SAN 1,600 IOPS 2 x 800GB RAID 1 (~800GB) 6 x 1.2TB RAID 10 (~3.5TB) 2 x 800GB RAID 1 (~800GB) 16 x 1.2TB RAID 10 (~9.5TB) Network 1Gbps Public & Private Uplinks 10Gbps Redundant Public & Private Uplinks OS RHEL IBM Corporation

42 DB2 on Cloud PayGo All plans available via pay-as-you-go (PAYGO) Digital purchasing directly through Bluemix using a credit card Also available through IBM Bluemix subscription Customers billed for the days since the service was activated All plans: 30 day minimum usage XL / 2XL: 14 days advance notice required to discontinue the service IBM Corporation

43 DB2 on Cloud Who Does What? Activity Customer IBM VM specification VM creation Hardware / VM management VM/Hypervisor Security patches DB2 product Installation DB2 instance creation Chooses from the menu Provides eight configurations (four sizes (S-XL) and two DB2 tiers (standard, advanced)) Single instance created as part of service readiness HA setup Documentation provided DB2 Fixpack mandatory upgrades Notify customer about FP availability ( ) DB2 Fixpack/Version optional upgrades OS patches Database backup and restore Setup Encryption at rest Service deletion Requested when ready Notify customer about FP/Version availability ( ) Perform deletion of the environment (servers/vms) IBM Corporation

44 HADR and DB2 on Cloud HADR provides redundant copy(s) of database(s) to protect against server or storage failure Regular features and capabilities of HADR all apply to DB2 on Cloud Multiple standbys supported (up to three) Reads on Standby allowed All sync modes supported Integrated Cluster Management TSA monitors primary and performs automated takeover Automatic Client Reroute Client application transparently connects to standby Primary Server HADR Keeps standby(s) in sync Standby Server IBM Corporation

45 dashdb for Analytics A Managed Data Warehouse Service in the Cloud 2016 IBM Corporation

46 Evolution of dashdb Plans dashdb Local, dashdb for Analytics MPP on AWS, dashdb TX with HA dashdb for Analytics name changes, dashdb PayGo plans dashdb for Transactions November 2016 dashdb for Analytics MPP July TB Virtual & Multi-tenant 4TB & 12TB SMP June 2015 April 2016 March 2015 Jan IBM Corporation

47 What s New in dashdb? Updates to features and functionality listed here: Includes dashdb for Analytics, dashdb for Transactions and dashdb Local IBM Corporation

48 IBM dashdb Analytics Warehouse as a Service In-database analytics capabilities for best performance atop a fully-managed warehouse BLU Acceleration Netezza In-Database Analytics Cloudant NoSQL Integration dashdb MPP For apps that need: Elastic scalability Fully-managed High availability data warehouse on cloud Data model flexibility Choice of SoftLayer or Amazon Web Services BLU Acceleration Data mobility columnar technology Text search + Netezza in-database analytics Geospatial BLU in-memory processing, data skipping, actionable compression, parallel vector processing, Load & Go administration Available as: Netezza predictive analytic algorithms Fully managed DBaaS Fully integrated RStudio & R language On-premises private cloud Oracle compatibility Hybrid architecture Massively Parallel Processing (MPP) On disk data encryption and secure connectivity for Analytics IBM Corporation

49 IBM dashdb A Fully Managed Analytics Warehouse Relieving the provisioning and management burden on your data warehouse DBA staff sets up, optimizes, and manages all aspects of the dashdb environment OS and database software installation Optimized configuration for analytics workloads BLU Acceleration "load and go" simplicity No need for creating auxiliary structures like indexes or aggregates Automatic memory management Automatic statistics gathering Automatic space reclamation Pre-configured workload management Ongoing OS and database software maintenance Automated daily backups 24/7 monitoring and restart after hardware or software failure Ongoing risk assessment and security monitoring Upgrade support moving to a larger dashdb size DBA only has to focus on data delivery Schema definition Data loading User management and database access control Application, ETL connectivity IBM Corporation

50 dashdb: What Makes BLU Acceleration Different? Unmatched innovations from IBM Research & Development labs Next Generation In-Memory In-memory columnar processing with dynamic movement of data from storage Analyze Compressed Data Patented compression technique that preserves order so data can be used without decompressing C1 C2 C3 C4 C5 C6 C7 C8 Encoded CPU Acceleration Multi-core and SIMD parallelism (Single Instruction Multiple Data) Data Skipping Skips unnecessary processing of irrelevant data Instructions Data Results IBM Corporation

51 dashdb for Analytics Plans Entry (Multi-tenant) SMP Small SMP Medium SMP Large Shared, multi-tenant environment 20 GB SAN storage capacity $50 / month (USD) flat rate FREE if < 1 GB of data used Dedicated, single tenant environment Virtual environment 16 vcpus 64 GB memory 1 TB * of data storage and temp space (SAN) $1170 / month (USD) Dedicated, single tenant environment Bare metal 32 cores 256 GB memory 4 TB * of data storage and temp space (SAN) $4700 / month (USD) Dedicated, single tenant environment Bare metal 32 cores 256 GB memory 12 TB * of data storage and temp space (SAN) $7370 / month (USD) MPP Small MPP Small for AWS Dedicated, single tenant environment SoftLayer Bare metal 3 node clusters and up 24 cores per node 256 GB memory per node 5 TB * of data storage and temp space (SSD) per node $5410 / month (USD) per node Dedicated, single tenant environment AWS Dedicated Virtual environment 3 node clusters and up 32 vcpus per node 244 GB memory per node 8 TB * of data storage and temp space (SSD) per node $6250 / month (USD) per node 51 Storage split between user data and temporary data. Sizes shown indicate amount of uncompressed, pre-load 2017 IBM Corporation user data and uncompressed temporary data that can be stored (assuming typical compression rates).

52 dashdb for Analytics PayGo Most plans now available via pay-as-you-go (PayGo) Digital purchasing directly through Bluemix using a credit card Applies to all plans *except* for MPP Small for AWS Still requires purchasing through an IBM salesperson (or partner) Ways that customers can acquire dashdb for Analytics PayGo (credit card) Bluemix subscription IBM salesperson (or partner) IBM Corporation

53 dashdb for Analytics Security Functional Encrypted data at-rest using AES 256 Encrypted data in-motion - via SSL/TLS Application authentication using embedded LDAP server Authorization Grant permissions to specific tables, rows, roles Optionally restrict access to specify client host names Infrastructure Automated backups (encrypted) on a daily basis for recovery purposes Dedicated bare metal nodes for dedicated local storage and compute (MPP) Host firewall to protect from port scans/network intrusion Private VLAN and VPN options available with ICIAE network service Governance & Compliance Operational ISO certified SOC 2 Type 1 & SOC 2 Type 2 certified, SOC 3 HIPAA-ready Privacy Shield certified More coming! Monitored 24x7 Fully managed for setup, configuration, tuning and DR operations InfoSphere Guardium-based audit reports and monitoring Sensitive data monitoring through Guardium Database Activity monitoring to discover sensitive data, connections and SQL statements SoftLayer: physical security compliance IBM Corporation

54 dashdb for Transactions A Managed Transactional Database Service in the Cloud 2016 IBM Corporation

55 IBM dashdb for Transactions Transactional database capabilities for best performance atop a fully-managed instance Excellent Transactional Performance Oracle Compatibility Robust Security For apps that need: Elastic scalability Fully-managed High transactional availability database Data model flexibility as a service Data mobility High performance database engine Text search optimized for transactional workloads Geospatial Row-organized tables Oracle compatibility Available as: for Transactions On disk data Fully encryption managed and DBaaS secure connectivity On-premises private cloud Two Enterprise Hybrid plans architecture plus HA versions 2 cores, 8 GB memory, 500 GB SAN 12 cores, 128 GB memory, 1.4 TB SSD IBM Corporation

56 A Managed Transactional Database Engine sets up, optimizes, and manages all aspects of the dashdb environment DBA only has to focus on data delivery OS and database software installation Optimized configuration for transactional workloads Secure connection Data encryption and key rotation Ongoing OS and database software maintenance Automated daily backups 24/7 monitoring and restart after hardware or software failure Ongoing risk assessment and security monitoring Upgrade support moving to a larger dashdb sizes Schema definition Database logical design User management and database access control Application, ETL connectivity IBM Corporation

57 dashdb for Transactions Plan Sizes Enterprise 2 cores - 8 GB Dedicated, single tenant environment Virtual environment 2 vcpus 8 GB memory HDD storage (for 500 GB of client data) $250 / month (USD) Enterprise 12 cores GB Dedicated, single tenant environment Dedicated Bare Metal 12 physical cores 128 GB memory SSD storage (for 1.4 TB of client data) $4000 / month (USD) Two single server configurations 2 vcpus, 8GB Ram, 500GB SAN 12 cores, 128GB Ram, 1.4TB SSD Fully managed Oracle compatibility Robust security Enterprise HA 2 cores - 8 GB Dedicated, single tenant environment Virtual environment 2 servers; per server: 2 vcpus 8 GB memory HDD storage (for 500 GB of client data) $500 / month (USD) Enterprise HA 12 cores GB Dedicated, single tenant environment Dedicated Bare Metal 2 servers; per server: 12 physical cores 128 GB memory SSD storage (for 1.4 TB of client data) $8000 / month (USD) Two high availability versions of configurations above 2 vcpus, 8GB Ram, 500GB SAN 12 cores, 128GB Ram, 1.4TB SSD Primary/standby pair included in each Single IP address for cluster for simplified client access IBM Corporation

58 dashdb for Transactions PayGo All plans available via pay-as-you-go (PAYGO) Digital purchasing directly through Bluemix using a credit card Also available through IBM Bluemix subscription Instant deployment is available for the small (2 core) plan Only for Dallas/Sydney/London data centers Can be deployed in other data centers, but not with instant deployment Customers billed for the days since the service was activated Small (2 core): No minimums on number of days Large (12 core): 30 day minimum usage; 14 days advance notice required to discontinue the service IBM Corporation

59 dashdb for Transactions High Availability Configuration Reduced outage times for unplanned outages and maintenance activities Configuration includes both a primary server plus a warm standby server Log shipping keeps standby up-to-date for fast failovers Simplified client configuration floating IP address always points to current primary Not logged operations that compromise data recoverability are blocked Integrated Cluster Management Health of servers monitored Automated takeover Automatic Client Reroute Clients transparently connect to standby when primary fails for Transactions High Availability Configuration Primary Server Transaction Log Record Shipping Keeps standby current Standby Server IBM Corporation

60 dashdb for Transactions Security Functional Encrypted data at-rest using AES 256 Encrypted data in-motion - via SSL/TLS Application authentication using embedded LDAP server Authorization Grant permissions to specific tables, rows, roles Optionally restrict access to specify client host names Infrastructure Automated backups (encrypted) on a daily basis for recovery purposes Dedicated bare metal nodes for dedicated local storage and compute (MPP) Host firewall to protect from port scans/network intrusion Private VLAN and VPN options available with ICIAE network service Governance & Compliance ISO certified SOC 2 Type 1 & SOC 2 Type 2 certified, SOC 3 Privacy Shield certified More coming! Operational Monitored 24x7 Fully managed for setup, configuration, tuning and DR operations InfoSphere Guardium-based audit reports and monitoring Sensitive data monitoring through Guardium Database Activity monitoring to discover sensitive data, connections and SQL statements SoftLayer: physical security compliance IBM Corporation

61 dashdb Local Simplified Data Warehousing for On-Premises and Private Cloud 2016 IBM Corporation

62 IBM dashdb Local Benefits of dashdb Technology with Fast Deployment into Private Cloud Environment Private or Virtualized Private Cloud Docker Container Technology dashdb Technology MPP with Automatic Scaling For apps that need: Highly flexible Elastic data scalability warehouse Optimized for High fast availability and flexible deployment into private or Data virtual model private flexibilityclouds Data mobility Uses Docker container technology Text search Built on top of dashdb technology, it shares the benefits Geospatial of BLU Acceleration in-memory columnar technology Available as: Netezza In-database Analytics Oracle Compatibility Fully managed DBaaS Massively Parallel On-premises Processing private cloud (MPP) with automated scaling Hybrid architecture capabilities to increase infrastructure efficiency IBM Corporation

63 dashdb Local comes with an Unmatched Value Proposition! Simple Deploy in minutes Load & go No expensive tuning Fast World-class in-memory columnar engine Flexible Automatic orchestrated configuration and adaption to infrastructure Elastic Scale up/down Scale out/in based on business needs Agile Runs wherever docker runs. On-premise or hosted IaaS Move applications as needed Smart Powered by Apache Spark Analyze data in-database Run Spark MPP apps Very Secure Embedded authentication Closed container for restricted access UI console Other vendors offer NO or ONLY partial Software Defined Environment (SDE) capabilities!!! IBM Corporation

64 dashdb Local Architecture Customer Deployed RStudio Container Customer Deployed R runtime Docker container Open LDAP Authentication dashdb Console DSM Workload Monitoring Customer s Infrastructure Management Software or Agents Systems Manager for HA dashdb engine Apache Spark Engine Docker Supported OS CPU MIN: 1 Cores REC: 2 x 12 core Xeon 2690 v3 Memory Min: 8GB REC: 256GB Clustered Filesystem IE GPFS, GFS2, VxFS, CXFS REC: 3000 MB/sec IO rate Scale Up CPU, Memory, IO according to your infrastructure availability IBM Corporation

65 dashdb Local Minimums and Recommended System Requirements SYSTEM REQUIREMENTS MINIMUM Single Host MINIMUM Multi-Host (MPP) RECOMMENDED 4TB raw data per Host Host Operating System Docker supported OS (Kernel 3.10+) Docker supported OS (Kernel 3.10+) CentOS 7 / RHEL 7 Processor 1x 2.0 GHz Core 8x 2.0 GHz Core 2 x 2.6 GHz 12-core Xeon 2690v3 CPU RAM 8GB 64GB 256GB Storage mounted on /mnt/bludata0 20GB 200GB Network attached (SAN) 2000GB 3000MB/sec IO Docker Version Hardware supported: Intel, POWER LE (currently as a technical preview) IBM Corporation

66 dashdb Local MPP Elastic Scalability Automatic detection of hardware resources for scaling operations Docker container automatically detects hardware resources available Minimal interruption to your database operation - requires temporarily stopping dashdb Local services while you implement the changes Scale in or scale out: removing existing or adding new nodes Partitions will be automatically re-balanced across all containers Scale up or scale down: change the resources available to a node Easy because independence between application container and named volume storage container Portability: Replacing the node and clustered file system Stop container on old server, copy data to new file system, start container on new server IBM Corporation

67 Getting Started 2016 IBM Corporation

68 Getting Started with Bluemix To use dashdb or any of the other services available on Bluemix, first register for the IBM Bluemix platform at If this is your first time using Bluemix, select the Sign Up option. Otherwise, if you have previously registered for Bluemix then select Log In. An IBM ID is required when you sign up if you don't already have an IBM ID then one will be created as part of the sign up process IBM Corporation

69 Getting Started with Bluemix (cont.) When you log in, the Bluemix dashboard is shown. If you are not brought to the dashboard immediately then click on the menu ( hamburger ) button in the upper left hand side of the screen and then click on Dashboard within the Services section. From here you can create new applications or provision new services. Click on Create Service to deploy a new instance of dashdb IBM Corporation

70 Finding the Services in the Bluemix Catalog The dashdb service is currently located in the Data & Analytics section (note that categories and placement might change over time) IBM Corporation

71 dashdb: Deploying an Instance of the Free Plan Click on the dashdb icon in the catalog and then fill in the information as shown: 1. Service name: Specify the name of your dashdb service 2. Credential name: Leave as Credentials-1 3. Connect to: Keep "Leave unbound" to specify that it is not to be bound to an existing Bluemix application 4. Pricing Plan: Scroll down to the Pricing Plans and select the "Entry" plan 5. Click the Create button to create the instance. This should take less than one minute to complete IBM Corporation

72 dashdb: Deploying an Instance of the Free Plan (cont.) Once the dashdb instance has been created, you will be taken to the dashdb launch screen. Click on OPEN to bring up the dashdb console IBM Corporation

73 Connecting Remote Applications to dashdb Security credentials are required to allow remote applications to connect to the database used by your dashdb service Includes hostname/ip address, port, database name, user name, password and URL connection strings Includes both a non-ssl listening port (50000) and an SSL port (50001) Use this connection information to point DataStudio and other applications to the database IBM Corporation

74 Make the Move to Cloud Risk Free! New DB2 BYOL Parts for Cloud Data Services New BYOL parts allow customers to move their licenses to/from the cloud Aimed at customers who s DB2 entitlements come through CEO bundles, IULA/ELA agreements, or developer licenses BYOL parts give the freedom to move to the cloud whenever you want without having to relinquish on-premises entitlements Depending on product entitlement, target cloud instances can be: dashdb MPP Small DB2 on Cloud (S/M/L/XL/2XL, Standard/Advanced) Terms of Use document specifies conversion rate for entitlements (PVU, TB, users) to number of instances of a given cloud data service IBM Corporation

75 New DB2 BYOL Parts for Cloud Data Services (cont.) Customer must maintain current S&S for the IBM program entitlements used in conjunction with the BYOL offering entitlements Not a strict exchange remember that IBM is providing the infrastructure (and in the case of dashdb, the management resources as well) Example: Customer has some number of PVUs of DB2 WSE under an ELA Wants to put move an existing application to cloud which requires a single large instance of DB2 on Cloud Standard Customer purchases IBM DB2 ON CLOUD STANDARD LARGE BYOL offering and consumes 560 PVUs of their own DB2 WSE entitlements (per the documented conversion factor) IBM Corporation

76 Hybrid Cloud Solutions with DB2 and dashdb On-premises or Private Cloud Public Cloud DB2 Software dashdb Local DB2 on Cloud dashdb Fully customizable On-premises or BYOL to cloud Customer managed Deploy on own infrastructure or private cloud Utilizes Docker container technology for fast and simple deployment Optimized for analytic workloads Scalable, elastic Customer managed Hosted database-asa-service Pre-defined hardware configurations Fully customizable Available on SoftLayer and AWS Customer managed Fully managed database-as-a-service Pre-defined hardware configurations optimized for analytics or transactional workloads Available on SoftLayer and AWS Common database engine for application compatibility and portability Write once, run anywhere IBM Corporation

77 For More Information dashdb Main IBM dashdb product page dashdb Knowledge Center dashdb Learning Center dashdb YouTube Channel dashdb service description in Bluemix catalog DB2 on Cloud DB2 on Cloud product page DB2 on Cloud section in DB2 Knowledge Center DB2 on Cloud Learning Center DB2 on Cloud service description in Bluemix catalog IBM Corporation

78 Kelly Schlamb IBM Corporation