Accelerate with IBM Storage: DS8000 Easy Tier

Similar documents
Spectrum Control Capacity Planning

Accelerate with IBM Storage: IBM DS8880: Hybrid cloud integration with Transparent Cloud Tiering

IBM Storwize Family Scaling Capabilities and Value

Features and Capabilities. Assess.

SVA Software Inc. BVQ - Infrastructure Performance Optimizer KEEP YOUR INFRASTRUCTURE BALANCED

1 Copyright 2011, Oracle and/or its affiliates. All rights reserved.

12 juni 2012 Fort Voordorp. What is Performance? Dependencies in Performance? What is expected? Jan Sterk en Jeroen Kleinnibbelink

Storage Workload Analysis

2015 IBM Corporation

IBM Data Mobility Services Softek LDMF

[Header]: Demystifying Oracle Bare Metal Cloud Services

IBM Data Management Services Softek Replicator UNIX technical overview Data protection with replication for increased availability

Information Lifecycle Management Solution from IBM

Understanding How Velostrata Technology Works

IBM i Reduce complexity and enhance productivity with the world s first POWER5-based server. Highlights

Inside IBM Tivoli Storage Productivity Center 4.1

IBM Spectrum Storage Professional Certification Program

Using IBM UrbanCode Deploy to automate the migration and deployment of on-premise WebSphere application and configuration to IBM Bluemix

COMPARE VMWARE. Business Continuity and Security. vsphere with Operations Management Enterprise Plus. vsphere Enterprise Plus Edition

Optimizing resource efficiency in Microsoft Azure

CONSOLIDATION BEST PRACTICES FOR YOUR ORACLE ENVIRONMENT KEVIN CLOSSON, CHIEF PERFORMANCE ARCHITECT, XTREMIO

Optimize your investments with IBM Tivoli Storage Productivity Center and IBM SmartCloud Virtual Storage Center IBM Redbooks Solution Guide

IBM ICE (Innovation Centre for Education) Welcome to: Unit 1 Overview of delivery models in Cloud Computing. Copyright IBM Corporation

COMPANY PROFILE.

Introduction to IBM Insight for Oracle and SAP

Optimize your Service Cloud Data Best Practices, Data Extraction and NextGen Reporting

WorkloadWisdom Storage performance analytics for comprehensive workload insight

SolutionBuilder & Guided Solution Sizing. Winning Together

BMC CONTROL-M WORKLOAD OPTIMIZATION

Meetup DB2 LUW - Madrid. IBM dashdb. Raquel Cadierno Torre IBM 1 de Julio de IBM Corporation

Central Management Server (CMS) for SMA

Microsoft FastTrack For Azure Service Level Description

Oracle Integrates Virtual Tape Storage with Public Cloud Economics

IBM Spectrum Scale. Transparent Cloud Tiering Deep Dive

Cisco Intelligent Automation for Cloud

Nimble Storage vs Nutanix: A Comparison Snapshot

BlackPearl Customer Created Clients for Media & Entertainment Using Free & Open Source Tools

Cisco Workload Optimization Manager: Setup and Use Cases

Infor LN Minimum hardware requirements. Sizing Documentation

Welcome to an introduction to SAP Business One.

Oracle Customer Service and Support Cloud Services Descriptions and Metrics October, 2017

Next Phase of Evolution in Storage Industry: Impact of Machine Learning

Tivoli Storage Resource Management

Adding IBM LTFS EE tape tier to an IBM SCSA managed storage cloud

Stewart Bazneh. IBM Storwize V National Gallery, Dublin (17 th November) 2010 IBM Corporation

What s New in Microsoft Dynamics CRM 4.0. Bryan Nielson Director, Product Marketing

EMC Navisphere Management Suite

100 Million Subscriber Performance Test Whitepaper:

NVMe: The Key to Unlocking Next-Generation Tier 0 Storage

Agenda. z/vm and Linux Performance Management. Customer Presentation. New Product Overview. Opportunity. Current products. Future product.

ENTERPRISE HYBRID CLOUD 4.1

UNIFIED DATA PROTECTION FOR EFFICIENT DELIVERY OF DIFFERENTIATED SERVICE LEVELS

BARCELONA. 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved

Welcome to IoT CE/CLM on Cloud

TECHNICAL GUIDE. DataStream. Coho Data SRM Integration Guide. Version February

Plan, Deploy and Configure Microsoft InTune

AVANTUS TRAINING PTE LTD

Strategies for Taming Data Growth through Archiving

IBM System Storage. Kim Mortensen Nordic Storage Product Manager 2011 IBM Corporation

Data Center Operating System (DCOS) IBM Platform Solutions

Guide to Modernize Your Enterprise Data Warehouse How to Migrate to a Hadoop-based Big Data Lake

The Multi-Channel Service Problem: Challenges, Testing, and Solutions

Product Brief SysTrack VMP

Successfully Planning and Executing Large-Scale Cloud and Data Center Migration Projects

"Charting the Course... MOC A: Architecting Microsoft Azure Solutions. Course Summary

Oracle Cloud Blueprint and Roadmap Service. 1 Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Quantum Artico Active Archive Appliance

SAP Jam Collaboration, advanced plus edition

Learn How To Implement Cloud on System z. Delivering and optimizing private cloud on System z with Integrated Service Management

RSD EOS 360. The new generation of EOS, enabling Mainframe operations efficiency. EOS 360: A new product from 40 years of experience

IBM Content Foundation on Cloud

Dell EMC XC and Nutanix: Overview and Demo of One-Click Simplicity for Infrastructure Upgrades, Capacity Expansion and How To Search

ERP SYSTEM IN VIRTUALIZED PRODUCTION ENVIRONMENT

Get The Best Out Of Oracle Scheduler

Enterprise APM version 4.2 FAQ

Cloud Management Platform Overview First Published On: Last Updated On:

SharePoint 2016: Hybrid Deployment Strategies

Introducing FUJITSU Software Systemwalker Centric Manager V15.0

Private Cloud. Service Description

Not Backup. NetBackup 6.0. Technical Seminar

Office 365 Governance & Security

Integrated Service Management

The Leading Low-code Application Platform For Modern Work Management

FlashStack For Oracle RAC

Oracle's Cloud Strategie für den Geschäftserfolg Alles Neue von der OOW

2017 IBM Elastic Storage Server - Update

MANAGEMENT METRICS FOR CRITICAL IT SERVICES

SAP Jam Collaboration, advanced plus edition

Quantifying the Value of Investing In VM Explorer

Tivoli Now IBM Corporation

Introduction of Hinemos an Open Source Integrated System Management Software

SAP Jam Collaboration, enterprise edition

Monitoring IBM XIV Storage System with VMware vcenter Operations Manager

z/vm Capacity Planning Overview

The IBM Reference Architecture for Healthcare and Life Sciences

A Cloud Migration Checklist

Quota and Space Management Best Practices

IBM PowerHA SystemMirror for AIX Enhancements IBM Redbooks Solution Guide

20246D: Monitoring and Operating a Private Cloud

Oracle PaaS and IaaS Universal Credits Service Descriptions

Transcription:

Accelerate with IBM Storage: DS8000 Easy Tier Brian Sherman Paul Spagnolo IBM Washington Systems Center

Accelerate with IBM Storage Webinars The Free IBM Storage Technical Webinar Series Continues... Washington Systems Center Storage experts cover a variety of technical topics Audience: Clients who have or are considering acquiring IBM Storage solutions. Business Partners and IBMers are also welcome How to sign up? To automatically receive announcements of upcoming Accelerate with IBM Storage webinars, Clients, Business Partners and IBMers are welcome to send an email request to accelerate-join@hursley.ibm.com. Information, schedules, and archives: Located in the Accelerate with IBM Storage Blog: https://www.ibm.com/developerworks/mydeveloperworks/blogs/accelerate/?lang=en YouTube IBM Washington System Center - Storage: https://www.youtube.com/playlist?list=plsdmgmn4aud-gkubcr8k0ksccif6e6zyd&disable_polymer=true Upcoming Webinars: Recent Webinars: Jan 9 th IBM DS8880 Easy Tier Dec 12 th IBM DS8000 R8.3 DSGUI Live Demo Jan 19 th What's New for Spectrum Scale V5 and ESS Dec 5 th FlashSystem A9000 and A9000R Update Feb 22 nd IBM DS8880 TCT Live Demo Nov 30 th LTO8 Drive and related updates to IBM tape products Mar 15 th I BM FlashSystem A9000/R and SVC Configuration Nov 16 th VersaStack - IBM s On Premise Cloud Solution Best Practices Nov1 st Spectrum Control Capacity Planning Oct10 th 2 z14 IO and Infrastructure Modernization Oct 3 rd GDPS Update Sept 14 th DS8000 R8.3 Update

Washington Systems Center Storage Customer demonstrations (IBM CTS and BP) Business Resiliency with IBM Copy Services Manager Test Drive DS8880 GUI Configuration Test Drive Proof of Concepts Bandwidth Studies DS8000 Global Mirror Bandwidth needed your RPO requirements Transparent Cloud Tiering (TCT) Analysis Estimated CPU Savings with TCT (DS8000 and TS7700) 3

Anatomy of an I/O Operation Write Data Read Cache Hit Read Miss Data DS8000 Data Cache Data Data Disk 4

Overview Easy Tier provides automatic volume management capabilities Sub-volume drive tiering Manual command based volume relocation Automated drive utilization rebalancing to remove hot spots or populate new, empty ranks To Manage Easy Tier the DS8000 provides A command line interface and a GUI for setup and management Storage Tier Advisor Tool (STAT) for I/O analysis and projected benefits (legacy) Integrated Easy Tier reporting (as of R8.3) Easy Tier is a no-charge licensed advanced function for the DS8700/DS8800/DS8870/DS8880 Supported by all server platforms with no additional software or host configuration No license is required to monitor and run STAT tool (described later) Easy Tier enabled by default as of R8.2 5

Cost versus Performance High Performance Flash/SSD Cost Per Gigabyte High Performance Enterprise Drives High Capacity Flash Low Performance Nearline Drives Performance 6

Configuration Optimization versus Performance Improvement Easy Tier is not application aware and it is entirely possible that manual data placement could provide more application specific performance improvements The majority of storage administrators do not have the skills nor the time to do this well even if they fully understood the details of each application The objective of Easy Tier is to optimize the usage of a particular environment by placing and distributing data appropriately on the underlying storage media without expert input and manual intervention we re trying to make it EASY By doing this at a granular sub-volume level it enables this to be done efficiently without making changes in the volume configuration or application data layout Data movement and placement is based on historical data access patterns 7

Easy Tier Processing Cycle Performance data collected every 5 minutes Data collected is for rank activity not I/O from hosts Continuous Workload Monitoring Workload Hotspot Analysis Workload analysis performed at various intervals 5 minutes, ~ 6 hours and ~ 24 hours Extents categorized based on small block I/O activity Can immediate promote an extent if necessary Statistics maintained for seven days Smart Data Placement DS8700 Movement of extents scheduled Cost benefit analysis to ensure excessive movement is avoided 8

Easy Tier Data Collection Easy Tier regularly collects backend performance data for each extent on the DS8000 every 5 minutes Not host I/O This activity is broken down by reads and writes & large block I/O and small block I/O for the analysis code to evaluate which data should be moved Large block I/Os are those which are basically a full track in size Easy Tier considers the small I/O when looking at prioritizing the extents to be moved. Any tracks that are staged as full tracks in track mode for read misses will therefore not be considered in this decision criteria these usually are a result of sequential access patterns Large I/Os are considered to evaluate whether ranks or device adapters may become overloaded by moving extents to Flash/SSDs 9

Performance Metrics Easy Tier continually monitors the back end rank utilization and records the following statistics for each active extent Reads and writes Small block I/O Large block I/O Latency I/O rate Data transferred 10

Easy Tier Support for High Capacity Flash High capacity flash is considered a unique tier within Easy Tier Separate tier from high performance flash tier High performance flash are 400, 800 1600 and 3200 GB High capacity flash are 3800 GB (and higher) Easy Tier is a three tier architecture Tier 0 is a high performance tier and will contain as much workload as possible Tier 2 is a quiet capacity tier intended to contain idle or near idle workload Tier 1 contains the rest of the workload DS8000 will only allow a maximum of 3 tiers in a storage pool (i.e., no 4 tier storage pools) DS8000 will not allow high performance flash, high capacity flash, enterprise HDD and nearline HDD in the same storage pool Legacy SSD technology drives are considered to be in the high performance flash tier (no change from before) 11

DS8880 Storage Pools Options (3 tier maximum in a single storage pool) 12

DS8000 Virtualization Concepts Disk Managed Array (RAID-5/6/10) Array Site Storage Pool (CKD/FB) DS8000 Server 0 (Cluster 0) DS8000 Server 1 (Cluster 1) 27 Extents 3 Extents 9 Extents 9 Extents Logical Volumes Storage Pool 13

Heat and Skew Hot data Hot data is simply extents that have more I/O workload, relatively speaking, when compared to other extents within the storage pool and tier Cold data Cold data either has low (or no) I/O workload. Cold data would not benefit from a higher tier and thus is not promoted and is considered for demotion Warm data Warm data is the rest of the workload that is not considered hot or cold. Warm data could be promoted but that would depend on the workload level and available resources Skew Highly skewed workload has a small number of hot extents Low skewed workload has a more even distribution of workload to extents 14

Workload Skew 15

Workload Skew Low skew about 65% of I/O is to 40% of disk extents 16

Workload Skew High skew about 90% of I/O is to 8% of disk extents 17

Easy Tier Functions by Release Introduced By Tier Support Auto Data Relocation Manual Data Relocation Comments DS8700 (R5.1) Two tier SSD+ENT / SSD+NL Promotion and swap Pool merge Volume migration Base Easy Tier functionality DS8700 (R6.1) DS8800 (R6.1) Any two tier SSD+ENT, SSD+NL ENT+NL Warm demotion and cold demotion Auto rebalance (hybrid pool only) Manual capacity rebalance Rank depopulation Any two tier support Better agility Storage admin features DS8700 (R6.2) DS8800 (R6.2) DS8870 (R7.0) Any three tier Three tier support Auto rebalance homogeneous pool Any three tier Three tier support Improved SSD utilization Capable of full system auto rebalance for performance Encryption support DS8870 (R7.1) Easy Tier directive data placement Easy Tier Heat Map Transfer Allows storage administrator to control data placement via CLI Provides directive data placement API to enable SW integration solutions Learning data capture and apply Storage Administrator interface to direct data placement Easy Heat Map Transfer for replication DS8870 (R7.3) Easy Tier on High Performance Flash Recognize and support high performance flash modules as Tier 0 DS8870 (R7.4) Easy Tier Application for System z Easy Tier Control Allow applications from z/os to give hints of data placement at dataset Allow customer control ET learning/migration behavior at pool/volume level Z application hint interface to direct data placement Storage Administrator interface to allow user control ET learning / migration activity DS8870 (R7.5) More replication options for Heat Map Transfer Support for Metro/Global Mirror Integration with GDPS and CSM Performance optimized DR sites in the event of a disaster Full GDPS support for 3 and 4 site MGM environments DS8880 (R8.1) Small extent support (16 MB or 21 cylinder) Warm promote Home tier Automatic reserve of ET space DS8880 (R8.3) High capacity flash support Easy Tier will map the different physical media to the 3-tier architecture 3.8 TB flash will be treated as a separate tier 18

Operating Modes Easy Tier Automatic Mode Promote/demote extents (sub-volume) within tiers of disk in same storage pool Requires multitier or hybrid storage pool to promote/demote North-South Homogeneous pool rebalancing Balances the load on the ranks within a given tier in an storage pool East-West Rebalance the workload when ranks (extents) are added to the storage pool Easy Tier Manual Mode Dynamic volume relocation Dynamic storage pool merge Rank depopulation Restripe a volume within the same pool 19

Easy Tier Managed Pools Flash Pools Enterprise Pools Nearline Pools Hybrid Pools Merge pools Easy Tier Application Application assisted data placement to designated tiers Manual volume migration Change disk class Change RAID type Change RPM Change Striping Easy Tier Application Volume-based data relocation Cross-tier data relocation Automated intra-tier rebalance 20

DS8000 Easy Tier Hybrid Storage Pool (Multiple Disk Tiers) Flash Rank Flash Rank Enterprise Rank Enterprise Rank Enterprise Rank Nearline Rank Enterprise Rank Enterprise Rank Enterprise Rank Nearline Rank Promote Demote Hybrid Storage Pool Logical Volumes Extent on Flash drive Extent on Enterprise drive Extent on Nearline drive Nearline Rank Nearline Rank Hybrid Storage Pool 21

Easy Tier Automatic Mode Overview Extent Migration Plan built based on I/O statistics collected (heat) Dynamically relocates a logical volume s extents Hot extents relocated to higher performance class of disk (enterprise Flash) Cold extents relocated to lower performance class of disk (enterprise Nearline) Extent level promotion/demotion requires mixed technologies in a merged storage pool (between any two or three tiers), for example: HPF + HCF + Enterprise HCF + Nearline Enterprise + Nearline DS8000 Extent Size 1GiB (large) or 16 MiB (small) for FB 1113 cylinder (large) or 21 cylinder (small) for CKD Small extents were introduced on DS8880 at R8.1.1 Nearline Enterprise Flash/SSD 22

Easy Tier Automatic Mode Promote extent Extent promotion occurs one tier at a time If all three tiers are present in a hybrid pool promotion must go through intermediate (adjacent) tier Demote extent Like promotion, demotion is one tier at a time Auto-rebalance within the tier Micro-tiering Automatic mode works at the extent (sub-volume) level Opposed to manual mode which operates only on the entire volume 23

Easy Tier Automatic Mode Promotion/Demotion Optimization of backend storage resources based on historical performance data Cold Extents Migrate Down Hot Extents Migrate Up Flash / SSD Sub-volume granularity using native DS8000 extents for any volume type Flexible configurations with any combination of drives of any size and speed Easy Tier Application provides APIs for policy and proactive actions Logical Volume Cold Extents Migrate Down Hot Extents Migrate Up Enterprise 10K/15K HDD Easy Tier Heat Map transfer enables workload history to be transferred for replication scenarios (DR, migration etc) Nearline 7200 HDD All tiers rebalance based on workload 24

Easy Tier Back-end Read Operations by Drive Class 144 x 1.2 TB Enterprise class drives (172.8 TB) Average I/O Rate: 14,113 25

Easy Tier Back-end Read Operations by Drive Class 144 x 1.2 TB Enterprise class drives (172.8 TB) 88% 30 x 800 GB Flash (24 TB) 12% Average I/O Rate: 29,025 26

Easy Tier Back-end Disk Read Response Times by Drive Class 144 x 1.2 TB Enterprise class drives (172.8 TB) Average Response Time: 5.59 ms @ 14,113 IOPS 27

Easy Tier Back-end Disk Read Response Times by Drive Class 144 x 1.2 TB Enterprise class drives (172.8 TB) 88% 30 x 800 GB Flash (24 TB) 12% Weighted Average Response Time: 0.71 ms @ 29,025 IOPS 28

Auto Rebalance Managed Storage Pool Extents moved between ranks of the same tier to balance workload Balances rank skew due to Workload Change in resources Proactively avoids hot spots Eliminates need to manually re-stripe extents Begins after 6 hours by default Cold Extents Migrate Down Extents migrated to balance workload across ranks Flash/SSD Rank Hot Extents Migrate Up 1 2 3 Rank 1 Rank 2 Rank 3 Enterprise Ranks 29

Auto Rebalance Managed Storage Pool Extents moved between ranks of the same tier to balance workload Balances rank skew due to Workload Change in resources Proactively avoids hot spots Eliminates need to manually re-stripe extents Accomplished on six hour cycle Cold Extents Migrate Down Extents migrated to balance workload across ranks Flash/SSD Rank Hot Extents Migrate Up 1 2 3 Rank 1 Rank 2 Rank 3 Enterprise Ranks 30

DS8000 Easy Tier - Homogeneous Disk Tier Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Logical Volumes Enterprise Rank Enterprise Rank Homogeneous Storage Pool Extent on Enterprise drive Enterprise Rank Enterprise Rank Homogeneous Storage Pool Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Without Easy Tier Homogeneous Rebalancing rank utilization skew can provide uneven I/O performance Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank Enterprise Rank With Easy Tier rank rebalancing rank utilization is more aligned resulting in more even I/O performance 31

Easy Tier Homogeneous Pool Rebalancing Easy Tier will automatically rebalance within a homogeneous storage pool Reduces skew and hot spots within a rank Extents are automatically rebalanced across ranks of the same tier within the storage pool based on I/O and bandwidth requirements Six hour cycle Rank hot cold hot cold Rank hot cold hot cold Rank Rank cold cold cold After After Rank hot cold cold Rank hot cold cold Rank hot Rank cold cold hot cold New rank added to pool Natural Performance Skew 32

Intra-tier Rebalancing Performance Tier Promote/ Demote Capacity Tier Capacity Tier Capacity Tier 33

Performance Gains with Homogeneous Pool Rebalancing 34

Micro-tiering Easy Tier automatic mode can also help intra-tier storage pool management Same class of drives but different device geometries Example: 1200 GB/10K drives with some RAID-5 some RAID-6 600 GB/15K + 600 GB/10K in same storage pool 300 GB SSD + 400 GB SSD in same storage pool SSD + high performance flash cards in the same storage pool RAID-5 + RAID-10 in same storage pool There is no promote/demote capability within the same drive class Micro-tiering is best thought of as a rebalance action Rebalance can occur if skew is significant 6 hour learning cycle Not driven by extent heat but rather device (rank) utilization Based upon performance characteristics of the rank 35

Easy Tier Volume Allocation Order When new logical volumes are defined in a storage pool, allocation location is dependent on user control High Utilization High Performance Use the DSCLI command chsi ettierorder highutil highperf to set High Utilization DS8880 Hybrid High Performance 1. Enterprise tier 1. High performance flash tier 2. High capacity flash tier 2. High capacity flash tier 3. Nearline tier 3. Enterprise tier 4. High performance flash tier 4. Nearline tier High Utilization DS8880 All Flash High Performance 1. High capacity flash tier 1. High performance flash tier 2. High performance flash tier 2. High capacity flash tier 36

Easy Tier Auto Mode Summary 37

Easy Tier Auto Mode Extent Migration Définitions Promote Moves the hotter extents to the ranks of the target tier with available capacity. Promote occur within adjacent tiers Demote Demotes colder extents from the higher tier to the lower tier. Demote occurs within adjacent tiers Move Auto-rebalance which is also known as intra-tier rebalancing, is a capability of Easy Tier that automatically rebalances the workload across all ranks of a storage tier within a managed storage pool Auto-rebalance also automatically populates new ranks that were added to the pool when rebalancing the workload within a tier Swap A swap moves a hot extent from a lower performance disk tier to a higher disk tier while simultaneously moving a cold extent from the higher disk tier to a lower performance disk tier Cold Demote Cold demote only occurs between HDD tiers; that is, between Enterprise and Nearline disks. Easy Tier Automatic Mode automatically locates and demotes inactive (or cold) extents that are on a higher performance tier to its adjacent lower-cost tier. In that way, Easy Tier Automatic Mode automatically frees extents on the higher storage tier before the extents on the lower tier become hot, and then helps the system to be more responsive to new hot data Warm Promote Occurs out of cycle when an extent can be moved to a higher performance tier to provide immediate better performance Warm Demote Easy Tier Automatic Mode monitors the performance of the ranks and triggers the movement of selected extents from the higherperformance tier to the lower-performance tier This action is based on predefined bandwidth or IOPS overload thresholds. Easy Tier continuously ensures that the higherperformance tier does not suffer from saturation or overload conditions that might affect the overall performance in the storage pool RB-Swap A rebalance swap, like the swap, moves two extents simultaneously. In this case, both extents are within the same disk tier The rebalance swap is used to clear space on a cold rank so a hot extent can be moved to its place. The intent is to balance I/O workload activity within all ranks of the same tier in the storage pool 38

Easy Tier Manual Mode Overview Easy Tier Manual Mode allows a user to perform the following actions: Dynamic Volume Migration User can change a logical volume s storage technology by dynamically relocating between storage pools User can change a logical volume s extent allocation algorithm (EAM) (e.g. can re-rotate extents within the target storage pool) Dynamic Storage Pool Merge User can merge two existing storage pools without moving data Consolidate storage pools with equivalent disks Merge storage pools with to create a mixed technology storage pool for Automatic Mode Rank Depopulation Storage Administrator can ask that a rank be removed from an storage pool Automatic, non-disruptive and transparent to host access, the used extents will be reallocated to other ranks in the pool and rank freed Add to another storage pool using different extent size (large : small) Manual Volume Rebalance Redistributes a volume s extents within a non-managed single-tier pool Same pool and can change EAM 39

Dynamic Volume Relocation Before Volume Migration 1004 Rank 0 Rank 2 Rank 4 Storage Pool 0 Rank 10 Rank 12 Rank 14 Storage Pool 10 GUI: Migrate or DSCLI: manageckdvol action migstart eam rotateexts -extpool p10 1004 After Volume Migration 1004 Rank 0 Rank 2 Rank 4 Storage Pool 0 Rank 10 Rank 12 Rank 14 Storage Pool 10 40

Dynamic Storage Pool Merge process Before Storage Pool Merge Rank 0 Rank 2 Rank 4 Storage Pool 0 Rank 10 Rank 12 Rank 14 Storage Pool 10 GUI: Merge or DSCLI: chextpool merge p10 p0 After Storage Pool Merge Pool 10 Rank 0 Rank 2 Rank 4 Rank 10 Rank 12 Rank 14 Storage Pool 0 41

Rank Depopulation Before Rank Depopulation Rank 0 Rank 2 Rank 4 Storage Pool 0 GUI: Unassign or DSCLI: chrank unassign r2 After Rank Depopulation Rank 0 Rank 4 Storage Pool 0 Rank 2 Unassigned 42

Manual Volume Rebalance Before Manual Volume Rebalance 1004 Rank 0 Rank 2 Rank 4 Rank 6 Rank 8 Rank 10 Storage Pool 0 GUI: Redistribute or DSCLI: managefbvol -action migstart 1004 After Manual Volume Rebalance 1004 Rank 0 Rank 2 Rank 4 Rank 6 Rank 8 Rank 10 Storage Pool 0 43

Easy Tier Manual Mode Summary Migrate Volume (Target Storage Pool, Extent Allocation Method) Can specify current storage pool or another storage pool Can specify extent allocation method (rotate volumes or rotate extents) Pause/Resume Volume Migration Pause puts volume in migration paused configuration state and stops initiation of any new extent migrations on a volume Resume puts volume in migrating configured state and continues migration Cancel Volume Migration Nullifies volume migration if it has not started and puts volume in normal configuration state Stops volume migration if it has started and puts volume in migration cancelled configuration state. Can request migrate volume to source or target storage pool to retry. Merge Storage Pool Moves all volumes in the source storage pool to the target storage pool Deletes source storage pool if merge is successful Rank Depopulation Can use Easy Tier to depopulate a rank and remove from an storage pool Automatic, non-disruptive and transparent to host access 44

Easy Tier Application DS8870 and DS8880 Function Easy Tier Application will enable administrators and applications to direct data placement based on business knowledge and application knowledge Database Systems and ISV solutions will be able to provide performance tips to Easy Tier Will guide what, when, where and how data is placed across the server and storage systems dynamically Command entered by storage administrator Provide pin / unpin (assignment) capability Tier placement Easy Tier Application Data Placement 45

Easy Tier Application Directive Data Placement Storage administrator can direct the data placement via GUI or DSCLI Building block for future software integration May be further adopted in the future by Operating systems Middleware applications for example database Provides a common API Storage Pool 4500 P Command operates at the volume level Commands available for storage administrator to assign an entire volume to a specific tier (not just specific extents within the volume 1200 P 2300 P Assign HPF or HCF Flash drives Easy Tier application data placement Passes on data placement requests Generates the migration plan Exclude Nearline Enterprise drives Tier assignment options Specific tier (nearline, high performance flash, high capacity flash, enterprise) Default Exclude HDD Nearline drives Exclude a tier (exclude nearline or exclude any HDD tier) 46

Easy Tier Application Support (assign a volume to a tier) 47

Easy Tier Application for IBM Z DS8870 / DS8880 Function Initial use case: DB2 database reorganization under z/os Without Easy Tier Application for IBM Z Database extents may currently be on high performance tier Database reorganization will move parts of the database to new extents To Easy Tier, these extents may have been cold since they were previously free space on the volume This may result in database extents now being relocated to lower performance tiers With Easy Tier Application for IBM Z z/os will query the DS8870/DS8880 to obtain average heat and tier assignments During the database reorganization z/os will specify the desired target tier Requires: DS8870 LMC R7.4 or higher or DS8880 z/os version 2.1 or higher DB2 version 10 or 11 with SPE 48

Use Case z/os DB2 Database Reorganization Without Easy Tier Application for IBM Z It takes time for ET to optimize the target datasets after re-org With Easy Tier Application for IBM Z Target datasets are already optimized before the re-org completes DB2 DB2 Re-org Re-org Assignment hint Storage Storage SSD Flash HDD SSD Flash HDD 49

Implementation New interface between z/os (Media Manager) and DS8000 Easy Tier API Introduces three new Media Manager functions and utilized by DB2 1) Report temperature of volume track ranges (query temperature) Returns token representing the average heat and tier allocation for the volume track range(s) 2) Assign volume track ranges (hint) Specify the target tier explicitly Specify the temperature token Specify both the target tier and temperature token 3) Set temperature of volume track ranges (set temperature) Easy Tier will set the heat of the volume s track range(s) to the average heat calculated Media Manager uses these commands to query and then set the desired tier allocation Normal heat assignment takes over after the lease expires Assignment is not permanent and Easy Tier will manage the extents as normal 50

Heat Map Transfer Utility DS8870 / DS8880 Function Integrated into GDPS, CSM and as a stand alone application under Windows Workload Hotspot Analysis MM/GC/GM Replication 51

You Need Some Free Space for Easy Tier You must have free extents on ranks for Easy Tier to function Plan on having approximately 5-10 free extents per rank in the pool Allows Easy Tier to promote/demote and rebalance Example: 5 ranks in the pool would recommend 50 free extents in the pool Starting with DS8880 R8.1 default is to reserve extents Enabled by default chsi etsrmode enable disable More efficient use of free space as Easy Tier automatically calculates the amount of space it will require based on your specific environment Reserved space is reported as pool overhead in DSCLI/DSGUI 52

Easy Tier Reporting From Within the User Interface DS8880 user interface now has direct view of Easy Tier activity Located within Performance graphs within DSGUI Easy Tier data policy report Easy Tier data activity report Easy Tier Data movement report Select the storage pool then select the type of Easy Tier report desired Select Storage Pool from drop down then 53

Easy Tier Data Activity Report 54

Easy Tier Data Movement Report 55

Easy Tier Data Policy Report 56

Exporting Easy Tier Summary Files Can still offload the three CSV files Useful if you want the Skew Curve Disk Magic Understand the concentration of I/O against a disk tier Useful if you want the details on extent movement STAT utility program will not process R8.3+ Easy Tier metrics Excel spreadsheet provided to import and format the CSV files if desired Requires Microsoft Excel at certain supported levels Can also use your own methodology to interpret the data Can export via GUI or DSCLI command (shown in examples at right) 57

Migration Plan Easy Tier auto mode creates migration plans when enabled Plans are generated for both auto-rebalance and cross-tier migrations Auto-rebalance plans are generated every 6 hours Cross-tier migration (promote/demote) are generated at least once every 24 hours No extent migration will occur until the plan is generated Users cannot set the plan start/end times Easy Tier license must be installed before any ET functions will execute Easy Tier creates one migration queue per storage pool Each pool is optimized independently One storage pool is not compared to another storage pool Decision windows for easy tier are based on short term and long term extent heat Short term heat has higher weight compared to long term extent heat Short term window is past 24 hours Long term window is past 7 days 58

Managing Easy Tier -action etmonpause Specifies that Easy Tier monitoring of this storage pool is paused. All current Easy Tier migration plans are unaffected, but no new migration plans are formed. -action etmonresume Specifies that Easy Tier monitoring of this storage pool is resumed. Any current Easy Tier migration plans are unaffected. -action etmonreset Specifies that all Easy Tier monitoring data (history), including migration plans, are erased. All new plans are based on new monitoring data. -action etmigpause Specifies that Easy Tier migrations of this storage pool are paused, including migrations that are required to relieve rank bandwidth performance issues. Easy Tier monitoring is unaffected by this action. -action etmigresume Specifies that Easy Tier migrations of this storage pool are resumed. Easy Tier monitoring is unaffected by this action. -duration time Specifies the duration of the pause time. For example, 4H would pause for 4 hours. Maximum duration is 168 hours (one week). Only valid for etmonpause and etmigpause. 59

Enabling Easy Tier License Order Easy Tier feature code #7083 Download license key from DSFA and apply it to the DS8000 https://www-03.ibm.com/storage/dsfa/ds8000/selectmachine.wss Enable Easy Tier Storage Image Properties (DS GUI) chsi Etautomode all tiered none storage_image_id Auto Mode all tiered none Automatically manage all single and multi-tier pools (default) Automatically manage multi-tier pools only Do not automatically manage any pools chsi Etmonitor all automode none storage_image_id Monitor automode Only volumes managed by Easytier auto mode are monitored all All volumes in the system are monitored. (default) none No volume is monitored. 60

References IBM DS8000 Easy Tier Redpaper - REDP-4667 http://www.redbooks.ibm.com/abstracts/redp4667.html?open IBM DS8000 Easy Tier Server Redpaper REDP-5013 http://www.redbooks.ibm.com/redpieces/abstracts/redp5013.html?open IBM DS8000 Easy Tier Application Redpaper REDP-5014 http://www.redbooks.ibm.com/redpieces/abstracts/redp5014.html?open IBM DS8000 Easy Tier Heat Map Transfer Redpaper REDP-5015 http://www.redbooks.ibm.com/redpieces/abstracts/redp5015.html?open IBM DS8870 Architecture and Implementation - SG24-8085 http://www.redbooks.ibm.com/abstracts/sg248085.html?open IBM DS8880 Architecture and Implementation SG24-8323 http://www.redbooks.ibm.com/abstracts/sg248323.html?open IBM DS8000 Easy Tier Volume Extent Allocation Chargeback Utility, REDP-4916 http://www.redbooks.ibm.com/abstracts/redp4916.html?open 61

Questions 62