1
Automating the provisioning of storage with TPM, TPC and IT Service Management Greg Van Hise Storage Management Architecture gvanhise@us.ibm.com
Agenda The storage provisioning problem Storage provisioning with Tivoli Provisioning Manager and TotalStorage Productivity Center ITSM Storage Process Manager Summary 3
Agenda The storage provisioning problem Storage provisioning with Tivoli Provisioning Manager and TotalStorage Productivity Center ITSM Storage Process Manager Summary 4
An example of a real life scenario to add storage Database Administrator System Administrator Storage Administrator Observe tablespace is full Check for more space on the file system Contact System admin Create a new datafile Check for more space on server Contact Storage admin Inform the server that new storage is available Expand the volume group Find available LUN(s) If none exist, allocate new ones Find the best LUN(s) for the application Assign the LUN(s) to the application server HBA(s) Adjust switch zones Expand the tablespace Expand the file system Contact DBA Find available Point-in-time and Remote copy target(s) Match source / target pairs Contact System admin 5
Increased demand to provision storage Demand for additional capacity Storage volumes growing 50%+ a year Extend existing file systems Cost control requires just in time provisioning Move to centralized SAN storage Increased skill requirements and complexity of provisioning More use of complex techniques such as boot on SAN 6
The need for best practice Major commercial bank in Europe had two outages during peak period prior to Christmas 2004 Administrators not following rules Best practice rules depend on the hardware Number of LUNs per adapter Number of hosts per adapter Dual Path connections to Subsystem adapters Must be no single point of failure Adapter bays, PSUs. 7
Existing manual storage management techniques High skill requirements Scarce skills Expensive skills Slow Manual processes High element of human involvement Division of responsibilities Error prone Reliant on up to date environment information Unforeseen consequences Lack of integration with other IT delivery processes End to end delivery is impacted by division of responsibilities 8
Agenda The storage provisioning problem Storage provisioning with Tivoli Provisioning Manager and TotalStorage Productivity Center ITSM Storage Process Manager Summary 9
IBM TotalStorage Productivity Center Capabilities Disk Management Heterogeneous Disk Subsystem Management Disk Performance Management Capacity and Asset reporting Fabric Management SAN Topology Display and Management Event reporting SAN Performance reporting Zone control Data Management Data collection and analysis, file systems and databases Reporting and quotas 10
Provisioning tasks in Productivity Center Create/Delete Volumes multi-vendor and virtualisation devices Assign volume to host Host ports Subsystem ports Create/Assign Fabric Zone Create Zone Add Zone Members Add and delete zonesets 11
Task Integration Integration of host, fabric and disk functions enables further productivity improvements Guided actions Checking valid options Wizard guides user through provisioning steps Selection of RAID level Selection of Array Volume Size, Name Host Ports Subsystem Ports Fabric Zones Zone Members 12
Provisioning steps 13
Provisioning steps 14
Provisioning steps 15
Provisioning steps 16
Provisioning steps 17
Volume provisioned 18
Automating Provisioning Processes Provisioning Automate execution of manual processes Capture data center best practices Help reduce human errors IT Task Identify resource Install software Configure security and network settings Return resources Total Time Estimated Manual 3 Days 5 10 Days 5 10 Days Variable 13-23 Days Estimated Automated <1 Hour <1 Hour <1 Hour Automated Minutes or Hours 19 Source: IBM analysis of Industry Consultant Reports and IBM customer engagements
Workflows automate best practices/processes relating to provisioning Workflow Captures IT expert know-how and dynamically executes processes in response to changing business requirements Traditional Scripts 1. Manual flow required 2. Infrastructure changes often requires script updates 3. Difficult to manage and track versus Workflows 1. Reusable and GUI based 2. Dynamically supports infrastructure changes (data center model) Workflow Example: Deploy a server Deploy operating system Roll Back Deploy software stack Move server to network Add server to cluster 20
Automating Storage Provisioning Tivoli Provisioning Manager Workflows TotalStorage Productivity Centre TPC for Fabric SAN fabric zoning provisioning TPC for Disk LUN mapping and masking Make disks usable for applications End to end server provision with storage configuration SAN Fabric Switches Storage Subsystem Volume Manager 21
TPM Provisioning architecture Task execution TPM Server File system and Volume Manager configuration Telnet/SSH Device Drivers TPM Storage Device Drivers Workflows Commands Telnet Zone Configuration SAN APIs Telnet/SSH Subsystem Configuration 22
Productivity Center storage provisioning architecture Task execution TPC Storage Device Driver TPM Server File system and Volume Manager configuration Telnet/SSH Data Center Model Device Drivers Workflows Commands Zone Configuration SAN SAN Discovery information API Discovery and Configuration Productivity Center Server Subsystem Configuration 23
Automation of storage provisioning Policy based storage configuration Amount MB, GB, TB, Capability RAID level, disk size File system type NTFS, JFS, VxFs IBM and non-ibm storage Any device SMI-S certified device Storage subsystems and SAN switches Integration of delivery processes across IT functions Allocation of storage capacity SAN SAN Volume creation, assignment and zoning Creation of file systems Update of backup systems 24
Storage provisioning functionality Functionality is build up using building blocks, or Logical Device Operations Create and Delete, Add and Remove Volumes, Zones, Zone Members, File systems End-to-end operations Add volume to host & Remove Create volume & LUN masking & Zoning Add storage to host & Remove Create volume & LUN masking & Zoning & OS device mapping & create file system Update backup systems Install backup software, configure backup agents and servers Incorporate best practices Zoning standards, port selection, number of paths 25
Environment model 26
Provisioning Storage Interface 27
Policy based provisioning Storage requirements predefined in templates Reusable Define all storage attributes Template selected at execution time 28
Storage provisioning capability comparison Capability Productivity Center 3.1 TPM standalone Productivity Center with TPM Provisioning Manual Automated Automated Wizard driven By policy By policy Environment discovery Automated Productivity Center for Fabric and Disk. Manual Spreadsheets, queries of devices, manual entry Automated Productivity Center for Fabric and Disk Disk support Best Any supported by Productivity Center Limited Drivers available for EMC and IBM ESS. Best Any supported by Productivity Center Fabric support Best Any supported by Productivity Center Good CISCO, Brocade, McData Best Any supported by Productivity Center File system support Limited Extension - VxFS, JFS Best VxFS, JFS, NTFS Best VxFS, JFS, NTFS 29
TPC storage provisioning support TPC 2.1 Supports TPM 2.1 (GA d Sept 2004) TPC 2.3 4Q 2005 Supports TPM 3.1 (GA d May 2005) IBM storage devices via SMI-S Update environment model as new devices are added TPC 3.1 Support available via TPC CLIs. TPC 3.1.2 Supports TPM 3.1 2Q 2006 IBM and non-ibm devices via SMI-S 30
Application and server provisioning Applications Attach Storage Management Applications Middleware Operating Systems Hardware Layer Security Server Provisioning Configure Networking Management Applications Virtualization Storage Devices Security Fabric / Network Virtualization Routers, Switches, etc. Security Fabric Protocols 31 Storage Provisioning Network Provisioning
Enterprise Con... E vent Groups Options Netw orks Databases Services Printers A p p lica tio n s Event Groups Enterprise Console S ource Groups O pt ions Help Event Sources Database Event Message List E vent Vie w T asks Automated Tasks Help CLOSED CLOSED CLOSED CLOSED CLOSED CLOSED CLOSED CLOSED CLOSED OPEN x T ivo li P lu s Update ON T ivo li/s e n try System Logfiles FATAL C RITICAL MINOR WA RNING HARMLESS UNKN OWN OP EN A CK NOW LE DGED CLOS E D View Messages View Action Status Acknowledge Message Number of Messages Total: 11 Class Severity Origin Host Nam e Message DB_Table_Full DB_Table_Full DB_Table_Full DB_C apacity DB_C apacity DB_C apacity DB_C apacity DB_C apacity DB_C apacity DB_C apacity FATAL FATAL FATAL C R IT IC AL C R IT IC AL C R IT IC AL C R IT IC AL C R IT IC AL C R IT IC AL WARNING 157.83.27.33 157.83.27.30 157.83.27.28 157.83.27.34 157.83.27.33 157.83.27.35 157.83.27.36 157.83.27.37 157.83.27.38 157.83.27.39 Dallas London Austin Tokyo Sydney LA RE O Paris Detroit Houston Close Message 2 2 2 2 2 Tivoli Now IT Service Providers On demand environment Internet Application environment BladeCenter Boot on SAN CISCO MDS Automated Provisioning Virtualised storage TotalStorage SAN Volume Controller TotalStorage DS4300 Disk Array 32
Agenda The storage provisioning problem Automating Storage Provisioning with Tivoli Provisioning Manager and TotalStorage Productivity Center ITSM Storage Process Manager Summary 33
Information On Demand: Tivoli ITSM Business Processes Manage, Collaborate, Optimize Business Driven Development Model, Design, Develop, Test Business Applications Commercial, Internally Developed, Composite-Based Information Accelerators Industry Specific Services, Models, Maps, Schemas & Policies Information Services Data Management, Information Integration, Business Intelligence, Content Management, Master Data Management IT Service Management Provision, Secure, Monitor, Optimize Effectively Manage Information Assets IBM IT Service Management IT Process Management IT Process Management Products Information Assets & Systems Files, Storage, Servers, Networks IT Service Management Platform IT Operational Management Products Best Practices 34
Automate Storage Best Practices- IT Service Management Service Level Management Availability Capacity Security IT Service IT Financial Management Management Management Continuity Management Change Management Incident Management Problem Management Release Management Configuration Management 35
IBM IT Service Management Making ITIL Actionable IBM IT Service Management Process Oriented Solutions to address Customer priorities, pains, & requirements IT Process Managers IBM Change and Configuration Management Database Technology Products Integrate and Automate processes (across domains) Standardize and share information Automate tasks (within a domain) Best Practices and Implementation Services 36
IBM Tivoli Storage Process Manager Example Scenario Change Management Storage Provisioning IBM IT IT Service Management IT Process Management Products IT Service Management Platform IT Operational Management Products Best Practices IBM TotalStorage Productivity Center IBM TotalStorage Productivity Center Request for Storage Provisioning Create RFC Process Automation Accept Request for Change Access Impact Approve & Schedule provisioning Deploy Storage Review & Close RFC Human Driven Tool Automated CMDB Shared data CMDB 37
Storage Provisioning RFC Storage Process Manager provides capability the customer to view storage process activities and status. 38
Storage Provisioning using ILM Policies Change Process OR Peregrine Change Manager Human Driven Tool Automated Data Service Level Objectives input to Provisioning Process Match Objectives with Storage Capabilities Adapters and Interfaces Operational Management Applications Assists customers in selecting appropriate type (tier) of storage for each class of server and/or applications. Integrates with TPM and/or TPC to perform the storage provisioning tasks. Allows for approvals before storage is provisioned Allows for validation of the change using TPC Storage Configuration Checker (Future) Customer Value: Improve efficiency in delivering storage services Ensure availability of applications and data according to SLA agreements Reduced cycle time,reduced release errors due to automated, repeatable actions Improved capacity to handle more releases, and fewer business impacting interruptions 39
Agenda The storage provisioning problem Storage provisioning with Tivoli Provisioning Manager and TotalStorage Productivity Center ITSM Storage Process Manager Summary 40
Summary TPC with Advanced Provisioning is used to automate end-to-end storage provisioning ITSM Storage Process Manager Enables the creation of best practice processes including task assignment and approvals, Integrates with TPC, TSM and TPM (future) to execute parts or all of the processes. 41
Hindi Russian Arabic Grazie Italian Traditional Chinese Thank You English Simplified Chinese Gracias Danke German Spanish Thai Obrigado Brazilian Portuguese Merci French Tamil Japanese Korean 42
Further Reading RedPaper Redp3900 An Introduction to Storage Provisioning with Tivoli Provisioning Manager and TotalStorage Productivity Center Tivoli Demo website TPM 3.1 Windows and Linux demos http://depot.tivlab.raleigh.ibm.com/ 43
Summary of automated storage provisioning benefits Automates storage provisioning process Reduces skill requirements Reduces admin costs Improves responsiveness Eliminates human error Improves availability Implements best practice Supports hardware from multiple vendors Can be extended to other platforms Integrates with IBM s TotalStorage Productivity Center Support for IBM storage 44
Further Automation of Storage Provisioning Storage Admin Select storage profile 1. Select storage profile with required storage characteristics 2. Create a volume in the subsystem 3. Assign LUN (SCSI Port) to volume 4. Unmask Volume/LUN to controller HBA 5. Select and map volume to host HBA(s) 6. For each HBA port, and switch set: i. Create zone ii. Get active zone set iii. Add zone to zone set 7. Map HBA LUNs to OS LUNs 8. Configure Dynamic Multi Path driver 9. Create OS volumes 10. Add volumes to volume group Tivoli Provisioning Manager 11. Create filesystem in volume group. Workflows Steps 2-5 Steps 6i-6iii Steps 7-9 Step 10 Step 11 Productivity Center for Disk Productivity Center for Fabric OP SYS VOL MGR FILE SYS 45
46
Disclaimers and Trademarks No part of this document may be reproduced or transmitted in any form without written permission from IBM Corporation. Product data has been reviewed for accuracy as of the date of initial publication. Product data is subject to change without notice. Any statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. THE INFORMATION PROVIDED IN THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IBM EXPRESSLY DISCLAIMS ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT. IBM products are warranted according to the terms and conditions of the agreements (e.g. IBM Customer Agreement, Statement of Limited Warranty, International Program License Agreement, etc.) under which they are provided. IBM customers are responsible for ensuring their own compliance with legal requirements. It is the customer's sole responsibility to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer's business and any actions the customer may need to take to comply with such laws. The following terms are trademarks or registered trademarks of the IBM Corporation in either the United States, other countries or both: DB2, e-business logo, eserver, IBM, IBM eserver, IBM logo, Lotus, Tivoli, WebSphere, Rational, z/os, zseries, System z. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States and/or other countries. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States and/or other countries. UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a trademark of Linus Torvalds in the United States and other countries. Other company, product, or service names may be trademarks or service marks of others. ITIL is a Registered Trade Mark, and a Registered Community Trade Mark of the Office of Government Commerce, and is Registered in the U.S. Patent and Trademark Office. IT Infrastructure Library is a Registered Trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. 47