Tivoli Workload Automation View, Control and Automate Composite Workloads Mark A. Edwards Market Manager Tivoli Workload Automation Corporation
Tivoli Workload Automation is used by customers to deliver core business services Retailers use it to update pricing on Web sites, control inventory and replenish systems, transfer data, backup data, and control CRM and data warehouse systems Banks use it to process consumer and commercial transactions, provide online account services to customers, execute investment transactions, process backend analytics and reports, and transfer and backup data Process and package food companies use it to schedule daily product runs, and to control inventory and deliveries Entertainment companies use it to schedule and load delivery trucks with media for distribution to the marketplace Healthcare providers use it to manage online services for customers and partners, to control back-end processes and backup data 2 Corporation
s evolution from Scheduling to Workload Automation It isn t just scheduling unattended batch jobs! Service-oriented architecture with open interfacing for J2EE, Web Services and custom applications Extended agents for packaged ERP, grid and z/os systems Integration with many Tivoli products for advanced services management and automation An enterprise backbone that drives composite according to business policies while providing consistent visibility, control and automation OPC & Maestro Batch Event-driven Batch ERP Legacy app Event-driven Batch Web Services J2EE Legacy app ERP Event-driven Batch Tivoli Workload Automation Composite services Composite apps Web Services J2EE Legacy app ERP Event-driven Batch 3 Corporation
s evolution from Scheduling to Workload Automation Tivoli Workload Automation Helps view, control and automate the entire process of delivering composite across heterogeneous applications and systems Labor driven Automated IT Service Execution Process Activities (Formal ITUP / PRM-IT Flow) Optimization Loop Business strategy Service level agreements Create service schedules and plans Maintain service schedules and plans Deliver and monitor service schedules and plans Detect service execution incidences and events Manage resources and, adapt delivery of service Measure, analyze and report performance Stand-alone requests Change Process Storage Process Continuity Process Availability Process Continuity Process Change Process Storage Process Capacity Process 4 Corporation
Tivoli Workload Automation services Modeling UI Operational UI Workload Management Service Business Processes Business Processes Business Processes Brokering and Execution Service Virtual Application Server Virtual Application Servers SOA Enterprise Service Bus Planning Service Triggering Service Choreography Service Virtualized Environment Virtual Storage Sun Dell EMC HP Network Hardware Virtual Networks Hitachi HP Provisioning Service Events Events Events Time and Calendaring Rules Integrate Tivoli Workload Automation managed with composite business services through SOA Model and plan time-triggered and policy-based event-triggered Choreograph composite and resolve dependencies throughout heterogeneous infrastructures Prioritize and broker to best available resources Consolidate management of all enterprise while virtualizing heterogeneous IT infrastructures 5 Corporation
Tivoli Workload Automation components Visibility Single, consistent view for monitoring, reporting and auditing Control Centralized planning and management of mixed Service oriented architecture High scalability Automation Alerts and notifications Fault tolerant and workload restart processes Policy-based event triggering Policy-based workload dispatching Adaptation to changes and incidences in the IT infrastructure Enhanced Tivoli Workload Scheduler LoadLeveler Tivoli Dynamic Workload Broker New Enhanced Job Scheduling Console New Dynamic Workload Console Tivoli Workload Scheduler Mainframe, Distributed or End to End Workload Automation Engines Enhanced Tivoli Workload Scheduler Agents New Enhanced J2EE and Web Services APIs Enhanced Tivoli Workload Scheduler for Applications HPC Grid Clusters AIX, HP, Solaris, Windows, Linux, OS/400, z/os SAP PeopleSoft Oracle 6 Corporation
Single point of control Job Scheduling Console Job Scheduling Console Drag-and-drop object-based planning and modeling Filterable views of all jobs and jobstreams including all dependencies Dynamic Workload Console Monitor and manage Dynamic Workload Console Exceptions-based monitoring Monitor and tune workload throughput and performance Take manual action Trial forecasting Report production plans and performance 7 Standard reports (templates) User-defined reports Historical execution data and statistics Audit reports for compliance Corporation
Mainframe workload automation Tivoli Workload Scheduler for z/os Environment: z/os View Centralized view of models, plans and production Integration with Tivoli Enterprise Portal and Tivoli Business Systems Manager Standby Controller z/os Tracker Sysplex I Standby Controller z/os Tracker Control Centralized management of heterogeneous, composite Policy-based calendar-, time- and event-triggered planning and modeling Highly secure and scalable New York Tokyo z/os Controller z/os Tracker Job Scheduling Console ISPF, PIF Dynamic Workload Console J2EE and Web Services APIs Automation Fault tolerant and workload recovery processes Remote z/os Tracker Sysplex II Remote z/os Tracker Critical path analysis Dispatching of to best available resources Integration with Tivoli Storage Manager to coordinate data backups with application workload events and plans Integration with Tivoli System Automation to start, stop and move applications Remote z/os Tracker 8 Corporation
New for Tivoli Workload Scheduler for z/os V8.3 (4Q2006) Service oriented architecture Open, published J2EE and Web Services APIs Graphical interfacing Enhanced Java-based Job Scheduling Console for planning New Tivoli Dynamic Workload Console, a web-based operations console for submitting and monitoring, exceptions-based monitoring, recovering failing or resources, and reporting Automation Workload prioritization and promotion, critical path analysis, dynamic brokering End-to-end Workload Automation Seamless and flexible integration with distributed components New ability to connect z controllers directly to distributed agents 9 Corporation
Critical path analysis Users are enabled to identify jobs that are critical for their business A At Daily Plan, TWS calculates the critical path to critical jobs B Latest start time = 10:10 C New views are provided to monitor Critical Jobs and their Critical Paths Jobs are automatically promoted when they risk to miss their deadline Internal priority for jobs in Ready status E D IA = 11:30 Duration = 40.00 Deadline = 12:00 (Planned end time = 12:10) 10:00 10:01 10:02 10:03 10:04 10:05 F H IA = 11:00 Duration =30.00 Deadline = 11:50 (Planned end time = 11:30) G I WLM Service Class for Started jobs WLM Service Classes will be specified at operation level IA = 12:00 Duration = 10.00 Deadline = 12:30 (Planned end time = 12:20) J 10 Corporation
Dynamic workload brokering TWS integrates with Workload Manager (WLM), leveraging Scheduling Environment (SE) and Service Class objects New integration with WLM SE has been provided Dynamic routing of workload to MVS systems in the Sysplex based on best available resources SE becomes part of TWS operation SE availability status is checked before jobs submission Automatic re-submission of jobs at SE availability status change Integration with WLM Service Class has been enhanced in TWS WLM Service class can be defined at TWS operation level Jobs will be promoted to the specified WLM Service Class if they are on the Critical Path Standby Controller z/os Tracker z/os Controller z/os Tracker Sysplex z/os Tracker z/os Tracker z/os Tracker 11 Corporation
Advanced data center automation Advanced data center automation provided through integration with Tivoli System Automation New TWS z/os user and programmatic interfacing dedicated to scheduling of SA commands according to plans Easy and intuitive way for TWS operators to use and issue SA commands Ability to start/stop/move applications and resources in a controlled fashion from within TWS TWS z/os Controller Trackers Status Observer Req Receiver SA for z/os Eliminates error-prone and time-consuming manual efforts to schedule SA commands via batch or command interfaces Greater visibility and control of System Automation from within TWS 12 Corporation
Distributed workload automation Tivoli Workload Scheduler Environment: UNIX, Windows, Linux, i5/o5 View Centralized view of models, plans and production Integration with Tivoli Enterprise Portal and Tivoli Business Systems Manager Control Centralized management of heterogeneous, composite Policy-based calendar-, time- and eventtriggered planning and modeling Highly secure and scalable flat or hierarchical topology Master Domain Domain A Planning Database Job Scheduling Console Dynamic Workload Console Scheduling Engine Java, Web Services & other APIs Backup Engine Domain Manager and Backup Domain B Plan File Automation Fault tolerant and workload recovery processes Event filtering and automation engine Integration with Tivoli Storage Manager to coordinate data backups with application workload events and plans Integration with Tivoli System Automation to start, stop and move applications Standard Agent Standard Agent Plan File Fault Tolerant Agent Fault Tolerant Agent Plan File 13 Corporation
Secure, highly scalable flat or hierarchical topology TWS provides extremely flexible hierarchy to suit a wide range of business goals and requirements Ability to leverage localized processing Geographic locations / time zones Organizational business functions or application groupings Platforms Virtual environments or physical servers Network traffic Network and node level fault tolerance for business resiliency 14 Corporation
New for Tivoli Workload Scheduler V8.3 (2Q2006) Service oriented architecture Built on WebSphere and DB2 (Oracle is optional) Open, published J2EE and Web Services APIs Graphical interfacing Enhanced Java-based Job Scheduling Console for planning New Tivoli Dynamic Workload Console, a web-based operations console for submitting and monitoring, exceptions-based monitoring, recovering failing or resources, and reporting Networking and security Full firewall support for secure, reliable execution when a firewall exists between domain managers and agents Protection of TWS environments by configuring TWS domains and interfacing to use SSL to authenticate workstation identity Centralized or decentralized user security and authentication models 15 Corporation
New for Tivoli Workload Scheduler V8.4 (3Q2007) Policy-based event automation engine Event monitoring, filtering and triggering of No scripting! Trial and forecast planning through the Dynamic Workload Console Agent-less technology LDAP and IPv6 support Reporting enhancements DB2 historical repository More templates Greater ability to customize TWS TDWB user interface single installer Integration with Tivoli Enterprise Portal 16 Corporation
ERP system workload automation Tivoli Workload Scheduler for Applications Environment: UNIX, Windows, Linux, z/os View Plan, model and track heterogeneous, composite Control Extend Tivoli Workload Scheduler automation capability to ERP and nonnatively supported systems Submit and restart SAP through Tivoli Workload Scheduler Automation Fault tolerance, workload recovery and load balancing Resolve dependencies between SAP and non-sap Symphony File Symphony File SAP X Agent PSFT X Agent TWS TWS z/os Symphony File Symphony File Oracle X Agent z/os X Agent Tivoli Workload Scheduler for Applications 17 Corporation
New for Tivoli Workload Scheduler for Applications V8.3 (3Q2006) SAP certification to provide full integration from the TWS Job Scheduling Console and Tivoli Dynamic Workload Console New SAP-specific panels in the Job Scheduling Console to create, modify and delete SAP jobs Monitor and manage SAP jobs whether created in SAP or in TWS Enhanced monitoring, tracking and restarting of SAP jobs Enhanced ability to intercept SAP jobs not defined in TWS to ensure they are launched at optimal times Enhanced parent-child feature to monitor and track instances when an SAP job spawns other jobs Manage and resolve interdependencies between SAP and non-sap environments Extended platform support for Oracle and PeopleSoft extended agents to Solaris and HP-UX 18 Corporation
New for Tivoli Workload Scheduler for Applications V8.4 (2H2006) Submit SAP through Tivoli Workload Scheduler Automatic updates to SAP calendars Monitoring and filtering of SAP events, trigger SAP and non-sap based on application and system events Alert notification based on SAP and non-sap events Load balancing for SAP IPv6, FIPS 140-2 standards 19 Corporation
Distributed dynamic workload brokering Tivoli Dynamic Workload Broker Environment: UNIX, Windows, Linux Stand-alone product Add-on product to Tivoli Workload Scheduler Users, applications and application servers can also submit directly Tivoli Workload Scheduler Job Scheduling Console Planning Database Dynamic Workload Console Scheduling Engine Java, Web Services & other APIs Policy-based dispatching Matches workload requirements, priorities and attributes to IT resource attributes, performance and availability Policy-based IT resource utilization Automatic discovery of configuration changes Tivoli Dynamic Workload Broker TDWB Server Resource Advisor Workload Dispatcher Planning Database Advanced automation Integrated with Tivoli Provisioning Manager to provision resources on demand Integration with Tivoli CCMDB to map Workload Automation into formal IT management processes TDWB Agent TDWB Agent TDWB Agent 20 Corporation
New for Tivoli Dynamic Workload Broker V1.1 (4Q2006) Manages the matching and dispatching of to best available resources Based on workload requirements, resource performance and attributes and business policies Physical resources Logical resources Optimizes the utilization of IT resources based on user-defined policies Enable maximum throughput of high priority when multiple are competing for limited resources Physical and virtual memory size and utilization CPU architecture, quantity, speed and utilization Operating system type and version Logical resources File systems required for running Enables user-defined optimization objectives including minimums, maximums and exact values Provides automatic discovery and integration of newly added resources into the workload matching pool 21 Corporation
New for Tivoli Dynamic Workload Broker V1.2 (2Q2007) Platform coverage extended to Solaris, HP-UX Option to install Oracle database Enhanced audit logging for easier report generation for compliance 22 Corporation
Tivoli Workload Automation in an end-to-end environment Dynamic Workload Console Job Scheduling Console Java, Web Services & other APIs Scheduling Plan TWS Distributed Engine TWS z/os Engine z/os Domain Scheduling Plan Sysplex TWS z/os Agent TWS Domain Manager TWS Domain Manager Distributed Domain Tivoli Dynamic Workload Broker TWS z/os Agents z/os Domain TWS Fault-Tolerant Agents TWS Apps SAP X-Agents Centralized planning, monitoring and control of end-to-end environments Mainframe-centric, distributed-centric or mixed-mode management 23 Corporation
Tivoli Workload Automation integration points Tivoli Monitoring PeopleSoft Oracle NetCool SAP Content Mgr on Demand WebSphere Tivoli NetView Tivoli Enterprise Console Tivoli Workload Automation WebSphere Extended Edition Tivoli CCMDB Tivoli Business Systems Manager Workload Manager z/os Tivoli System Automation Tivoli Provisioning Manager Tivoli Storage Manager Tivoli Configuration Manager Consolidate management of Java application, Web Services, ERP system and data backups Provide higher level exceptions monitoring Provide composite business service monitoring according to key performance indicators Provide higher level event correlation Provide provisioning on demand Start, stop and move resources on demand Higher level event-triggering Map and integrate Workload Automation into formal IT management processes 24 Corporation
Tivoli Workload Automation value Automatically manage composite Policy-based execution of while resolving all mixed workload dependencies across heterogeneous IT resources Automatically execute services to meet contracted levels Policy-based event filtering and triggering of Automatically manage and adapt to planned configuration changes Identify configuration changes and incorporate into workload execution without manually updating plans and choreography 25 Automatically adapt to unplanned incidences Monitor and IT resources by exception Generate alerts Restart failed Failover scheduling engine and domain managers with no loss of service or historical or in-flight data Adapt service execution to unplanned incidences by relocating to available IT resources without manually updating plans and choreography Corporation
Tivoli Workload Automation value (continued) Automatically shrink batch windows High scalability and high performance Workload Automation infrastructure Centrally monitor and IT resources on exceptions basis, generate alerts Automatic adaptation to unplanned incidences Automatically adapt to spikes in workload volumes Employ policy-based resource utilization to avoid overloading or idling IT resources Distribute across available IT resources Provision resources on demand (through integration with Tivoli Provisioning Manager or similar) Automatically manage virtualized infrastructures Adapt to virtual configuration changes automatically without manually updating plans and choreography Distribute across available virtual resources based on availability, performance and policies Provision virtual resources on demand (through integration with Tivoli Provisioning Manager or similar) 26 Corporation
Tivoli Workload Automation value (continued) vision, investment, commitment and support to Elevate Workload Automation in strategic priority Help to improve your ability to deliver reliable and scalable composite enterprise and services Help to reduce your administrative and operations expenses and complexity, and increase return on investment for existing IT resources 27 Corporation