Stonebranch Architecture: Agent and Integration Technologies

Size: px

Start display at page:

Download "Stonebranch Architecture: Agent and Integration Technologies"

Dale Young
6 years ago
Views:

Stonebranch Architecture: Agent and Integration Technologies Overview, Status

2 Objectives Give an overview of how the fits into Stonebranch s integration architecture. Show how Stonebranch enhancements did and will improve the agent as main application execution and monitoring component. Show how customers are and will be able to enhance Agent functionality using Stonebranch s architecture. Stonebranch All rights reserved. 6. October 2017 Seite 2

3 Agenda Stonebranch Architecture: Motivation and overview : Status and Outlook Universal Integration Platform: Status and Outlook 04 Conclusion Stonebranch All rights reserved. 6. October 2017 Seite 3

4 Stonebranch Architecture: Providing Control and Visibility Scheduler-Agnostic Agent Agent-only Installations Central monitoring and control using third-party schedulers Maintenance using UEC and Agent Utilities UEC Universal Utilities Third-party scheduling TWS Control-M UC4 Any Scheduler Control Distributed Agent-based automation s Visibility CLI SOA SAP MFT Any API Stonebranch All rights reserved. 6. October 2017 Seite 4

5 Stonebranch Architecture: Providing Control and Visibility From Client-Agnostic Agent to API-Agnostic Enterprise Automation Broker REST + CLI Python Web UI Self-Service Client integration Any Client Central Agentless automation 1 (+HA) Control REST + SOAP JDBC SSH Any API OMS TWS Control-M UC4 Any Scheduler Visibility Third-party scheduling N Distributed Agent-based automation s UEC Universal Utilities CLI SOA SAP MFT Any API Unique Flexibility: Any API. Any Application. Any Scheduler. Any Service Model. Stonebranch All rights reserved. 6. October 2017 Seite 5

6 Design Goals and Universal Automation Center Reliability Security Compliance Scalability Interoperability Openness Ease of Use Easy to Operate CLI, UIs Troubleshooting Workload Easy to Maintain Install Upgrade Easy to Integrate Any Scheduler Any Application Easy to Transition Any Scheduler to Migration tool support Interoperability and Openness are key success criteria. Stonebranch All rights reserved. 6. October 2017 Seite 6

7 Agenda Stonebranch Architecture: Motivation and overview : Status and Outlook Universal Integration Platform: Status and Outlook 04 Conclusion Stonebranch All rights reserved. 6. October 2017 Seite 7

9 : Selected Updates Done and planned UAgent: Debian packaging UEncrypt update UBroker: New key store Universal Automation Center (UAC) Any Scheduler Universal Broker UAgent platform support: New PowerLinux LE and BE ports Updates for AIX, IBM i Docker image UCMD + UDM: JES-less scheduling Workload balancing UCMD UDM USAP USOA UEM UFTP UPPS Custom Agent: Easily extend agent functionality UCMD + UDM: New ciphers, e.g., AES256-GCM-SHA384 SOA Connector: Refreshed FTP Client: New FTP(S) Module Peoplesoft Connector: New UAgent Module Any Application Significant investment in UAgent, which will remain the core execution module. Stonebranch All rights reserved. 6. October 2017 Seite 9

10 + Controller integration: Components Integration with, Monitor and Trigger Types L/Unix Win z/os PPS SAP UDM File Mon Mon Mon OMS Universal Broker UCMD UDM USAP USOA UEM UFTP UPPS UAG OMS Any Application Stonebranch All rights reserved. 6. October 2017 Seite 10

11 + Controller integration: Selected Updates Done and planned Web Services : New REST and SOAP connector (agentless), Monitor and Trigger Types Monitor: New observer UEC++ Agent Manager : Controller centrally manages definitions and tracks instances Agent auto-update: Centrally manage versions and configs; key store, credentials L/U/W s z/os WebSvc PPS SAP UDM OMS File Mon Universal Broker Mon Mon Universal : Custom code on CLI or REST; Implementations for various applications + SSH/agentless Controller Extensions: Custom Controller functionality UAgent connectivity: Multiple agents on Windows; Multiple OMS per agent UCMD UDM USAP USOA UEM UFTP UPPS UAG OMS SAP Connector: Calendar import Peoplesoft : Integrate with UPPS Custom Agent: Easily extend agent functionality UAG Agent: Sysplex support with full tracking UAgent benefits from integration with UController. Stonebranch All rights reserved. 6. October 2017 Seite 11

12 Status 10/2017 and Outlook key enhancements Updates 2017: SOA Connector Refresh Security: Certificates / Broker Key Store UEncrypt New cipher suites DEB Packages UPPS: Peoplesoft Connector UFTP: FTP Client Outlook: Platform support: PowerLinux, IBM i; Docker Multi-Broker Deployment Workload balancing z/os specific: JES-less scheduling in UCMD Parallel Sysplex (full tracking) for UAG UController as Agent Manager UEC Workload Balancing Key store Auto-update and config Define jobs (task definitions) Track job execution (task instances) Custom Agents Stonebranch All rights reserved. 6. October 2017 Seite 12

13 Peoplesoft Connector Architecture Multi-architecture integration: UCMD vs. OMS Control Third-Party Scheduler, Monitor and Trigger Types UC L/Unix Win z/os PPS SAP UDM File Mon Mon Mon UA OMS UAgent UBroker Universal Broker UCMD Mgr UCMD UDM USAP USOA UEM UFTP UPPS UAG OMS PeopleSoft Stonebranch All rights reserved. 6. October 2017 Seite 13

14 Agenda Stonebranch Architecture: Motivation and overview : Status and Outlook Universal Integration Platform: Status and Outlook 04 Conclusion Stonebranch All rights reserved. 6. October 2017 Seite 14

16 Universal Automation Center: Control/Visibility Cycle Scope of integrations Universal Automation Center (UAC) OMS OMS 1 (+HA) N s Control Data Applications + Services Containers Cloud Infrastructure Automation (any API / CLI) System state Logging data Events Downstream Systems Stonebranch All rights reserved. 6. October 2017 Seite 16

17 Universal Automation Center: Control/Visibility Cycle Scope of integrations Upstream Systems Self-service Schedulers Automation Control Universal Automation Center (UAC) OMS OMS 1 (+HA) Control Applications + Services Containers Cloud Infrastructure Automation (any API / CLI) Downstream Systems System state N System state Logging data Events Data s Data Logging data Events UAgent and UController part of control/data loop: Enterprise Automation Broker. Stonebranch All rights reserved. 6. October 2017 Seite 17

Universal Integration Platform: Enabling Extensibility and Interoperability Do-it-yourself extensibility and interoperability for future automation needs Self-service Schedulers Automation Control

18 Universal Integration Platform: Enabling Extensibility and Interoperability Do-it-yourself extensibility and interoperability for future automation needs Self-service Schedulers Automation Control Universal Automation Center (UAC) REST API / CLI Controller Extensions Universal s Control Applications + Services Containers Cloud Infrastructure Upstream Systems Language Bindings OMS 1 (+HA) Automation (any API / CLI) Downstream Systems System state Logging data Events Data N s UCMD UDM SAP UAG Custom Agents Data System state Logging data Events Data Conversion Toolkit Data Data Automation as Code External Version Control Stonebranch All rights reserved. 6. October 2017 Seite 18

19 Status 10/2017 and Outlook Status 2017: SOA Connector Refresh Web Service (UController) RESTful API (UController) Universal (UController) Outlook: Custom agent Controller extensions REST APIs revised: JSON Automation as Code Git integration UC UA Marketplace Stonebranch All rights reserved. 6. October 2017 Seite 19

20 Custom Agents: Liberating Distributed Control and Visibility Multi-architecture integration: UCMD vs. OMS Control Automation Client, Monitor and Trigger Types Controller Extensions Controller Extensions: Implement new functionality in L/Unix Win z/os PPS SAP UDM File Mon Mon Mon Universal s Universal s: Form-based automation against any CLI or Web Service OMS Use custom variables and functions to interact with Custom Agent functionality UAgent UBroker Universal Broker UCMD Mgr UCMD UDM USAP USOA UEM UFTP UPPS UAG OMS Custom Agents Custom Agents: Implement custom functionality against external protocols and interfaces Any External API Stonebranch All rights reserved. 6. October 2017 Seite 20

21 Custom UCMD Script Extensions Available today Any Scheduler UCMD Mgr. Port 7887/tcp UBroker: Manages lifecycle of different UAgent modules Universal Broker IPC / socket UCMD CLI (short-running commands) Custom script (Python or other): Executes custom logic, using wide array of available Python modules Custom py script Python Runtime Custom Any API Control Script Extensions to access sychronous APIs. Stonebranch All rights reserved. 6. October 2017 Seite 21

22 Custom UCMD Extension Agent Full UBroker support; Embedded Python Runtime; Similar to SAP, FTP and Peoplesoft Connectors Any Scheduler UBroker: Manages lifecycle of different UAgent modules, incl. Custom Agent Module Custom Agent Implementation: Executes custom functionality, using wide array of available Python modules UCMD Mgr. Port 7887/tcp Universal Broker IPC / sockets UCMD CLI Custom Agent (py script) Python/C Runtime + CLI Library Custom Agent Interface Custom Any API Custom Agent Interface: Translates between Custom Agent and CLI, includes Python runtime; configured via UBroker (short-running commands) Control Custom Agents add UBroker configuration, preserve state, load modules, custom authentication, etc. Stonebranch All rights reserved. 6. October 2017 Seite 22

23 Custom OMS Extension Agent Full UBroker support; Embedded Python Runtime; Similar to new Peoplesoft Messaging Connector Java UController Extensions: Implement logic to translate OMS messages into variables and functions used in Universal UC Extensions Universal s Universal s v2: Use custom variables and functions to interact with Custom Agent functionality UBroker: Manages lifecycle of different UAgent modules, incl. OMS Universal Broker IPC / sockets Port 7878 /tcp OMS Port 7878 /tcp Custom Agent Implementation: Executes custom functionality against external protocols and interfaces, using wide array of available Python modules, exchanging messages on OMS Custom Agent (py script) Python/C Runtime + Libraries Custom Agent Interface Custom Any API Custom Agent Interface: Translates between Custom Agent and CLI + OMS, includes Python runtime, configured via UBroker Control Custom OMS Agents add messaging to UController (monitoring etc.), allow complex API interaction. Credentials, keys, settings can be configured from UController. Stonebranch All rights reserved. 6. October 2017 Seite 23

24 Custom Hybrid Extension Agent UAG and OMS integration; Maximum Flexibility Java UController Extensions: Implement logic to translate OMS messages into variables and functions used in Universal UC Extensions Universal s Universal s v2: Use custom variables and functions to interact with Custom Agent functionality UBroker: Manages lifecycle of different UAgent modules, incl. OMS Universal Broker IPC / sockets Port 7878 /tcp OMS UAG Port 7878 /tcp CLI Custom Agent Implementation: Executes custom functionality, using wide array of available Python modules, able to handle the CLI and to exchange messages on OMS Custom Agent (py script) Python/C Runtime + Libraries Custom Agent Interface Custom Custom Agent Interface: Translates between Custom Agent and CLI + OMS Any API Control Custom Hybrid Agents add allow access from UAG and OMS, allow complex API interaction. Credentials, keys, settings can be configured from UController. Stonebranch All rights reserved. 6. October 2017 Seite 24

25 Custom Hybrid Extension Agent CLI can be reused for UCMD Java UController Extensions: Implement logic to translate OMS messages into variables and functions used in Universal UC Extensions Universal s Universal s v2: Use custom variables and functions to interact with Custom Agent functionality Any Scheduler UBroker: Manages lifecycle of different UAgent modules, incl. OMS IPC / sockets Port 7878 /tcp OMS Port 7878 /tcp Custom Agent Implementation: Executes custom functionality, using wide array of available Python modules, able to handle the CLI and to exchange messages on OMS Custom Agent (py script) Custom Any API UCMD Mgr. Port 7887/tcp Universal Broker UAG CLI Python/C Runtime + Libraries Custom Agent Interface Custom Agent Interface: Translates between Custom Agent and CLI + OMS CLI UCMD Control Custom UCMD and UAG Ext. Agents share one implementation. Stonebranch All rights reserved. 6. October 2017 Seite 25

Custom Agent Summary: Empowering You the customers Any Scheduler UC Extensions Universal s OMS Benefits: For customers: From quick adaptations to One-off complex integrations (beyond scripting) For

26 Custom Agent Summary: Empowering You the customers Any Scheduler UC Extensions Universal s OMS Benefits: For customers: From quick adaptations to One-off complex integrations (beyond scripting) For Stonebranch: Faster time to market for standard application integration SB Dev Team can focus on where it provides unique value: Improving the Core OMS Custom Agent (py script) Custom Any API UCMD Mgr. UCMD/UDM UBr Python/C Runtime + Libraries CLI Custom Agent Interface Control One Custom Agent for all architectures. Stonebranch All rights reserved. 6. October 2017 Seite 26

27 Agenda Stonebranch Architecture: Motivation and overview : Status and Outlook Universal Integration Platform: Status and Outlook 04 Conclusion Stonebranch All rights reserved. 6. October 2017 Seite 27

28 Conclusion Any Client is key to support Stonebranch s integration architecture: Any client, any scheduler, any API. Interoperability and Openness goals: Anyone can extend Agent functionality, and this will be become simpler and more powerful. will improve central management of s and define custom integrations. Any API Any Scheduler s Any API Stonebranch All rights reserved. 6. October 2017 Seite 28

29 Thank you! Contact Information Dr. Gregor Heinrich Chief Product Architect Stonebranch GmbH Siemensstr Bad Homburg v. d. Höhe T: M:

Dell IT Proven: Cloud Native Applications at Your Service

Dell IT Proven: Cloud Native Applications at Your Service Raj Markala, Sr. Manager, Cloud Platforms, Dell IT Ian Cheasty, Principle Developer, Dell IT Agenda 1 Cloud Native Agenda 2 Pivotal Cloud Foundry