Extensible Message Processing Solutions using IBM Software July 2013 Hursley

Transcription

1 Applied Messaging Solutions Extensible Message Processing Solutions using IBM Software July 2013 Hursley Richard Whyte CEng,CITP,FBCS,FIET CTO and Principal Architect Software Services UKI 2013 IBM Corporation

2 Message processing In the Cloud Introduction Traditional brokerage New use-cases Clearing in the cloud Introducing Payment Scheme Clearing Specialised nodes deployed to a private cloud Dedicated context sensitive IT console Business and Technology Opportunities IIB can be used to create disruptive applications 2 July 12

3 IBM Integration Bus as a foundation for SOA IIB is positioned as a highly capable service bus mediates between parties. Stateless deployment to perform generic tasks Traditionally considered to do Integration not application serving. 3 July 12

4 IIB is also positioned as an integration Hub Deployed to connect systems mediates between parties. Stateless deployment to perform generic tasks Avoid becoming a system No business logic No storage of information Avoid direct connect to Systems of Record 4 July 12

5 IIB can be deployed as an application foundation Important not to build applications into the Service Bus This is an architectural construct that does not do business logic Deploy a new instance Specific to the need Focus on request/response capabilities 5 July 12

6 Any Questions? 6 July 12

7 Any Questions? Why not combine IIB with virtualisation Build a virtual image WMQ/IIB clone it to scale. Use WMQ clustering to load balance route around failure Use case examples are: Insurance quotes Money laundering fraud detection Payments processing 7 July 12

8 Message processing In the Cloud Introduction Traditional brokerage New use-cases Clearing in the cloud Introducing Payment Scheme Clearing Specialised nodes deployed to a private cloud Dedicated context sensitive IT console Business and Technology Opportunities IIB can be used to create disruptive applications 8 July 12

9 Introducing Payment Scheme Clearing To make it interesting (in the UK there are:) Over 1,000,000 merchants, 20 card schemes, and several hundred issuers. Around 70m card transactions each day (various types) Card transactions peak at over 5,000 transactions per second 9 July 12

10 Client business imperatives Perform high speed clearing operations fast and efficiently Market is cost sensitive; reduce cost per transaction Maintain reputation for quality of service at lower cost Preferred platform is VMware on commodity hardware Platform must be safely adapted to support evolving business Business relies on being reliable and efficient Current system is difficult and time consuming to change Lacks transparency for fees and other sensitive calculations Deliver price performance without future compromise Extensible and Scalable; predictable cost and technology impact Peak throughput 5,000tps but expected to increase Platform protects itself from failure and human error [1] 10 July 12

11 Payment Scheme Clearing what s the problem? Scheme Clearing ingests authorisations and payments [1], enriches the information, matches authorisations to payments, calculates fees, and formats payments for acceptance by card schemes [2]. Information from schemes [3] is sent to the enterprise [4]. 11 July 12

12 Design rationale Batch orientation creates peaks in demand Focuses load on a few components. The virtual environment lends itself to parallel processing Product based separation of concerns causes bottlenecks For example database server, rules server Build a solution with no short-cuts but no points of contention Network of peers allows work to be processed anywhere Load balancing anomalies cause bottlenecks Differences in work effort per item cause bottlenecks Queuing technology smoothes peaks and buffers anomalies 12 July 12

13 Building the cloud Design a solution that can be deployed as a single node. Components with identifiable actions in processing work are deployed as roles. Work can be directed to the first role and processed to completion on one node. Add nodes to add resilience and capacity 13 July 12

14 Key technical elements Connections to enterprise Secure connections via F5 switches to Sterling File Gateway SSL connections to database (warehouse and reference data) F5 balances across all available instances of each ingest ROLE Security External connections require certificates WebSphere MQ cluster marks the PLATFORM boundary Queue managers can only attach using a PLATFORM certificate Payments independently routed Filter to analytics and extended processing tasks Prioritise higher value customers Horizontally scale 14 July 12

15 Provide a console to protect the platform Present platform as specialised cloud Abstract away from the technology Proxy the cloud for monitoring and management CONSOLE UI CONSOLE (Server) FDNNODE NODEMGR CONSOLE (Server) FDNNODE NODEMG R NODEMGR FDNNODE Other ROLES NODEMGR FDNNODE Other ROLES BOOTMGR BOOTMGR_ROLE BOOTMGR_ROLE Embed intelligence into console to protect the platform. BOOTMGR_ROLE Console displays state of platform and allows interaction on the same pane. 15 July 12

16 Payment Scheme Clearing In the Cloud Introduction Introducing Payment Scheme Clearing Business imperatives for the client Platform constraints and imperatives Clearing in the cloud Specialised nodes deployed to a private cloud Dedicated context sensitive IT console Business and Technology Opportunities IIB can be used to create disruptive applications 16 July 12

17 The approach is disruptive: Creates Business Opportunities Real-time payment settlement engine Sees authorisations as they are made and payments as submitted cheaper to operate than batch higher margins/reduced fees Higher possibility of same-day settlement to scheme lower fees Extensible to add new capabilities Analytics to create value to customers Extend fraud capabilities to reduce losses and fees Add E-wallet capabilities to create important new customers Low cost of purchase, build, and operation Running costs expected to be predictable and lower than previously Commodity hardware can scale up and down and used elsewhere Used for other systems when not required 17 July 12

18 Questions? Key technologies WebSphere MQ: Connectivity between NODES, load balancing, fault tolerance, workload prioritisation, and connection security. MQ cluster marks boundary. WebSphere Message Broker: Application runtime environment hosting Jrules and project defined ROLES as well as Sterling File connections WebSphere Jrules: Business rules used for validation and fee calculations IBM SolidDB: Fast in-memory database hosts reference data and other data on each node. Dedicated gateway connects to the enterprise data sources 18 July 12

19 Any Questions? Thank you. 19 July 12

20 Richard Whyte Richard is the Chief Technology Officer (CTO) and principal architect for IBM Software Group Services for WebSphere. He is known for his Applied messaging solutions ; using IBM messaging technology to deliver first of a kind solutions to customers across many industries. Classic examples include the Lloyds TSB Straight through processing (2002), BBC Digital fabric (2005), Bank Of America WW Business Activity Monitoring Platform (2010), and WorldPay payments scheme clearing platform (2013); all are first of a kind solutions that extend the value customers get from IBM products and drive product innovation - keeping them vital and relevant. He is a Chartered Engineer and Fellow of the Institute of Engineering and Technology as well as Chartered IT professional and Fellow of the British Computer Society. Applied Messaging Solutions

21 References Human error [1] BMJ March 18; 320(7237): PMCID: PMC Human error: models and management James Reason, professor of psychology [2] Human Factors and Operator Errors P. L. Clemens February nd Edition [3] Aaron B. Brown, IBM Research, Communications of the ACM, Coping with human error in IT systems, [4] Focus Research (Oct 2010) CA Technologies, Devastating Downtime: The Surprising Cost of Human Error and Unforeseen Events [5] Figures quoted are supplied by the National Office for Statistics and relate to projected spend during the period January December [6] Channel 4 News, [7] Tech Week Europe, RBS, NatWest Failure Blamed On Human Error. RBS cancells Wimbledon jolly and may sue CA, while Mervyn King promises an inquiry into the banking disaster, IBM Software IBM soliddb product Information Center (v7.0), SolidDB Redbook: Tim Dunn et-al (2012), WebSphere Message Broker V8 for Linux 64-bit on xseries performance report, IBM WebSphere MessageBroker Information Center: home_msgbroker.htm WebSphere MQ Fundamentals (Redbook): WebSphere MQ Information Center: