Operational Insight for MDM

Transcription

1 Operational Insight for MDM Introducing the MDM Hub Analyzer Presented By: Hosted By: Jeff Klagenberg VP, Products & Solutions; GlobalSoft.

2 Webinar Agenda Introduction to GlobalSoft Challenges for Operational Reporting for MDM Overview of Key Metrics Hub Analyzer Introduction and Demo Q&A 2

3 About GlobalSoft Vendor-focused! Integration & data management 15+ years Range of Services! Project delivery! Training (development & delivery)! Engineering! Support Informatica Partner! 5+ years with Siperian! MDM. and more! Architects & Product Spec.! Training partner Solutions Program! Product & Service Offerings! Complementary to vendor products Locations! San Jose! London! Bangalore 3

4 Operational MDM MDM Hub is an Essential Operational Repository! Connecting many data sources! A repository for critical business applications! Integrated with data warehouses! Any data or performance issues affect many systems! Issues detected system wide Cause could be in integrated systems or in the hub MDM has a Distributed / 3 Tier Architecture! Performance characteristics can be affected by any tier! Tier issues could be software or hardware related 4

5 Typical MDM Deployments Underlying Infrastructure Application Server(s) Database Server(s) Storage Client Desktops 6

6 Typical MDM Deployments MDM Software Real-Time APIs Security Enforcement Data Matching Data Cleansing Application Server(s) Batch Data Processing Data Merging History Retention Database Server(s) Storage Client Desktops Data Stewardship 7

7 Typical MDM Deployments Complete System Data sources `` MDM Hub Fully integrated Applications End Users Data Warehouses 8

8 Typical MDM Deployments Issues ssues Can Occur Anywhere in the System Data sources MDM Hub ``` Data Warehouses 9 Fully integrated Applications End Users

9 Operational MDM Needed Insight Need to Monitor and Understand the State of the Hub! Is the data throughput high enough?! Are SLAs being met?! How effective are the match rules?! Is data growing within planned capacity? Quickly Isolate Hub versus System Wide Issues And If there are Issues, Where Should Analysis Focus! Isolate quickly to appropriate layer! How does system IO look?! What specific process are effected?! Which match rules are most productive? 10

10 Understanding Some Key Metrics Throughput! The volume of data passed per unit time by key MDM processes! Key measurement for data movement and transformation! Need baseline measurements to detect changes Match Productivity! Number of matches detected by a rule! Number of matches ending in a merge (unless un merged later) Clock Time vs. Processing Time (for SLAs)! Clock time refers to time of workday needed to complete a task! Processing varies depending on number of processors / threads! Service levels typically measured in Clock Time 11

11 Hub Analyzer Intro Issues are detected within the overall system Hub Analyzer gives ability to isolate issues Presents KPIs grouped in dashboard formats Stand alone web app or as IDD tab 12

12 Operational Insight key areas Managing a Hub Environment Requires Key Insights! Understand throughput over time Isolate bottlenecks if / where they exist! See if system is keeping within SLAs Understand on average how system is doing See if there are day of week issues! Understand match productivity See if there are reasons to review / update match rules Determine if auto / manual rule settings should be changed! See system growth over time Predict when system should be allocated more capacity 13

13 Hub Analyzer Architecture Hub Store / ORSs Hub Analyzer Data Aggregators Scheduler DB Server Data Collectors Data Visualization Security Data Retention Policy MDM Hub Server Analyzer IDD Console Analyzer Web Console Analyzer Store Fact Tables Aggregate Tables 14

14 Deployment Options Shared Server Fewer servers Application Server Application Server 1 Separate Server Increased availability Lower load Application Server 2 MDM Server MDM Server Analyzer Server Analyzer Server Database Server Database Server ORS Schemas ORS Schemas Analyzer Schema Analyzer Schema 15

15 Throughput Dashboard Quickly see if slow throughput is an issue and if so determine which operations are affected. This dashboard also includes graphs of key system IO metrics to see if throughput is isolated to MDM functions or related to system wide issue. Included KPIs Records Loaded per second Matches per second Database IO Records Cleansed per second Merges per second File system IO Records Tokenized per second Slowest Jobs by job type Average rate Load & Merge 16

16 SLA Dashboard Determine if hub processing has exceeded windows. Shows average processing time per each day of the week to quickly determine if there is a dependency on a specific process. Processing times are shown by each operation type allowing the operations team to quickly focus on the area of most benefit. Included KPIs Daily System Usage Processing Time by Day of Week Long Running Jobs 17

17 Match and Data Quality Dashboard Understanding the productiveness and success of data matching is very valuable to ongoing MDM Hub operations. This dashboard will allow operators to see which match rules to modify, potentially drop or change their auto / manual merge status. Included KPIs Match count per match rule Unmerge count per match rule Rejected Record Count Manual matches merged count Validated Address Count 18

18 Data Capacity Dashboard During the lifetime of the hub projecting data growth is essential to keeping the system sized correctly. This dashboard shows how the system is growing and gives provides insight about any unanticipated changes in growth, which can be further reviewed. Included KPIs Consolidated Object count by object and state Cross Reference count by object and state History Record Count Table space Used over time 19

19 Possible Analyzer Customization Options As a service offering other capabilities that can be added! Business services data collection and reporting! Monitoring system integration Custom JMX / SNMP traps! Other Custom data collection Include stats from data cleansing Include stats from data transport! Custom KPIs Add KPIs from existing data 20

20 MDM Hub Analyzer Demo 21

21 Availability Inquire about beta / trial availability solutions@globalss.com Product GA April / May

22 Find us on Informatica Marketplace Informatica Marketplace! 500 Apps.! 15,000 monthly visitors.! 2,000 downloads every month. Have you been to the Informatica Marketplace yet? With everything you need to augment, extend, and enhance your Informatica investment, the Marketplace is your one-stop shop for innovative solutions that improve productivity, speed time to implementation, and lower total cost of ownership. Visit and get started today! For more details, write to 23

23 GlobalSoft Solutions GlobalSoft Enterprise Apps! Plugin Products extending Informatica Products! Data Augmentation Adapters Available Today Add third party data into the MDM Hub! MDM Hub Analyzer Available April Give MDM customers insight into Hub Operations! MDM Business Services Manager Available TBD Quickly deploy and maintain course grained services for the SIF GlobalSoft Services! Independent MDM Performance Assessment When a neutral party is desired to assess MDM performance 24

24 GlobalSoft - Data Enrichment Adapters Native interface into MDM Cleanse Mapping! Bring data in from 3 rd party web service into the MDM Hub! Support WSDL of REST based web services! Allows the creation of associated IDD tasks! Appropriate for real-time or daily batch processing! Customer live on D&B adapter Future Development Plans! Extending to Informatica Platform 25

25 Q & A Contact details! Speaker jeff.klagenberg@globalss.com! GlobalSoft, Inc. info@globalss.com Solution / product inquiries solutions@globalss.com 26