Information Builders Enterprise Information Management Solution Transforming data into business value Fateh NAILI Enterprise Solutions Manager

Size: px
Start display at page:

Download "Information Builders Enterprise Information Management Solution Transforming data into business value Fateh NAILI Enterprise Solutions Manager"

Transcription

1 Information Builders Enterprise Information Management Solution Transforming data into business value Fateh NAILI Enterprise Solutions Manager June 20 th,

2 Agenda Introduction Information Builders Solutions Data Integration Data Quality Master Data Management Roadmap Summary

3 Introduction

4 Enterprise Information Management What do we do? We do Enterprise Information Management! Information Builders helps align, link and leverage people, processes and technology around information assets across the enterprise.

5 A complete platform How do we do it? Intelligence BI Portal Embedded InfoApps Mobile Hot Social Bad Feedback Predictive Analytics Sentiment and Word Analytics Search Performance Management Natural Language/ Narrative BI Write-Back High-Performance Data Store Data Discovery Reporting Dashboards Location Analytics Casting and Archiving In-Document Analytics Integrity Data Quality Data Governance Master Data Management Integration Batch ETL Real-Time ESB Hadoop-Based Legacy Systems Applications Relational/Cubes Big Data IoT Columnar/In Memory Unstructured Social Media Web Services Trading Partners

6 An optimal implementation approach Data Distribution Analyse Propagate Communicate Data Mastering Match Merge Build Data Governance Data Quality Standardise Enrich Improve Manage Control Share Data Analysis Data Integration Explore Profile Connect Orchestrate Know Get

7 Data Integration

8 iway Data Integration Solution Introduction Unique and powerful Integration Platform Real time and Batch Processing Compose, Orchestrate and Automate complex integration processes Drag and drop interface for pre-built components Expose processes as reusable Services (Web Service, REST ) 300+ Pre-Built Integration Adapters Bi-directional Data, Application, Industry, etc Use any messaging infrastructure

9 iway Data Integration Solution Key Features Backbone for all data processing Data Quality, Master Data Management, Data Governance, WebFOCUS can all be stacked on top of this real-time data engine for complete data access. Native XML and JSON processing Automatically transform A2A and B2B messages (IoT) Complete end-to-end security authentication, authorization, encryption Full API support Generate and consume API/REST Cloud and on-premise

10 iway Data Integration Solution Tools and components BI Application BPM Application Web Service Application Application Server iway Operational Tools iway Web Console IWay BAM IWay Sentinel Operational Time Event Driven Real Time Processing SWIFT Adapter iway Service Manager MySAP Adapter iway Process Flows Oracle Adapter Web Service Routing Transform Security XA iway Adapter Framework Run Time CICS Adapter. iway Integration Tools iway Service Designer IWay Service Transformer iway Application Explorer Design Time Applications, ERP, CRM, Mainframe Data, Applications and Transactions Databases, Data Warehouse, Files, Excel CSV, XML SWIFT, HIPAA, EDI Formats iway Repositories

11 iway Data Integration Solution Activity Monitoring Enhance iway Data Integration Solution by monitoring complete components Provide improved activity visibility Provide detailed message Auditing Provide Alerting Allow user definition metrics Dashboards, Reports Message Resubmission Manual Reprocess! Persist monitored activities and events in database

12 Data Quality

13 Omni-Gen DQ Edition Introduction Standalone solution designed to optimize the integrity of information throughout the enterprise Packaged with comprehensive, fully customizable business rules and a portfolio of libraries Collaboration Well defined implementation approach DQ Profiling DQ Rules DQ Monitoring

14 Data Quality Profiling Analyze the quality of the data Data profiling shows the presence of errors with Metrics Information Profiling Features include Patterns/Masking Custom Business Rules Extremes Quantities Frequency Analysis Foreign Key Analysis Localization Charting Grouping/Aggregate Drilldown/Interactive Displays Most organizations say data quality issues are detected when reported by employees, customers or prospects. Fewer than 50% of companies conduct proactive data audits to discover data quality issues.

15 Data Quality Rules Implement Data Quality rules Data Cleansing and Standardization Data Enrichment Data Scoring Internal/external reference data Matching / Merging Probabilistic and Deterministic Levenshtein distance Golden record John Smith y=f x Id column for Names Alter Format Remove titles Strip Titles Parse Names Guess Name Surname Prepare out values Column Assigner Remove columns Alter Format

16 Data Quality Monitoring Analyze data overtime Advanced Profiling Custom analysis of data Defined by user and relevant to data context Multiple fields can be considered, e.g. Address lines Complex computation may be required Output is Binary (true/false) Data Quality Indicators

17 Data Quality Remediation Manual correction Operational Dashboard for Data Stewards and Data Supervisors to investigate and correct data Provide an ability to do data! Cleansing, Matching, Merging, Unlinking Improved reporting, filtering and searches Track data quality issues in real time End-to-end audit trail of all data changes Workflow interface

18 Extending Data Quality Data Quality Firewall Avoid dissemination at root (Upstream vs Downstream correction) Extend the reach of your Data Quality Initiative Create a firewall protecting your systems from bad data

19 Master Data Management

20 Why Master data Management? The road to Master Data Management Many silos of data often out-of-sync Poor data quality affecting BI and reporting Integration complexity Point-to-point integration is costly (interfaces, language ) Inevitable manual process Error-prone and inconsistency No way to audit No way to rollback changes Different people involved (Updates interpreted by systems experts) Time and resource consuming

21 What are the benefits? The road to Master Data Management Consistent and comprehensives information across the enterprise: Know your customer, Single view of citizen Support data governance and compliance requirements between cross-functional teams Consolidate and rationalize information from different systems across the enterprise to improve transactional and analytical processes Enforces data modeling, quality, policies, governance, hierarchical and standardize data across the enterprise Data of the highest quality to feed into their operational and analytical systems

22 Omni-Gen MDM Edition Product View Omni-Gen Master Data Management Edition Data Quality Edition Integration Edition Profiling Integration Cleansing Mastering

23 Omni-Gen MDM Edition Introduction Top-down approach centered on business problems Collaboration between the business and IT Simplifies data integration and mapping of source systems Pre-packaged mapping documents Automates key steps in the MDM process From data integration to Data Quality processing Facilitates the implementation of mastering templates and rules Advanced business user interfaces Master view, source and instance records for full resolution and 360 view

24 Omni-Gen MDM Edition Omni Designer Model driven and multi-domain framework to generate the various component as part of an MDM system Auto mapping DQS Plugins Workflow customization editor

25 Omni-Gen MDM Edition 360 Viewer 360⁰ view of Data Subjects. Centralised view of all attributes belonging to a mastered record. View all instance information and full history.

26 Omni-Gen MDM Edition Lifecycle Cloud-based systems Legacy assets ERP applications Business partners Cloud-based systems Downstream applications Data warehouses Business partners

27 Roadmap

28 iway Integration - Roadmap 2017 Release 7.0 SP7- Q Service Pack Release Customer Issue resolutions FTP Updates AVRO Enhancements MQ/JMS Dynamic Queues Oauth Updates Release 8.0 SP1 - Q View of the payload across process objects Basic and Advance user configuration options RAML/Swagger based channels API Management Support Inherited runtime configurations Console monitoring improvements SWIFT 2017 support HIPAA Updates Release 8.0 Q New L&F Intuitive Design Environment Support for themes and visual customization New process flow palette & new objects Action/Verb approach for process configuration Added support for RAML Native JSON support and new services DB and Queuing Services Upgrades Python/JS support as part of process flow Support for Tradacoms EDI standard

29 iway Integration Platform 8.0 Product direction Simplicity, Usability & Accessibility at all levels Automated Deployment and Optimized Maintenance All-in-one Application Projects supporting Team Work API Management & Micro-services platform

30 iway Integration Platform 8.0 Summary of New Features Design Time Re-architected iway Integration Tools provides a new Look and Feel for expedited development and enhanced user experience New Object Palette and new objects such as Console Log & Document provide quick access. More objects introduced with each update simplifying access.

31 Omni-Gen DQ Edition DQ Workbench - Profiling 31

32 Omni-Gen DQ Edition DQ Workbench Data Grid 32

33 iway Big Data Integrator 100% Run in Hadoop architecture Simplified interface Native Hadoop script generation Process mgmt. & governance Simplified easy-to-use interface to integrate in Hadoop Marshals Hadoop resources and standards Takes advantage of performance and resource negotiation Includes sophisticated process management and governance Big Data Hadoop Any distribution, Any data iway Big Data Integrator Simplified, modern, native Hadoop integration Sqoop, Flume Avro, JSON Traditional applications and data stores 1. Data Ingestion Enterprise Data Hub 2. ETL / ELT 3. Predictive Analytics - RStat 4. Business Intelligence - WebFocus 5. Low-cost storage of large data volumes 33

34 Summary

35 Summary Data Governance It s a process and it s iterative Enable the process via technology Start with Data Integration and grow into MDM Understand that requirements will change over time Know that Information Builders can help you

36 36 Thank you Fateh Naili Enterprise Solutions Manager EMEA Information Builders