The Reality of Real-Time

Transcription

1 The Reality of Real-Time The "what, why, and how of accessing and using real-time data from your enterprise systems. Moving the Needle 2014 Thursday, Nov. 6 th - 9:40 am Brian Parish CEO and Founder, IData

2 The primary takeaway from this presentation? Your Goal is A Clear Path from Question to Answer. How does real-time data fit in this path?

3 Agenda The Reality of Real-time

4 Agenda The Reality of Real-time When? When is real-time? What do we mean by real-time data? Why? Understanding your business needs/questions What? Understanding what data you need How? Architecture and Connectivity options for real time. So? Getting people to use and trust the data Who? How IData can help you on the path.

5 Introductions

6 About the IData Presenters Brian S. Parish: President, IData Inc. 19 years in Higher Ed Tech Worked with well over 150 schools on technology and reporting projects

7 About IData Incorporated Higher Education Data Management Started in 2004 Based in Alexandria, VA Technology Services Reporting and Data Governance System Integration Custom Application Development Implementation and Migration Services Innovative Software

8 IData Products Web services integration platform for building connectors to higher education ERP systems Collaborative data dictionary and data management tool for higher education

9 Who is here? From an IT office? From an IR office? From a functional office? From a vendor? Other?

10 When? WHAT DO WE MEAN BY REAL-TIME?

11 When is real-time? Some Definitions first: What is Real-time data? What is near real-time data? What is snap-shot data? What is Longitudinal data? Do people sometimes mean Automated? real-time

12 Why? UNDERSTANDING YOUR BUSINESS NEEDS/QUESTIONS

13 Why? There are compelling business reasons for realtime. Are these needs well understood. Thought All data request should be a conversation that start with the business need or the question being asked.

14 Why? Examples of real-time data requirements?

15 Why? Think critically about the need. Some solutions will require real-time data Some will not (even though it was asked for) Some can be solved by looking at different architecture options More on this later.

16 What? UNDERSTANDING WHAT DATA YOU NEED

17 Data Management Practices? Data Governance Group Data Dictionary Data request process Report Specification templates or tools IR and IT collaboration BI Group Report/Data documentation or transparency Trust?

18 What? The key is good data definitions Your functional definitions (business rules) Your technical definitions (data systems) Multiple technical definitions for different data sources (real-time vs warehouse) Understand and document both as part of any reporting project.

19 Observation: Reporting is Hard. Institutions continue to struggle with reporting. Some schools are successful with a wide range of reporting tools. Many schools have been unsuccessful with the same tools.

20 Conclusion:

21 How? ARCHITECTURE AND CONNECTIVITY OPTIONS FOR REAL TIME.

22 Reporting Architecture

23 Reporting Environment? Data Warehouse? Homegrown Commercial (COTS) Operational Data Store? Transactional Reporting tools? Census Data Extracts Aggregate reporting (combining systems) Standard ETL Tools?

24 Direct Reporting vs Warehousing Real-time reporting is simple if you are primarily reporting directly from the production transactional system. Things get more complicated for real-time if you are primarily reporting out of a data warehouse Hybrid approaches can work. Real-time ETL can also work

25 5 architecture approaches Direct to Transaction reporting Direct to warehouse with scheduled ETL Direct to warehouse with real-time (triggered) ETL Reporting that connects to both warehouse and transactional system Separate tools for real-time and warehouse reporting

26 Architecture Options Direct to Transaction reporting Transactional Systems

27 Architecture Options Direct to warehouse with scheduled ETL Transactional Systems Data Warehouse

28 Architecture Options Direct to warehouse with real-time (triggered) ETL Transactional Systems Data Warehouse

29 Architecture Options Reporting that connects to both warehouse and transactional system Transactional Systems Data Warehouse

30 Architecture Options Separate tools for real-time and warehouse reporting Transactional Systems Data Warehouse

31 Actually connecting to the systems ETL Tools Native Tools Third Party Tools Direct Database connections ODBC/Queries Web Services InBound or Outbound Master Data Management tools

32 Data Systems REAL-TIME CONNECTIVITY OPTIONS

33 Systems? ERP/SIS Ellucian Banner Oracle/PeopleSoft Campus Solutions Ellucian Colleague Jenzabar (EX, CX) Campus Vue Ellucian Power Campus Homegrown Others Any Plans for Workday?

34 Ellucian Banner Modules: Student Finance HR Alumni Development Mobile Banner Mobile Connect Banner delivered a customizable package Languages/Tech: Anything that compiles in Oracle No specific toolkit New UI being developed in Groovy Portal Luminus based on UPortal Hosting or SaaS? Database/OS: Oracle Unix Reporting Banner ODS, Banner EDW (Enterprise Data Warehouse), Partner with IBM Cognos and evisions Argos for reporting tools Hosting available Integration Most integration is done through Oracle New Ellucian XE Framework for WS

35 Ellucian Colleague Modules: Student Finance HR Advancement Mobile Partnership with DubLabs to implement MOX mobile app Languages/Tech: Proprietary Envision toolkit Colleague Studio Portal Provides portal support based on SharePoint Hosting or SaaS? Database/OS: Unidata, SQL Server, Oracle Unix, Linux, Windows Reporting BusinessObjects Bb Analytics for warehouse ODS Hosting Available Integration Import/export batch files using ELF A few APIs through Sharepoint

36 PeopleSoft Campus Solutions Modules: Student HR Finance Alumni (Contributor Relations) Mobile No standard May partner with DubLabs AT&T offering Languages/Tech: PeopleTools Portal Oracle Enterprise Portal Hosting or SaaS? No Database/OS: Oracle, SQL Server Unix, Linux, Windows Reporting Integration PeopleSoft Campus solutions warehouse BbAnalytics Oracle Discoverer Integration Broker SQR imports/exports SAIP

37 CampusVue Student Modules: Student Finance HR-use Talisma for fundraising Languages/Tech: Built on.net platform CampusVue forms Mobile Portal Talisma CRM for sending notices and alerts to mobile devices SharePoint- CampusVue portal Hosting or SaaS? Database/OS: SQL Server Windows Reporting CampusVue Performance Analytics for warehouse CampusVue Reporting Services with Crystal Reports SSRS Yes Integration CampusLink

38 Jenzabar EX Modules: Student Finance HR Alumni Development PowerFAIDS Mobile JICS Go-browser based Languages/Tech: PowerBuilder C++, C# Portal.net Portal-JICS Hosting or SaaS? Yes Database/OS: SQL Server WIndows Reporting Integration Reporting through SSRS Provides data access using SSIS

39 Ellucian Power Campus Modules: Student Finance-Microsoft Dynamics HR-Microsoft Dynamics Financial Aid- PowerFAIDS Advancement Mobile No standard mobile option Languages/Tech: Visual Basic Visual Studio Portal SharePoint Database/OS: SQL Server Windows Reporting Microsoft reporting tools Hosting or SaaS? No Integration Provides data access using SSIS

40 Unit 4-Agresso Modules: Mobile Student Finance HR Financial Aid- PowerFAIDS Provide reporting apps Languages/Tech: Web-based architecture using.net framework, supports XMLbased data sharing Portal No standard portal offering Hosting or SaaS? Database/OS: SQL Server, Oracle Windows, Linux, Unix Reporting Agresso Reporting and Analytic tools Yes Integration Can be integrated with third-party systems at basic level, CSV, or XML

41 WorkDay Modules: HR Finance Mobile Mobile apps for IPad, IPhone and Blackberry Languages/Tech: Java-based WorkDay business process framework for workflow Portal No standard portal offering Hosting or SaaS? Database/OS: MySQL Linux Reporting Built-in BI WorkDay Actionable Analytics Fully SaaS Integration WorkDay integration Cloud to integrate other systems to WorkDay

42 Three Rivers CAMS Modules: Student Finance-Microsoft Dynamics HR-Microsoft Dynamics Languages/Tech: Built using Microsoft technology and tools Mobile Portal CAMS Student Mobile Portal Microsoft technology Hosting or SaaS? Yes Database/OS: SQL Server Windows Reporting Integration Provides the BYOR (Build Your Own Reports) No clear integration strategy

43 TopSchool Modules: Student Financials Mobile No standard mobile options Languages/Tech: Microsoft tools for development.net framework SharePoint Portal SharePoint Hosting or SaaS? Database/OS: SQL Server All browserbased, possibly Internet Explorer Reporting Microsoft Reporting Services Yes Integration TopX set of web services that include APIs for customers to build their own integrations

44 Kuali Modules: Languages/Tech: Hosting or SaaS? Yes Finance Student HR Java-based Eclipse Workbench Database/OS: Google Web toolkit UPortal for UI Databaseindependent, primarily MySQL Linux, Unix, Windows Mobile Portal Reporting Integration Kuali Mobiliity Enterprise No standard offering currently Will be based on Uportal or Google widget Cognos Kuali Ricemiddleware component

45 Jenzabar JX Modules: FrontRunner Advancement Mobile GWT optimized for different browsers Languages/Tech: Google Widget Toolkit Java Portal Hosting or SaaS? Database/OS: Database independent OS dependent on database option Reporting Cognos Not yet Integration

46 Client Counts (SIS) System Total FTE Total Campuses Banner 7M 1444 Colleague 3.2M 792 PeopleSoft 4.5M 875 CampusVue 276K 473 Jenzabar EX 352K 258 Jenzabar CX 281K 125 PowerCAMPUS 165K 116 Agresso 7K 4 WorkDay - - Three Rivers 132K 89 Top School 2K 3 Kuali 41K 5 Jenzabar JX - - SunGard Matrix 113K 120

47 So? GETTING PEOPLE TO USE AND TRUST THE DATA

48 Simple illustration of Reporting Process Data Request and Requirements Gathering Report Development Report Consumption

49 Simple illustration of Reporting Process Data Request and Requirements Gathering Report Development Report Consumption What happens here?

50 The Reaction Where the hell did these numbers come from?

51 Root causes of lack of trust Inconsistent numbers Dueling Data Lack of understanding of data definitions Lack of involvement in decision making Previous failed projects Perceived (or real) data quality issues No transparency in to the data rules Personal conflict

52 9 Steps for Building Trust and Adoption 1. Ask more questions Data requests should be a conversation 2. Place importance on the purpose of each report. Ask Why not What 3. Train in the Data more than the Tool

53 9 Steps for Building Trust and Adoption 4. Start documenting your own reports Be very specific in defining reporting terms Document for the functional and technical user 5. Create an institutional knowledge base Knowledge is developed one question at a time. It is happening now at your institution. Are you capturing it? 6. Establish and empower Data Stewards

54 9 Steps for Building Trust and Adoption 7. Create a report request/change process with a standard for report specifications Include the data stewards in this process 8. Make your knowledge base easily shared and accessible: Liberate the knowledge 9. Link your delivered reports to the knowledge base.

55 Who? HOW IDATA CAN HELP YOU ON THE PATH.

56 IData Products Web services integration platform for building connectors to higher education ERP systems Collaborative data dictionary and data management tool for higher education

57 The Data Cookbook

58 What is the Data Cookbook?

59 What is the Data Cookbook? DataCookbook.com is an online and collaborative data management tool for higher education

60 What is the Data Cookbook? It combines a good reporting process with a governed knowledge base

61 Data Cookbook Features Features include: Data Dictionary Report Specifications/Documentation Report Request/Change Workflow Data Governance Workflow Community for collaboration with other institutions, vendors, and agencies

62 The IDataHub

63 ERP Integration an illustration Current Institution Architecture With the IDataHub

64 High-Level Architecture School Servers Web Services or Batch IDataHub ERP Connectors

65 Data Providers and Consumers Third Party Software External Agencies Mobile devices Other external systems IDataHub Institution Admin Site Administer transactions View logs View/Edit configuration Create/Edit Procedures & tasks The Cloud Transaction Web services and/or Batch Files Admin web services Service Oriented Front-End Architecture (SOFEA) Institution Network Institution Firewall Admin System Connectors Procedures/Tasks Scheduling Logging System Connections Administrative Systems ERP (Datatel, Banner, etc.) LMS (Bb, Moodle, etc.) Other internal Systems Standard API Custom API Application Database

66 Admin UI

67 IData Services

68 IData Services Reporting and Data Governance Data management assessments and workshops Building data governance organizational structures Implementing data management and reporting processes Reporting and data warehouse development (agile iterations and project-based) Report migrations (moving to new reporting systems) Requirements and design for reporting and data analysis projects Implementation and training for the Data Cookbook (IData s data management tool)

69 IData Services System Integration Services Develop custom web services Streamline batch processing Automate and monitor data integrations Standardize system integration API s Agile Technical Staffing Developer/Analysts Project Managers Strategic Consulting

70 Find Out More Brian Parish

71 Wrap Up

72

73 Revisiting the Presentation Goals

74 Final Thought Understand how to access real-time data when you need it. However Real-time data is only one potential method to a useful answer.

75 Discussion

76 Thank You VISIT OR FOR MORE INFORMATION