Automated Data Source Creation using Tableau SDK & Rest API 24 th Oct :00 PM 1:00 PM MCCNO - L2-297

Transcription

1

2 Welcome

3 # T C 1 8 Automated Data Source Creation using Tableau SDK & Rest API 24 th Oct :00 PM 1:00 PM MCCNO - L2-297 Sham Reddy Solution Architect (BI & Data) TriNet Group Inc. Ram Mutupuru Solution Architect (BI & Data) TriNet Group Inc.

4 Agenda Introduction Background DEMO Q&A

5 About Our Industry Professional employer organizations (PEOs) provide comprehensive HR solutions to small and mid-sized businesses across the country, including payroll, benefits, HR, tax administration, and regulatory compliance assistance Through the scale of TriNet, employees of small businesses gain access to a big company employee experience, including: 401(k)plans; health, dental, life, and other insurance; a mobile app; and other benefits they might not typically receive as employees of a small company. * This information compiled from NAPEO and PEO websites to help explain what advantages a PEO brings to a business

6 Introduction - TriNet TriNet Group Inc. is a leading PEO organization supporting 16K clients with over 350K active WSE s. We are headquartered in Dublin, California. * This information compiled from NAPEO and PEO websites to help explain what advantages a PEO brings to a business

7 Legacy BI & reporting landscape Sources Data Warehouse Reporting HR Nightly batch load Finance CRM Telephony ODI Stage ODI & PL-SQL EDW Dashboards & Reports TriNet Colleagues Other Apps ITSM Apps Others Oracle DB Platform Cognos

8 Problem Statement Today s businesses are evolving fast & constantly changing. Our business demands are many in area of data & analytics. Some of the key requirements are - Data (Backend) Reporting & Collaboration (Front End) Near Real Time Slowly Changing Dimensions Rich Visualization Column Level Security Metadata Management Attribute Groups Data Level Security Enterprise Scalability Enterprise Scalability Ad hoc Reporting Report Search Global Filters & Variables Improved Query Performance Data Snapshots Faster response time (5-15 sec) Point in Time Share, Subscribe & Schedule Usage Tracking Row Level Security Time Series (YTD, MTD, QTD) Favorites User Defined Calculated fields Cross Functional Reporting Historical Trend & Audit Reporting User Personalization Ease of Use

9 Metadata Repository Presentation Layer Tableau API s Data Sources Data Sources Current Landscape Sources HR Data Warehouse Near Real Time Reporting & Analytics Customer App PDF Documents Solution meets following business needs Near Real Time Data Level Security Data (Backend) Slowly Changing Dimensions Enterprise Scalability Finance Golden Gate HR FS Logical Dimensions (Type1 & Type2) Dashboards Customers Improved Query Performance Data Snapshots CRM Telephony CRM Telephony PL/SQL Informatica Facts TIGER Reporting & Collaboration (Frontend) Rich Visualization Enterprise Scalability Column Level Security Ad hoc Reporting Other Apps Informatica Others Snapshots Dashboards TriNet Colleagues Faster response time Row Level Security Cross Functional Reporting Metadata Management Point in Time Time Series (YTD, MTD, QTD) Historical Trend & Audit Reporting Attribute Groups ITSM Apps Persistent Stage Core Layer Analytical Reports Report Search Share, Subscribe & Schedule Favorites Global Filters & Variables Usage Tracking User Defined Calculated fields Others Oracle DB Platform Tiger Portal & Tableau User Personalization Ease of Use

10 Metadata Repository Presentation Layer Tableau API s Data Sources Data Sources Current Landscape Sources HR Data Warehouse Near Real Time Reporting & Analytics Customer App PDF Documents Solution meets following business needs Near Real Time Data Level Security Data (Backend) Slowly Changing Dimensions Enterprise Scalability Finance Golden Gate HR FS Logical Dimensions (Type1 & Type2) Dashboards Customers Improved Query Performance Data Snapshots CRM Telephony CRM Telephony PL/SQL Informatica Facts TIGER Reporting & Collaboration (Frontend) Rich Visualization Enterprise Scalability Column Level Security Ad hoc Reporting Other Apps Informatica Others Snapshots Dashboards TriNet Colleagues Faster response time Row Level Security Cross Functional Reporting Metadata Management Point in Time Time Series (YTD, MTD, QTD) Historical Trend & Audit Reporting Attribute Groups ITSM Apps Persistent Stage Core Layer Analytical Reports Report Search Share, Subscribe & Schedule Favorites Global Filters & Variables Usage Tracking User Defined Calculated fields Others Oracle DB Plaform Tiger Portal & Tableau User Personalization Ease of Use

11 API Gateway Portal Framework Portal Java Services DB Platforms Attribute Selector Query Preparation Metadata API s Metadata Repository (Oracle) Presentation Model Query Generation Data Transformations Redis EDW (Oracle) Tableau Data Source Visualization Tableau Rest API s Additional Services Object Repo Mongo DB Entitlement Service Solution meets following business needs Faster response time Row Level Security Cross Functional Reporting Time Series (YTD, MTD, QTD) Ease of Use Column Level Security Ad hoc Reporting Attribute Groups Global Filters & Variables

12 Tiger Portal - Presentation Model Centralized enterprise presentation layer of all data subject areas with a user friendly layout Supportability to cross functional reporting Row level security based on various data policies Column level security & Data masking for PII columns Supportability for different query patterns such as UNION, Analytical functions, Timeseries (YTD, QTD, MTD) etc., Dynamic Measures/Attribute groups for grouping multiple attributes and perform auto PIVOT Optimal query generation Usage of global/recommended filters based on data subject area Data dictionary such as definition, description for all presentation fields

13 Demo Note: Data shown in the video s is random mock-up data

14 Portal & Tableau Integration using Rest API Python TIGER Tableau Extract or Live Connection Extract Portal executes the query & passes JSON file to Python script Using TableauSDK module generate the.tde/.hyper file Live Portal Passes the SQL query to Python script Using Sample.tds file, replace the SQL query and create a new.tds file Lookup MongoDB metadata to Identify the Personal Project name for the User Logged Lookup Tableau to get the Project LUID based on the Project Name using Query Projects REST API Update the Owner of the Data source as the User creating the DS using Update Data Source REST API Publish the Data source into the User folder by calling Publish Data Source REST API Yes Project Exists No Create User Personal Project by calling Create Project REST API

15 Python Script for Live Connection

16 Python Script for Extract

17 Python Script for Extract

18 Python Script Location in GITHUB

19 Demo Advanced Features Note: Data shown in the video s is random mock-up data

20 Q&A

21 Please complete the session survey from the Session Details screen in your TC18 app

22 #TC18 Thank you! Contact or CTA info goes here

23