TAP Air Portugal. in Real Time TÍTULO. Subtítulo. Rui Monteiro - February 19. Data da apresentação

Transcription

1 TAP Air Portugal in Real Time Rui Monteiro - rmonteiro@tap.pt February 19

2 Resume The information is a strategic asset to support decision making and legacy data analysis has been the focus of analytical structures until today! Real time data is now helping IT to deliver the right information, business to make the best decisions in the right time and, most important, for people to succeed on their jobs. The users know all the story before they have to decide, receiving the right information by the right means (devices). The data is streamed by complementing the Data Warehouse with the Data Lake and data publishing is supported by MicroStrategy dashboards from Smart TVs and Mobile devices. Legacy and Real Time together are bringing new challenges and the company is more prepared for the future strategy. This presentation will walk through our experienced tour, including some of the lessons learned, the pitfalls, and best practices. 2

3 TAP Air Portugal TAP s Data Warehouse Company Structure 48 > (47 projects) Board Business Measures 2554 Support Measures analytical models 2100 MicroStrategy Operations Customer Commercial Maintenance & Overhaul Finance HR Logistics TAP IT Data Warehouse (18 TB storage) 3

4 2018 Strategy: Self-Service Cultural Triangle PEOPLE We still investing in technology, people and processes to foster our analytical culture. PEOPLE BI Project Management Business & Technology Love-Hate Relationship BI COE PROCESSES Self-Service life-cycle Data Governance Model Silver to Gold Service TECHNOLOGY PROCESSES TECHNOLOGY Self-Service promotion Performance Cockpit 5

5 2019 Strategy: Agility Agile Triangle PEOPLE We add Product and Architecture in our strategic roadmap to foster the agility of our team. PEOPLE Analytics Team profile Curation Team PRODUCT Data Catalog BI Portal BI Blue Print ARCHITECTURE PRODUCT ARCHITECTURE Cloud-Based architecture Streaming Big Data 6

6 Agile Architecture Data Core Agile BI Data Consumption Data Provisioning Data Curation Data Acquisition Integration & Governance Data Sources 7

7 2019 Strategy: Agility Agile Triangle PEOPLE We add Product and Architecture in our strategic roadmap to foster the agility of our team. ARCHITECTURE PRODUCT ARCHITECTURE Cloud-Based architecture Streaming Big Data 8

8 Traditional BI Integration Agile Architecture Data Warehouse architecture Reporting OLAP Data Marts Legacy architecture stills to be our analytical support framework, but in EDW nowadays is not enough to answer to the most recent business needs. ETL For that, we need to push our limits to upgrade the framework ODS Structured Data 9

9 Traditional BI Integration Agile Architecture Data Lake functional architecture Self Service Reporting Data Marts OLAP A data lake is now our arsenal to store vast amounts of raw data EDW for future use. Big data technologies support ETL and enhance modern analytics but do not necessarily replace traditional analytics systems. ODS Agile BI Structured Data 10

10 Traditional BI Integration Data Quality Data Science Agile Architecture Data Lake functional architecture Self Service Reporting Data Marts OLAP Operational A data lake is now our arsenal to store vast amounts of raw data EDW for future use. ETL Operationalization Big data technologies support Curation and enhance modern analytics but do not necessarily replace Analytics Sandbox traditional analytics systems. ODS Persistent Active Archive Agile BI Structured Data Unstructured Data Streaming Data 11

11 BI Agile Architecture The Data Lake functional architecture As these analysts identify new data sources that may provide additional business insight, they will help to shape and Curate this data to provide self-service analytics to a broader audience. As self-service analysts continue to refine the use of Curated data sources, they will work with the data management team to Operationalize data to be presented to the broadest audience of the business. Data scientists and analysts are granted access to the data at this layer in order to perform discovery and experimentation in an Analytics Sandbox set aside for their use. Data from all internal and external source systems including structured, semi-structured and unstructured data, as well as streaming sources is gathered in a single Persistent layer in the data lake. Active Archive is a high performance solution for archiving, retrieving, retaining and managing the growing volume and variety of enterprise data. 12

12 Data Quality BI Agile Architecture The Data Lake functional architecture Since these data artifacts are generally consumed through the highest levels of the organization and are required for day-to-day decision making, they will ultimately reside in the high-speed query engines of the Enterprise Data Warehouse (EDW) and OLAP layers to support typical Business Intelligence functions. Self Service Reporting OLAP Operational Data Marts Maintaining control and records of the content stored in the various layers of the data lake is very important. Having a strong but flexible governance policy and mechanism for metadata and content management to support discovery, standardization, master data management and security is a key factor in the success of implementing a big data strategy. EDW 13

13 BI Agile Architecture Agile Development The traditional data warehouse/business intelligence approach has done a great job of simplifying data access and reporting, as well as combining data from many sources, in order to answer all of the questions an organization may have. But it s impossible to anticipate every question a business might ask and every report they might need. Metrics change from year to year, month to month and sometimes even day to day. In addition, there is a flood of new data types. Information from the web, social media, servers, sensors, documents, comments and devices has caused an explosion in the volume of data that organizations are trying to understand. Structured Data Scoping Development Testing Streaming Data Unstructured Data Feeding Prototyping Development Testing Ad-hoc analysis DATA WAREHOUSE 14

14 2019 Strategy: Agility Agile Triangle PEOPLE We add Product and Architecture in our strategic roadmap to foster the agility of our team. PEOPLE Analytics Team Wrangler Team 15

15 Pessoas Equipa de BI 16

16 Core Team (inside BI architecture) Data Provisioning Data Curation Data Acquisition Data Sources 17

17 2020 BI Model BI Current Scenario Best Scenario Business Business Data Consumers REV OPS MKT ME Support Business Support Data Support Current Scenario Business Data Consumers REV OPS MKT ME Support Business Business Support BI & Analytics IT Data Support BI & Analytics IT 18

18 2019 Strategy: Agility Our Product PEOPLE We add Product and Architecture in our strategic roadmap to foster the agility of our team. Agility PRODUCT BI Portal & Data Catalog Company Finger Print ARCHITECTURE PRODUCT 19

19 Analytical Portfolio Data Hub Mobile Based Web Based Self Dossiers TV Based 20

20 Analytical Portfolio Data Hub (Style Guide) 21

21 Analytical Portfolio TV Dashboards Persistent Layer Transaction Services Weather API UX & UI Dashboard 22

22 Integrated Operational Control Center Punctuality (TV Based) 23

23 Integrated Operational Control Center Punctuality (Transaction Services) 24

24 Integrated Operational Control Center Punctuality (Web Based) 25

25 Integrated Operational Control Center Punctuality (Mobile Based) 26

26 Integrated Operational Control Center Punctuality (Heuristic Evaluation) 27

27 Integrated Operational Control Center Stations (TV Based) 28

28 Integrated Operational Control Center Stations (TV Based) 29

29 Portfolio Backlog Crew Efficiency 30

30 Portfolio Backlog Net Promoter Score 31

31 Portfolio Backlog Real Time Sales 32

32 Thank You 39