HOW TO NAVIGATE THROUGH THE CORNUCOPIA OF POWER BI ARCHITECTURE OPTIONS

Transcription

1 1 HOW TO NAVIGATE THROUGH THE CORNUCOPIA OF POWER BI ARCHITECTURE OPTIONS GREG SHARROW DIRECTOR COMMERCIAL DIGITAL SOLUTIONS October 6, 2018

2 Visit the Sponsor Booths Lots of Raffle Prizes! Get your parking paid via Sponsor Bingo Thank you Sponsors! Platinum Sponsor: Gold Sponsors:

3 PASSMN News/Info Sponsors: Thanks to all our sponsors of 2018! We need Sponsors for Nov/Dec 2018 and 2019! Special thanks to our annual sponsor: Board Member Elections in November/December: Your chance to help out the MN SQL community!

4 Join the brightest data professionals focused on the Microsoft Data Platform! November 5 th Through November 9 th Pre-Conference Sessions Monday/Tuesday Conference Wednesday through Friday

5 SQLSaturday #796 After Party Location: 4th Floor of Mall of America Time: 6:30PM 10PM There will be drinks and appetizers as well as free game cards and bowling! Hang out with some new friends you ve made.

6 6 Agenda Introduction Survey Overall thoughts My background Ecolab at a glance Architecture approaches and discussion Report server SSAS tabular AAS Direct query Imported and published Composite/Aggregates Streaming Embedding Premium Mobile Licensing Our experience

7 7 Overall thoughts A special thanks to my team, as without them this presentation would not be possible The goal is to initiate discussion Each architecture has nuances, things are changing quickly, and the lines between some of the options are blurring There is a lot of material, so not enough time to go in depth Focus on tabular data structures and direct query (not multidimensional) Want to hear others opinions and questions!

8 8 My Background Director for the Commercial Digital Solutions BI/DW team at Ecolab Focused on customer and field facing solutions globally - 10 of thousands of customer locations - Thousands of field employees We are primarily using Microsoft technologies Member of the Microsoft champions and Advisors groups Career highlights Started out my career as a consultant, for the first 15+ years Focused on data, database, and BI solutions Worked with many large companies across a number of industries Experience with other technologies such as Oracle, DB2, BO, Qlik, MicroStrategy, and Cognos Was a data warehouse architect for a large medical device company Joined Ecolab in 2010 as an Enterprise Architect Linked in Profile: greg.sharrow@ecolab.com

9 9 Ecolab Overview ABOUT ECOLAB Ecolab is the global leader in water, hygiene and energy technologies and services. Around the world businesses in foodservice, food processing, hospitality, healthcare, industrial, and oil and gas markets choose Ecolab products and services to keep their environment clean and safe, operate efficiently and achieve sustainability goals. CLEAN WATER Water is the world's most valuable resource, and growing demand for clean water is putting enormous pressure on the available supply. Water is integral to many of our customers' key processes. ABUNDANT ENERGY Around the world, the demand for energy is growing - and meeting the demand is becoming more difficult. With innovative programs and technologies, we help energy companies extract more energy with fewer resources. SAFE FOOD The foods we eat today come from a global marketplace. And all foods - no matter where or how they are produced - need to be handled, prepared and stored properly to prevent the growth of harmful microorganisms that can cause illness. HEALTHY ENVIRONMENTS The spread of disease can be devastating to people - and to businesses. That's why we provide healthcare facilities with comprehensive solutions that help reduce healthcare-acquired infections and improve patient safety.

10 Ecolab at a glance 10 Size and customer base 13.8B revenue in 2017 Nearly 3 million customer locations in more than 170 countries History 95-year history of innovation More than 8,700 patents Associates Impact 48,000 associates including: 26,500 service professionals 1,600 RD&E scientists, engineers and technical specialists IN 2017, ECOLAB HELPED CUSTOMERS: Conserve more than 170 billion gallons of water Save 12 trillion BTUs of energy Clean 40 billion hands Make 27% of the world's processed foods safe Support clean kitchens serving 45 billion restaurant meals Manage water and process technology enabling: 22% of the world's electricity 40% of all nuclear power 45% of petroleum products

11 Ecolab Awards 11 Forbes America s Best Employers Barron s 100 Most Sustainable Companies Ranked #3 in Chemicals Industry Ranked #7 in Business Services & Supplies Ranked #7 in Business Services & Supplies Ranked #8 Ranked #29 Water A List Ranked #2 U.S. 500 List 2018 Gold Medal for Sustainable Development Ranked #43 Ranked #87 Forbes 2018 World s Most Innovative Companies Ranked #93 12 th Consecutive Year 2017 North America Index 4 th Consecutive Year Named Best for Vets Employer 100% Corporate Equality Index 2017 Visionary Award Ranked #30 Ranked #16

12 12 Report Server Data Sources Reports Optional Analysis Services Report Server Highlights On premise or hosted cloud solution Supports SSRS Great for sensitive data that you do not want in the public cloud Can be part of a hybrid solution Potential Challenges Need Enterprise with SA or a premium capacity Lags behind the service in features No Dashboards, real time streaming, Q&A, quick insights, Analyze in Excel, R visuals, and preview features Different version of desktop

13 13 with SSAS Tabular Data Sources Apps Dashboards Reports SSAS Tabular Gateway Service Highlights In memory model is fast Data model is built using dev/ops tools Can link cube refresh to data source events/loads Decouple and size front end and back end loads Ratio of memory to CPU is more flexible than AAS Potential Challenges Processing the model takes time/resources Needs infrastructure and SQL license for SSAS environment Need the gateway Certain features (e.g. composite, aggregates) not on the roadmap Cached queries use significant resources Does not support AAD for RLS

14 14 with Azure Analysis Services Data Sources Optional gateway Apps Dashboards Reports Azure Analysis Services Service Highlights In memory model is fast Data model is built using dev/ops tools Can link cube refresh to data source events/loads No server to manage Decouple and size front end and back end loads Supports Azure active directory for RLS Potential Challenges Processing the model takes time/resources AAS can be expensive (QPU to memory ratio) AAS no plans to support composite or aggregates (merge into PBI service). Merging into premium Cached queries use significant resources (does not use disk like SSAS on prem)

15 15 Direct Query (SQL 2016 forward) Data Sources Optional gateway Apps Dashboards Reports Service Highlights No processing The data is always current Good for recent data (smaller data set) Does not store any data in the model No 1GB dataset limit Potential Challenges Data source must be query performant Not as performant as an in memory model Limited data source support One data source per model and model complexity is limited Can return inconsistent results (Cache)

16 16 Imported and Published Data Sources Optional gateway Apps Dashboards Reports Service Highlights In memory model is fast Easy to mashup data from multiple sources No need for SSAS/AAS infrastructure Supports new features like composite, and aggregate models Microsoft has stated the imported model functionality will be a superset of SSAS/AAS Potential Challenges Processing the model takes time/resources Refresh (8 times) and data size (1gb) limited Link a refresh to source data events/loads (XMLA Endpoints just announced in premium) Development of some models could require a large workstation Shared service infrastructure

17 17 Composite and Aggregates Data Sources Optional gateway Apps Dashboards Reports Service Highlights Can help scale very large models (game changing functionality) Allows more than one direct query source Can speed processing (only load subset of data) Use to drill to lightly used detail data without having to load into the model Potential Challenges Still in preview (no RLS yet), questions/concerns about M2M Only available in imported models Not currently planned for AAS or SSAS Link a refresh to source data events/loads (XMLA Endpoints just announced in premium) Development of some models requires large workstation

18 18 Push dataset Data Sources Dashboards Reports Service Potential Challenges Highlights Real time data display in dashboards Can have multiple tables, measures, relationships etc. Can use Q&A and pin the result as a tile Stores the data Dataset is created through the REST API Real time through dashboard tiles only Cannot pin entire report Data limitations 1M rows per hour 5M per table in none retention 200K per table FIFO dataset 120 post rows per minute

19 19 streaming data set Data Sources Dashboards Service Highlights Real time data display in dashboards Smooth animation Can set up dataset through the service No limit on data throughput Potential Challenges Does not store the data (one hour) unless enabling historical data analysis Limited to one table Cannot build reports on dataset

20 20 PubNub streaming data set Data Sources Dashboards Service Highlights Reads data from a PubNub data stream Smooth animation No limit data throughput since data is in PubNub Potential Challenges Does not store the data (in PubNub) Need a PubNub dataset Cannot build reports on dataset

21 21 Embedded Data Sources Optional gateway Premium PBI Web App Your Web App PBI Embedded Optional Analysis Services SSO/Security Highlights Uses a premium option Can control the user experience Embed Power PBI in your applications Grant outside users access without a license Can be very cost effective for a large user base Potential Challenges Functionality in the embedded product lags behind the service Need web development skills for the PBI web app RLS and SSO can be difficult to set up Collecting logs of specific users can be challenging

22 22 Premium Data Sources Optional gateway premium Apps Dashboards Reports Optional Analysis Services Service Highlights Way to scale and adjust licensing Dataset 1gig limit is removed (100T per capacity, 10 GB dataset) Possible to share without purchasing licenses for each user Easy to add to your environment and it is seamless to the users Potential Challenges Can be expensive Multiple SKU types, P and EM are office capacities, A is an Azure capacity Dedicated capacity for backend only If using SSAS or AAS, those are not in premium capacity

23 23 Mobile Data Sources Optional gateway premium Optional Analysis Services Service Highlights Mobile specific views Easier for users on mobile device to interact with content Available for report server Leverage existing dashboards and reports Potential Challenges User must install product on the device Usually re-formatting is needed to make a suitable mobile view Some widgets/features lag

24 24 Licensing Report Server free Purchase premium and it allows the same amount of cores for your report server Purchase SQL Server Enterprise Edition with Software Assurance. This allows you to install report server Only content creators would need Pro licenses Develop in desktop Publish reports to service No sharing No RLS No Workspaces Pro Cost per user per month Share except embedded Analyze in Excel Receive non premium content shared to you from other users Integrate with MSFT Teams Premium Three types of SKUs (A, EM, and P) A SKUs and EM/P SKUs are identical in their resources and capabilities. A1=EM1 A3=EM3, A4=P1 etc.

25 25 Licensing Premium Feature Embedded Premium Capacity Premium Capacity (A SKUs) (EM SKUs) (P SKUs) Embed artifacts from a App workspace Azure capacity Office 365 capacity Office 365 capacity Consume reports in an Embedded application Yes Yes Yes Consume reports in SharePoint No Yes Yes Consume reports in Dynamics No Yes Yes Consume reports in Teams (excludes mobile app) Access content with a FREE license in Powerbi.com and mobile Access content with a FREE license embedded in MS Office apps No Yes Yes No No Yes No Yes Yes

26 26 Licensing Premium A SKU ( Embedded) EM SKU ( Premium) P SKU ( Premium) Purchase Azure Portal Office Office Use cases Embed Content in your own App. Embed content in your own application Embed content in your own application Embed content in MS Office applications: SharePoint Teams (excludes mobile app) Dynamics 365 Embed content in MS Office applications: SharePoint Teams (excludes mobile app) Dynamics 365 Billing Hourly Monthly Monthly Share content with users through the service Commitment No Commitment Yearly Monthly/Yearly Differentiation Full elasticity- can scale up/ down, pause/ resume resources in Azure portal or through API Can be used to embed content in SharePoint Online and Microsoft Teams (excludes mobile app) Combine embedding in applications and use the Service in the same capacity

27 27 Our Experience (Architecture 1) Azure PaaS DB Azure Analysis Services Premium Web App PBI Embedded Highlights Used A SKU Embedding in our own app Can scale, pause through Azure Portal Did not need infrastructure Can link refresh to DW load Used custom data attribute for RLS Ready for AAD Challenges AAS can be expensive (QPU to memory ratio) AAS no plans to support composite or aggregates Web app code is complex RLS uses master account, so log data is a challenge Failover and globalization is challenging

28 28 Our Experience (Architecture 2) SQL Server SSAS Tabular Gateway Premium Web App PBI Embedded Highlights Used A SKU Embedding in our own app Can scale, pause through Azure Portal Had existing infrastructure Can link refresh to DW load Used EffectiveUserName attribute for RLS Challenges SSAS no plans to support composite or aggregates Web app code is complex RLS uses master account, so log data is a challenge Failover and globalization is challenging Need to change for AAD

29 29 Questions?

30 30 Links