The Importance of good data management and Power BI

Size: px

Start display at page:

Download "The Importance of good data management and Power BI"

Erick Perry
5 years ago
Views:

1 The Importance of good data management and Power BI

2 The BI Iceberg Visualising Data is only the tip of the iceberg Data Preparation and provisioning is a complex process Streamlining this process is key to success Data Provisioning Data Governance Data Migration Data Modelling Data Sources

3 Offerings Rapid Return Business Intelligence The more data that is created, the better understanding and wisdom people can obtain.

4 Data capabilities at each maturity stage Capabilities Maturity Model SQL Descriptive Diagnostic Predictive Prescriptive Relational data Relational & non-relational data, siloed Any data from any source Any data from any source Know your business better through manual reports built using structured department data. Make smarter decisions using self-service tools to separately display relational and nonrelational data sets available through a virtualized network. Plan for the future by analyzing and modeling diverse data types integrated in real time through a hybrid environment. Trigger automated rules to respond to analysis of data sets integrated in real time through a hybrid environment. ACTIVITIES Manual reports: Request IT to pull data and build reports Historical analysis: Review business periodically and track against goals Departmental data: Combine data manually for business-level insights Self-service & mobile BI: Access anywhere, on any device Visualizations and dashboards: Answer questions by visualizing data External data: Capture big data for future use Real-time insights: Track business changes up to the minute Integrated data sources: Combine and analyze all kinds of data Predictive analytics: Use complex modeling and analysis for predictions Immediate innovation: Make changes on the fly using real-time data Asset feedback: Monitor IoT data to identify new business models Automated actions: Trigger automatic actions to changing trends TIME-TO-DATA: WEEKS OVERNIGHT MINUTES REAL-TIME

7 Data is a key strategic asset $ 1.6T Additional business value captured by companies that are leaders in using data assets to their advantage Source: IDC, % Percent of organizations expected to have a highly profitable business unit specifically for productizing and commercializing their data by 2020 Source: Gartner, 2016

8 Massive data growth 50ZB Widely available unstructured data Analytics driving digital transformation { } Build data into all your apps Deliver powerful insights over big data Modernize your apps with built-in analytics

9 Improving visibility and making accurate predictions with remote monitoring Getting the right products to the right places with inventory management Offering customers exactly what they want, when they want it, with personalization Fixing problems proactively before they start with predictive maintenance Exploring new business opportunities with data-driven services

10 10

Understand Corporate Strategy Gather Requirements Business Requirements Implement Data Warehouse Reporting & Analytics Design Reporting & Analytics

11 Understand Corporate Strategy Gather Requirements Business Requirements Implement Data Warehouse Reporting & Analytics Design Reporting & Analytics Development Dimension Modelling Physical Design Technical Requirements ETL Design ETL Development Data sources Setup Infrastructure Install and Tune

12 OLTP Apps Data Warehouse Analytics Cubes & Services BI Reports CRM Finance Data Mart or Operational Data Store ERP Big Data Storage Hive Query

Need to collect any data Harness the growing and changing nature of data Structured Unstructured Streaming Challenge is combining transactional data

13 Need to collect any data Harness the growing and changing nature of data Structured Unstructured Streaming Challenge is combining transactional data stored in relational databases with less structured data Big Data = All Data Get the right information to the right people at the right time in the right format

14 Increased data types and volumes Varied data sources Added complexity and cost

analytic engines like Hadoop Devices Batch queries

15 Ingest all data regardless of requirements Store all data in native format without schema definition Do analysis Using analytic engines like Hadoop Devices Batch queries Interactive queries Real-time analytics Machine Learning Data warehouse

16 OLTP Apps Modern Data Warehouse Big Data & Analytics Comprehensive BI + other data sources CRM Finance Data Mart or Operational Data Store Web ERP Data Lake BI Users NoSQL IoT LOB Social Big Data Storage Streaming IT Pro Business Analyst

17 Self-Service Dashboarding Reporting Mobile Data Source Ingest Train Prepare Analyse and Publish Consume Data stream queries In-stream predictions Raw Data pass-through Serialize Raw Data Stream Aggregated Results Ad-Hoc data for analysis Power BI Big Data Processing Hive/Spark/HBase ROLAP/Direct Query Excel ETL Direct / Real Time Reporting

18 Transform data into intelligent action with Cortana Intelligence Data Sources People Apps Apps Sensors & Devices Cortana Intelligence Automated systems Data Intelligence Action

19 Using exclusive, advanced intelligence technologies Preconfigured Solutions Dashboards and Visualizations Machine Learning and Analytics Big Data Store Information Management Intelligence Cognitive Services Bot Framework Cortana

Azure Machine Learning Beyond business intelligence machine intelligence Get started with just a browser Requires no provisioning; simply log on to your Azure subscription or try it for free off

21 Azure Machine Learning Beyond business intelligence machine intelligence Get started with just a browser Requires no provisioning; simply log on to your Azure subscription or try it for free off azure.com/ml Experience the power of choice Choose from hundreds of algorithms and packages from R and Python or drop in your own custom code Take advantage of business-tested algorithms from Xbox and Bing Deploy solutions in minutes With the click of a button, deploy the finished model as a web service that can connect to any data, anywhere Microsoft Azure Machine Learning Studio Modeling environment (shown) Microsoft Azure Machine Learning API service Model in production as a web service Microsoft Azure Machine Learning Marketplace APIs and solutions for broad use Connect to the world Brand and monetize solutions on our global Machine Learning Marketplace

22 Deploy in Minutes Expand your Reach Web Service Gallery Discover Learn Share

23 Today, BI extends to everyone 3rd wave End user BI Everyone 2 nd wave Self-service BI Analyst to end user 1st wave Technical BI IT to end user

24 Turning data into business insights is challenging Common BI challenges include End-to-end view Data often resides in disparate locations, making it difficult to see a complete picture of your business Multiple data sources Right data for the right users at the right time Data residing in cloud solutions and on-premise locations is difficult to access and refresh securely Different roles have different needs and business users need the latest operational data

On-premise systems / other Azure-resident systems SaaS Data Sources Power BI

. to life Power BI web browser With natural language query, visual

Azure SQL/DW Azure Stream Analytics Power BI Mobile Apps with dashboards,

25 On-premise systems / other Azure-resident systems SaaS Data Sources Power BI Technical Architecture Bring your data.. to life Power BI web browser With natural language query, visual exploration etc. Azure SQL/DW Azure Stream Analytics Power BI Mobile Apps with dashboards, alerting and visual exploration HDInsight Excel PBI Desktop Power BI Enterprise Gateway Real time Dashboards using Push API or ASA Corporate Data Sources AS Tabular Power BI Personal Gateway

26 Excel The standard among Business Analysts Easily migrate the data and underlying models from Excel SQL Server Analysis Services DAX Compatibility POWER BI GATEWAY SQL Server Reporting Services SSRS output can be pinned on Power BI dashboards 26

27 Connecting any user, in any business, anywhere, with their data Feature Power BI Industry-leading SaaS service o 5 seconds to sign up, 5 minutes to WOW Large Power BI ecosystem o ISVs, SIs and partners creating unparalleled momentum Integrated across Microsoft products o Customers benefit from integration with other Microsoft products

29 See your data the way you want it Feature Visualize data in a variety of ways Growing number of visualization types o o o Donuts, basic area, waterfall, filled maps, tree maps, funnel, gauges combo charts, R charts and more Custom visuals available from Power BI visuals gallery (visuals.powerbi.com) Tools to develop, test, package new custom visuals Visualizations on report page are connected select value in one visualization to change other visualizations Full screen pop out mode for report visuals to show additional details

Cortana (called Answer Pages) Interact with the visualizations as you would in Power BI, to further explore an answer, simply open a result

30 Power BI Cortana Integration Feature Cortana can find answers from data in Power BI, e.g. What were our biggest deals that closed last month? Similar to Q&A, ask or type a question in natural language Cortana can find answers directly from dataset or from report pages designed for Cortana (called Answer Pages) Interact with the visualizations as you would in Power BI, to further explore an answer, simply open a result in Power BI Cortana ranks the answers from Power BI, giving you one or more best matches Easily create Answer Pages in the Power BI service

On-premise data sources SQL Server, Teradata, Oracle, DB2, MySQL, PostgreSQL, Sybase, SAP HANA, Access, Custom SQL,

31 Keep your data where it is and connect securely Feature Faster time to insight with a hybrid BI solution Cloud data sources SaaS sources Azure SQL, DW, Blob, Table, HDInsight, Marketplace SharePoint, web sources, OData OneDrive On-premise data sources SQL Server, Teradata, Oracle, DB2, MySQL, PostgreSQL, Sybase, SAP HANA, Access, Custom SQL, Custom ODBC Drivers SQL Server Analysis Services (tabular and multi-dimensional) Files/folder, SharePoint on-premises

Microsoft business intelligence & analytics $500 $240 $120 $ Gartner Magic Quadrant for Business Intelligence & Analytics Platforms, February 2016 Microsoft Qlik Per user / year Tableau The most

32 Microsoft business intelligence & analytics $500 $240 $120 $ Gartner Magic Quadrant for Business Intelligence & Analytics Platforms, February 2016 Microsoft Qlik Per user / year Tableau The most complete BI solution The above graphics were published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from Microsoft. Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

33 Power BI Desktop Create Power BI Content Connect to data and build reports for Power BI

Azure ML Data Camp. Ivan Kosyakov MTC Architect, Ph.D. Microsoft Technology Centers Microsoft Technology Centers. Experience the Microsoft Cloud

Azure ML Data Camp. Ivan Kosyakov MTC Architect, Ph.D. Microsoft Technology Centers Microsoft Technology Centers. Experience the Microsoft Cloud Microsoft Technology Centers Microsoft Technology Centers Experience the Microsoft Cloud Experience the Microsoft Cloud ML Data Camp Ivan Kosyakov MTC Architect, Ph.D. Top Manager IT Analyst Big Data Strategic