ARCHITECTURES ADVANCED ANALYTICS & IOT. Presented by: Orion Gebremedhin. Marc Lobree. Director of Technology, Data & Analytics

Size: px
Start display at page:

Download "ARCHITECTURES ADVANCED ANALYTICS & IOT. Presented by: Orion Gebremedhin. Marc Lobree. Director of Technology, Data & Analytics"

Transcription

1 ADVANCED ANALYTICS & IOT ARCHITECTURES Presented by: Orion Gebremedhin Director of Technology, Data & Analytics Marc Lobree National Architect, Advanced Analytics

2 EDW THE RIGHT TOOL FOR THE RIGHT WORKLOAD RDBMS Data Stores SSIS Local Data Sources Unstructured data Flat File Upload Azure SQL DW HDInsight Storage blob Azure SQL database On-Premises Reporting & Analytics SSIS Excel (Direct Access)

3 ESA EDW REFERENCE ARCHITECTURE HYBRID BIG DATA PROCESSING On-Demand-Compute Direct Access/ Report Model Level Integration Cloud Storage Cube PowerShell AZCopy SSIS SSIS Data Layer Level Integration Tabular

4 ON PREMISES BIG DATA IMPLEMENTATIONS

5 USE CASE: ETL OFFLOADING Have you outgrown your data delivery SLAs? Is your business frustrated with data delays? Get the right data at the right time.

6 Neudesic partnered with one of the nation s largest utility companies that recently deployed Smar Utility Meters for power customers, nearly a million meters sending usage data every 15 minutes. The result: an Azure hybrid big data processing solution that enabled the customer to perform gap analytics: a process for identifying gaps that exist in the power usage readings, over 7x faster than their previous solution! Billions of Smart Meter reads get processed to identify the nature and duration of the gaps to mitigate revenue losses.

7 USE CASE: REAL-TIME ANALYSIS Got end users that need data now? Provide business units the data they need at the time they need it.

8 REAL TIME TRAFFIC MANAGEMENT Toll Data EventsHub StreamAnalytics Toll Way Event Generator Toll Violations Reference Data Vehicle Registration Toll Violation Tickets

9 Real-Time Analysis On-premises Using Data Lake to capture all data for everyone. OLTP Kafka Spark MLlib Kafka Logs HDFS PM B DM MDM Machine learning

10 USE CASE: INTERNET OF THINGS What action does your IoT device drive? Help guide end-users to the action they are looking to take.

11 VENDING MACHINE MANAGEMENT Vending Machine EventsHub StreamAnalytics Vending Machine Vending Transactions EventsHub Batch Predictions Real-time Notifications Machine learning EventsHub Vehicle Location Info

12 REAL TIME TRAFFIC MANAGEMENT Toll Data EventsHub StreamAnalytics Toll Way Event Generator Toll Violations Reference Data Vehicle Registration Toll Violation Tickets

13 IOT WEARABLE MANAGEMENT Processing device data in real time. HD Insight Spark SQL Analyze Device API Azure Event Hub or IOT Hub Azure Stream Analytics Power BI Dataset Temporal Power BI Dashboards

14 USE CASE: ITERATIVE EXPLORATION What can we do with all of this data? Mine for answers-one question at a time.

15 ITERATIVE EXPLORATION Build expert systems, move to supervised learning, and evolve to reinforced learning. Web Service used for Orchestration HD Insight Azure Machine Learning API End Point Azure Data Warehouse Power BI

16 ITERATIVE EXPLORATION Monitor and remove noise from textual data. Web Service used for Orchestration Azure SQL DB Keyword Analytics Power BI Dataset Statistical Media Services Power BI Dashboards Machine Learning API End Point Event Hubs Stream Analytics Power BI Dataset Temporal

17 USE CASE: SELF SERVICE Are your reports only telling half the story? Quickly deliver large datasets for ad hoc analysis.

18 SELF SERVICE Allowing business to fulfill their analytics needs. Semi-structured Files Apache Hadoop Spark SQL Analyze Service Bus SQL Server

19 HYBRID SELF SERVICE

20 HYBRID SELF SERVICE

21 USE CASE: DATA AS A SERVICE Got savvy end users that need more data? Provide data scientists with what they need while making it easy for the business user.

22 Data-as-a-Service USING AZURE Using Data Lake to capture all data for everyone. Data Sources Loading Data Lake Raw Data Lake Building Data Streams Self-Service Catalog SQL Data Factory Click Stream Logs Data Factory Azure ML Azure Data Catalog Data Historian (PI Server) App Service Azure Data Lake Store Data Factory Azure Data Lake Store HDInsight Hive or Spark Power BI Dashboards Device API Azure Event Hub or IOT Hub Azure Stream Analytics Azure Blob Storage

23 Advanced Analytics Methodology

24 Solution Development Process Business Objective Understanding Data Understanding Data Model Creation + Testing Integration in Data Strategy Model Creation + Testing Data Acquisition Visual Analysis Model(s) Selection Model Comparison Integration in Data Strategy Build Model + Web Service Location for SQL query Consumption Layer

25 Model Selection: Supervised (we know the response). Parametric Regression Linear Polynomial Stepwise Binomial Splines Partial Least Squares Generalized Linear Models Classification Logistic Linear / Quadratic Discriminant Analysis Non Parametric K Nearest Neighbors Decision Trees Random Forests Boosting Neural Network Support Vector Machines Generalized Additive Models Forecasting Moving Averages Exponential Smoothing ARIMA Regressions *Some models can change (parametric/nonparametric) and (regression/classification)

26 Model Selection: MAPE & RMSE & R^2 Mean Average Percent Error Root Mean Square Error Variation explained by Predictor We want to choose the model that reduces the test error and has a high percent value for how much the predictors explains the response

27 Examining Weather and Active Meters in the System by Time Temperature by time Active Metes by time Seasonality of temperature Constant increase of active meters

28 Usage & Temp Usage by Day of Week & Verse Temperature Day of Week Trend Hourly Usage Trends Day of Month Temp = Red Usage = Blue

29 Auto-Regressive Integrated Moving Average ARIMA(p,d,q)x(P,D,Q)[m] AR(p) = number of seasonal autoregressive terms I(d) = number of differencing terms MA(q) = number of seasonal moving average terms m = periods inside frequency Stationary Mean & Variance Avg. Temperature Time Series

30

31 NEXT STEP BECOME THE BI SUPERHERO Information Management Big Data Storage Apache Hadoop Real-time intelligence Machine learning IoT Dashboards and Visualizations and more! Ideate, chart your quick wins, ask questions and get answers to your real Big Data challenges. It s insightful, it s easy and can be done from the comfort of your conference room.

32 BIG DATA & Advanced Analytics Roadshow Questions? Orion Gebremedhin Marc Lobree

ADVANCED ANALYTICS & IOT ARCHITECTURES

ADVANCED ANALYTICS & IOT ARCHITECTURES ADVANCED ANALYTICS & IOT ARCHITECTURES Presented by: Orion Gebremedhin Director of Technology, Data & Analytics Marc Lobree National Architect, Advanced Analytics EDW THE RIGHT TOOL FOR THE RIGHT WORKLOAD

More information

BIG DATA & ADVANCED ANALYTICS ROADSHOW

BIG DATA & ADVANCED ANALYTICS ROADSHOW BIG DATA & ADVANCED ANALYTICS ROADSHOW 2 Copyright 2014, Neudesic. All rights reserved. CO-SPONSORS UPCOMING ROADSHOW STOPS Los Angeles: Wednesday, February 10 th Orange County: Thursday, February 11 th

More information

BIG DATA PROCESSING A DEEP DIVE IN HADOOP/SPARK & AZURE SQL DW

BIG DATA PROCESSING A DEEP DIVE IN HADOOP/SPARK & AZURE SQL DW BIG DATA PROCESSING A DEEP DIVE IN HADOOP/SPARK & AZURE SQL DW TOPICS COVERED 1 2 Fundamentals of Big Data Platforms Major Big Data Tools Scaling Up vs. Out SCALE UP (SMP) SCALE OUT (MPP) + (n) Upgrade

More information

Azure Data Analytics & Machine Learning Seminar. Daire Cunningham: BI Practice Area Manager

Azure Data Analytics & Machine Learning Seminar. Daire Cunningham: BI Practice Area Manager Azure Data Analytics & Machine Learning Seminar Daire Cunningham: BI Practice Area Manager AGENDA 09:00 AM 09:30 AM Registration & Refreshments 09.30AM 10:00 AM 10:00 AM 10:30 AM Welcome & Keynote, Ger

More information

20775A: Performing Data Engineering on Microsoft HD Insight

20775A: Performing Data Engineering on Microsoft HD Insight 20775A: Performing Data Engineering on Microsoft HD Insight Duration: 5 days; Instructor-led Implement Spark Streaming Using the DStream API. Develop Big Data Real-Time Processing Solutions with Apache

More information

20775: Performing Data Engineering on Microsoft HD Insight

20775: Performing Data Engineering on Microsoft HD Insight Let s Reach For Excellence! TAN DUC INFORMATION TECHNOLOGY SCHOOL JSC Address: 103 Pasteur, Dist.1, HCMC Tel: 08 38245819; 38239761 Email: traincert@tdt-tanduc.com Website: www.tdt-tanduc.com; www.tanducits.com

More information

Microsoft Azure Essentials

Microsoft Azure Essentials Microsoft Azure Essentials Azure Essentials Track Summary Data Analytics Explore the Data Analytics services in Azure to help you analyze both structured and unstructured data. Azure can help with large,

More information

20775A: Performing Data Engineering on Microsoft HD Insight

20775A: Performing Data Engineering on Microsoft HD Insight 20775A: Performing Data Engineering on Microsoft HD Insight Course Details Course Code: Duration: Notes: 20775A 5 days This course syllabus should be used to determine whether the course is appropriate

More information

Course Content. The main purpose of the course is to give students the ability plan and implement big data workflows on HDInsight.

Course Content. The main purpose of the course is to give students the ability plan and implement big data workflows on HDInsight. Course Content Course Description: The main purpose of the course is to give students the ability plan and implement big data workflows on HDInsight. At Course Completion: After competing this course,

More information

Business is being transformed by three trends

Business is being transformed by three trends Business is being transformed by three trends Big Cloud Intelligence Stay ahead of the curve with Cortana Intelligence Suite Business apps People Custom apps Apps Sensors and devices Cortana Intelligence

More information

Azure ML Data Camp. Ivan Kosyakov MTC Architect, Ph.D. Microsoft Technology Centers Microsoft Technology Centers. Experience the Microsoft Cloud

Azure ML Data Camp. Ivan Kosyakov MTC Architect, Ph.D. Microsoft Technology Centers Microsoft Technology Centers. Experience the Microsoft Cloud Microsoft Technology Centers Microsoft Technology Centers Experience the Microsoft Cloud Experience the Microsoft Cloud ML Data Camp Ivan Kosyakov MTC Architect, Ph.D. Top Manager IT Analyst Big Data Strategic

More information

20775 Performing Data Engineering on Microsoft HD Insight

20775 Performing Data Engineering on Microsoft HD Insight Duración del curso: 5 Días Acerca de este curso The main purpose of the course is to give students the ability plan and implement big data workflows on HD. Perfil de público The primary audience for this

More information

EXAMPLE SOLUTIONS Hadoop in Azure HBase as a columnar NoSQL transactional database running on Azure Blobs Storm as a streaming service for near real time processing Hadoop 2.4 support for 100x query gains

More information

Big data is hard. Top 3 Challenges To Adopting Big Data

Big data is hard. Top 3 Challenges To Adopting Big Data Big data is hard Top 3 Challenges To Adopting Big Data Traditionally, analytics have been over pre-defined structures Data characteristics: Sales Questions answered with BI and visualizations: Customer

More information

Advanced Analytics in Azure

Advanced Analytics in Azure Explore What s Possible. Advanced Analytics in Azure Amie Mason, Practice Lead Data Science & Analytics amiem@attunix.com The Attunix Difference business technology Attunix delivers results at the intersection

More information

The Importance of good data management and Power BI

The Importance of good data management and Power BI The Importance of good data management and Power BI The BI Iceberg Visualising Data is only the tip of the iceberg Data Preparation and provisioning is a complex process Streamlining this process is key

More information

Measure Consume. Store. Data Governance

Measure Consume. Store. Data Governance Collect Process Manage Measure Consume Store Data Governance Big Data Sources (Raw, Unstructured) Azure Machine Learning Business Insights Sensors Devices Intelligent Systems Service Hadoop on Windows

More information

Jason Virtue Business Intelligence Technical Professional

Jason Virtue Business Intelligence Technical Professional Jason Virtue Business Intelligence Technical Professional jvirtue@microsoft.com Agenda Microsoft Azure Data Services Azure Cloud Services Azure Machine Learning Azure Service Bus Azure Stream Analytics

More information

HDInsight - Hadoop for the Commoner Matt Stenzel Data Platform Technical Specialist

HDInsight - Hadoop for the Commoner Matt Stenzel Data Platform Technical Specialist HDInsight - Hadoop for the Commoner 10-1-2016 Matt Stenzel Data Platform Technical Specialist SQL Saturday #557 Thank you Sponsors! Please visit the sponsors and enter their end-of-day raffles. Event After

More information

Making Realtime Reporting a Reality

Making Realtime Reporting a Reality Making Realtime Reporting a Reality Transforming government for greater impact and outcomes Jek De Chavez-Hermida Data Platform Solution Specialist Microsoft Philippines Data Analytics & Intelligence

More information

Boston Azure Cloud User Group. a journey of a thousand miles begins with a single step

Boston Azure Cloud User Group. a journey of a thousand miles begins with a single step Boston Azure Cloud User Group a journey of a thousand miles begins with a single step 3 Solution Architect at Slalom Boston Business Intelligence User Group Leader I am a bit shy but passionate. BI Architect

More information

Spotlight Sessions. Nik Rouda. Director of Product Marketing Cloudera, Inc. All rights reserved. 1

Spotlight Sessions. Nik Rouda. Director of Product Marketing Cloudera, Inc. All rights reserved. 1 Spotlight Sessions Nik Rouda Director of Product Marketing Cloudera @nrouda Cloudera, Inc. All rights reserved. 1 Spotlight: Protecting Your Data Nik Rouda Product Marketing Cloudera, Inc. All rights reserved.

More information

Business Intelligence in Azure Alex Whittles

Business Intelligence in Azure Alex Whittles Business Intelligence in Azure Alex Whittles Alex@PurpleFrogSystems.com PurpleFrogSystems.com PurpleFrogSystems.com/blog @PurpleFrogSys Alex Whittles SQL Relay Committee SQLRelay.co.uk SQL Bits Committee

More information

Alexander Klein. ETL meets Azure

Alexander Klein. ETL meets Azure Alexander Klein ETL meets Azure Thanks to our sponsors: Who am I? Independent BI Consultant > 15 years experience of SQL Server Focus on Microsoft BI Stack & AI & Azure a.klein@consulting-bi.de @SQL_Alex

More information

SAP Predictive Analytics Suite

SAP Predictive Analytics Suite SAP Predictive Analytics Suite Tania Pérez Asensio Where is the Evolution of Business Analytics Heading? Organizations Are Maturing Their Approaches to Solving Business Problems Reactive Wait until a problem

More information

AZURE HDINSIGHT. Azure Machine Learning Track Marek Chmel

AZURE HDINSIGHT. Azure Machine Learning Track Marek Chmel AZURE HDINSIGHT Azure Machine Learning Track Marek Chmel SESSION AGENDA Understanding different scenarios of Hadoop Building an end to end pipeline using HDInsight Using in-memory techniques to analyze

More information

Azure Offerings for Big data. In Kee Paek Cloud Data Solution Architect Microsoft Korea October. 2016

Azure Offerings for Big data. In Kee Paek Cloud Data Solution Architect Microsoft Korea October. 2016 Azure Offerings for Big data In Kee Paek Cloud Data Solution Architect Microsoft Korea October. 2016 Agenda 1. Integrated Big data Platform - Cortana Intelligent Suite 2. Scalable Machine Learning - R

More information

Common Customer Use Cases in FSI

Common Customer Use Cases in FSI Common Customer Use Cases in FSI 1 Marketing Optimization 2014 2014 MapR MapR Technologies Technologies 2 Fortune 100 Financial Services Company 104M CARD MEMBERS 3 Financial Services: Recommendation Engine

More information

Digital transformation is the next industrial revolution

Digital transformation is the next industrial revolution Digital transformation is the next industrial revolution Steam, water, mechanical production equipment Division of labor, electricity, mass production Electronics, IT, automated production Blurring the

More information

Data Analytics. Nagesh Madhwal Client Solutions Director, Consulting, Southeast Asia, Dell EMC

Data Analytics. Nagesh Madhwal Client Solutions Director, Consulting, Southeast Asia, Dell EMC Data Analytics Nagesh Madhwal Client Solutions Director, Consulting, Southeast Asia, Dell EMC Last 15 years IT-centric Traditional Analytics Traditional Applications Rigid Infrastructure Internet Next

More information

Architecting an Open Data Lake for the Enterprise

Architecting an Open Data Lake for the Enterprise Architecting an Open Data Lake for the Enterprise 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Today s Presenters Daniel Geske, Solutions Architect, Amazon Web Services Armin

More information

INTRODUCTION TO R FOR DATA SCIENCE WITH R FOR DATA SCIENCE DATA SCIENCE ESSENTIALS INTRODUCTION TO PYTHON FOR DATA SCIENCE. Azure Machine Learning

INTRODUCTION TO R FOR DATA SCIENCE WITH R FOR DATA SCIENCE DATA SCIENCE ESSENTIALS INTRODUCTION TO PYTHON FOR DATA SCIENCE. Azure Machine Learning Data Science Track WITH EXCEL INTRODUCTION TO R FOR DATA SCIENCE PROGRAMMING WITH R FOR DATA SCIENCE APPLIED MACHINE LEARNING SCENARIOS HDInsight Certificate of DATA SCIENCE ORIENTATION QUERYING DATA WITH

More information

Building a Modern Data Warehouse in Azure for Power BI

Building a Modern Data Warehouse in Azure for Power BI Building a Modern Data Warehouse in Azure for Power BI About Us Phil Spokas email phil@intellitect.com Web Intellitect.com/phil Twitter Linked In @philspokas /in/philspokas web Twitter Intellitect.com

More information

Big Data at PennDOT (ISTO DW-BI Team)

Big Data at PennDOT (ISTO DW-BI Team) Big Data at PennDOT (ISTO DW-BI Team) DW/BI at PennDOT The DW/BI team provides a robust Data Warehouse and Business Intelligence platform (PDIF), and delivers DW-BI solutions and services to the Department.

More information

Cask Data Application Platform (CDAP) Extensions

Cask Data Application Platform (CDAP) Extensions Cask Data Application Platform (CDAP) Extensions CDAP Extensions provide additional capabilities and user interfaces to CDAP. They are use-case specific applications designed to solve common and critical

More information

Confidential

Confidential June 2017 1. Is your EDW becoming too expensive to maintain because of hardware upgrades and increasing data volumes? 2. Is your EDW becoming a monolith, which is too slow to adapt to business s analytical

More information

Aurélie Pericchi SSP APS Laurent Marzouk Data Insight & Cloud Architect

Aurélie Pericchi SSP APS Laurent Marzouk Data Insight & Cloud Architect Aurélie Pericchi SSP APS Laurent Marzouk Data Insight & Cloud Architect 2005 Concert de Coldplay 2014 Concert de Coldplay 90% of the world s data has been created over the last two years alone 1 1. Source

More information

Two offerings which interoperate really well

Two offerings which interoperate really well Microsoft Two offerings which interoperate really well On-premises Cortana Intelligence Suite SQL Server 2016 Cloud IAAS Enterprise PAAS Cloud Storage Service 9 SQL Server 2016: Everything built-in built-in

More information

aka.ms/ uber-selfies

aka.ms/ uber-selfies aka.ms/uber-selfies aka.ms/computing-cancer aka.ms/carnival Security & Management Platform Services Hybrid Cloud Security Center Portal Azure Active Directory Azure AD B2C Multi-Factor Authentication Media

More information

HPE Flexible Capacity with Microsoft Azure & Azure Stack

HPE Flexible Capacity with Microsoft Azure & Azure Stack HPE Flexible Capacity with Microsoft Azure & Azure Stack The vision behind making Hybrid IT consumption a reality Reuben Melville Version 2.0 Compliance Recent outages of Public Cloud solutions, major

More information

5th Annual. Cloudera, Inc. All rights reserved.

5th Annual. Cloudera, Inc. All rights reserved. 5th Annual 1 The Essentials of Apache Hadoop The What, Why and How to Meet Agency Objectives Sarah Sproehnle, Vice President, Customer Success 2 Introduction 3 What is Apache Hadoop? Hadoop is a software

More information

How In-Memory Computing can Maximize the Performance of Modern Payments

How In-Memory Computing can Maximize the Performance of Modern Payments How In-Memory Computing can Maximize the Performance of Modern Payments 2018 The mobile payments market is expected to grow to over a trillion dollars by 2019 How can in-memory computing maximize the performance

More information

Integrating the Enterprise. How Business Leaders are Implementing Digital Integration

Integrating the Enterprise. How Business Leaders are Implementing Digital Integration Integrating the Enterprise How Business Leaders are Implementing Digital Integration Today s Session In Review Business Value of IoT Building an IoT Backbone Integrating the Enterprise Market Potential

More information

Course 20535A: Architecting Microsoft Azure Solutions

Course 20535A: Architecting Microsoft Azure Solutions Course 20535A: Architecting Microsoft Azure Solutions Module 1: Application Architecture Patterns in Azure This module introduces and reviews common Azure patterns and architectures as prescribed by the

More information

1% + 99% = AI Popularization

1% + 99% = AI Popularization 1% + 99% = AI Popularization Unifying Data Science and Engineering Jason Bissell General Manager, APAC The beginnings of Apache Spark at UC Berkeley AMPLab funded by tech companies: Got a glimpse at their

More information

Your Big Data to Big Data tools using the family of PI Integrators

Your Big Data to Big Data tools using the family of PI Integrators 1 Your Big Data to Big Data tools using the family of PI Integrators Presented by Martin Bryant Field Service Engineer @osisoft PI Integrators PI Integrator for Business Analytics PI Integrator for Business

More information

The Internet of Things Wind Turbine Predictive Analytics. Fluitec Wind s Tribo-Analytics System Predicting Time-to-Failure

The Internet of Things Wind Turbine Predictive Analytics. Fluitec Wind s Tribo-Analytics System Predicting Time-to-Failure The Internet of Things Wind Turbine Predictive Analytics Fluitec Wind s Tribo-Analytics System Predicting Time-to-Failure Big Data and Tribo-Analytics Today we will see how Fluitec solved real-world challenges

More information

Azure Data Factory Hybrid data integration, at global scale. Erika Harris Senior Program Manager AzureCAT

Azure Data Factory Hybrid data integration, at global scale. Erika Harris Senior Program Manager AzureCAT Azure Data Factory Hybrid data integration, at global scale Erika Harris Senior Program Manager AzureCAT Data Cloud AI There are barriers to getting value from data Data silos Incongruent data types Complexity

More information

Operational Hadoop and the Lambda Architecture for Streaming Data

Operational Hadoop and the Lambda Architecture for Streaming Data Operational Hadoop and the Lambda Architecture for Streaming Data 2015 MapR Technologies 2015 MapR Technologies 1 Topics From Batch to Operational Workloads on Hadoop Streaming Data Environments The Lambda

More information

Actionable Insights with PI Integrators

Actionable Insights with PI Integrators Actionable Insights with PI Integrators Hans Otto Weinhold, Partner Solutions Architect Joy Wang, Product Manager Agenda Introduction to PI Integrators Learn about Integrators and how they add value to

More information

Incorporating Predictive Models for Operational Intelligence

Incorporating Predictive Models for Operational Intelligence Incorporating Predictive Models for Operational Intelligence Presented by Curt Hertler Partner Solutions Architect, OSIsoft Copyright 2015 OSIsoft, LLC History The only has thing a way new of repeating

More information

Modern Analytics Architecture

Modern Analytics Architecture Modern Analytics Architecture So what is a. Modern analytics architecture? Machine Learning AI Open source Big Data DevOps Cloud In-memory IoT Trends supporting Next-Generation analytics Source: Next-Generation

More information

Your Top 5 Reasons Why You Should Choose SAP Data Hub INTERNAL

Your Top 5 Reasons Why You Should Choose SAP Data Hub INTERNAL Your Top 5 Reasons Why You Should Choose INTERNAL Top 5 reasons for choosing the solution 1 UNIVERSAL 2 INTELLIGENT 3 EFFICIENT 4 SCALABLE 5 COMPLIANT Universal view of the enterprise and Big Data: Get

More information

Industrial IoT Solution Architecture Design From Connectivity to Data

Industrial IoT Solution Architecture Design From Connectivity to Data Industrial IoT Solution Architecture Design From Connectivity to Data Cheryl Hsu Program Manager Strategic Engagement & Industrial IoT, Microsoft IoT Enables a Digital Feedback Loop The benefits are profound

More information

Power BI. Melissa Coates. Atlanta SQLSaturday BI Edition 1/9/2016. Blog: sqlchick.com

Power BI. Melissa Coates. Atlanta SQLSaturday BI Edition 1/9/2016. Blog: sqlchick.com Power BI Architecture, Integration Points, Implementation Options Atlanta SQLSaturday BI Edition 1/9/2016 Melissa Coates Solution Architect, BlueGranite blue-granite.com Blog: sqlchick.com Twitter: @sqlchick

More information

Five Advances in Analytics

Five Advances in Analytics Five Advances in Analytics Fern Halper TDWI Director of Research for Advanced Analytics @fhalper March 26, 2015 Sponsor 2 Speakers Fern Halper Research Director for Advanced Analytics, TDWI Mike Watschke

More information

Architecting Microsoft Azure Solutions

Architecting Microsoft Azure Solutions Microsoft Official Course - 20535 Architecting Microsoft Azure Solutions Length 5 days Prerequisites Create resources and resource group in Azure. Manage users, groups, and subscriptions in an Azure Active

More information

IIOT Data Access with the PI System

IIOT Data Access with the PI System IIOT Data Access with the PI System Presented by Nathawan H. Systems Engineer Copyright 2017 OSIsoft, LLC PI System data is utilized across the enterprise to solve various business impacts Safety & Security

More information

Big Data Introduction

Big Data Introduction Big Data Introduction Who we are Experts At Your Service Over 50 specialists in IT infrastructure Certified, experienced, passionate Based In Switzerland 100% self-financed Swiss company Over CHF8 mio.

More information

How to create an Azure subscription

How to create an Azure subscription How to create an Azure subscription Azure is a cloud hosting service offered by Microsoft, and offers services like file storage, backups, database and Windows and Linux virtual machines. Anyone can harness

More information

Turn Data into Business Value

Turn Data into Business Value Turn Data into Business Value Infinite Video Platform Analytics Layne Berg, Product Manager Steve Epstein, Distinguished Engineer June 21, 2017 Applying Big Data Analytics to Video Today, primarily descriptive

More information

Control Anything. Gain Insights. Connect Things. Action. 10% of the data on earth will come from IoT by B connected devices by 2020

Control Anything. Gain Insights. Connect Things. Action. 10% of the data on earth will come from IoT by B connected devices by 2020 Connect Things Control Anything Gain Insights Take Action 30B connected devices by 2020 $1.5M average increase in operating income for digitally transformed enterprises 10% of the data on earth will come

More information

DevOps och IoT. Infrastructure Architect - Avanade DK Blog:

DevOps och IoT. Infrastructure Architect - Avanade DK Blog: DevOps och IoT Infrastructure Architect - Avanade DK Michael.Jonsson@outlook.com Twitter: @Michael_Jonsson Blog: http://azurefabric.com/ (How would you solve this without the cloud?) DevOps The Base for

More information

IIoT Data Access with the PI System

IIoT Data Access with the PI System IIoT Data Access with the PI System Daniel McGovern November 8 th, 2017 PI System Data is Used Across the Enterprise to Achieve Business Impacting Change Safety & Security Energy Utilization Process Efficiency

More information

Fast Innovation requires Fast IT

Fast Innovation requires Fast IT Fast Innovation requires Fast IT Cisco IT - Analytics Implementation Vineet Jain Cisco IT Dramatic Internet Growth Occurring Through New Connections Fixed Computing Mobility / BYOD Internet of Things Internet

More information

Using Technology and Big Data to Provide Customers with a Passenger Experience. IBTTA September 12, 2017

Using Technology and Big Data to Provide Customers with a Passenger Experience. IBTTA September 12, 2017 Using Technology and Big Data to Provide Customers with a Passenger Experience IBTTA September 12, 2017 Big Data What is Big Data? Definition: Extremely large data sets that may be analyzed computationally

More information

Apache Hadoop in the Datacenter and Cloud

Apache Hadoop in the Datacenter and Cloud Apache Hadoop in the Datacenter and Cloud The Shift to the Connected Data Architecture Digital Transformation fueled by Big Data Analytics and IoT ACTIONABLE INTELLIGENCE Cloud and Data Center IDMS Relational

More information

Building data-driven applications with SAP Data Hub and Amazon Web Services

Building data-driven applications with SAP Data Hub and Amazon Web Services Building data-driven applications with SAP Data Hub and Amazon Web Services Dr. Lars Dannecker, Steffen Geissinger September 18 th, 2018 Cross-department disconnect Cross-department disconnect Cross-department

More information

Angat Pinoy. Angat Negosyo. Angat Pilipinas.

Angat Pinoy. Angat Negosyo. Angat Pilipinas. Angat Pinoy. Angat Negosyo. Angat Pilipinas. Four megatrends will dominate the next decade Mobility Social Cloud Big data 91% of organizations expect to spend on mobile devices in 2012 In 2012, mobile

More information

Security Solutions in Azure

Security Solutions in Azure Security Solutions in Azure Dylan de Jong Cloud solution architect Dyjong@Microsoft.com Welk jaar was dit? ADD A FOOTER Welk jaar werd het Microsoft Azure? 4 ADD A FOOTER 10 Jaar + Geleden ADD A FOOTER

More information

OSIsoft Super Regional Transform Your World

OSIsoft Super Regional Transform Your World OSIsoft Super Regional Transform Your World Copyright 208 OSIsoft, LLC OSIsoft Vision & Roadmap Chris Nelson, VP Software Development 2 st August, 208 Copyright 208 OSIsoft, LLC Copyright 208 OSIsoft,

More information

MapR Pentaho Business Solutions

MapR Pentaho Business Solutions MapR Pentaho Business Solutions The Benefits of a Converged Platform to Big Data Integration Tom Scurlock Director, WW Alliances and Partners, MapR Key Takeaways 1. We focus on business values and business

More information

Accelerating Your Big Data Analytics. Jeff Healey, Director Product Marketing, HPE Vertica

Accelerating Your Big Data Analytics. Jeff Healey, Director Product Marketing, HPE Vertica Accelerating Your Big Data Analytics Jeff Healey, Director Product Marketing, HPE Vertica Recent Waves of Disruption IT Infrastructu re for Analytics Data Warehouse Modernization Big Data/ Hadoop Cloud

More information

Azure Data Lake How to organize. Jan Cordtz, Microsoft Denmark Cloud Solution Architect

Azure Data Lake How to organize. Jan Cordtz, Microsoft Denmark Cloud Solution Architect Azure Data Lake How to organize Jan Cordtz, Microsoft Denmark jcordtz@microsoft.com Cloud Solution Architect Platform as a Service Security & Management Security Center Portal Azure Active Directory Azure

More information

Analytics Platform System

Analytics Platform System Analytics Platform System Big data. Small data. All data. Audie Wright, DW & Big Data Specialist Audie.Wright@Microsoft.com Ofc 425-538-0044, Cell 303-324-2860 Sean Mikha, DW & Big Data Architect semikha@microsoft.com

More information

Guide to Modernize Your Enterprise Data Warehouse How to Migrate to a Hadoop-based Big Data Lake

Guide to Modernize Your Enterprise Data Warehouse How to Migrate to a Hadoop-based Big Data Lake White Paper Guide to Modernize Your Enterprise Data Warehouse How to Migrate to a Hadoop-based Big Data Lake Motivation for Modernization It is now a well-documented realization among Fortune 500 companies

More information

Architecting for Real- Time Big Data Analytics. Robert Winters

Architecting for Real- Time Big Data Analytics. Robert Winters Architecting for Real- Time Big Data Analytics Robert Winters About Me 2 ROBERT WINTERS Head of Business Intelligence, TravelBird Ten years experience in analytics, five years with Vertica and big data

More information

CASE STUDY Delivering Real Time Financial Transaction Monitoring

CASE STUDY Delivering Real Time Financial Transaction Monitoring CASE STUDY Delivering Real Time Financial Transaction Monitoring Steve Wilkes Striim Co-Founder and CTO Background Customer is a US based Payment Systems Provider Large Network of ATM and Cashier Operated

More information

TAP Air Portugal. in Real Time TÍTULO. Subtítulo. Rui Monteiro - February 19. Data da apresentação

TAP Air Portugal. in Real Time TÍTULO. Subtítulo. Rui Monteiro - February 19. Data da apresentação TAP Air Portugal in Real Time Rui Monteiro - rmonteiro@tap.pt February 19 Resume The information is a strategic asset to support decision making and legacy data analysis has been the focus of analytical

More information

Data Lake Organization A Hadoop Eco-System. Jan Cordtz, Microsoft Denmark Cloud Solution Architect

Data Lake Organization A Hadoop Eco-System. Jan Cordtz, Microsoft Denmark Cloud Solution Architect Data Lake Organization A Hadoop Eco-System Jan Cordtz, Microsoft Denmark jcordtz@microsoft.com Cloud Solution Architect Hyper scale Infrastructure 100+ Datacenters across 42 Regions Worldwide Learn more:

More information

Analyzing Data with Power BI

Analyzing Data with Power BI Course 20778A: Analyzing Data with Power BI Course Outline Module 1: Introduction to Self-Service BI Solutions Introduces business intelligence (BI) and how to self-serve with BI. Introduction to business

More information

Big Data The Big Story

Big Data The Big Story Big Data The Big Story Jean-Pierre Dijcks Big Data Product Mangement 1 Agenda What is Big Data? Architecting Big Data Building Big Data Solutions Oracle Big Data Appliance and Big Data Connectors Customer

More information

Application Performance Management for Microsoft Azure and HDInsight

Application Performance Management for Microsoft Azure and HDInsight ebook Application Performance Management for Microsoft Azure and HDInsight How to build fast and reliable Big Data Apps on Microsoft Azure HDInsight and Azure Analytical Services Microsoft Azure makes

More information

Sunnie Chung. Cleveland State University

Sunnie Chung. Cleveland State University Sunnie Chung Cleveland State University Data Scientist Big Data Processing Data Mining 2 INTERSECT of Computer Scientists and Statisticians with Knowledge of Data Mining AND Big data Processing Skills:

More information

Architecting Microsoft Azure Solutions

Architecting Microsoft Azure Solutions Architecting Microsoft Azure Solutions 20535A; 5 Days; Instructor-led Course Description This course is intended for architects who have experience building infrastructure and applications on the Microsoft

More information

MapR: Solution for Customer Production Success

MapR: Solution for Customer Production Success 2015 MapR Technologies 2015 MapR Technologies 1 MapR: Solution for Customer Production Success Big Data High Growth 700+ Customers Cloud Leaders Riding the Wave with Hadoop The Big Data Platform of Choice

More information

Modernizing Your Data Warehouse with Azure

Modernizing Your Data Warehouse with Azure Modernizing Your Data Warehouse with Azure Big data. Small data. All data. Christian Coté S P O N S O R S The traditional BI Environment The traditional data warehouse data warehousing has reached the

More information

Data Analytics for Semiconductor Manufacturing The MathWorks, Inc. 1

Data Analytics for Semiconductor Manufacturing The MathWorks, Inc. 1 Data Analytics for Semiconductor Manufacturing 2016 The MathWorks, Inc. 1 Competitive Advantage What do we mean by Data Analytics? Analytics uses data to drive decision making, rather than gut feel or

More information

Cloud & Datacenter Monitoring with System Center Operations Manager

Cloud & Datacenter Monitoring with System Center Operations Manager Cloud & Datacenter Monitoring with System Center Operations Manager Course 10964B - Five days - Instructor-led - Hands-on Introduction This five-day course will provide students with the key knowledge

More information

Real-time Streaming Insight & Time Series Data Analytic For Smart Retail

Real-time Streaming Insight & Time Series Data Analytic For Smart Retail Real-time Streaming Insight & Time Series Data Analytic For Smart Retail Sudip Majumder Senior Director Development Industry IoT & Big Data 10/5/2016 Economic Characteristics of Data Data is the New Oil..then

More information

Analytics in Action transforming the way we use and consume information

Analytics in Action transforming the way we use and consume information Analytics in Action transforming the way we use and consume information Big Data Ecosystem The Data Traditional Data BIG DATA Repositories MPP Appliances Internet Hadoop Data Streaming Big Data Ecosystem

More information

30 min. Close. Facilitating innovation with IoT. Digital Transformation. Microsoft portfolio for product development

30 min. Close. Facilitating innovation with IoT. Digital Transformation. Microsoft portfolio for product development Close Facilitating innovation with IoT Microsoft portfolio for product development 30 min Digital Transformation IoT & analytics in the product lifecycle Data Analytics Cloud Digital Transformation Engage

More information

Course Outline (10996A)

Course Outline (10996A) Course Outline (10996A) Module 1: Overview of System Center 2016 In this module, you will learn about the different components in System Center 2016 including how they are placed within the architecture.

More information

E-guide Hadoop Big Data Platforms Buyer s Guide part 1

E-guide Hadoop Big Data Platforms Buyer s Guide part 1 Hadoop Big Data Platforms Buyer s Guide part 1 Your expert guide to Hadoop big data platforms for managing big data David Loshin, Knowledge Integrity Inc. Companies of all sizes can use Hadoop, as vendors

More information

Experiences in the Use of Big Data for Official Statistics

Experiences in the Use of Big Data for Official Statistics Think Big - Data innovation in Latin America Santiago, Chile 6 th March 2017 Experiences in the Use of Big Data for Official Statistics Antonino Virgillito Istat Introduction The use of Big Data sources

More information

Analyzing Data with Power BI (20778)

Analyzing Data with Power BI (20778) Analyzing Data with Power BI (20778) Duration: 3 Days Live Course Delivery Price: $1795 MOC On-Demand Price: $895 Discounts: We offer multiple discount options. Click here for more info. Delivery Options:

More information

Ventana Research. Big Data, Analytics & Cloud There s No Free Lunch! David Menninger SVP & Research Director Ventana

Ventana Research. Big Data, Analytics & Cloud There s No Free Lunch! David Menninger SVP & Research Director Ventana 1 Big Data, Analytics & Cloud There s No Free Lunch! David Menninger SVP & Research Director Ventana Research @dmenningervr Conducted Research on Big Data, Analytics and Cloud Data and Analytics in the

More information

Responsive enterprise the future of the enterprise PERSPECTIVE

Responsive enterprise the future of the enterprise PERSPECTIVE Responsive enterprise the future of the enterprise PERSPECTIVE Experience is not merely a buzzword today, it is quickly becoming a key differentiator in the digital world. Parameters such as quality, pricing,

More information

Data Science, realizing the Hype Cycle. Luigi Di Rito, Director Data Science Team, SAP Center of Excellence

Data Science, realizing the Hype Cycle. Luigi Di Rito, Director Data Science Team, SAP Center of Excellence Data Science, realizing the Hype Cycle. Luigi Di Rito, Director Data Science Team, SAP Center of Excellence Data Science, Machine Learning and Artificial Intelligence Deep Learning AREAS OF AI Rule-based

More information

Databricks Cloud. A Primer

Databricks Cloud. A Primer Databricks Cloud A Primer Who is Databricks? Databricks was founded by the team behind Apache Spark, the most active open source project in the big data ecosystem today. Our mission at Databricks is to

More information