Two offerings which interoperate really well

Similar documents
Business is being transformed by three trends

Digital transformation is the next industrial revolution

Microsoft Azure Essentials

The Importance of good data management and Power BI

Azure Offerings for Big data. In Kee Paek Cloud Data Solution Architect Microsoft Korea October. 2016


Azure ML Data Camp. Ivan Kosyakov MTC Architect, Ph.D. Microsoft Technology Centers Microsoft Technology Centers. Experience the Microsoft Cloud

A World of Data. Raghu Ramakrishnan. CTO for Data, Technical Fellow Microsoft

Hortonworks Connected Data Platforms

Big data is hard. Top 3 Challenges To Adopting Big Data

Azure Data Analytics & Machine Learning Seminar. Daire Cunningham: BI Practice Area Manager

Democratization of AI with Cognitive Services. Adnan Masood, PhD. UST Global

AmCham Vietnam Digital Transformation with Cloud. Jeremy Showalter

30 min. Close. Facilitating innovation with IoT. Digital Transformation. Microsoft portfolio for product development

Insights to HDInsight

AZURE HDINSIGHT. Azure Machine Learning Track Marek Chmel

The next (R)Evolution?

Big Data Cloud. Simple, Secure, Integrated and Performant Big Data Platform for the Cloud

Alexander Klein. ETL meets Azure

What s new on Azure? Jan Willem Groenenberg

Security Solutions in Azure

Course 20535A: Architecting Microsoft Azure Solutions

Power BI with Big Data Stores

Embracing the Hybrid Cloud using Power BI in CSP. Name Role Group

Microsoft Big Data. Solution Brief

Course Content. The main purpose of the course is to give students the ability plan and implement big data workflows on HDInsight.

Advanced Analytics in Azure

20775A: Performing Data Engineering on Microsoft HD Insight

20775: Performing Data Engineering on Microsoft HD Insight

Enabling Data Intelligence in the Trusted Cloud. Oil&Gas

BRINGING AI TO ALL DEVELOPERS

HDInsight - Hadoop for the Commoner Matt Stenzel Data Platform Technical Specialist

How to create an Azure subscription

20775A: Performing Data Engineering on Microsoft HD Insight

Architecting Microsoft Azure Solutions

Hortonworks Data Platform

HPE Flexible Capacity with Microsoft Azure & Azure Stack

Data Lake Organization A Hadoop Eco-System. Jan Cordtz, Microsoft Denmark Cloud Solution Architect

Microsoft FastTrack For Azure Service Level Description

aka.ms/ uber-selfies

Maturing IoT solutions with Microsoft Azure. Glenn Colpaert Azure/IoT Domain

Architecting Microsoft Azure Solutions

Azure. Bruno Kovačić Axilis, Microsoft MVP

20775 Performing Data Engineering on Microsoft HD Insight

Microsoft Azure Architect Design (AZ301)

INTRODUCTION TO R FOR DATA SCIENCE WITH R FOR DATA SCIENCE DATA SCIENCE ESSENTIALS INTRODUCTION TO PYTHON FOR DATA SCIENCE. Azure Machine Learning

Industrial IoT Solution Architecture Design From Connectivity to Data

MICROSOFT AZURE THE CLOUD PLATFORM FOR DIGITAL TRANSFORMATION

Implementing Microsoft Azure Infrastructure Solutions

Implementing Microsoft Azure Infrastructure Solutions 20533B; 5 Days, Instructor-led

Architecting Microsoft Azure Solutions

Big Data with Azure: where to begin?

Apache Hadoop in the Datacenter and Cloud


Accelerating Your Big Data Analytics. Jeff Healey, Director Product Marketing, HPE Vertica

Aurélie Pericchi SSP APS Laurent Marzouk Data Insight & Cloud Architect

IMPLEMENTING MICROSOFT AZURE INFRASTRUCTURE SOLUTIONS

Azure: Microsoft Cloud. Microsoft Cloud End-to-end solutions

Limitless Creativity in the Cloud

Mobile:

Analytics Platform System

Azure PaaS and SaaS Microsoft s two approaches to building IoT solutions

Architecting Microsoft Azure Solutions

IDC, February 1, 2016 IDC Health Insights Report on Healthcare Provider IT Budgets

Azure Data Lake How to organize. Jan Cordtz, Microsoft Denmark Cloud Solution Architect

SOLUTION SHEET Hortonworks DataFlow (HDF ) End-to-end data flow management and streaming analytics platform

Making Realtime Reporting a Reality

Azure IoT Suite. Secure device connectivity and management. Data ingestion and command + control. Rich dashboards and visualizations

"Charting the Course... MOC A: Architecting Microsoft Azure Solutions. Course Summary

MICROSOFT AI PLATFORM

Jason Virtue Business Intelligence Technical Professional

Who is Databricks? Today, hundreds of organizations around the world use Databricks to build and power their production Spark applications.

AGILITY & CONTROL IN THE CLOUD WITHOUT TRADEOFFS

How to develop Data Scientist Super Powers! Using Azure from R to scale and persist analytic workloads.. Simon Field

WiFi MSFTGUEST msevent439sh

Building a Modern Data Warehouse in Azure for Power BI

Cask Data Application Platform (CDAP) Extensions

Amsterdam. (technical) Updates & demonstration. Robert Voermans Governance architect

From Data Deluge to Intelligent Data


Analytics in Action transforming the way we use and consume information

SAP Leonardo a SCP cloud

ADVANCED ANALYTICS & IOT ARCHITECTURES

Make Business Intelligence Work on Big Data

SKF Digitalization. Building a Digital Platform for an Enterprise Company. Jens Greiner Global Manager IoT Development

Building data-driven applications with SAP Data Hub and Amazon Web Services

REDEFINE BIG DATA. Zvi Brunner CTO. Copyright 2015 EMC Corporation. All rights reserved.

EXECUTIVE BRIEF. Successful Data Warehouse Approaches to Meet Today s Analytics Demands. In this Paper

5th Annual. Cloudera, Inc. All rights reserved.

Building IoT Solutions in Azure

Azure Part 2 - Cloud Agility with ZVR. Mike Nelson, Cloud Architect Shannon Snowden, Sr. Technical Architect

E-guide Hadoop Big Data Platforms Buyer s Guide part 1

Integrating the Enterprise. How Business Leaders are Implementing Digital Integration

Modernizing Your Data Warehouse with Azure

Oracle Big Data Cloud Service

Microsoft Dynamics 365 for Operations Microsoft Dynamics 365 for Operations Reasons to accelerate your path to the cloud with the new Dynamics 365

Pentaho 8.0 and Beyond. Matt Howard Pentaho Sr. Director of Product Management, Hitachi Vantara

Cognitive Data Warehouse and Analytics

SOLUTION SHEET End to End Data Flow Management and Streaming Analytics Platform

Transcription:

Microsoft Two offerings which interoperate really well On-premises Cortana Intelligence Suite SQL Server 2016

Cloud IAAS Enterprise PAAS Cloud Storage Service

9 SQL Server 2016: Everything built-in built-in built-in built-in built-in built-in $2,230 80 70 60 50 43 69 49 SQL Server SQL Server SQL Server 40 30 20 10 0 34 29 22 20 22 18 15 6 4 5 0 1 3 3 0 0 2010 2011 2012 2013 2014 2015 #1 #2 #3 Oracle is #5 $480 $120 Microsoft Tableau Oracle SQL Server Oracle MySQL SAP HANA TPC-H Self-service BI per user at massive scale In-memory across all workloads Consistent experience from on-premises to cloud The above graphics were published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from Microsoft. Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. National Institute of Standards and Technology Comprehensive Vulnerability Database update 10/2015 TPC-H 10TB non-clustered results as of 04/06/15, 5/04/15, 4/15/14 and 11/25/13, respectively. http://www.tpc.org/tpch/results/tpch_perf_results.asp?resulttype=noncluster

Business is being transformed by three trends Big Data Cloud Intelligence

Stay ahead of the curve with Cortana Intelligence Suite Business apps People Custom apps Apps Sensors and devices Cortana Intelligence Automated systems Data Intelligence Action

Transform data into intelligent action Data Sources Information Management Data Factory Big Data Stores Data Lake Store Machine Learning and Analytics Machine Learning Intelligence Cognitive Services People Apps Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Web Event Hubs HDInsight (Hadoop and Spark) Cortana Apps Mobile Bots Data Sensors and devices Stream Analytics Dashboards & Visualizations Power BI Automated Systems Data Intelligence Action

Platform Services Security & Management Service Creation & Configuration User/Group Directory Store Identity Sign-Up and sign-in Multi-Factor Authentication Scheduled Service Management Task Scheduler Stateless Compute Scheduled Compute Jobs Simple Queuing Hybrid Connections Distributed Compute Virtual App Streaming B2B Integration Pub/Sub Queuing Web Apps Infrastructure Mobile Backends API Management API App Infrastructure Business Process Automation Push Notifications Big Data Analytics Relational SQL Database Distributed In-Memory Cache Predictive Analytics Data Warehouse Search Data Stream Analytics Document Database Service Simple Key/Value Store Big Data Storage Hybrid Operations Directory Health Monitoring Privileged Identity Management Domain Join & Policy Management Server Data Backup Operational Analytics Encryption Key Store Development Tools Software Development Kits Data Pipelines Device Data Collection Data Source Management Bulk Data Import And Export Software/Solution Marketplace Pre-Build VM Images Live & OD Media Streaming Content Delivery Network (CDN) Software Lifecycle Management Application Instrumentation Infrastructure Services IoT Device Management Mobile Analytics Disaster Recovery Hybrid/Intelligent Data Backup

Azure is an open cloud DevOps Clients Management Applications PaaS & DevOps App Frameworks & Tools Databases & Middleware Infrastructure

Dartmouth-Hitchcock Demo + Video

Information Management Data Sources Information Management Data Factory Apps Data Catalog Event Hubs Sensors and devices Data

Compose and orchestrate data services at scale Information Management SQL Data Factory INGEST Data Catalog DATA SOURCES <> SQL Event Hubs SQL { } Create, schedule, orchestrate, and manage data pipelines Visualize data lineage Connect to on-premises and cloud data sources Monitor data pipeline health Automate cloud resource management Move relational data for Hadoop processing Transform with Hive, Pig, or custom code

Get more value from your enterprise data assets Information Management Data Factory Data Catalog Event Hubs Spend less time looking for data, and more time getting value from it Register enterprise data sources, discover data assets and unlock their potential, and capture tribal knowledge to make data understandable Bridge the gap between IT and the business, allowing everyone to contribute their insights, tags, and descriptions Intuitive search and filtering to understand the data sources and their purpose Let your data live where you want; connect using tools you choose Integrate into existing tools and processes with open REST APIs

Ingest events from websites, apps and devices at cloud scale Information Management Data sources SQL Database Machine Learning Data Factory Data Catalog Apps Azure API Management Storage HDInsight Event Hubs Sensors and devices Data Backend Services Event Hubs Stream Analytics Power BI Log millions of events per second in near real time Connect devices using flexible authorization and throttling Use time-based event buffering Get a managed service with elastic scale Get a managed service with elastic scale Reach a broad set of platforms using native client libraries Pluggable adapters for other cloud services

ThyssenKrupp Demo + Video

Big Data Stores Data Sources Information Management Big Data Stores Data Factory Data Lake Store Apps Data Catalog SQL Data Warehouse Event Hubs Sensors and devices Data

A hyper-scale repository for big data analytics workloads Big Data Stores ADL Analytics Data Lake Store SQL Data Warehouse Devices LOB Applications Social Video ADL Store HDInsight R Web Sensors Spark Relational Clickstream Machine Learning A Hadoop Distributed File System for the cloud No fixed limits on file size No fixed limits on account size Unstructured and structured data in their native format Massive throughput to increase analytic performance High durability, availability, and reliability Azure Active Directory access control

Elastic data warehouse as a service with enterprise-class features Big Data Stores Data Lake Store Power BI Hadoop SQL Data Warehouse App Service SQL Database SQL Data Warehouse Intelligent App Machine Learning Petabyte scale with massively parallel processing Independent scaling of compute and storage in seconds Transact-SQL queries across relational and non-relational data Full enterprise-class SQL Server experience Works seamlessly with Power BI, Machine Learning, HDInsight, and Data Factory

Azure Data Lake (Store, HDInsight, Analytics) ADL Analytics ADL HDInsight Compute U-SQL Hive Hive YARN Data WebHDFS Store

Microsoft Azure Data Lake Analytics Service HDInsight U-SQL YARN HDFS Store

Hadoop in IaaS Hadoop in PaaS Big Data as a Service Pros Complete Control On-Demand Cluster Sizing Storage - Local or Cloud Cons Only VMs managed for HA Administration required Clusters need to stay active Pros Fully managed SLA bound Flexible resizing Pay-on-use Customization Options Deployed in minutes Cons Forgo some control Pros Abstracted from clusters Automated resource alignment Easy to use interface and APIs Familiar languages Faster time to market Cons Even Pricing is abstracted

Recent Forrester Wave Report on Big Data Hadoop Cloud

Machine Learning and Analytics Data Sources Information Management Big Data Stores Machine Learning and Analytics Data Factory Data Lake Store Machine Learning Apps Data Catalog SQL Data Warehouse Data Lake Analytics Event Hubs HDInsight (Hadoop and Spark) Sensors and devices Stream Analytics Data Intelligence

Easily build, deploy, and share predictive analytics solutions Machine Learning and Analytics Machine Learning Data Lake Analytics HDInsight (Hadoop and Spark) Stream Analytics Simple, scalable, cutting edge. A fully managed cloud service that enables you to easily build, deploy, and share predictive analytics solutions. Deploy in minutes. Azure Machine Learning means business. You can deploy your model into production as a web service that can be called from any device, anywhere and that can use any data source. Publish, share, monetize. Share your solution with the world in the Gallery or on the Azure Marketplace.

http://demos.datasciencedojo.com/demo/titanic/ https://sanddance.azurewebsites.net/beachpartyapp/beachpartyapp.html Azure Machine Learning : https://studio.azureml.net/

Big data analytics made easy Machine Learning and Analytics Machine Learning Data Lake Analytics Data Lake Analytics HDInsight (Hadoop and Spark) Stream Analytics SQL DW SQL DB Data Lake Store Storage Blobs SQL DB in a VM Analyze data of any kind and size Develop faster, debug and optimize smarter Interactively explore patterns in your data No learning curve use U-SQL, Spark, Hive, HBase and Storm Managed and supported with an enterprise-grade SLA Dynamically scales to match your business priorities Enterprise-grade security with Azure Active Directory Built on YARN, designed for the cloud

Comprehensive set of managed Apache big data projects Machine Learning and Analytics Machine Learning Batch Script SQL NoSQL Streaming In-Memory Data Lake Analytics Map Reduce Pig Hive HBase Storm Spark HDInsight (Hadoop and Spark) Core Engine Stream Analytics Scale to petabytes on demand Process unstructured and semi-structured data Develop in Java,.NET, and more Skip buying and maintaining hardware Deploy in Windows or Linux Spin up an Apache Hadoop cluster in minutes Visualize your Hadoop data in Excel Easily integrate on-premises Hadoop clusters

Real-time stream processing in the cloud Machine Learning and Analytics SQL Database Machine Learning Event Hubs Blob Storage Data Lake Analytics HDInsight (Hadoop and Spark) Blob Storage Stream Analytics Event Hubs Table Storage Power BI Stream Analytics Perform real-time analytics for your Internet of Things solutions Stream millions of events per second Get mission-critical reliability and performance with predictable results Create real-time dashboards and alerts over data from devices and applications Correlate across multiple streams of data Use familiar SQL-based language for rapid development

http://melnyrides75xlb64pcm2yuaws.azurewebsites.net/

Dashboards & Visualizations Data Sources Information Management Data Factory Big Data Stores Data Lake Store Machine Learning and Analytics Machine Learning Cognitive Services Apps Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Event Hubs HDInsight (Hadoop and Spark) Cortana Sensors and devices Stream Analytics Dashboards & Visualizations Data Power BI Data Intelligence

Keep a pulse on your business with live, interactive dashboards Stream Analytics Event Hubs Power BI Machine Learning Dashboards & Visualizations Power BI Power BI Storage SQL database HDInsight Power BI Analytics for everyone, even non-data experts Your whole business on one dashboard Create stunning, interactive reports Drive consistent analysis across your organization Embed visuals in your applications Get real-time alerts when things change

Custom Visual Gallery

Intelligence Data Sources Information Management Big Data Stores Machine Learning and Analytics Intelligence Data Factory Data Lake Store Machine Learning Cognitive Services Apps Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Cortana Sensors and devices Event Hubs HDInsight (Hadoop and Spark) Stream Analytics Dashboards & Visualizations Data

Microsoft Cognitive Services: Introducing the Seeing AI app At Build, Microsoft previewed Seeing AI, a research project that helps people who are visually impaired or blind to understand who and what is around them. The app will use computer vision, image & speech recognition, natural language processing and machine learning from Microsoft Cognitive Services and technology from Office Lens. The app is under development and is not available today. Read Blog Here Watch Video Here

Microsoft Cognitive Services Give your apps a human side

Cognitive Services API Collection Microsoft Cognitive Services Give your apps a human side

Vision Computer Vision API Face API Emotion API Video API Distill actionable information from images Detect, identify, analyze, organize, and tag faces in photos Personalize experiences with emotion recognition Analyze, edit, and process videos within your app

Speech Bing Speech API Convert speech to text and back again, and understand its intent Speaker Recognition API Give your app the ability to know who's talking Custom Recognition Intelligent Service Fine-tune speech recognition for anyone, anywhere

Language Bing Spell Check API Detect and correct spelling mistakes within your app Web Language Model API Leverage the power of language models trained on web-scale data Linguistic Analysis API Easily parse complex text with language analysis Language Understanding Intelligent Service Teach your apps to understand commands from your users Text Analytics API Detect sentiment, key phrases, topics, and language from your text

Search Bing Web Search API Bing Autosuggest API Bing Image Search API Bing Video Search API Bing News Search API Connect powerful search to your apps Give your app intelligent autosuggest options for searches Bring advanced image and metadata search to your app Trending videos, detailed metadata, and rich results Link your users to robust and timely news searches

Documentation http://www.projectoxford.ai/doc Developer Resources Client SDKs https://github.com/microsoft/projectoxford-clientsdk https://github.com/felixrieseberg/project-oxford (nodejs) https://github.com/southwood/project-oxford-python Example Code https://github.com/jsturtevant/happy-image-tester-django https://github.com/jsturtevant/happy-image-tester-nodejs

Your bots wherever your users converse Intelligence Cognitive Services Bot Framework Cortana Bot Connector Service: A service to register your bot, configure channels and publish to the Bot Directory. Connect your bot(s) seamlessly to text/sms, Office 365 mail, Skype, Slack, Twitter, and more. Bot Builder SDK: An open source SDK hosted on GitHub. Everything you need to build great dialogs within your Node.js or C# bot Bot Directory: A public directory of bots registered through the Bot Connector Service. Discover, try, and add bots to conversation experiences

Transform data into intelligent action Data Sources Information Management Data Factory Big Data Stores Data Lake Store Machine Learning and Analytics Machine Learning Intelligence Cognitive Services People Apps Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Web Event Hubs HDInsight (Hadoop and Spark) Cortana Apps Mobile Bots Data Sensors and devices Stream Analytics Dashboards & Visualizations Power BI Automated Systems Data Intelligence Action

Cortana Intelligence Competitions

Thank you & Next Steps Learn more Email: MESHAH@Microsoft.com And Visit the Cortana Intelligence page Remembering Marvin Minsky NO computer has ever been designed that is ever aware of What it s doing; but most of the time we aren t either.

2016 Microsoft Corporation. All rights reserved.