Microsoft Two offerings which interoperate really well On-premises Cortana Intelligence Suite SQL Server 2016
Cloud IAAS Enterprise PAAS Cloud Storage Service
9 SQL Server 2016: Everything built-in built-in built-in built-in built-in built-in $2,230 80 70 60 50 43 69 49 SQL Server SQL Server SQL Server 40 30 20 10 0 34 29 22 20 22 18 15 6 4 5 0 1 3 3 0 0 2010 2011 2012 2013 2014 2015 #1 #2 #3 Oracle is #5 $480 $120 Microsoft Tableau Oracle SQL Server Oracle MySQL SAP HANA TPC-H Self-service BI per user at massive scale In-memory across all workloads Consistent experience from on-premises to cloud The above graphics were published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from Microsoft. Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. National Institute of Standards and Technology Comprehensive Vulnerability Database update 10/2015 TPC-H 10TB non-clustered results as of 04/06/15, 5/04/15, 4/15/14 and 11/25/13, respectively. http://www.tpc.org/tpch/results/tpch_perf_results.asp?resulttype=noncluster
Business is being transformed by three trends Big Data Cloud Intelligence
Stay ahead of the curve with Cortana Intelligence Suite Business apps People Custom apps Apps Sensors and devices Cortana Intelligence Automated systems Data Intelligence Action
Transform data into intelligent action Data Sources Information Management Data Factory Big Data Stores Data Lake Store Machine Learning and Analytics Machine Learning Intelligence Cognitive Services People Apps Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Web Event Hubs HDInsight (Hadoop and Spark) Cortana Apps Mobile Bots Data Sensors and devices Stream Analytics Dashboards & Visualizations Power BI Automated Systems Data Intelligence Action
Platform Services Security & Management Service Creation & Configuration User/Group Directory Store Identity Sign-Up and sign-in Multi-Factor Authentication Scheduled Service Management Task Scheduler Stateless Compute Scheduled Compute Jobs Simple Queuing Hybrid Connections Distributed Compute Virtual App Streaming B2B Integration Pub/Sub Queuing Web Apps Infrastructure Mobile Backends API Management API App Infrastructure Business Process Automation Push Notifications Big Data Analytics Relational SQL Database Distributed In-Memory Cache Predictive Analytics Data Warehouse Search Data Stream Analytics Document Database Service Simple Key/Value Store Big Data Storage Hybrid Operations Directory Health Monitoring Privileged Identity Management Domain Join & Policy Management Server Data Backup Operational Analytics Encryption Key Store Development Tools Software Development Kits Data Pipelines Device Data Collection Data Source Management Bulk Data Import And Export Software/Solution Marketplace Pre-Build VM Images Live & OD Media Streaming Content Delivery Network (CDN) Software Lifecycle Management Application Instrumentation Infrastructure Services IoT Device Management Mobile Analytics Disaster Recovery Hybrid/Intelligent Data Backup
Azure is an open cloud DevOps Clients Management Applications PaaS & DevOps App Frameworks & Tools Databases & Middleware Infrastructure
Dartmouth-Hitchcock Demo + Video
Information Management Data Sources Information Management Data Factory Apps Data Catalog Event Hubs Sensors and devices Data
Compose and orchestrate data services at scale Information Management SQL Data Factory INGEST Data Catalog DATA SOURCES <> SQL Event Hubs SQL { } Create, schedule, orchestrate, and manage data pipelines Visualize data lineage Connect to on-premises and cloud data sources Monitor data pipeline health Automate cloud resource management Move relational data for Hadoop processing Transform with Hive, Pig, or custom code
Get more value from your enterprise data assets Information Management Data Factory Data Catalog Event Hubs Spend less time looking for data, and more time getting value from it Register enterprise data sources, discover data assets and unlock their potential, and capture tribal knowledge to make data understandable Bridge the gap between IT and the business, allowing everyone to contribute their insights, tags, and descriptions Intuitive search and filtering to understand the data sources and their purpose Let your data live where you want; connect using tools you choose Integrate into existing tools and processes with open REST APIs
Ingest events from websites, apps and devices at cloud scale Information Management Data sources SQL Database Machine Learning Data Factory Data Catalog Apps Azure API Management Storage HDInsight Event Hubs Sensors and devices Data Backend Services Event Hubs Stream Analytics Power BI Log millions of events per second in near real time Connect devices using flexible authorization and throttling Use time-based event buffering Get a managed service with elastic scale Get a managed service with elastic scale Reach a broad set of platforms using native client libraries Pluggable adapters for other cloud services
ThyssenKrupp Demo + Video
Big Data Stores Data Sources Information Management Big Data Stores Data Factory Data Lake Store Apps Data Catalog SQL Data Warehouse Event Hubs Sensors and devices Data
A hyper-scale repository for big data analytics workloads Big Data Stores ADL Analytics Data Lake Store SQL Data Warehouse Devices LOB Applications Social Video ADL Store HDInsight R Web Sensors Spark Relational Clickstream Machine Learning A Hadoop Distributed File System for the cloud No fixed limits on file size No fixed limits on account size Unstructured and structured data in their native format Massive throughput to increase analytic performance High durability, availability, and reliability Azure Active Directory access control
Elastic data warehouse as a service with enterprise-class features Big Data Stores Data Lake Store Power BI Hadoop SQL Data Warehouse App Service SQL Database SQL Data Warehouse Intelligent App Machine Learning Petabyte scale with massively parallel processing Independent scaling of compute and storage in seconds Transact-SQL queries across relational and non-relational data Full enterprise-class SQL Server experience Works seamlessly with Power BI, Machine Learning, HDInsight, and Data Factory
Azure Data Lake (Store, HDInsight, Analytics) ADL Analytics ADL HDInsight Compute U-SQL Hive Hive YARN Data WebHDFS Store
Microsoft Azure Data Lake Analytics Service HDInsight U-SQL YARN HDFS Store
Hadoop in IaaS Hadoop in PaaS Big Data as a Service Pros Complete Control On-Demand Cluster Sizing Storage - Local or Cloud Cons Only VMs managed for HA Administration required Clusters need to stay active Pros Fully managed SLA bound Flexible resizing Pay-on-use Customization Options Deployed in minutes Cons Forgo some control Pros Abstracted from clusters Automated resource alignment Easy to use interface and APIs Familiar languages Faster time to market Cons Even Pricing is abstracted
Recent Forrester Wave Report on Big Data Hadoop Cloud
Machine Learning and Analytics Data Sources Information Management Big Data Stores Machine Learning and Analytics Data Factory Data Lake Store Machine Learning Apps Data Catalog SQL Data Warehouse Data Lake Analytics Event Hubs HDInsight (Hadoop and Spark) Sensors and devices Stream Analytics Data Intelligence
Easily build, deploy, and share predictive analytics solutions Machine Learning and Analytics Machine Learning Data Lake Analytics HDInsight (Hadoop and Spark) Stream Analytics Simple, scalable, cutting edge. A fully managed cloud service that enables you to easily build, deploy, and share predictive analytics solutions. Deploy in minutes. Azure Machine Learning means business. You can deploy your model into production as a web service that can be called from any device, anywhere and that can use any data source. Publish, share, monetize. Share your solution with the world in the Gallery or on the Azure Marketplace.
http://demos.datasciencedojo.com/demo/titanic/ https://sanddance.azurewebsites.net/beachpartyapp/beachpartyapp.html Azure Machine Learning : https://studio.azureml.net/
Big data analytics made easy Machine Learning and Analytics Machine Learning Data Lake Analytics Data Lake Analytics HDInsight (Hadoop and Spark) Stream Analytics SQL DW SQL DB Data Lake Store Storage Blobs SQL DB in a VM Analyze data of any kind and size Develop faster, debug and optimize smarter Interactively explore patterns in your data No learning curve use U-SQL, Spark, Hive, HBase and Storm Managed and supported with an enterprise-grade SLA Dynamically scales to match your business priorities Enterprise-grade security with Azure Active Directory Built on YARN, designed for the cloud
Comprehensive set of managed Apache big data projects Machine Learning and Analytics Machine Learning Batch Script SQL NoSQL Streaming In-Memory Data Lake Analytics Map Reduce Pig Hive HBase Storm Spark HDInsight (Hadoop and Spark) Core Engine Stream Analytics Scale to petabytes on demand Process unstructured and semi-structured data Develop in Java,.NET, and more Skip buying and maintaining hardware Deploy in Windows or Linux Spin up an Apache Hadoop cluster in minutes Visualize your Hadoop data in Excel Easily integrate on-premises Hadoop clusters
Real-time stream processing in the cloud Machine Learning and Analytics SQL Database Machine Learning Event Hubs Blob Storage Data Lake Analytics HDInsight (Hadoop and Spark) Blob Storage Stream Analytics Event Hubs Table Storage Power BI Stream Analytics Perform real-time analytics for your Internet of Things solutions Stream millions of events per second Get mission-critical reliability and performance with predictable results Create real-time dashboards and alerts over data from devices and applications Correlate across multiple streams of data Use familiar SQL-based language for rapid development
http://melnyrides75xlb64pcm2yuaws.azurewebsites.net/
Dashboards & Visualizations Data Sources Information Management Data Factory Big Data Stores Data Lake Store Machine Learning and Analytics Machine Learning Cognitive Services Apps Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Event Hubs HDInsight (Hadoop and Spark) Cortana Sensors and devices Stream Analytics Dashboards & Visualizations Data Power BI Data Intelligence
Keep a pulse on your business with live, interactive dashboards Stream Analytics Event Hubs Power BI Machine Learning Dashboards & Visualizations Power BI Power BI Storage SQL database HDInsight Power BI Analytics for everyone, even non-data experts Your whole business on one dashboard Create stunning, interactive reports Drive consistent analysis across your organization Embed visuals in your applications Get real-time alerts when things change
Custom Visual Gallery
Intelligence Data Sources Information Management Big Data Stores Machine Learning and Analytics Intelligence Data Factory Data Lake Store Machine Learning Cognitive Services Apps Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Cortana Sensors and devices Event Hubs HDInsight (Hadoop and Spark) Stream Analytics Dashboards & Visualizations Data
Microsoft Cognitive Services: Introducing the Seeing AI app At Build, Microsoft previewed Seeing AI, a research project that helps people who are visually impaired or blind to understand who and what is around them. The app will use computer vision, image & speech recognition, natural language processing and machine learning from Microsoft Cognitive Services and technology from Office Lens. The app is under development and is not available today. Read Blog Here Watch Video Here
Microsoft Cognitive Services Give your apps a human side
Cognitive Services API Collection Microsoft Cognitive Services Give your apps a human side
Vision Computer Vision API Face API Emotion API Video API Distill actionable information from images Detect, identify, analyze, organize, and tag faces in photos Personalize experiences with emotion recognition Analyze, edit, and process videos within your app
Speech Bing Speech API Convert speech to text and back again, and understand its intent Speaker Recognition API Give your app the ability to know who's talking Custom Recognition Intelligent Service Fine-tune speech recognition for anyone, anywhere
Language Bing Spell Check API Detect and correct spelling mistakes within your app Web Language Model API Leverage the power of language models trained on web-scale data Linguistic Analysis API Easily parse complex text with language analysis Language Understanding Intelligent Service Teach your apps to understand commands from your users Text Analytics API Detect sentiment, key phrases, topics, and language from your text
Search Bing Web Search API Bing Autosuggest API Bing Image Search API Bing Video Search API Bing News Search API Connect powerful search to your apps Give your app intelligent autosuggest options for searches Bring advanced image and metadata search to your app Trending videos, detailed metadata, and rich results Link your users to robust and timely news searches
Documentation http://www.projectoxford.ai/doc Developer Resources Client SDKs https://github.com/microsoft/projectoxford-clientsdk https://github.com/felixrieseberg/project-oxford (nodejs) https://github.com/southwood/project-oxford-python Example Code https://github.com/jsturtevant/happy-image-tester-django https://github.com/jsturtevant/happy-image-tester-nodejs
Your bots wherever your users converse Intelligence Cognitive Services Bot Framework Cortana Bot Connector Service: A service to register your bot, configure channels and publish to the Bot Directory. Connect your bot(s) seamlessly to text/sms, Office 365 mail, Skype, Slack, Twitter, and more. Bot Builder SDK: An open source SDK hosted on GitHub. Everything you need to build great dialogs within your Node.js or C# bot Bot Directory: A public directory of bots registered through the Bot Connector Service. Discover, try, and add bots to conversation experiences
Transform data into intelligent action Data Sources Information Management Data Factory Big Data Stores Data Lake Store Machine Learning and Analytics Machine Learning Intelligence Cognitive Services People Apps Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Web Event Hubs HDInsight (Hadoop and Spark) Cortana Apps Mobile Bots Data Sensors and devices Stream Analytics Dashboards & Visualizations Power BI Automated Systems Data Intelligence Action
Cortana Intelligence Competitions
Thank you & Next Steps Learn more Email: MESHAH@Microsoft.com And Visit the Cortana Intelligence page Remembering Marvin Minsky NO computer has ever been designed that is ever aware of What it s doing; but most of the time we aren t either.
2016 Microsoft Corporation. All rights reserved.