Azure Offerings for Big data. In Kee Paek Cloud Data Solution Architect Microsoft Korea October. 2016
|
|
- Myron Riley
- 6 years ago
- Views:
Transcription
1
2 Azure Offerings for Big data In Kee Paek Cloud Data Solution Architect Microsoft Korea October. 2016
3 Agenda 1. Integrated Big data Platform - Cortana Intelligent Suite 2. Scalable Machine Learning - R & Spark on HDInsight 3. GPUs in Azure for Compute & Visualization
4 Stay ahead of the curve with Cortana Intelligence Suite Business apps People Custom apps Apps Sensors and devices Cortana Intelligence Automated systems Data Intelligence Action
5 Cortana Intelligence combines the services you already know
6 Transform data into intelligent action Data Sources Information Management Data Factory Big Data Stores Data Lake Store Machine Learning and Analytics Machine Learning Intelligence Cognitive Services People Apps Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Web Event Hubs HDInsight (Hadoop and Spark) Cortana Apps Mobile Bots Data Sensors and devices Stream Analytics Dashboards & Visualizations Power BI Automated Systems Data Intelligence Action
7 Information Management Data Sources Information Management Data Factory Apps Data Catalog Event Hubs Sensors and devices Data
8 Compose and orchestrate data services at scale Information Management SQL Data Factory INGEST Data Catalog DATA SOURCES <> SQL Event Hubs SQL { } Create, schedule, orchestrate, and manage data pipelines Visualize data lineage Connect to on-premises and cloud data sources Monitor data pipeline health Automate cloud resource management Move relational data for Hadoop processing Transform with Hive, Pig, or custom code
9 Get more value from your enterprise data assets Information Management Data Factory Data Catalog Event Hubs Spend less time looking for data, and more time getting value from it Register enterprise data sources, discover data assets and unlock their potential, and capture tribal knowledge to make data understandable Bridge the gap between IT and the business, allowing everyone to contribute their insights, tags, and descriptions Intuitive search and filtering to understand the data sources and their purpose Let your data live where you want; connect using tools you choose Integrate into existing tools and processes with open REST APIs
10 Ingest events from websites, apps and devices at cloud scale Information Management Data sources SQL Database Machine Learning Data Factory Data Catalog Apps Azure API Management Storage HDInsight Event Hubs Sensors and devices Data Backend Services Event Hubs Stream Analytics Power BI Log millions of events per second in near real time Connect devices using flexible authorization and throttling Use time-based event buffering Get a managed service with elastic scale Get a managed service with elastic scale Reach a broad set of platforms using native client libraries Pluggable adapters for other cloud services
11 Big Data Stores Data Sources Information Management Big Data Stores Data Factory Data Lake Store Apps Data Catalog SQL Data Warehouse Event Hubs Sensors and devices Data
12 A hyper-scale repository for big data analytics workloads Big Data Stores ADL Analytics Data Lake Store SQL Data Warehouse Devices LOB Applications Social Video ADL Store HDInsight R Web Sensors Spark Relational Clickstream Machine Learning A Hadoop Distributed File System for the cloud No fixed limits on file size No fixed limits on account size Unstructured and structured data in their native format Massive throughput to increase analytic performance High durability, availability, and reliability Azure Active Directory access control
13 Elastic data warehouse as a service with enterprise-class features Big Data Stores Data Lake Store Power BI Hadoop SQL Data Warehouse App Service SQL Database SQL Data Warehouse Intelligent App Machine Learning Petabyte scale with massively parallel processing Independent scaling of compute and storage in seconds Transact-SQL queries across relational and non-relational data Full enterprise-class SQL Server experience Works seamlessly with Power BI, Machine Learning, HDInsight, and Data Factory
14 Machine Learning and Analytics Data Sources Information Management Big Data Stores Machine Learning and Analytics Data Factory Data Lake Store Machine Learning Apps Data Catalog SQL Data Warehouse Data Lake Analytics Event Hubs HDInsight (Hadoop and Spark) Sensors and devices Stream Analytics Data Intelligence
15 Easily build, deploy, and share predictive analytics solutions Machine Learning and Analytics Machine Learning Data Lake Analytics HDInsight (Hadoop and Spark) Stream Analytics Simple, scalable, cutting edge. A fully managed cloud service that enables you to easily build, deploy, and share predictive analytics solutions. Deploy in minutes. Azure Machine Learning means business. You can deploy your model into production as a web service that can be called from any device, anywhere and that can use any data source. Publish, share, monetize. Share your solution with the world in the Gallery or on the Azure Marketplace.
16 Big data analytics made easy Machine Learning and Analytics Machine Learning Data Lake Analytics Data Lake Analytics HDInsight (Hadoop and Spark) Stream Analytics SQL DW SQL DB Data Lake Store Storage Blobs SQL DB in a VM Analyze data of any kind and size Develop faster, debug and optimize smarter Interactively explore patterns in your data No learning curve use U-SQL, Spark, Hive, HBase and Storm Managed and supported with an enterprise-grade SLA Dynamically scales to match your business priorities Enterprise-grade security with Azure Active Directory Built on YARN, designed for the cloud
17 Comprehensive set of managed Apache big data projects Machine Learning and Analytics Machine Learning Batch Script SQL NoSQL Streaming In-Memory Data Lake Analytics Map Reduce Pig Hive HBase Storm Spark HDInsight (Hadoop and Spark) Core Engine Stream Analytics Scale to petabytes on demand Process unstructured and semi-structured data Develop in Java,.NET, and more Skip buying and maintaining hardware Deploy in Windows or Linux Spin up an Apache Hadoop cluster in minutes Visualize your Hadoop data in Excel Easily integrate on-premises Hadoop clusters
18 Real-time stream processing in the cloud Machine Learning and Analytics SQL Database Machine Learning Event Hubs Blob Storage Data Lake Analytics HDInsight (Hadoop and Spark) Blob Storage Stream Analytics Event Hubs Table Storage Power BI Stream Analytics Perform real-time analytics for your Internet of Things solutions Stream millions of events per second Get mission-critical reliability and performance with predictable results Create real-time dashboards and alerts over data from devices and applications Correlate across multiple streams of data Use familiar SQL-based language for rapid development
19 Intelligence Data Sources Information Management Big Data Stores Machine Learning and Analytics Intelligence Data Factory Data Lake Store Machine Learning Cognitive Services Apps Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Cortana Event Hubs HDInsight (Hadoop and Spark) Sensors and devices Stream Analytics Data
20 Agenda 1. Integrated Big data Platform - Cortana Intelligent Suite 2. Scalable Machine Learning - R & Spark on HDInsight 3. GPUs in Azure for Compute & Visualization
21 Cortana Intelligent Suite Data Sources Information Management Data Factory Big Data Stores Data Lake Store Machine Learning and Analytics Machine Learning Intelligence Cognitive Services People Apps Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Web Event Hubs HDInsight (Hadoop and Spark) Cortana Apps Mobile Bots Data Sensors and devices Stream Analytics Dashboards & Visualizations Power BI Automated Systems Data Intelligence Action
22 Infinite world of scalable machine learning logistic regression, linear models, basic statistics, hypothesis testing, k-means, decision trees page rank, collaborative filtering, graph processing, SVD, PCA, Bayesian models, deep learning over various types of networks
23 Use cases of scalable machine learning Retail Financial services Healthcare Manufacturing loyalty programs customer acquisition pricing strategy supply chain mgnt customer churn fraud detection risk & compliance cross-sell & upsell personalization bill collection operational efficiency patient demographics pay for performance demand forecasting pricing strategy supply chain optimization predictive maintenance remote monitoring product recommendations intelligent search routing robotics image, video recognition sentiment analysis text comprehension natural language processing ad placement predictive maintenance robotics bots augmented reality predictive maintenance
24 Scalable machine learning offerings in HDInsight Server
25
26 What is R Language Platform The most popular statistical programming language A data visualization tool Open source What is Community 2.5+M users Taught in most universities New and recent grad s use it Thriving user groups worldwide Ecosystem contributed packages Rich application & platform integration
27 R from Microsoft brings Peace of mind Speed and scalability Flexibility
28 Open Source R "
29 Microsoft R Server /data/binary.csv
30 R Server Parallelized by Spark /data/binary.csv
31 R Server on HDInsight R R R R R R R R R R R Server
32 R Server and Spark resource sharing R Tools for VS R Studio Edge node R server DeployR YARN Default Queue IntelliJ IDEA Jupyter notebooks BI Tools Head node Livy server Thrift server Thrift Queue
33 Parallelized and Distributed Algorithms ETL Data import Delimited, Fixed, SAS, SPSS, OBDC Variable creation & transformation Recode variables Factor variables Missing value handling Sort, Merge, Split Aggregate by category (means, sums) Descriptive Statistics Min / Max, Mean, Median (approx.) Quantiles (approx.) Standard Deviation Variance Correlation Covariance Sum of Squares (cross product matrix for set variables) Pairwise Cross tabs Risk Ratio & Odds Ratio Cross-Tabulation of Data (standard tables & long form) Marginal Summaries of Cross Tabulations Statistical Tests Chi Square Test Kendall Rank Correlation Fisher s Exact Test Student s t-test Predictive Statistics Sum of Squares (cross product matrix for set variables) Multiple Linear Regression Generalized Linear Models (GLM) exponential family distributions: binomial, Gaussian, inverse Gaussian, Poisson, Tweedie. Standard link functions: cauchit, identity, log, logit, probit. User defined distributions & link functions. Covariance & Correlation Matrices Logistic Regression Predictions/scoring for models Residuals for all models Variable Selection Stepwise Regression Machine Learning Decision Trees Decision Forests Gradient Boosted Decision Trees Naïve Bayes Clustering K-Means Simulation Simulation (e.g. Monte Carlo) Parallel Random Number Generation Custom Parallelization rxdatastep rxexec PEMA-R API
34 Microsoft R Server: scale-out R, Enterprise Class!
35
36 Apache Spark
37 Spark as a Platform Data Sources
38 Spark MLlib algorithms
39 Spark MLlib algorithms in R language
40 Spark MLlib algorithms in Python language
41 60% KNuggets poll (2014) 50% 40% 30% 20% R and Python are two dominant languages 10% 0% R SAS Python SQL Java the poll
42 R and Spark are better together
43
44 Brief history of Deep learning
45 Deep Learning is about big models and big data
46 Deep Neural Network training
47 Scalable Machine Learning offerings in HDInsight R language Python language Scala/Java Server Server + R Ecosystem + Python Ecosystem + Spark Ecosystem + Spark Ecosystem
48 Agenda 1. Integrated Big data Platform - Cortana Intelligent Suite 2. Scalable Machine Learning - R & Spark on HDInsight 3. GPUs in Azure for Compute & Visualization
49 GPU Virtualization Vision Deliver accelerated graphics & compute capabilities in Azure infrastructure High end performance Not Swiss-army knife offering Helps achieve true HPC in the Cloud Close partnership with NVIDIA
50 Media Stream high fidelity video games Encoding and transcoding Image processing Social media sentiment analysis
51 Rendering Visual Effects (VFX) Ray-Tracing rendering Advertising & Marketing CAD Applications in Architecture Simulations
52 GPU Virtualization Technology DDA (Discrete Device Assignment) Entire device is mapped into the VM just as it would be running on bare metal Allows for full access to capabilities of that device as well as allowing the device s native driver to be used Introduced in Windows Server 2016 as part of Hyper-V Pass-through PCIe devices directly to a Guest VM Allows for close to bare-metal performance
53
54 Compute Virtual Machines
55 Tesla K80 It s fast 15x K80 CPU 10x 5x 0x Benchmarks Molecular Dynamics Quantum Chemistry Physics
56 Accuracy Rate of Improvement 100% 100% 100% 95% 90% 85% 80% GPU 84% 88% 93% 96% 95% 90% 85% 80% 90% 80% 70% 60% Top Score 55% 72% 66% 62% 79% 75% 87.5% 83% 86% 75% 70% 72% 74% 75% 70% 50% 40% 45% 39% 65% % %
57
58 Visualization Virtual Machines
59
60 Collaboration with CNTK First class citizen Scalability multi-gpu-multi-vm Performance Internal use-cases across various Microsoft properties and products (DSVM) Data Science VM by Azure Machine Learning N-Series and CNTK works really well together
61 Samples per Second CNTK Performance on DDA Avg. Samples/Sec Linear (Avg. Samples/Sec) CPU 1 GPU 2 GPUs 3 GPUs 4 GPUs Resource
62 NV = Tesla M60 and supports OpenGL & DirectX NC = Tesla K80 and supports CUDA & OpenCL Sign Azure Batch aka.as/tryazurehpc Teradici NVIDIA
63 2016 Microsoft Corporation. All rights reserved.
Analytical Capability Security Compute Ease Data Scale Price Users Traditional Statistics vs. Machine Learning In-Memory vs. Shared Infrastructure CRAN vs. Parallelization Desktop vs. Remote Explicit vs.
More informationMicrosoft Azure Essentials
Microsoft Azure Essentials Azure Essentials Track Summary Data Analytics Explore the Data Analytics services in Azure to help you analyze both structured and unstructured data. Azure can help with large,
More informationARCHITECTURES ADVANCED ANALYTICS & IOT. Presented by: Orion Gebremedhin. Marc Lobree. Director of Technology, Data & Analytics
ADVANCED ANALYTICS & IOT ARCHITECTURES Presented by: Orion Gebremedhin Director of Technology, Data & Analytics Marc Lobree National Architect, Advanced Analytics EDW THE RIGHT TOOL FOR THE RIGHT WORKLOAD
More informationMicrosoft Big Data. Solution Brief
Microsoft Big Data Solution Brief Contents Introduction... 2 The Microsoft Big Data Solution... 3 Key Benefits... 3 Immersive Insight, Wherever You Are... 3 Connecting with the World s Data... 3 Any Data,
More informationMICROSOFT AI PLATFORM
MICROSOFT AI PLATFORM Build Intelligent Software Artificial Intelligence productivity for every developer and every scenario With the Azure platform and productivity services, you can create the next generation
More informationBrian Macdonald Big Data & Analytics Specialist - Oracle
Brian Macdonald Big Data & Analytics Specialist - Oracle Improving Predictive Model Development Time with R and Oracle Big Data Discovery brian.macdonald@oracle.com Copyright 2015, Oracle and/or its affiliates.
More informationBig Data Analytics for Retail with Apache Hadoop. A Hortonworks and Microsoft White Paper
Big Data Analytics for Retail with Apache Hadoop A Hortonworks and Microsoft White Paper 2 Contents The Big Data Opportunity for Retail 3 The Data Deluge, and Other Barriers 4 Hadoop in Retail 5 Omni-Channel
More informationE-guide Hadoop Big Data Platforms Buyer s Guide part 1
Hadoop Big Data Platforms Buyer s Guide part 1 Your expert guide to Hadoop big data platforms for managing big data David Loshin, Knowledge Integrity Inc. Companies of all sizes can use Hadoop, as vendors
More informationAzure IoT Suite. Secure device connectivity and management. Data ingestion and command + control. Rich dashboards and visualizations
Azure IoT Suite Secure device connectivity and management Data ingestion and command + control Rich dashboards and visualizations Business workflow integration Move beyond building blocks with pre-configured
More informationCopyright - Diyotta, Inc. - All Rights Reserved. Page 2
Page 2 Page 3 Page 4 Page 5 Humanizing Analytics Analytic Solutions that Provide Powerful Insights about Today s Healthcare Consumer to Manage Risk and Enable Engagement and Activation Industry Alignment
More informationApache Spark 2.0 GA. The General Engine for Modern Analytic Use Cases. Cloudera, Inc. All rights reserved.
Apache Spark 2.0 GA The General Engine for Modern Analytic Use Cases 1 Apache Spark Drives Business Innovation Apache Spark is driving new business value that is being harnessed by technology forward organizations.
More informationSimplifying the Process of Uploading and Extracting Data from Apache Hadoop
Simplifying the Process of Uploading and Extracting Data from Apache Hadoop Rohit Bakhshi, Solution Architect, Hortonworks Jim Walker, Director Product Marketing, Talend Page 1 About Us Rohit Bakhshi Solution
More informationBig Data The Big Story
Big Data The Big Story Jean-Pierre Dijcks Big Data Product Mangement 1 Agenda What is Big Data? Architecting Big Data Building Big Data Solutions Oracle Big Data Appliance and Big Data Connectors Customer
More informationBringing the Power of SAS to Hadoop Title
WHITE PAPER Bringing the Power of SAS to Hadoop Title Combine SAS World-Class Analytics With Hadoop s Low-Cost, Distributed Data Storage to Uncover Hidden Opportunities ii Contents Introduction... 1 What
More informationJason Virtue Business Intelligence Technical Professional
Jason Virtue Business Intelligence Technical Professional jvirtue@microsoft.com Agenda Microsoft Azure Data Services Azure Cloud Services Azure Machine Learning Azure Service Bus Azure Stream Analytics
More informationOperational Hadoop and the Lambda Architecture for Streaming Data
Operational Hadoop and the Lambda Architecture for Streaming Data 2015 MapR Technologies 2015 MapR Technologies 1 Topics From Batch to Operational Workloads on Hadoop Streaming Data Environments The Lambda
More informationMicrosoft FastTrack For Azure Service Level Description
ef Microsoft FastTrack For Azure Service Level Description 2017 Microsoft. All rights reserved. 1 Contents Microsoft FastTrack for Azure... 3 Eligible Solutions... 3 FastTrack for Azure Process Overview...
More informationDeloitte School of Analytics. Demystifying Data Science: Leveraging this phenomenon to drive your organisation forward
Deloitte School of Analytics Demystifying Data Science: Leveraging this phenomenon to drive your organisation forward February 2018 Agenda 7 February 2018 8 February 2018 9 February 2018 8:00 9:00 Networking
More informationHybrid Data Management
Kelly Schlamb Executive IT Specialist, Worldwide Analytics Platform Enablement and Technical Sales (kschlamb@ca.ibm.com, @KSchlamb) Hybrid Data Management IBM Analytics Summit 2017 November 8, 2017 5 Essential
More informationIBM SPSS & Apache Spark
IBM SPSS & Apache Spark Making Big Data analytics easier and more accessible ramiro.rego@es.ibm.com @foreswearer 1 2016 IBM Corporation Modeler y Spark. Integration Infrastructure overview Spark, Hadoop
More informationDLT AnalyticsStack. Powering big data, analytics and data science strategies for government agencies
DLT Stack Powering big data, analytics and data science strategies for government agencies Now, government agencies can have a scalable reference model for success with Big Data, Advanced and Data Science
More informationSAS Machine Learning and other Analytics: Trends and Roadmap. Sascha Schubert Sberbank 8 Sep 2017
SAS Machine Learning and other Analytics: Trends and Roadmap Sascha Schubert Sberbank 8 Sep 2017 How Big Analytics will Change Organizations Optimization and Innovation Optimizing existing processes Customer
More informationEmbracing Disruption: Financial Services and the Microsoft Cloud
Embracing Disruption: Financial Services and the Microsoft Cloud Resources Executive Summary Challenges and Opportunities in the Microsoft Cloud Security, Privacy & Data Sovereignty http://endj.in/cloud/trust
More informationData Analytics with MATLAB Adam Filion Application Engineer MathWorks
Data Analytics with Adam Filion Application Engineer MathWorks 2015 The MathWorks, Inc. 1 Case Study: Day-Ahead Load Forecasting Goal: Implement a tool for easy and accurate computation of dayahead system
More informationFrom Information to Insight: The Big Value of Big Data. Faire Ann Co Marketing Manager, Information Management Software, ASEAN
From Information to Insight: The Big Value of Big Data Faire Ann Co Marketing Manager, Information Management Software, ASEAN The World is Changing and Becoming More INSTRUMENTED INTERCONNECTED INTELLIGENT
More informationETL challenges on IOT projects. Pedro Martins Head of Implementation
ETL challenges on IOT projects Pedro Martins Head of Implementation Outline What is Pentaho Pentaho Data Integration (PDI) Smartcity Copenhagen Example of Data structure without an OLAP schema Telematics
More informationCloud service models
Onur Dogruoz Cloud service models Security & Management Security Center Portal Azure Active Directory Azure AD B2C Multi-Factor Authentication Media Services Logic Apps Media & CDN API Management Media
More informationLimitless Creativity in the Cloud
Limitless Creativity in the Cloud (Secure and on Schedule) Michael Krulik, Principal Solutions Specialist, Avid Joel Sloss, Sr. Program Manager, Microsoft Dec. 6, 2017 Emerging Threats Specific/sequential
More informationYour Big Data to Big Data tools using the family of PI Integrators
1 Your Big Data to Big Data tools using the family of PI Integrators Presented by Martin Bryant Field Service Engineer @osisoft PI Integrators PI Integrator for Business Analytics PI Integrator for Business
More informationInternet of Things. Point of View. Turn your data into accessible, actionable insights for maximum business value.
Point of View Internet of Things Turn your data into accessible, actionable insights for maximum business value Executive Summary Use a connected ecosystem to create new levels of business value The Internet
More informationReal-time Streaming Insight & Time Series Data Analytic For Smart Retail
Real-time Streaming Insight & Time Series Data Analytic For Smart Retail Sudip Majumder Senior Director Development Industry IoT & Big Data 10/5/2016 Economic Characteristics of Data Data is the New Oil..then
More informationHouse Keeping. You are in Listen Only Mode. Azure 101: Azure Overview. Azure 201: How to do a Cost Estimate for Virtual Machines
House Keeping You are in Listen Only Mode Use the WebEx Chat window to enter question Azure 101: Azure Overview First Tuesday of each Month Azure 201: How to do a Cost Estimate for Virtual Machines Second
More informationMicrosoft Dynamics 365 and Columbus
Microsoft Dynamics 365 and Columbus Start your cloud journey Cloud services Cloud transformation series If you agree that modern cloud computing is a great way to benefit from innovative, powerful technology
More informationETL on Hadoop What is Required
ETL on Hadoop What is Required Keith Kohl Director, Product Management October 2012 Syncsort Copyright 2012, Syncsort Incorporated Agenda Who is Syncsort Extract, Transform, Load (ETL) Overview and conventional
More information"Charting the Course... MOC A: Architecting Microsoft Azure Solutions. Course Summary
MOC 20535 A: Architecting Microsoft Course Summary Description This course is intended for architects who have experience building infrastructure and applications on the Microsoft platform. Students should
More informationIntegrating MATLAB Analytics into Enterprise Applications
Integrating MATLAB Analytics into Enterprise Applications David Willingham 2015 The MathWorks, Inc. 1 Run this link. http://bit.ly/matlabapp 2 Key Takeaways 1. What is Enterprise Integration 2. What is
More informationData Strategy: How to Handle the New Data Integration Challenges. Edgar de Groot
Data Strategy: How to Handle the New Data Integration Challenges Edgar de Groot New Business Models Lead to New Data Integration Challenges Organisations are generating insight Insight is capital 3 Retailers
More informationLeveraging Oracle Big Data Discovery to Master CERN s Data. Manuel Martín Márquez Oracle Business Analytics Innovation 12 October- Stockholm, Sweden
Leveraging Oracle Big Data Discovery to Master CERN s Data Manuel Martín Márquez Oracle Business Analytics Innovation 12 October- Stockholm, Sweden Manuel Martin Marquez Intel IoT Ignition Lab Cloud and
More informationBig Data & Advanced Analytics - "managed Services on Azure
Big Data & Advanced Analytics - "managed Services on Azure Guido Jacobs Global Black Belt TSP Big Data Guido.Jacobs@microsoft.com Microsoft Deutschland GmbH Hyper scale Infrastruktur das ist Azure! US
More informationBoston Azure Cloud User Group. a journey of a thousand miles begins with a single step
Boston Azure Cloud User Group a journey of a thousand miles begins with a single step 3 Solution Architect at Slalom Boston Business Intelligence User Group Leader I am a bit shy but passionate. BI Architect
More informationDATA ANALYTICS WITH R, EXCEL & TABLEAU
Learn. Do. Earn. DATA ANALYTICS WITH R, EXCEL & TABLEAU COURSE DETAILS centers@acadgild.com www.acadgild.com 90360 10796 Brief About this Course Data is the foundation for technology-driven digital age.
More informationStreaming Analytics, Data Lakes and PI Integrators
Streaming Analytics, Data Lakes and PI Integrators Presented by Matt Ziegler Aaron Loe Conference Theme and Keywords 2 A journey through history 2010 Machine 2014 Learning and IoT 2016 2012 2014 2015 3
More informationCloud Integration and the Big Data Journey - Common Use-Case Patterns
Cloud Integration and the Big Data Journey - Common Use-Case Patterns A White Paper August, 2014 Corporate Technologies Business Intelligence Group OVERVIEW The advent of cloud and hybrid architectures
More informationE-guide Hadoop Big Data Platforms Buyer s Guide part 3
Big Data Platforms Buyer s Guide part 3 Your expert guide to big platforms enterprise MapReduce cloud-based Abie Reifer, DecisionWorx The Amazon Elastic MapReduce Web service offers a managed framework
More informationTop 5 Challenges for Hadoop MapReduce in the Enterprise. Whitepaper - May /9/11
Top 5 Challenges for Hadoop MapReduce in the Enterprise Whitepaper - May 2011 http://platform.com/mapreduce 2 5/9/11 Table of Contents Introduction... 2 Current Market Conditions and Drivers. Customer
More informationTurn Data into Business Value
Turn Data into Business Value Infinite Video Platform Analytics Layne Berg, Product Manager Steve Epstein, Distinguished Engineer June 21, 2017 Applying Big Data Analytics to Video Today, primarily descriptive
More informationLet s distribute.. NOW: Modern Data Platform as Basis for Transformation and new Services
Let s distribute.. NOW: Modern Data Platform as Basis for Transformation and new Services Matthias Kupczak, Michael Probst; SAP June, 2017 Agenda 09:30-09:55 Coffee 09:55-10:00 Welcome Message T-Systems
More informationHow to sell Azure to SMB customers. Paul Bowkett Microsoft NZ
How to sell Azure to SMB customers Paul Bowkett Microsoft NZ CLOUD INFRASTRUCTURE DEVELOPER + APP PLATFORM Visual Studio Family + Azure App Service DATA + ANALYTICS Cortana Analytics Suite INTERNET OF
More informationMike Strickland, Director, Data Center Solution Architect Intel Programmable Solutions Group July 2017
Mike Strickland, Director, Data Center Solution Architect Intel Programmable Solutions Group July 2017 Accelerate Big Data Analytics with Intel Frameworks and Libraries with FPGA s 1. Intel Big Data Analytics
More informationOracle Big Data Discovery The Visual Face of Big Data
Oracle Big Data Discovery The Visual Face of Big Data Today's Big Data challenge is not how to store it, but how to make sense of it. Oracle Big Data Discovery is a fundamentally new approach to making
More informationOracle Big Data Cloud Service
Oracle Big Data Cloud Service Delivering Hadoop, Spark and Data Science with Oracle Security and Cloud Simplicity Oracle Big Data Cloud Service is an automated service that provides a highpowered environment
More informationArchitecture Overview for Data Analytics Deployments
Architecture Overview for Data Analytics Deployments Mahmoud Ghanem Sr. Systems Engineer GLOBAL SPONSORS Agenda The Big Picture Top Use Cases for Data Analytics Modern Architecture Concepts for Data Analytics
More informationSr. Sergio Rodríguez de Guzmán CTO PUE
PRODUCT LATEST NEWS Sr. Sergio Rodríguez de Guzmán CTO PUE www.pue.es Hadoop & Why Cloudera Sergio Rodríguez Systems Engineer sergio@pue.es 3 Industry-Leading Consulting and Training PUE is the first Spanish
More informationBullSequana S series. Powering Enterprise Artificial Intelligence
BullSequana S series Powering Enterprise Artificial Intelligence Every enterprise faces digital transformation Customer contact is increasingly managed by intelligent automated routines. The Internet-of-Things
More informationBIG DATA and DATA SCIENCE
Integrated Program In BIG DATA and DATA SCIENCE CONTINUING STUDIES Table of Contents About the Course...03 Key Features of Integrated Program in Big Data and Data Science...04 Learning Path...05 Key Learning
More informationCloud Based Analytics for SAP
Cloud Based Analytics for SAP Gary Patterson, Global Lead for Big Data About Virtustream A Dell Technologies Business 2,300+ employees 20+ data centers Major operations in 10 countries One of the fastest
More informationInfoSphere Warehouse. Flexible. Reliable. Simple. IBM Software Group
IBM Software Group Flexible Reliable InfoSphere Warehouse Simple Ser Yean Tan Regional Technical Sales Manager Information Management Software IBM Software Group ASEAN 2007 IBM Corporation Business Intelligence
More informationBuilding Your Big Data Team
Building Your Big Data Team With all the buzz around Big Data, many companies have decided they need some sort of Big Data initiative in place to stay current with modern data management requirements.
More informationWhat s Happening to the Mainframe? Mobile? Social? Cloud? Big Data?
Glenn Anderson, IBM Lab Services and Training What s Happening to the Mainframe? Mobile? Social? Cloud? Big Data? Winter SHARE March 2014 Session 15126 Today s mainframe is a hybrid system InfoSphere Streams
More informationDesigning Business Intelligence Solutions with Microsoft SQL Server 2014
Designing Business Intelligence Solutions with Microsoft SQL Server 2014 20467D; 5 Days, Instructor-led Course Description This five-day instructor-led course teaches students how to implement self-service
More informationHadoop and Analytics at CERN IT CERN IT-DB
Hadoop and Analytics at CERN IT CERN IT-DB 1 Hadoop Use cases Parallel processing of large amounts of data Perform analytics on a large scale Dealing with complex data: structured, semi-structured, unstructured
More informationCorporate Overview CRM. the Cloud
SharePoint 2013 + Web Portal Analytics Corporate Overview CRM the Cloud + Collective Intelligence Inc., Founded in 1999 Headquartered in Lemoyne, PA Serving the Northeast and Mid Atlantic Region Serve
More informationDigitalisieren Sie Ihr Unternehmen mit dem Internet der Dinge Michael Epprecht Microsoft GBB IoT
Digicomp Microsoft Evolution Day 2015 1 Digitalisieren Sie Ihr Unternehmen mit dem Internet der Dinge Michael Epprecht Microsoft GBB IoT michael.epprecht@microsoft.com @fastflame Partner: Becoming a digital
More informationHarnessing the Power of Big Data to Transform Your Business Anjul Bhambhri VP, Big Data, Information Management, IBM
May, 2012 Harnessing the Power of Big Data to Transform Your Business Anjul Bhambhri VP, Big Data, Information Management, IBM 12+ TBs of tweet data every day 30 billion RFID tags today (1.3B in 2005)
More informationBusiness Intelligence in Azure Alex Whittles
Business Intelligence in Azure Alex Whittles Alex@PurpleFrogSystems.com PurpleFrogSystems.com PurpleFrogSystems.com/blog @PurpleFrogSys Alex Whittles SQL Relay Committee SQLRelay.co.uk SQL Bits Committee
More informationAnalyzing Data with Power BI
Course 20778A: Analyzing Data with Power BI Course Outline Module 1: Introduction to Self-Service BI Solutions Introduces business intelligence (BI) and how to self-serve with BI. Introduction to business
More informationMake the most of the cloud with Microsoft System Center and Azure
December 2015 Make the most of the cloud with Microsoft System Center and Azure Writer: Daniel Örneling Amsterdam - Dallas - Ottawa Table of Content 1.1 The Dilemma: too many customers 3 1.2 Is the cloud
More informationHP SummerSchool TechTalks Kenneth Donau Presale Technical Consulting, HP SW
HP SummerSchool TechTalks 2013 Kenneth Donau Presale Technical Consulting, HP SW Copyright Copyright 2013 2013 Hewlett-Packard Development Development Company, Company, L.P. The L.P. information The information
More informationINSIGHTS & BIG DATA. Data Science as a Service BIG DATA ANALYTICS
INSIGHTS & BIG DATA Data Science as a Service BIG DATA ANALYTICS Our data sciences consulting and business analytics solutions help enterprises take effective data-driven business decisions and find innovative
More informationMachine Learning 101
Machine Learning 101 Mike Alperin September, 2016 Copyright 2000-2016 TIBCO Software Inc. Agenda What is Machine Learning? Decision Tree Models Customer Analytics Examples Manufacturing Examples Fraud
More information7 October Rolf Tesmer. SQL & BI Solutions Architect. b https://mrfoxsql.wordpress.com/ in https://au.linkedin.
7 October 2015 Rolf Tesmer SQL & BI Solutions Architect b https://mrfoxsql.wordpress.com/ in https://au.linkedin.com/in/rolftesmer Agenda BI Refresher What is Datazen Managing the Datazen Server Client
More informationUncover the Power of a Big Data Platform Machine Learning at Work
Uncover the Power of a Big Data Platform Machine Learning at Work Vivek RR / Balasubramanya Nagaraj, SAP July, 2017 Agenda SAP Leonardo Machine Learning Foundation SAP HANA External Machine Learning AFL
More informationMicrosoft s Azure App Service Reduces Time and Cost for Web Application Development and Management
Microsoft s Azure App Service Reduces Time and Cost for Web Application Development and Management Published by: Value Prism Consulting Sponsored by: Microsoft Corporation Publish date: February 2016 Abstract:
More informationOracle's Cloud Strategie für den Geschäftserfolg Alles Neue von der OOW
Oracle's Cloud Strategie für den Geschäftserfolg Alles Neue von der OOW Matthias Weiss Direktor Mittelstand Technologie Oracle Deutschland B.V. & Co. KG Agenda 1 2 3 4 5 6 Digital Transformation and CEO
More informationEdge Analytics for IoT Device Intelligence
Edge Analytics for IoT Device Intelligence 1. IoT Trends 2. IoT Analytics 3. Edge Analytics Platform: Kanga 4. Future Direction 2017. 3. 10 IoT Trends - Business/Technology (1/3) Google : IoT Solution
More informationSAP Big Data. Markus Tempel SAP Big Data and Cloud Analytics Services
SAP Big Data Markus Tempel SAP Big Data and Cloud Analytics Services Is that Big Data? 2015 SAP AG or an SAP affiliate company. All rights reserved. 2 What if you could turn new signals from Big Data into
More informationEBOOK: Cloudwick Powering the Digital Enterprise
EBOOK: Cloudwick Powering the Digital Enterprise Contents What is a Data Lake?... Benefits of a Data Lake on AWS... Building a Data Lake on AWS... Cloudwick Case Study... About Cloudwick... Getting Started...
More informationTransforming Big Data to Business Benefits
Transforming Big Data to Business Benefits Automagical EDW to Big Data Migration BI at the Speed of Thought Stream Processing + Machine Learning Platform Table of Contents Introduction... 3 Case Study:
More informationData Engineer. Purpose of the position. Organisational position / Virtual Team. Direct Reports: Date Created: July 2017
Data Engineer Business Unit: Strategy and Growth Reporting to: Data Engineering Direct Reports: None Date Created: July 2017 Purpose of the position The purpose of the Data Engineer role is to design,
More information: Boosting Business Returns with Faster and Smarter Data Lakes
: Boosting Business Returns with Faster and Smarter Data Lakes Empower data quality, security, governance and transformation with proven template-driven approaches By Matt Hutton Director R&D, Think Big,
More informationSYSPRO Product Roadmap Q Version 03
SYSPRO Product Roadmap Q4 2017 Version 03 This roadmap is intended for use as a guideline and for information purposes only, and represents SYSPRO s current view of our product direction. Due to the dynamic
More informationIBM Watson Explorer. IBM Software. IBM Watson Explorer. Search, analyze and interpret information to enable cognitive exploration
IBM Watson Explorer IBM Software IBM Watson Explorer Search, analyze and interpret information to enable cognitive exploration 2 IBM Watson Explorer Contents 2 Introduction 6 Unique Watson Explorer capabilities
More informationEvolution to Revolution: Big Data 2.0
Evolution to Revolution: Big Data 2.0 An ENTERPRISE MANAGEMENT ASSOCIATES (EMA ) White Paper Prepared for Actian March 2014 IT & DATA MANAGEMENT RESEARCH, INDUSTRY ANALYSIS & CONSULTING Table of Contents
More informationHow Data Science is Changing the Way Companies Do Business Colin White
How Data Science is Changing the Way Companies Do Business Colin White BI Research July 17, 2014 Sponsor 2 Speakers Colin White President, BI Research Bill Franks Chief Analytics Officer, Teradata 3 How
More informationThe ABCs of. CA Workload Automation
The ABCs of CA Workload Automation 1 The ABCs of CA Workload Automation Those of you who have been in the IT industry for a while will be familiar with the term job scheduling or workload management. For
More informationEnterprise Architecture for Digital Business
Enterprise Architecture for Digital Business Dave Chappelle Enterprise Architect Global EA Program October 26, 2015. Safe Harbor Statement The following is intended to outline our general product direction.
More informationInfoSphere Warehousing 9.5
IBM Software Group Optimised InfoSphere Warehousing 9.5 Flexible Simple Phil Downey InfoSphere Warehouse Technical Marketing 2007 IBM Corporation Information On Demand End-to-End Capabilities Optimization
More informationFaster Insights from Any Data Technical White Paper
Faster Insights from Any Data Technical White Paper Published: June 2013 Applies to: SQL Server 2014 and SQL Server 2012 Summary: Even the modern business intelligence (BI) platform must adapt to a whole
More informationCopyright 2015, Oracle and/or its affiliates. All rights reserved.
Copyright 2015, Oracle and/or its affiliates. All rights reserved. Finding new business potential with Big Data Analytics Carsten Frisch Oracle Business Analytics DOAG 2015 Business Solutions Conference
More informationData Analytics and CERN IT Hadoop Service. CERN openlab Technical Workshop CERN, December 2016 Luca Canali, IT-DB
Data Analytics and CERN IT Hadoop Service CERN openlab Technical Workshop CERN, December 2016 Luca Canali, IT-DB 1 Data Analytics at Scale The Challenge When you cannot fit your workload in a desktop Data
More informationBig Data Anwendungsfälle aus dem Bereich der digitalen Medien
Presented by Kate Tickner Date 12 th October 2012 Big Data Anwendungsfälle aus dem Bereich der digitalen Medien Using Big Data and Smarter Analytics to Increase Consumer Engagement Dramatic forces affecting
More informationTIBCO Live Datamart providing an operational command and control center in a virtual train application.
TIBCO Live Datamart BENEFITS Serve your real-time application needs with a purpose-built live data mart that continuously pushes the right data to the right clients. Detect problems when they happen by
More informationCloud Customer Architecture for Hybrid Integration
Cloud Customer Architecture for Hybrid Integration Executive Overview IT environments are now fundamentally hybrid in nature devices, systems, and people are spread across the globe, and at the same time
More informationDigital Insight CGI IT UK Ltd. Digital Customer Experience. Digital Employee Experience
Digital Insight Digital Customer Experience Digital Employee Experience Digital Insight Internet of Things Payments IP Solutions Cyber Security Cloud 2015 CGI IT UK Ltd. Contents Introduction Business
More informationProduct presentation. Fujitsu HPC Gateway SC 16. November Copyright 2016 FUJITSU
Product presentation Fujitsu HPC Gateway SC 16 November 2016 0 Copyright 2016 FUJITSU In Brief: HPC Gateway Highlights 1 Copyright 2016 FUJITSU Convergent Stakeholder Needs HPC GATEWAY Intelligent Application
More informationHadoop Integration Deep Dive
Hadoop Integration Deep Dive Piyush Chaudhary Spectrum Scale BD&A Architect 1 Agenda Analytics Market overview Spectrum Scale Analytics strategy Spectrum Scale Hadoop Integration A tale of two connectors
More informationThinking of using Microsoft Office 365 For Your Business? If Not, You Should.
Thinking of using Microsoft For Your? If Not, You Should. www.intivix.com (415) 543-1033 info@intivix.com Why should my business use? Because Microsoft is built for businesses of all sizes, and its tools
More informationENABLING GLOBAL HADOOP WITH DELL EMC S ELASTIC CLOUD STORAGE (ECS)
ENABLING GLOBAL HADOOP WITH DELL EMC S ELASTIC CLOUD STORAGE (ECS) Hadoop Storage-as-a-Service ABSTRACT This White Paper illustrates how Dell EMC Elastic Cloud Storage (ECS ) can be used to streamline
More informationKnowledge Discovery and Data Mining
Knowledge Discovery and Data Mining Unit # 19 1 Acknowledgement The following discussion is based on the paper Mining Big Data: Current Status, and Forecast to the Future by Fan and Bifet and online presentation
More informationIBM Tivoli Workload Automation View, Control and Automate Composite Workloads
Tivoli Workload Automation View, Control and Automate Composite Workloads Mark A. Edwards Market Manager Tivoli Workload Automation Corporation Tivoli Workload Automation is used by customers to deliver
More information