Hadoop in the Cloud. Ryan Lippert, Cloudera Product Cloudera, Inc. All rights reserved.

Size: px
Start display at page:

Download "Hadoop in the Cloud. Ryan Lippert, Cloudera Product Cloudera, Inc. All rights reserved."

Transcription

1 Hadoop in the Cloud Ryan Lippert, Cloudera Product 1

2 2

3 Cloudera Confidential 3

4 Drive Customer Insights Improve Product & Services Efficiency Lower Business Risk 4

5 The world s largest taxi company owns ZERO vehicles. The world s largest accommodation provider owns ZERO real estate. The world s most popular media owner creates ZERO content. The world s leading music platform owns no music. 5

6 Our relationship with data is changing 6

7 What s Driving Hadoop to the Cloud? Enterprise customers using cloud for big data analytics Hadoop deployments in cloud are accelerating: Executive mandate: minimize on-prem datacenter footprint Perceived lower overall TCO Increased agility: end-user self-service Elasticity: optimize infrastructure usage 7

8 8

9 Common workloads in the cloud Reduce Operating Costs New Insights, New Revenue Run Without Risk ETL/Modeling (Data Engineering) BI/Analytics (Analytic Database) App Delivery (Operational Database) Only pay for what you need, when you need it Explore and analyze all data, wherever it lives Enterprise-grade to protect your business, no matter what Transient clusters Elastic workload Object storage centric Cloud-native deployment Transient or Persistent clusters Sized to demand HDFS or object storage Lift-and-shift or cloud-native deployment Fixed clusters Periodic sync All HDFS storage Lift-and-shift deployment 9

10 CUSTOMER 360 FINANCIAL SERVICES» BEHAVIORAL ANALYTICS» PREDICTIVE ANALYTICS» SCALABLE PROCESSING Crunching 1,000+ Business Metrics per Customer with Sub-Second Responses Enables granular targeting of customers 50% reduction in marketing cost execution at one bank with focus on high potential customers Stores and processes thousands of critical events at scale at a low cost Provides flexibility, agility to support customer needs with Cloudera on Amazon Web Services and on premises 10

11 Common workloads in the cloud Reduce Operating Costs New Insights, New Revenue Run Without Risk ETL/Modeling (Data Engineering) BI/Analytics (Analytic Database) App Delivery (Operational Database) Only pay for what you need, when you need it Explore and analyze all data, wherever it lives Enterprise-grade to protect your business, no matter what Transient clusters Elastic workload Object storage centric Cloud-native deployment Transient or Persistent clusters Sized to demand HDFS or object storage Lift-and-shift or cloud-native deployment Fixed clusters Periodic sync All HDFS storage Lift-and-shift deployment 11

12 DATA-DRIVEN PRODUCTS MANUFACTURING» CUSTOMER 360» DATA DRIVEN PRODUCTS» DATA DRIVEN SERVICES Measure user interaction across the ecosystem, help direct R&D and development spend Virtuous cycle: Identify features that facilitate sharing of content that drive new customers Real-time streaming and batch data from product logs, web analytics, channel data and ERP Impala connects to third-party data wrangling and BI tools for fast reporting 12

13 Common workloads in the cloud Reduce Operating Costs New Insights, New Revenue Run Without Risk ETL/Modeling (Data Engineering) BI/Analytics (Analytic Database) App Delivery (Operational Database) Only pay for what you need, when you need it Explore and analyze all data, wherever it lives Enterprise-grade to protect your business, no matter what Transient clusters Elastic workload Object storage centric Cloud-native deployment Transient or Persistent clusters Sized to demand HDFS or object storage Lift-and-shift or cloud-native deployment Fixed clusters Periodic sync All HDFS storage Lift-and-shift deployment 13

14 COMPLIANCE» DATA INGEST» STREAM PROCESSING» EVENT MONITORING REDUCE RISK Process 30-billion market events per day to build a holistic picture of US market activity Market event graph database built on Cloudera on AWS Rapid, interactive access to 2+ years data Operational efficiencies resulting from the platform s scalability result in net annual savings of $20 million 14

15 Key Requirements of Big Data in the Cloud Elastic Hybrid/Multi-Cloud Enterprise Grade Size compute and storage independently, grow and shrink clusters dynamically, and pay only for what you use on ad-hoc, transient workloads Preserve business flexibility and data portability and minimize cloud lock-in by running in any one of the three major public cloud providers or in private cloud Reduce risk with comprehensive manageability, availability, security, and governance required for production big data workloads 15

16 How do you do Hadoop in the cloud? 16

17 Patterns of Cloud-Native Applications Flexibility, Self-Service Models, and New Cost Dynamics COMPUTE Decoupled Storage and Compute for Elastic Scale Object Store Embrace Transience for Lower Costs SPIN UP 1h r SPIN DOWN Compartmentalize for Greater Isolation Object Store 17

18 Persistent application Data Source s Kafka/ Flume Spark Streaming Kafka HBase or Impala/Kudu (beta) Real-Time Serving Application Streaming Architecture S3 Impala Analytics Hive/Spark/HoS Batch Data Transformations 18

19 Transient application Data Source s Kafka/ Flume Spark Streaming Kafka HBase, or Impala/Kudu (beta) Real-Time Serving Application Batch Analytics S3 S3 Hive/Spark/HoS Impala Batch Data Transformations BI & Analytics 19

20 Combining the two: lambda architecture Data Source s Kafka/ Flume Spark Streaming Kafka HBase or Impala/Kudu (beta) Real-Time Serving Application S3 S3 Hive/Spark/HoS Impala Batch Data Transformations BI & Analytics 20

21 Director Provisioning: Cluster Lifecycle Management Spin up, grow & shrink, terminate CDH clusters that read/write to object store Easy Administration Dynamic cluster lifecycle management Single pane of glass: multi-cluster view Cloudera Director Flexible Deployments Multi-cloud: AWS, Azure, GCP Fast cluster deployments Scaling of CDH clusters Spot instance support Enterprise-grade Integration across Cloudera Enterprise Management of CDH deployments at scale 21

22 Get started with Cloudera Enterprise in the cloud Cloudera Director AWS Quickstart Azure Marketplace Deploy and manage Cloudera Enterprise in the cloud environment of your choice Deploy an enterprise data hub on AWS Provision and deploy Cloudera Enterprise on the Azure Marketplace 22

23 Thank You 23

Taking Advantage of Cloud Elasticity and Flexibility

Taking Advantage of Cloud Elasticity and Flexibility Taking Advantage of Cloud Elasticity and Flexibility Fred Koopmans Sr. Director of Product Management 1 Public cloud adoption is surging 2 Cloudera customers are leading the way 3 Hadoop was born for the

More information

Architecture Optimization for the new Data Warehouse. Cloudera, Inc. All rights reserved.

Architecture Optimization for the new Data Warehouse. Cloudera, Inc. All rights reserved. Architecture Optimization for the new Data Warehouse Guido Oswald - @GuidoOswald 1 Use Cases This image cannot currently be displayed. This image cannot currently be displayed. This image cannot currently

More information

Spotlight Sessions. Nik Rouda. Director of Product Marketing Cloudera, Inc. All rights reserved. 1

Spotlight Sessions. Nik Rouda. Director of Product Marketing Cloudera, Inc. All rights reserved. 1 Spotlight Sessions Nik Rouda Director of Product Marketing Cloudera @nrouda Cloudera, Inc. All rights reserved. 1 Spotlight: Protecting Your Data Nik Rouda Product Marketing Cloudera, Inc. All rights reserved.

More information

Apache Spark 2.0 GA. The General Engine for Modern Analytic Use Cases. Cloudera, Inc. All rights reserved.

Apache Spark 2.0 GA. The General Engine for Modern Analytic Use Cases. Cloudera, Inc. All rights reserved. Apache Spark 2.0 GA The General Engine for Modern Analytic Use Cases 1 Apache Spark Drives Business Innovation Apache Spark is driving new business value that is being harnessed by technology forward organizations.

More information

5th Annual. Cloudera, Inc. All rights reserved.

5th Annual. Cloudera, Inc. All rights reserved. 5th Annual 1 The Essentials of Apache Hadoop The What, Why and How to Meet Agency Objectives Sarah Sproehnle, Vice President, Customer Success 2 Introduction 3 What is Apache Hadoop? Hadoop is a software

More information

Sr. Sergio Rodríguez de Guzmán CTO PUE

Sr. Sergio Rodríguez de Guzmán CTO PUE PRODUCT LATEST NEWS Sr. Sergio Rodríguez de Guzmán CTO PUE www.pue.es Hadoop & Why Cloudera Sergio Rodríguez Systems Engineer sergio@pue.es 3 Industry-Leading Consulting and Training PUE is the first Spanish

More information

Big Data Hadoop Administrator.

Big Data Hadoop Administrator. Big Data Hadoop Administrator www.austech.edu.au WHAT IS BIG DATA HADOOP ADMINISTRATOR?? Hadoop is a distributed framework that makes it easier to process large data sets that reside in clusters of computers.

More information

Hortonworks Connected Data Platforms

Hortonworks Connected Data Platforms Hortonworks Connected Data Platforms MASTER THE VALUE OF DATA EVERY BUSINESS IS A DATA BUSINESS EMBRACE AN OPEN APPROACH 2 Hortonworks Inc. 2011 2016. All Rights Reserved Data Drives the Connected Car

More information

Common Customer Use Cases in FSI

Common Customer Use Cases in FSI Common Customer Use Cases in FSI 1 Marketing Optimization 2014 2014 MapR MapR Technologies Technologies 2 Fortune 100 Financial Services Company 104M CARD MEMBERS 3 Financial Services: Recommendation Engine

More information

Oracle Big Data Cloud Service

Oracle Big Data Cloud Service Oracle Big Data Cloud Service Delivering Hadoop, Spark and Data Science with Oracle Security and Cloud Simplicity Oracle Big Data Cloud Service is an automated service that provides a highpowered environment

More information

TechArch Day Digital Decoupling. Oscar Renalias. Accenture

TechArch Day Digital Decoupling. Oscar Renalias. Accenture TechArch Day 2018 Digital Decoupling Oscar Renalias Accenture !"##$ oscar.renalias@acenture.com @oscarrenalias https://www.linkedin.com/in/oscarrenalias/ https://github.com/accenture THE ERA OF THE BIG

More information

EXAMPLE SOLUTIONS Hadoop in Azure HBase as a columnar NoSQL transactional database running on Azure Blobs Storm as a streaming service for near real time processing Hadoop 2.4 support for 100x query gains

More information

Big data is hard. Top 3 Challenges To Adopting Big Data

Big data is hard. Top 3 Challenges To Adopting Big Data Big data is hard Top 3 Challenges To Adopting Big Data Traditionally, analytics have been over pre-defined structures Data characteristics: Sales Questions answered with BI and visualizations: Customer

More information

Big Data Cloud. Simple, Secure, Integrated and Performant Big Data Platform for the Cloud

Big Data Cloud. Simple, Secure, Integrated and Performant Big Data Platform for the Cloud Big Data Cloud Simple, Secure, Integrated and Performant Big Data Platform for the Cloud Big Data Platform engineered for the data-driven enterprise Oracle s Big Data Cloud delivers a Big Data Platform

More information

MapR Pentaho Business Solutions

MapR Pentaho Business Solutions MapR Pentaho Business Solutions The Benefits of a Converged Platform to Big Data Integration Tom Scurlock Director, WW Alliances and Partners, MapR Key Takeaways 1. We focus on business values and business

More information

Datametica DAMA. The Modern Data Platform Enterprise Data Hub Implementations. What is happening with Hadoop Why is workload moving to Cloud

Datametica DAMA. The Modern Data Platform Enterprise Data Hub Implementations. What is happening with Hadoop Why is workload moving to Cloud DAMA Datametica The Modern Data Platform Enterprise Data Hub Implementations What is happening with Hadoop Why is workload moving to Cloud 1 The Modern Data Platform The Enterprise Data Hub What do we

More information

Transforming your Business with SAP HANA Enterprise Cloud

Transforming your Business with SAP HANA Enterprise Cloud Transforming your Business with SAP HANA Enterprise Cloud Stephen Spears, Senior Vice President, SAP HANA Enterprise Cloud, SAP SAP HANA CIO Innovation Forum September 12, 2013 New York Our world at an

More information

Insights-Driven Operations with SAP HANA and Cloudera Enterprise

Insights-Driven Operations with SAP HANA and Cloudera Enterprise Insights-Driven Operations with SAP HANA and Cloudera Enterprise Unleash your business with pervasive Big Data Analytics with SAP HANA and Cloudera Enterprise The missing link to operations As big data

More information

Data Analytics. Nagesh Madhwal Client Solutions Director, Consulting, Southeast Asia, Dell EMC

Data Analytics. Nagesh Madhwal Client Solutions Director, Consulting, Southeast Asia, Dell EMC Data Analytics Nagesh Madhwal Client Solutions Director, Consulting, Southeast Asia, Dell EMC Last 15 years IT-centric Traditional Analytics Traditional Applications Rigid Infrastructure Internet Next

More information

WELCOME TO. Cloud Data Services: The Art of the Possible

WELCOME TO. Cloud Data Services: The Art of the Possible WELCOME TO Cloud Data Services: The Art of the Possible Goals for Today Share the cloud-based data management and analytics technologies that are enabling rapid development of new mobile applications Discuss

More information

MapR: Converged Data Pla3orm and Quick Start Solu;ons. Robin Fong Regional Director South East Asia

MapR: Converged Data Pla3orm and Quick Start Solu;ons. Robin Fong Regional Director South East Asia MapR: Converged Data Pla3orm and Quick Start Solu;ons Robin Fong Regional Director South East Asia Who is MapR? MapR is the creator of the top ranked Hadoop NoSQL SQL-on-Hadoop Real Database time streaming

More information

HADOOP SOLUTION USING EMC ISILON AND CLOUDERA ENTERPRISE Efficient, Flexible In-Place Hadoop Analytics

HADOOP SOLUTION USING EMC ISILON AND CLOUDERA ENTERPRISE Efficient, Flexible In-Place Hadoop Analytics HADOOP SOLUTION USING EMC ISILON AND CLOUDERA ENTERPRISE Efficient, Flexible In-Place Hadoop Analytics ESSENTIALS EMC ISILON Use the industry's first and only scale-out NAS solution with native Hadoop

More information

Data Analytics and CERN IT Hadoop Service. CERN openlab Technical Workshop CERN, December 2016 Luca Canali, IT-DB

Data Analytics and CERN IT Hadoop Service. CERN openlab Technical Workshop CERN, December 2016 Luca Canali, IT-DB Data Analytics and CERN IT Hadoop Service CERN openlab Technical Workshop CERN, December 2016 Luca Canali, IT-DB 1 Data Analytics at Scale The Challenge When you cannot fit your workload in a desktop Data

More information

Architecting an Open Data Lake for the Enterprise

Architecting an Open Data Lake for the Enterprise Architecting an Open Data Lake for the Enterprise 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Today s Presenters Daniel Geske, Solutions Architect, Amazon Web Services Armin

More information

Big Data Introduction

Big Data Introduction Big Data Introduction Who we are Experts At Your Service Over 50 specialists in IT infrastructure Certified, experienced, passionate Based In Switzerland 100% self-financed Swiss company Over CHF8 mio.

More information

Modernizing Your Data Warehouse with Azure

Modernizing Your Data Warehouse with Azure Modernizing Your Data Warehouse with Azure Big data. Small data. All data. Christian Coté S P O N S O R S The traditional BI Environment The traditional data warehouse data warehousing has reached the

More information

How In-Memory Computing can Maximize the Performance of Modern Payments

How In-Memory Computing can Maximize the Performance of Modern Payments How In-Memory Computing can Maximize the Performance of Modern Payments 2018 The mobile payments market is expected to grow to over a trillion dollars by 2019 How can in-memory computing maximize the performance

More information

Transforming Analytics with Cloudera Data Science WorkBench

Transforming Analytics with Cloudera Data Science WorkBench Transforming Analytics with Cloudera Data Science WorkBench Process data, develop and serve predictive models. 1 Age of Machine Learning Data volume NO Machine Learning Machine Learning 1950s 1960s 1970s

More information

How to Build Your Data Ecosystem with Tableau on AWS

How to Build Your Data Ecosystem with Tableau on AWS How to Build Your Data Ecosystem with Tableau on AWS Moving Your BI to the Cloud Your BI is working, and it s probably working well. But, continuing to empower your colleagues with data is going to be

More information

Datametica. The Modern Data Platform Enterprise Data Hub Implementations. Why is workload moving to Cloud

Datametica. The Modern Data Platform Enterprise Data Hub Implementations. Why is workload moving to Cloud Datametica The Modern Data Platform Enterprise Data Hub Implementations Why is workload moving to Cloud 1 What we used do Enterprise Data Hub & Analytics What is Changing Why it is Changing Enterprise

More information

Insights to HDInsight

Insights to HDInsight Insights to HDInsight Why Hadoop in the Cloud? No hardware costs Unlimited Scale Pay for What You Need Deployed in minutes Azure HDInsight Big Data made easy Enterprise Ready Easier and more productive

More information

Adobe and Hadoop Integration

Adobe and Hadoop Integration Predictive Behavioral Analytics Adobe and Hadoop Integration JANUARY 2016 SYNTASA Copyright 1.0 Introduction For many years large enterprises have relied on the Adobe Marketing Cloud for capturing and

More information

Copyright - Diyotta, Inc. - All Rights Reserved. Page 2

Copyright - Diyotta, Inc. - All Rights Reserved. Page 2 Page 2 Page 3 Page 4 Page 5 Humanizing Analytics Analytic Solutions that Provide Powerful Insights about Today s Healthcare Consumer to Manage Risk and Enable Engagement and Activation Industry Alignment

More information

Cloudera Data Science and Machine Learning. Robin Harrison, Account Executive David Kemp, Systems Engineer. Cloudera, Inc. All rights reserved.

Cloudera Data Science and Machine Learning. Robin Harrison, Account Executive David Kemp, Systems Engineer. Cloudera, Inc. All rights reserved. Cloudera Data Science and Machine Learning Robin Harrison, Account Executive David Kemp, Systems Engineer 1 This is the age of machine learning. Data volume NO Machine Learning Machine Learning 1950s 1960s

More information

Adobe and Hadoop Integration

Adobe and Hadoop Integration Predictive Behavioral Analytics Adobe and Hadoop Integration DECEMBER 2016 SYNTASA Copyright 1.0 Introduction For many years large enterprises have relied on the Adobe Marketing Cloud for capturing and

More information

MapR: Solution for Customer Production Success

MapR: Solution for Customer Production Success 2015 MapR Technologies 2015 MapR Technologies 1 MapR: Solution for Customer Production Success Big Data High Growth 700+ Customers Cloud Leaders Riding the Wave with Hadoop The Big Data Platform of Choice

More information

Business is being transformed by three trends

Business is being transformed by three trends Business is being transformed by three trends Big Cloud Intelligence Stay ahead of the curve with Cortana Intelligence Suite Business apps People Custom apps Apps Sensors and devices Cortana Intelligence

More information

Introduction to Big Data(Hadoop) Eco-System The Modern Data Platform for Innovation and Business Transformation

Introduction to Big Data(Hadoop) Eco-System The Modern Data Platform for Innovation and Business Transformation Introduction to Big Data(Hadoop) Eco-System The Modern Data Platform for Innovation and Business Transformation Roger Ding Cloudera February 3rd, 2018 1 Agenda Hadoop History Introduction to Apache Hadoop

More information

Apache Hadoop in the Datacenter and Cloud

Apache Hadoop in the Datacenter and Cloud Apache Hadoop in the Datacenter and Cloud The Shift to the Connected Data Architecture Digital Transformation fueled by Big Data Analytics and IoT ACTIONABLE INTELLIGENCE Cloud and Data Center IDMS Relational

More information

Cloudera Hadoop & Industrie 4.0 wohin mit dem Datenstrom?

Cloudera Hadoop & Industrie 4.0 wohin mit dem Datenstrom? Cloudera Hadoop & Industrie 4.0 wohin mit dem Datenstrom? Bernard Doering Regional Sales Director, Central Europe 1 Cloudera Hadoop Scalable Flexible Open Cost- EffecLve 2 2014 Cloudera, Inc. All rights

More information

Hortonworks Data Platform

Hortonworks Data Platform Hortonworks Data Platform An open-architecture platform to manage data in motion and at rest Highlights Addresses a range of data-at-rest use cases Powers real-time customer applications Delivers robust

More information

Microsoft Azure Essentials

Microsoft Azure Essentials Microsoft Azure Essentials Azure Essentials Track Summary Data Analytics Explore the Data Analytics services in Azure to help you analyze both structured and unstructured data. Azure can help with large,

More information

Cloudera, Inc. All rights reserved.

Cloudera, Inc. All rights reserved. 1 Data Analytics 2018 CDSW Teamplay und Governance in der Data Science Entwicklung Thomas Friebel Partner Sales Engineer tfriebel@cloudera.com 2 We believe data can make what is impossible today, possible

More information

Make Business Intelligence Work on Big Data

Make Business Intelligence Work on Big Data Make Business Intelligence Work on Big Data Speed. Scale. Simplicity. Put the Power of Big Data in the Hands of Business Users Connect your BI tools directly to your big data without compromising scale,

More information

Analytics for All Your Data: Cloud Essentials. Pervasive Insight in the World of Cloud

Analytics for All Your Data: Cloud Essentials. Pervasive Insight in the World of Cloud Analytics for All Your Data: Cloud Essentials Pervasive Insight in the World of Cloud The Opportunity We re living in a world where just about everything we see, do, hear, feel, and experience is captured

More information

Managing explosion of data. Cloudera, Inc. All rights reserved.

Managing explosion of data. Cloudera, Inc. All rights reserved. Managing explosion of data 1 Customer experience expectations are converging on the brand, not channel Consistent across all channels and lines of business Contextualized to present location and circumstances

More information

Building data-driven applications with SAP Data Hub and Amazon Web Services

Building data-driven applications with SAP Data Hub and Amazon Web Services Building data-driven applications with SAP Data Hub and Amazon Web Services Dr. Lars Dannecker, Steffen Geissinger September 18 th, 2018 Cross-department disconnect Cross-department disconnect Cross-department

More information

AZURE HDINSIGHT. Azure Machine Learning Track Marek Chmel

AZURE HDINSIGHT. Azure Machine Learning Track Marek Chmel AZURE HDINSIGHT Azure Machine Learning Track Marek Chmel SESSION AGENDA Understanding different scenarios of Hadoop Building an end to end pipeline using HDInsight Using in-memory techniques to analyze

More information

Safe Harbor Statement

Safe Harbor Statement Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment

More information

Analytics in the Cloud, Cross Functional Teams, and Apache Hadoop is not a Thing Ryan Packer, Bank of New Zealand

Analytics in the Cloud, Cross Functional Teams, and Apache Hadoop is not a Thing Ryan Packer, Bank of New Zealand Paper 2698-2018 Analytics in the Cloud, Cross Functional Teams, and Apache Hadoop is not a Thing Ryan Packer, Bank of New Zealand ABSTRACT Digital analytics is no longer just about tracking the number

More information

Machine Learning, Artificial Intelligence and the Future of Big Data Analytics. Amy O Connor Big Data Evangelist, Cloudera

Machine Learning, Artificial Intelligence and the Future of Big Data Analytics. Amy O Connor Big Data Evangelist, Cloudera Machine Learning, Artificial Intelligence and the Future of Big Data Analytics Amy O Connor Big Data Evangelist, Cloudera Cloudera, Inc. All rights reserved. 4 Extracting value from data an untapped opportunity

More information

Cask Data Application Platform (CDAP) Extensions

Cask Data Application Platform (CDAP) Extensions Cask Data Application Platform (CDAP) Extensions CDAP Extensions provide additional capabilities and user interfaces to CDAP. They are use-case specific applications designed to solve common and critical

More information

TechValidate Survey Report. Converged Data Platform Key to Competitive Advantage

TechValidate Survey Report. Converged Data Platform Key to Competitive Advantage TechValidate Survey Report Converged Data Platform Key to Competitive Advantage TechValidate Survey Report Converged Data Platform Key to Competitive Advantage Executive Summary What Industry Analysts

More information

Big and Fast Data: The Path To New Business Value

Big and Fast Data: The Path To New Business Value Big and Fast Data: The Path To New Business Value A Pivotal Overview Umair Riaz vspecialist 2 Gain Business Value with Big and Fast Data Pivotal Provides Agile Platform for Data-Driven Applications Ingest

More information

Cask Data Application Platform (CDAP)

Cask Data Application Platform (CDAP) Cask Data Application Platform (CDAP) CDAP is an open source, Apache 2.0 licensed, distributed, application framework for delivering Hadoop solutions. It integrates and abstracts the underlying Hadoop

More information

New Big Data Solutions and Opportunities for DB Workloads

New Big Data Solutions and Opportunities for DB Workloads New Big Data Solutions and Opportunities for DB Workloads Hadoop and Spark Ecosystem for Data Analytics, Experience and Outlook Luca Canali, IT-DB Hadoop and Spark Service WLCG, GDB meeting CERN, September

More information

AWS for Finance Institutes

AWS for Finance Institutes AWS for Finance Institutes The 1 st Stpps to adopt AWS Bertram Dorn Specialized Sollutions Architect for Secuirty and Compliance 30. Juni 2016 2016, Amazon Web Services, Inc. or its Affiliates. All rights

More information

Modern Analytics Architecture

Modern Analytics Architecture Modern Analytics Architecture So what is a. Modern analytics architecture? Machine Learning AI Open source Big Data DevOps Cloud In-memory IoT Trends supporting Next-Generation analytics Source: Next-Generation

More information

Accelerating Your Big Data Analytics. Jeff Healey, Director Product Marketing, HPE Vertica

Accelerating Your Big Data Analytics. Jeff Healey, Director Product Marketing, HPE Vertica Accelerating Your Big Data Analytics Jeff Healey, Director Product Marketing, HPE Vertica Recent Waves of Disruption IT Infrastructu re for Analytics Data Warehouse Modernization Big Data/ Hadoop Cloud

More information

Pentaho 8.0 Overview. Pedro Alves

Pentaho 8.0 Overview. Pedro Alves Pentaho 8.0 Overview Pedro Alves Safe Harbor Statement The forward-looking statements contained in this document represent an outline of our current intended product direction. It is provided for information

More information

AWS Architecture Case Study: Real-Time Bidding. Tom Maddox, Solutions Architect

AWS Architecture Case Study: Real-Time Bidding. Tom Maddox, Solutions Architect AWS Architecture Case Study: Real-Time Bidding Tom Maddox, Solutions Architect Who am I? Gardener (Capacity Planning) Motorcyclist (Agility) Mobile App Writer Problem Solver Technology Geek Solutions Architect

More information

Architecture Overview for Data Analytics Deployments

Architecture Overview for Data Analytics Deployments Architecture Overview for Data Analytics Deployments Mahmoud Ghanem Sr. Systems Engineer GLOBAL SPONSORS Agenda The Big Picture Top Use Cases for Data Analytics Modern Architecture Concepts for Data Analytics

More information

Course Content. The main purpose of the course is to give students the ability plan and implement big data workflows on HDInsight.

Course Content. The main purpose of the course is to give students the ability plan and implement big data workflows on HDInsight. Course Content Course Description: The main purpose of the course is to give students the ability plan and implement big data workflows on HDInsight. At Course Completion: After competing this course,

More information

ADVANCED ANALYTICS & IOT ARCHITECTURES

ADVANCED ANALYTICS & IOT ARCHITECTURES ADVANCED ANALYTICS & IOT ARCHITECTURES Presented by: Orion Gebremedhin Director of Technology, Data & Analytics Marc Lobree National Architect, Advanced Analytics EDW THE RIGHT TOOL FOR THE RIGHT WORKLOAD

More information

Confidential

Confidential June 2017 1. Is your EDW becoming too expensive to maintain because of hardware upgrades and increasing data volumes? 2. Is your EDW becoming a monolith, which is too slow to adapt to business s analytical

More information

Mastering the Microservices, Fast Data & Hybrid Cloud Trifecta

Mastering the Microservices, Fast Data & Hybrid Cloud Trifecta Mastering the Microservices, Fast Data & Hybrid Cloud Trifecta Edward Hsu, VP Product 2018.10.23 2018 Mesosphere, Inc. All Rights Reserved. 2 Cloud On Who s Terms? 2018 Mesosphere, Inc. All Rights Reserved.

More information

Filling your Data Lake with potable data using Oracle Data Integration

Filling your Data Lake with potable data using Oracle Data Integration CON-5465 Filling your Data Lake with potable data using Oracle Data Integration Mike Matthews Senior Director, Product Management Jayant Mahto Senior Product Manager October 2 nd 2017 Safe Harbor Statement

More information

20775A: Performing Data Engineering on Microsoft HD Insight

20775A: Performing Data Engineering on Microsoft HD Insight 20775A: Performing Data Engineering on Microsoft HD Insight Duration: 5 days; Instructor-led Implement Spark Streaming Using the DStream API. Develop Big Data Real-Time Processing Solutions with Apache

More information

Azure Data Factory Hybrid data integration, at global scale. Erika Harris Senior Program Manager AzureCAT

Azure Data Factory Hybrid data integration, at global scale. Erika Harris Senior Program Manager AzureCAT Azure Data Factory Hybrid data integration, at global scale Erika Harris Senior Program Manager AzureCAT Data Cloud AI There are barriers to getting value from data Data silos Incongruent data types Complexity

More information

Welcome to. enterprise-class big data and financial a. Putting big data and advanced analytics to work in financial services.

Welcome to. enterprise-class big data and financial a. Putting big data and advanced analytics to work in financial services. Welcome to enterprise-class big data and financial a Putting big data and advanced analytics to work in financial services. MapR-FSI Martin Darling We reinvented the data platform for next-gen intelligent

More information

Hadoop and Analytics at CERN IT CERN IT-DB

Hadoop and Analytics at CERN IT CERN IT-DB Hadoop and Analytics at CERN IT CERN IT-DB 1 Hadoop Use cases Parallel processing of large amounts of data Perform analytics on a large scale Dealing with complex data: structured, semi-structured, unstructured

More information

REDEFINE BIG DATA. Zvi Brunner CTO. Copyright 2015 EMC Corporation. All rights reserved.

REDEFINE BIG DATA. Zvi Brunner CTO. Copyright 2015 EMC Corporation. All rights reserved. 1 REDEFINE BIG DATA Zvi Brunner CTO 2 2020: A NEW DIGITAL WORLD 30B DEVICES 7B PEOPLE Millions OF NEW BUSINESSES Source: Gartner Group, 2014 DIGITIZATION IS ALREADY BEGINNING PRECISION FARMING DRESS THAT

More information

Combine Microservices Framework for Flexible, Scalable, High Availability Big Data Analytics

Combine Microservices Framework for Flexible, Scalable, High Availability Big Data Analytics Combine Microservices Framework for Flexible, Scalable, High Availability Big Data Analytics Dan Widdis, Principal Operations Research Analyst May 10, 2016 Approved for public release; distribution is

More information

Infrastructure Efficiency Yields Significant Cost Savings

Infrastructure Efficiency Yields Significant Cost Savings Infrastructure Efficiency Yields Significant Cost Savings Executive Summary Each year, the amount of data that businesses need to manage grows at an astounding rate 1. The explosive growth of data presents

More information

20775 Performing Data Engineering on Microsoft HD Insight

20775 Performing Data Engineering on Microsoft HD Insight Duración del curso: 5 Días Acerca de este curso The main purpose of the course is to give students the ability plan and implement big data workflows on HD. Perfil de público The primary audience for this

More information

HyperCloud. IT s Cloud Dilemma

HyperCloud. IT s Cloud Dilemma HyperCloud DATASHEET Consume IT, Don t Build IT. In today s shared economy companies drive a competitive edge by focusing on their core competencies and leveraging technology to innovate and create new

More information

Enterprise-Scale MATLAB Applications

Enterprise-Scale MATLAB Applications Enterprise-Scale Applications Sylvain Lacaze Rory Adams 2018 The MathWorks, Inc. 1 Enterprise Integration Access and Explore Data Preprocess Data Develop Predictive Models Integrate Analytics with Systems

More information

CLOUDCHECKR ON AWS AND AZURE: A GUIDE TO PUBLIC CLOUD COST MANAGEMENT

CLOUDCHECKR ON AWS AND AZURE: A GUIDE TO PUBLIC CLOUD COST MANAGEMENT ebook CLOUDCHECKR ON AWS AND AZURE: A GUIDE TO PUBLIC CLOUD COST MANAGEMENT Guide to Cost Management CloudCheckr 2017 1 TABLE OF CONTENTS 3 4 7 9 10 Intro Optimization Requires Visibility Cost Management

More information

Application Performance Management for Microsoft Azure and HDInsight

Application Performance Management for Microsoft Azure and HDInsight ebook Application Performance Management for Microsoft Azure and HDInsight How to build fast and reliable Big Data Apps on Microsoft Azure HDInsight and Azure Analytical Services Microsoft Azure makes

More information

20775: Performing Data Engineering on Microsoft HD Insight

20775: Performing Data Engineering on Microsoft HD Insight Let s Reach For Excellence! TAN DUC INFORMATION TECHNOLOGY SCHOOL JSC Address: 103 Pasteur, Dist.1, HCMC Tel: 08 38245819; 38239761 Email: traincert@tdt-tanduc.com Website: www.tdt-tanduc.com; www.tanducits.com

More information

Hybrid Data Management

Hybrid Data Management Kelly Schlamb Executive IT Specialist, Worldwide Analytics Platform Enablement and Technical Sales (kschlamb@ca.ibm.com, @KSchlamb) Hybrid Data Management IBM Analytics Summit 2017 November 8, 2017 5 Essential

More information

E-guide Hadoop Big Data Platforms Buyer s Guide part 1

E-guide Hadoop Big Data Platforms Buyer s Guide part 1 Hadoop Big Data Platforms Buyer s Guide part 1 Your expert guide to Hadoop big data platforms for managing big data David Loshin, Knowledge Integrity Inc. Companies of all sizes can use Hadoop, as vendors

More information

PARTNER OPPORTUNITY PLAYBOOK. Cloud Migration and Modernization

PARTNER OPPORTUNITY PLAYBOOK. Cloud Migration and Modernization PARTNER OPPORTUNITY PLAYBOOK Cloud Migration and Modernization TABLE OF CONTENTS The market for migration Why modernization matters now Big benefits for resellers Building a migration practice Next steps

More information

Analytics for the NFV World with PNDA.io

Analytics for the NFV World with PNDA.io for the NFV World with.io Speaker Donald Hunter Principal Engineer in the Chief Technology and Architecture Office at Cisco. Lead the MEF OpenLSO project which uses.io as a reference implementation for

More information

MapR Streams A global pub-sub event streaming system for big data and IoT

MapR Streams A global pub-sub event streaming system for big data and IoT MapR Streams A global pub-sub event streaming system for big data and IoT Ben Sadeghi Data Scientist, APAC IDA Forum on IoT Jan 18, 2016 2015 MapR Technologies 2015 MapR Technologies MapR Streams: Vision

More information

Building a Single Source of Truth across the Enterprise An Integrated Solution

Building a Single Source of Truth across the Enterprise An Integrated Solution SOLUTION BRIEF Building a Single Source of Truth across the Enterprise An Integrated Solution From EDW modernization to self-service BI on big data This solution brief showcases an integrated approach

More information

Embracing the Hybrid Cloud using Power BI in CSP. Name Role Group

Embracing the Hybrid Cloud using Power BI in CSP. Name Role Group Embracing the Hybrid Cloud using Power BI in CSP Name Role Group Agenda Cloud Vision & Opportunity What is Power BI Power BI in CSP Power BI in Action Summary Microsoft vision for new era Unified platform

More information

EBOOK: Cloudwick Powering the Digital Enterprise

EBOOK: Cloudwick Powering the Digital Enterprise EBOOK: Cloudwick Powering the Digital Enterprise Contents What is a Data Lake?... Benefits of a Data Lake on AWS... Building a Data Lake on AWS... Cloudwick Case Study... About Cloudwick... Getting Started...

More information

Analytics Platform System

Analytics Platform System Analytics Platform System Big data. Small data. All data. Audie Wright, DW & Big Data Specialist Audie.Wright@Microsoft.com Ofc 425-538-0044, Cell 303-324-2860 Sean Mikha, DW & Big Data Architect semikha@microsoft.com

More information

Digital transformation is the next industrial revolution

Digital transformation is the next industrial revolution Digital transformation is the next industrial revolution Steam, water, mechanical production equipment Division of labor, electricity, mass production Electronics, IT, automated production Blurring the

More information

An Overview of the AWS Cloud Adoption Framework

An Overview of the AWS Cloud Adoption Framework An Overview of the AWS Cloud Adoption Framework Version 2 February 2017 2017, Amazon Web Services, Inc. or its affiliates. All rights reserved. Notices This document is provided for informational purposes

More information

Cognitive Data Warehouse and Analytics

Cognitive Data Warehouse and Analytics Cognitive Data Warehouse and Analytics Hemant R. Suri, Sr. Offering Manager, Hybrid Data Warehouses, IBM (twitter @hemantrsuri or feel free to reach out to me via LinkedIN!) Over 90% of the world s data

More information

Preface About the Book

Preface About the Book Preface About the Book We are living in the dawn of what has been termed as the "Fourth Industrial Revolution" by the World Economic Forum (WEF) in 2016. The Fourth Industrial Revolution is marked through

More information

KnowledgeENTERPRISE FAST TRACK YOUR ACCESS TO BIG DATA WITH ANGOSS ADVANCED ANALYTICS ON SPARK. Advanced Analytics on Spark BROCHURE

KnowledgeENTERPRISE FAST TRACK YOUR ACCESS TO BIG DATA WITH ANGOSS ADVANCED ANALYTICS ON SPARK. Advanced Analytics on Spark BROCHURE FAST TRACK YOUR ACCESS TO BIG DATA WITH ANGOSS ADVANCED ANALYTICS ON SPARK Are you drowning in Big Data? Do you lack access to your data? Are you having a hard time managing Big Data processing requirements?

More information

20775A: Performing Data Engineering on Microsoft HD Insight

20775A: Performing Data Engineering on Microsoft HD Insight 20775A: Performing Data Engineering on Microsoft HD Insight Course Details Course Code: Duration: Notes: 20775A 5 days This course syllabus should be used to determine whether the course is appropriate

More information

#mstrworld. A Deep Dive Into Self-Service Data Discovery In MicroStrategy. Vijay Anand Gianthomas Tewksbury Volpe. #mstrworld

#mstrworld. A Deep Dive Into Self-Service Data Discovery In MicroStrategy. Vijay Anand Gianthomas Tewksbury Volpe. #mstrworld A Deep Dive Into Self-Service Data Discovery In MicroStrategy Vijay Anand Gianthomas Tewksbury Volpe Introducing MicroStrategy Analytics Agenda Introduction to MicroStrategy Analytics Platform Product

More information

Koen van den Biggelaar Senior Manager, Solutions Architecture Amazon Web Services

Koen van den Biggelaar Senior Manager, Solutions Architecture Amazon Web Services Koen van den Biggelaar Senior Manager, Solutions Architecture Amazon Web Services koen@amazon.com Amazon Cloud? Leadership Principles Innovation Approach Intro Amazon AWS Innovation Innovation Applied

More information

Optimal Infrastructure for Big Data

Optimal Infrastructure for Big Data Optimal Infrastructure for Big Data Big Data 2014 Managing Government Information Kevin Leong January 22, 2014 2014 VMware Inc. All rights reserved. The Right Big Data Tools for the Right Job Real-time

More information

Stateful Services on DC/OS. Santa Clara, California April 23th 25th, 2018

Stateful Services on DC/OS. Santa Clara, California April 23th 25th, 2018 Stateful Services on DC/OS Santa Clara, California April 23th 25th, 2018 Who Am I? Shafique Hassan Solutions Architect @ Mesosphere Operator 2 Agenda DC/OS Introduction and Recap Why Stateful Services

More information

AMD and Cloudera : Big Data Analytics for On-Premise, Cloud and Hybrid Deployments

AMD and Cloudera : Big Data Analytics for On-Premise, Cloud and Hybrid Deployments August, 2018 AMD and Cloudera : Big Data Analytics for On-Premise, Cloud and Hybrid Deployments Standards Based AMD is committed to industry standards, offering you a choice in x86 architecture with design

More information