SAS Applica?ons with Oracle Exadata and Big Data Appliance: Turning Data into Knowledge

Size: px

Start display at page:

Download "SAS Applica?ons with Oracle Exadata and Big Data Appliance: Turning Data into Knowledge"

Dwayne Jefferson
6 years ago
Views:

1 SAS Applica?ons with Oracle Exadata and Big Data Appliance: Turning Data into Knowledge May 3, 2016 Exadata SIG Virtual Conference Mathew Steinberg Exadata Product Management Oracle Database Development Copyright 2014 Oracle and/or its affiliates. All rights reserved.

2 Safe Harbor Statement The following is intended to outline our general product direc?on. It is intended for informa?on purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or func?onality, and should not be relied upon in making purchasing decisions. The development, release, and?ming of any features or func?onality described for Oracle s products remains at the sole discre?on of Oracle. Copyright 2014 Oracle and/or its affiliates. All rights reserved. 2

3 A Bit About Mat Exadata and Database In-Memory Product Management Focus on Adop?on, Partners and Cloud Business Development Oracle Communica?ons Business Unit Sun Telco OEM Business Development Oracle Exadata SIG Liaison Hobbies: Teenage kids Favorite Sports Team: Core 18 Black GS Warriors (Not a fair weather fan! ) Copyright 2014 Oracle and/or its affiliates. All rights reserved. 3

4 Agenda Trends SAS and Oracle Right Plaborm for the Engine Configuring Big Data for Mixed Workloads SAS in the Oracle Cloud SAS and Oracle Case Studies Summary Copyright 2014 Oracle and/or its affiliates. All rights reserved. 4

5 Top Technology Trends of 2016 IT no longer supports the business; it is the business. As a result, IT is learning to think in business terms and ask ques?ons such as, "How will we differen?ate?" and "How will we grow our top line and bohom line? But as 2016 approaches, the focus is shijing toward more specific decisions guided by relevant data in cri?cal contexts. Bringing in new sources of data to complete the analy;cal picture the right sources for the right analysis will allow IT-driven businesses to improve the decisions, at scale, that deliver the most produc;vity, while mi?ga?ng risk to the organiza?on. cloud pla?orms really begin to typify the development style. IT is going to need to look more like clouds produce private cloud for the enterprise that has most of the same proper;es as the public cloud. Dan Hushon, Chief Technology Officer CSC (Solu?ons and Services) Copyright 2014 Oracle and/or its affiliates. All rights reserved.

SAS AND ORACLE WORKING TOGETHER TO CREATE CUSTOMER VALUE Joint R & D development and Product

natively in Oracle database Joint performance engineering optimizations Template physical

physical effort Overall reduction in lifecycle costs Best Practice papers SAS and Oracle Engineers

7 SAS AND ORACLE WORKING TOGETHER TO CREATE CUSTOMER VALUE Joint R & D development and Product Management teams in Cary and Redwood Shores Focus on driving SAS technology components to run natively in Oracle database Joint performance engineering optimizations Template physical architectures developed based on use-cases Physically tested and benchmarked together Reduction in physical effort Overall reduction in lifecycle costs Best Practice papers SAS and Oracle Engineers provide joint "Sizing and Architecture Analysis and Design" Copyright 2012, SAS Institute Inc. All rights reserved.

8 SAS Ins?tute Analy?cs Big Data Analy?cs Data Mining Machine Learning Visualiza?on Explore relevant data, iden?fy drivers SAS Visual Sta?s?cs interac?ve predic?ve modeling Discovery Point and click access Predic?ve Analy?cs Sta?s?cal Analysis Copyright 2014, Oracle and/or its affiliates. All rights reserved. 8

10 Oracle Engineered Systems for Data Management Big Data Appliance Opera;onal Simplicity Simplify Access to ALL Data Open Analy;cs Pla?orm Full Stack Integra;on Cloudera CDH Data Hub included Oracle NoSQL Exadata Ideal Database Hardware Smart System SoNware Full-Stack Integra;on Highest Performance, Lowest TCO Copyright 2014, Oracle and/or its affiliates. All rights reserved. 10

11 Data Management Technology Comparison Select the Right Tool for the Job Ingest DR Acces HDFS NoSQL RDBMS Data Type Chunk Record Transac?on Write Type Synchronous Eventually Consistent ACID Compliant Data Prepara?on No Parsing No Parsing Parsing and Valida?on DR Type Second Cluster Node Replica Second RDBMS DR Unit File Record Transac?on DR Timing Batch Record Transac?on Complex Analy?cs? Yes No Yes Query Speed Slow Fast for simple ques?ons Fast # of Data Access Methods One (full table scan) One (index lookup) Many (Op?mized) Affordable Scale Low Predictable Latency Flexible Performance Copyright 2014, Oracle and/or its affiliates. All rights reserved. 11

12 Oracle Exadata and SAS Highest Performance just by changing the hardware plaborm Runs SAS unchanged Real?me Enterprise Faster Applica?ons Scalability Maximum Availability Stability Reduce Administra;on and Maintenance Costs Same Oracle Database: same skill set, same tools, not disrup?on to opera?ons Simplify IT: The en?re stack comes from Oracle Agility Improve Time to Market for Applica?on Delivery Faster Time to Deploy Faster Time to Provision On Premise or In the Oracle Cloud Same architecture, Same sojware, Same skills Copyright 2014, Oracle and/or its affiliates. All rights reserved. 12

13 SAS High Performance Analy?cs with Exadata SAS/Access Interface to Oracle, SAS Scoring Accelerator PARTNER PERSPECTIVE SAS/ACCESS to Oracle and SAS Scoring Accelerator support for Oracle combines the power of Oracle Exadata with cuung edge analy;cs for SAS to decrease )me to business insights and improves model scoring performance, which translates to top-line and bo9om-line impact for our customers. - Michael Rosenthal Alliances Manager, SAS Linear Scalability for Scoring Accelerator Scale up consistency: Time; Rows/sec 30x scalability from Qtr to Full Rack Near linear scalability with maximum parallelism > 25 x improvement with maximum parallelism Scoring Accelerator was over 2X faster on Exadata than baseline system to score 100M records Copyright 2014, Oracle and/or its affiliates. All rights reserved. 13

14 Big Data Plaborm Op?ons from Oracle Oracle Big Data Appliance Simple to Deploy Fast out of the Box Lower Cost than DIY Clusters Oracle Big Data Cloud Service Oracle Big Data SQL Oracle SQL across ALL your data Secure access to data in NoSQL, Hadoop and Oracle Database High performance on un-modeled data Same architecture as on-premises High performance data processing Enables Big Data SQL in Oracle Public Cloud Copyright 2014, Oracle and/or its affiliates. All rights reserved. 14

SAS Big Data on Big Data Appliance Flexible Architectural op?

onally select nodes N, N-1, N-2, for addi?onal SAS Services such as SAS Compute Tier, SAS MidTier Op?

c Compute Environment by shijing Big Data Appliance roles Op?on to selec?

16 SAS Big Data on Big Data Appliance Flexible Architectural op?ons for SAS deployments Can run on Starter, Half and Full configura?ons Op?onally select nodes N, N-1, N-2, for addi?onal SAS Services such as SAS Compute Tier, SAS MidTier Op?onally select node subset N, N-1, N-2, N-3, ) for more dedicated resources for SAS Analy?c Compute Environment by shijing Big Data Appliance roles Op?on to selec?vely add more memory on a per node basis depending on specific workload distribu?on SAS Grid Visual Analy?cs Scoring Accelerator Code Accelerator Copyright 2015, Oracle and/or its affiliates. All rights reserved.

17 Sharing and Managing Resources Private Cloud Not about security / isola?on but instead about mul?ple workloads (tenants) on a single cluster Ignore VMs Two main ways (outside of VM/Docker) of preven?ng resource grabs: Linux Control Groups (cgroups) Yet Another Resource Nego?ator (YARN) Copyright 2015, Oracle and/or its affiliates. All rights reserved. 17

18 YARN CapacityScheduler Designed for mul?ple tenants Based on resource queues Enables administrators to distribute resources to apps and users FairScheduler Designed to average out resources per applica?on Does support queues, but as a minimum guarantee Lower maintenance, but less control Copyright 2015, Oracle and/or its affiliates. All rights reserved. 18

19 Why cgroups? YARN does require developers to write applica?ons in a specific way Some?mes it is quicker and simpler to not adhere to YARN Some?mes the requirements are not overly complex cgroups enables guarantees by hard par??oning of the nodes at the Linux level cgroups are sta?c, yet create a simple to administer and robust separa?on of resources Copyright 2015, Oracle and/or its affiliates. All rights reserved. 19

SAS Big Data on Big Data Appliance On Premise or Hosted Deploy SAS Analy?cs on Hadoop nodes SAS Grid: Visual analy?cs, Scoring, etc Reduce Total Cost of Ownership Flexible Architectural op?

20 SAS Big Data on Big Data Appliance On Premise or Hosted Deploy SAS Analy?cs on Hadoop nodes SAS Grid: Visual analy?cs, Scoring, etc Reduce Total Cost of Ownership Flexible Architectural op?ons for SAS deployments Can run on Starter, Half and Full configura?ons SAS Grid Visual Analy?cs Scoring Accelerator Code Accelerator SAS HPA Root Node SAS Visual Analy;cs Metadata Server SAS Compute SAS Mid?er SAS Visual Analy?cs High-Performance Analy?c Compute Environment co-located with Hadoop Copyright 2014, Oracle and/or its affiliates. All rights reserved. 20

Data Appliance Hadoop & NoSQL Exadata Relational Data Mining Statistical Analysis Forecasting Text

Governance & MDM Event Stream Processing Oracle Big Data Connectors Oracle Big Data SQL Oracle

cs Plaborm Visualization Reporting-oriented Visual Data Exploration Easy Analytics Often Interactive

21 SAS Enterprise Analy?cs Data Lake with Oracle Big Data Appliance and Exadata Analytics Data Management Data Integration Big Data Appliance Hadoop & NoSQL Exadata Relational Data Mining Statistical Analysis Forecasting Text Analytics Optimization & Simulation Execution Innovation Data Quality Data Preparation for Hadoop Data Governance & MDM Event Stream Processing Oracle Big Data Connectors Oracle Big Data SQL Oracle Governance & Security Enterprise Analy?cs Plaborm Visualization Reporting-oriented Visual Data Exploration Easy Analytics Often Interactive enterprise Reporting wide & in scope, Dashboards cross LoB you Collaboration know the questions to Mobile ask BI Discovery Data Exploration Highly visual and/or interactive you don t know the questions to ask Copyright 2014 Oracle and/or its affiliates. All rights reserved. 21

23 On Premise or in the Oracle Cloud CoExistence and Migra;on Same Architecture Private Cloud Same Standards Same Products Oracle Cloud 100% Upward Compa?bility with On-Premise Enables Coexistence and Migra?on Copyright 2014 Oracle and/or its affiliates. All rights reserved. 23

24 SAS Enterprise Analy?cs on Oracle Cloud VPN / Fast Connect Analy;cs Visualiza;on Discovery IaaS / Paas Exadata Cloud Service Big Data Cloud Copyright 2014 Oracle and/or its affiliates. All rights reserved. 24

2TB Storage 4 Node Cloudera Hadoop Cluster Database Cloud Service / Exadata Cloud

25 SAS Analy?cs in the Oracle Public Cloud Configura?on COMPUTE SAS Visual Analy?cs 7.3 COMPUTE / Big Data Cloud Service Infrastructure SAS + Hadoop 28 OCPU, 210GB RAM 1.2TB Storage 4 Node Cloudera Hadoop Cluster Database Cloud Service / Exadata Cloud Service Oracle Database 12c Copyright 2014 Oracle and/or its affiliates. All rights reserved. 25

onal data > 300 million accounts > 10 x Exadata Benefits Decreased?me to produc?

27 Synchrony (GE Capital) Use SAS with Exadata for: Repor?ng and Porbolio Analy?cs Advanced Modeling Forecas?ng Opera?onal Environment 600 users in risk, marke?ng, opera?ons, finance, decision science and fraud TB opera?onal data > 300 million accounts > 10 x Exadata Benefits Decreased?me to produc?on for new customers High availability Superior backup, restore and recovery Faster Queries Magnitudes of performance improvement Hours to minutes Minutes to seconds Copyright 2014 Oracle and/or its affiliates. All rights reserved. 27

28 Major Pharmaceu?cal Company Exadata a key plaborm for SAS and other key clinical related applica?ons Exadata selected for analy?c and repor?ng performance Consolida?on Consolidate other clinical applica?on databases with SAS on Exadata Could not consolidate databases with alterna?ves No sacrifice in performance when consolida;ng databases Copyright 2014 Oracle and/or its affiliates. All rights reserved. 28

Major European Bank SAS on Oracle Big Data Appliance Challenge Drama?c increase in amount of data collected Data explora?on at massive scale No ability for predic?ve analysis Visual Analy?

29 Major European Bank SAS on Oracle Big Data Appliance Challenge Drama?c increase in amount of data collected Data explora?on at massive scale No ability for predic?ve analysis Visual Analy?cs Visual Sta?s?cs In-memory Stats for Hadoop Solu?on SAS on Oracle Big Data Appliance SAS Visual Analy?cs Intui?ve visual analy?cs SAS Visual Sta?s?cs Descrip?ve and Predic?ve Modeling Model Comparison Dynamic group processing SAS in-memory Sta?s?cs for Hadoop In-Memory Sta?s?cs for Hadoop Programming interface for SAS model development Copyright 2014 Oracle and/or its affiliates. All rights reserved. 29

cs users in the enterprise EDW FDM Net Cube ADM ABT Exadata Database Machine Reuse exis?

30 Telco (Asia) SAS on Oracle Big Data Appliance with Exadata Challenges Solu?on Increasing need for data SAS on Big Data Appliance More data held at more granular levels Expansion of Analy?cs users in the enterprise EDW FDM Net Cube ADM ABT Exadata Database Machine Reuse exis?ng workflows Retarget output to Hadoop friendly formats Removed batch window Infrastructure no longer challenged by explosive growth Copyright 2014 Oracle and/or its affiliates. All rights reserved. 30

Oracle Big Data Appliance and Exadata On Premises and In

Each commercial model uniquely addresses specific market

Use Same Architecture Same Sojware Same Skills Oracle Cloud

32 Oracle Big Data Appliance and Exadata On Premises and In the Oracle Cloud Designed to give choice to the customer Each commercial model uniquely addresses specific market requirements On Premises Purchase, Hosted, Lease, Right to Use Same Architecture Same Sojware Same Skills Oracle Cloud Copyright 2015, Oracle and/or its affiliates. All rights reserved.

33 SAS and Oracle Be9er Together Analy?cs Visualiza?on Discovery + = Data Management Big Appliance Exadata Analyze Your Business Faster More Nimbly Lowest TCO Copyright 2014 Oracle and/or its affiliates. All rights reserved. 33

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Copyright 2012, Oracle and/or its affiliates. All rights reserved. 1 Exadata Database Machine IOUG Exadata SIG Update February 6, 2013 Mathew Steinberg Exadata Product Management 2 The following is intended to outline our general product direction. It is intended for