Oracle Big Data Cloud at Customer

Transcription

1 Oracle Big Data Cloud at Customer Delivering Hadoop, Spark and Data Science with Oracle Security and Cloud Simplicity on your Premises Oracle Big Data Cloud at Customer is a unique offering from Oracle that provides a high-powered environment tailor-made for advancing businesses analytical capabilities leveraging Oracle s advanced Big Data cloud infrastructure on your premises. With automated lifecycle management and one-click security, Big Data Cloud at Customer is designed to optimally and securely run a wide variety of big data workloads and technologies while simplifying operations. Big Data Cloud at Customer includes several high-end analytic components, ranging from Oracle Big Data Spatial and Graph to R and embedded components like Apache Spark and Impala. Big Data Cloud at Customer Overview Oracle Big Data Cloud at Customer is an optimized system delivering a productiongrade Hadoop and Spark platform with the power of dedicated nodes and the flexibility and simplicity of a cloud offering. Big Data Cloud at Customer is optimized to run a diverse set of workloads from Hadoop-only workloads (ETL, Spark, Hive etc.) to interactive, all-encompassing interactive SQL queries using SQL-on-Hadoop tools and/or Oracle Big Data SQL. The Best Big Data Platform in the Industry With Big Data Cloud at Customer, organizations get the best possible cloud environment for Big Data workloads. As part of this environment, Big Data Cloud at Customer provides a massively scalable Big Data environment featuring: Cloudera s comprehensive software suite including Cloudera Distribution including Apache Hadoop and Apache Spark as well as Apache Kafka Oracle Big Data Spatial and Graph provides cutting-edge tools for exploring and analyzing massive graphs and geo-locational data Oracle Big Data Connectors including the Oracle R Advanced Analytics for Hadoop, providing an R language interface to large scale Spark-based Machine Learning Fast provisioning, automatically creating Highly Available and fully secured clusters in a matter of hours Simplified operations, and automated lifecycle management though a single utility of the entire stack

2 Open for Innovation KEY BUSINESS BENEFITS Oracle Big Data Cloud at Customer speeds time to value by providing an on-premises cloud based solution for big data processing with Cloudera CDH, Apache Kafka and Apache Spark. Big Data Cloud at Customer provides a consistently high-performance environment for big data management through: Cloud simplicity with on-premises deployment Optimized Configurations Proven mission critical Hadoop system Simple security, including encryption set up with web based provisioning Comprehensive Software Stack Reduced IT administration On-premises deployment eliminates compliance and data sovereignty issues Big Data Cloud at Customer embraces the innovations in the big data domain by providing an open environment for innovation, while automated lifecycle management and simple security ensure organizations do not compromise enterprise-level stability and safety. Organizations are free to deploy external software to support new functionality such as natural language processing and fraud detection to meet the needs of the application. Support for non-oracle components is delivered by their respective support channels and not by Oracle. End-to-End Security Securing data is critical to Big Data solutions in the enterprise; Big Data Cloud at Customer provides strong authentication, authorization and auditing of data in Hadoop with just a single click. Strong authentication is provided using Kerberos. This ensures that all users are who they claim to be and that rogue services are not added to the system. Big Data Cloud Service leverages Apache Sentry (an open-source project of which Oracle is a founding member) to authorize SQL access via tools like Hive and Impala. By delivering and developing Sentry, Oracle delivers Big Data Cloud Security with the highest data security levels currently available for Hadoop. Both encryption of data-at-rest and network encryption are capabilities included with Oracle Big Data Cloud at Customer and supported by Oracle. Network encryption prevents network sniffing from capturing protected data. In addition to securing the Hadoop system, Oracle Big Data SQL enables organizations to leverage Oracle s security capabilities when querying data by utilizing Oracle Database Cloud Service Exadata Edition or an Oracle Database installed in the same Data Center. Big Data Cloud at Customer with Hadoop security in place, in combination with Oracle Big Data SQL delivers the most comprehensive security of any big data system. Optimized and Versatile Hardware Big Data Cloud at Customer delivers its optimized Hadoop and Spark stack on top of the industry leading Oracle Big Data Appliance. Big Data Appliance features advanced and powerful hardware, delivering a platform for a wide variety of workloads. Key characteristics of Big Data Cloud at Customer: Powerful, standard Hadoop nodes with: 32 cores of x86 Processors 256GB of DDR-4 memory standard 48TB of customer available Storage on 12x 7,200 RPM drives Low latency, high throughput InfiniBand networking between the nodes supporting very high data exchange rates between Hadoop nodes. High throughput ingesting network and multiple client networks support high data load rates System hardware (switches, power, networking and software set up) configured for High Availability 2 ORACLE BIG DATA CLOUD AT CUSTOMER DATASHEET

3 Hardware scalability in single node increments, offering an easy expansion as well as a small starting point; scalable to large node counts without expensive top-of-rack switching Best Cloud Offering for Big Data Workloads KEY FEATURES Oracle Big Data Cloud at Customer provides a comprehensive environment for accelerating big data analytics. Automatically included in the software are Cloudera s Distribution 5.x including Apache Hadoop and Apache Spark Open platform offering full control of the environment, as well as enabling 3 rd party software installs into the cluster Pay-as-you-go, subscription based pricing Oracle Big Data Spatial and Graph for cutting-edge analytics on places and networks Oracle Big Data Connectors to simplify integration of data and enable Spark based R Machine Learning Oracle Data Integrator to simplify big data operations through visual codebuilding RELATED PRODUCTS Oracle Database Exadata Cloud at Customer Oracle Cloud at Customer Oracle Big Data SQL Oracle Big Data Cloud Oracle IoT Cloud Service Oracle GoldenGate Oracle Storage Cloud Service On top of the industry leading Oracle Big Data platform, Big Data Cloud at Customer adds the ease, simplicity and flexibility of the software that powers the Oracle Public Cloud. Organizations can now access a full range of Hadoop, Spark and analytics tools on a simple consumption/subscription model in their own data centers behind their firewall. Oracle experts manage the infrastructure on behalf of customers, significantly reducing IT administration cost. Provisioning and expanding the service deployed on the Big Data Cloud at Customer is driven through simple web interfaces. With Big Data Cloud at Customer, organizations can easily embark on a cloud strategy and immediately leverage cloud computing benefits without going through a complex lift and shift to the public cloud. There are a few distinct customer profiles that immediately benefit from Big Data Cloud at Customer: Customers who are subject to data regulatory, data sovereignty and data residency laws or policies that require their data to be stored within a corporate entity or a political territory, and not in a public cloud data center. Customers whose applications require the throughput or latency of a local LAN rather than a WAN. Customers whose infrastructure is tightly-coupled with existing applications and infrastructure and are not ready to move these applications to the public cloud. Customers that want the agility, simplicity, elasticity, and subscription based payment benefits of a big data cloud, but are not ready to move their data management infrastructure to a public cloud. Big Data Cloud at Customer Service Details Big Data Cloud at Customer enables a full Hadoop and Spark analytics platform in customers data centers, orchestrated by Oracle s cloud software, with infrastructure managed by Oracle s cloud experts. Big Data Cloud at Customer clusters are preconfigured based on joint engineering with Cloudera and apply specific best practices tailored to the hardware and software configured. Service Overview Big Data Cloud at Customer is available through a subscription offering that requires a minimum term of 4 years. The following table specifies in further detail the software included and available with Big Data Cloud at Customer: Big Data Cloud at Customer - Included Software Software Available on Provisioned Cluster Instances Oracle Linux 6 Oracle Java JDK 8 Cloudera Enterprise (Data Hub Edition) 5.x 3 ORACLE BIG DATA CLOUD AT CUSTOMER DATASHEET

4 Cloudera s Distribution including Apache Hadoop (CDH) Cloudera Impala HBase (as well as support for Accumulo) Cloudera Search Apache Spark 1.x and 2.x Cloudera Manager including: Cloudera Back-up and Disaster Recovery (BDR) Cloudera Navigator Oracle R Distribution Additional Included Software Components Oracle Big Data Connectors Oracle SQL Connector for Hadoop Oracle Loader for Hadoop Oracle XQuery for Hadoop Oracle R Advanced Analytics for Hadoop Oracle Data Integrator Enterprise Edition Oracle Big Data Spatial and Graph Customers connect to the configured clusters from their applications using standard clients, or leverage an edge node within the cluster as a security or application node. Customers have full administrative privileges within the Virtual Machines running on the nodes of the Big Data Cloud at Customer, while Oracle has administrative privileges over the underlying infrastructure such as the InfiniBand switches. Customers build a Big Data Cloud at Customer configuration starting with a sizing of the number of nodes for each cluster to be ordered. Once sized the hardware is configured to accommodate the total number of nodes. Each node in the cluster is limited to a specific number of OCPUs under management and a specific disk and memory footprint. Compute and Storage bursting is going to be enabled on Big Data Cloud at Customer in the future but is not currently available. Starting with a minimum node count of six nodes, the system can grow in increments on one node. The smallest cluster size on the hardware is set to three nodes. For production clusters, Oracle recommends at least 5 nodes allocated to the Hadoop cluster. Detailed specifications for Big Data Cloud at Customer configuration are provided at the end of this document. Administration With Big Data Cloud at Customer, customers have complete access to all Cloudera CDH Enterprise Data Hub features and functions as well as integration with Oracle Public Cloud components. 4 ORACLE BIG DATA CLOUD AT CUSTOMER DATASHEET

5 Each Big Data Cloud at Customer instance is configured such that there is a single Virtual Machine (VM), which is dedicated to the customer, in each Hadoop server of the Big Data system. Customers have root privileges for the Hadoop server VMs and they can configure the system as they like, and load additional software on the nodes to conform to business standards or analytics requirements. To facilitate applications to be installed according to Hadoop best practices, Big Data Cloud at Customer enables Edge Nodes. Edge nodes are directly attached to the InfiniBand network and can be configured via the Service Console. Connecting over InfiniBand enables the edge node to serve as a bastion as well as a staging area to land data. Customers perform familiar Hadoop administration and OS administration tasks aided by cloud automation for patching and upgrades. Upgrades are pre-tested by Oracle and are implemented in a standard way. All supporting infrastructure for Big Data Cloud Service is deployed, maintained and managed by Oracle, including datacenter networking, private Big Data Cloud at Customer InfiniBand network, physical compute and storage servers, firmware, etc. This enables customers to focus on their business needs and application requirements, and not IT infrastructure management. Customers on their preferred schedule initiate Hadoop, Spark and OS patching while infrastructure patching is performed automatically by Oracle, with little/no disruption to the service. Cloud Control Plane through Oracle Cloud at Customer A subscription to the Big Data Cloud Machine also requires a separate subscription to the Oracle Cloud at Customer (OCC), with the Oracle Public Cloud Machine X6 - Control Plane Non-metered being the minimal requirement. OCC is required to deploy the Oracle Cloud Control Plane, which is a sophisticated software suite that collectively brings the cloud experience to customers. It includes cloud infrastructure components that perform order management, subscription/billing/capacity management, account and identity management, REST services, and compute/storage/virtual networking management for multiple Cloud at Customer configurations. It also provides 5 ORACLE BIG DATA CLOUD AT CUSTOMER DATASHEET

6 a consistent user interface portal for self-service of multiple cloud services deployed on OCC and Big Data Cloud at Customer. OCC can also be used as an Infrastructure as a Service (IaaS) platform in the customer data center. Besides, it offers optional services such as Java Cloud Service, Integration Cloud Service, and general-purpose Database Cloud Service. Customers can use these OCC services to deploy application-specific Oracle Cloud Services, which subsequently connect to the Hadoop components deployed in Big Data Cloud at Customer. Remote Monitoring through Oracle Advanced Support Gateway Another essential component of the Big Data Cloud at Customer configuration is the Oracle Advanced Support Gateway. The Oracle Advanced Support Gateway, which is part of Oracle Advanced Support Platform, has been used for a number of years to facilitate numerous Oracle Support Services at leading customer sites around the world. The Gateway also acts as the central conduit to facilitate remote monitoring and management of Big Data Cloud at Customer. The Gateway platform is a software appliance, based on the Oracle Linux operating system and hosts a full stack of Oracle software, including Automated Service Request (ASR), Oracle Enterprise Manager, Oracle Configuration Manager (OCM), patch management (such as YUM services), and a suite of Java applications. Together, these applications aggregate and route telemetry messages from the Big Data Cloud at Customer environment to the Oracle Support Services infrastructure. The Gateway provides remote access for Oracle engineers to access the Big Data Cloud at Customer and Oracle Cloud at Customer infrastructure to carry out required monitoring and management. The Gateway is typically located in the customer data center DMZ behind a firewall, with network access to the Big Data Cloud at Customer it is monitoring. It is not directly exposed to the Internet, but it should be continuously accessible from Oracle Cloud Operations infrastructure, using a TLS/VPN tunnel. The following diagram shows a typical configuration of Big Data Cloud at Customer, along with the Oracle Cloud at Customer deployed with the Oracle Cloud Control Plane, the Oracle Advanced Support Gateway and Oracle Cloud Operations infrastructure: 6 ORACLE BIG DATA CLOUD AT CUSTOMER DATASHEET

7 Oracle Cloud Operations All hardware and software infrastructure associated with Big Data Cloud at Customer is managed and maintained by Oracle Cloud Operations, powered by Oracle Advanced Customer Support (ACS). This is done via the Oracle Advanced Support Platform, which includes: Automation tools to deliver Oracle Advanced Support Service Oracle Advanced Support Gateway Oracle Cloud Operations delivery teams Infrastructure management of the Big Data Cloud at Customer consists of managing the following components: Oracle Big Data Cloud at Customer Servers Power Distribution Units (PDUs) InfiniBand Network and Switches Management Switch Oracle VM (Hypervisor) With Oracle Cloud Operations managing the infrastructure Oracle brings ACS global business and technical expertise directly to customer data centers. For more than 10 years, ACS has been helping global customers drive rapid return on their Oracle investment through an outstanding global capability and local service affinity. ACS has delivery professionals, with an average of 15 years Oracle experience, providing 24 x 7 monitoring and management to more than 100,000 targets. ACS utilizes ISO 27001:2013 and SSAE16/SOC 1 Type II compliant global competence centers to deliver such outstanding service. For further details on ACS, refer to customer-support/index.html. Cloud Operations Service Included with Big Data Cloud at Customer Subscription A suite of Cloud Operations Services is available to customers as part of subscribing to Big Data Cloud at Customer. All of these services are delivered by Oracle Cloud Operations. Some of the key services offered are: Pre-installation Services Orientation session Datacenter site survey Physical site readiness Analysis of customer network configuration requirements Maintenance window identification Installation and Configuration Services Installation of Oracle Cloud at Customer / Oracle Advanced Support Gateway / Big Data Cloud at Customer Connecting to necessary data center networks and firewalls Required configuration of the Big Data Cloud at Customer, including VM set up and Cloudera configuration Validation of the configuration 7 ORACLE BIG DATA CLOUD AT CUSTOMER DATASHEET

8 Monitoring Big Data Cloud at Customer infrastructure layer incident monitoring / management / root cause analysis Threshold performance analysis Change Management Regular infrastructure update & upgrade planning / scheduling / implementing Bug and security fixes inside Dom0 Firmware updates/upgrades to any of the hardware components including networking components and InfiniBand switches Proactive infrastructure upgrades to make infrastructure software consistent with Oracle Public Cloud Access and Security Big Data Cloud at Customer provides secure high-performance access from existing on- premises systems. To ensure consistent high-performance and isolation, multiple separate physical networks are provided. Client networks provide 10Gbps connectivity for applications to send and receive data to and from the Hadoop clusters. The Administration network provides a separate physical network for customer administrators. A secure isolated Cloud Infrastructure Management network is used by the Oracle Gateway to manage the servers, storage and switches. This network is not accessible to customers. InfiniBand is used internally for ultra-high-speed networking between nodes of the cluster. InfiniBand security is enforced using InfiniBand partitioning, which provides network isolation on the InfiniBand network. Since customer Hadoop clusters run in a VM container on Big Data Cloud at Customer servers, they are isolated from the underlying hardware resources. Provisioning Big Data Cloud at Customer includes a simple easy-to-use web-based provisioning interface through which customers can quickly provision their chosen system and subsequently their Hadoop clusters. Upon subscribing to Big Data Cloud at Customer, following deployment steps are carried out by Oracle Cloud Operations working with designated customer IT staff members: Deploying Oracle Advanced Support Gateway Deploying Oracle Cloud at Customer (OCC) including Oracle Cloud Control Plane components Connecting the Gateway to the OCC Capturing required network/ip Address information, and executing Oracle Configuration Assistant to generate necessary configuration files 8 ORACLE BIG DATA CLOUD AT CUSTOMER DATASHEET

9 Deploying Big Data Cloud at Customer this involves connecting Big Data Cloud at Customer to customer data center network as well as to the OCC and the Gateway Provisioning Big Data Cloud at Customer instance from the Oracle Cloud Control Plane Once a Big Data system is provisioned, the designated customer account administrator gets notified that the system is available for cluster creation. Customers now can create their clusters in a very simple manner through a web-based wizard which includes details like secure clusters, and node role configuration as shown below: Figure 1. Configuring Node Types Figure 2. Setting up Connectivity and Security Big Data Cloud at Customer Customer Benefits Driving business benefits from Big Data infrastructure is critical. Big Data Cloud at Customer delivers. Specific business benefits include: Secure clusters, ensuring that data infrastructure remains secure. In Big Data Cloud at Customer, security is simple to enable, is tested and remains in place across upgrades. Highly Available, ensuring your environment remains functional even during certain infrastructure failures. Big Data Cloud at Customer features a tested and automated High Availability architecture. Full Control, enables your users to configure the system for their needs. This enables the users to use their favorite tools, both from partners and from Oracle directly on Big Data Cloud Service. 9 ORACLE BIG DATA CLOUD AT CUSTOMER DATASHEET

10 BIG DATA CLOUD AT CUSTOMER X7-2 TECHNICAL SPECIFICATIONS Full Rack Starter Rack Each Node plus InfiniBand Infrastructure 18 x Compute / Storage Nodes 6 x Compute / Storage Nodes 1 x Compute / Storage Nodes Per Node: 32 OCPUs 256 GB of RAM 48 TB on 12x High Capacity SAS Drives 2 x QDR 40Gb/sec InfiniBand Ports 4 x 10 Gb Ethernet Ports 1 x ILOM Ethernet Port 2 x 32 Port QDR InfiniBand Leaf Switch 32 x InfiniBand ports 8 x 10Gb Ethernet ports (4 ports for internal use) 1 x 36 Port QDR InfiniBand Spine Switch 36 x InfiniBand Ports Additional Hardware Components included: Ethernet Administration Switch 2 x Redundant Power Distributions Units (PDUs) 42U rack packaging Leverages the leaf switches from the Starter Rack Leverages the spine switch from the Starter Rack Leverages the administration switch, PDUs and base rack from the Starter Rack Spares Kit Included: 1 x 10 TB High Capacity SAS disk InfiniBand cables Leverages the spares kit from the Starter Rack BIG DATA CLOUD AT CUSTOMER X7-2 COMPONENT ENVIRONMENTAL SPECIFICATIONS X7-2 High Capacity Node plus InfiniBand Infrastructure Physical Dimensions Height Width Depth Weight Power Cooling Airflow in. (87.6 mm) 17.5 in. (445.0 mm) 29.0 in. (737.0 mm) 33.1 kg (73.0 lbs) Maximum: 0.7 kw Typical 1 : 0.5 kw Maximum: 2,481 BTU/hour Typical 1 : 1,736 BTU/hour Maximum: 115 CFM Typical 1 : 80 CFM Operating temperature/humidity: 5 ºC to 32 ºC (41 ºF to 89.6 ºF), 10% to 90% relative humidity, noncondensing Altitude Operating: Up to 3,048 m, max. ambient temperature is de-rated by 1 C per 300m above 900m 10 ORACLE BIG DATA CLOUD AT CUSTOMER DATASHEET

11 1 Typical power usage varies by application workload 2 Airflow must be front to back BIG DATA CLOUD AT CUSTOMER X7-2 ENVIRONMENTAL SPECIFICATIONS Physical Dimensions Full Rack Height Width Depth 42U, mm mm mm Weight Rack Shipping Starter Rack 415kg 915lbs 546kg 1203lbs Full Rack 836kg 1843lbs 979kg 2158lbs Power Starter Rack Full Rack Maximum: 5.2KW Typical 1 : 3.6KW Maximum: 13.0KW Typical 1 : 9.1KW Cooling Starter Rack Full Rack Maximum:17,521 BTU/hour Typical 1 : 12,265 BTU/hour Maximum: 44,136 BTU/hour Typical 1 : 30,895 BTU/hour Airflow 2 Starter Rack Full Rack Maximum: 811 CFM Typical 1 : 568 CFM Maximum: 2043 CFM Typical 1 : 1430 CFM Big Data Cloud at Customer X7-2 Further Environmental Specifications Operating temperature/humidity: 5 ºC to 32 ºC (41 ºF to 89.6 ºF), 10% to 90% relative humidity, noncondensing Altitude Operating: Up to 3,048 m, max. ambient temperature is de-rated by 1 C per 300m above 900m Big Data Cloud Machine X7-2 Regulations and Certifications Regulations 3 Safety: UL/CSA , EN , IEC CB Scheme with all country differences RFI/EMI: EN55022, EN , EN ORACLE BIG DATA CLOUD AT CUSTOMER DATASHEET

12 Immunity: EN Emissions and Immunity: EN Certifications 3 North America (NRTL), European Union (EU), International CB Scheme, BSMI (Taiwan), C-Tick (Australia), CCC (PRC), MSIP (Korea), CU EAC (Customs Union), VCCI (Japan) European Union Directives /95/EC Low Voltage Directive, 2004/108/EC EMC Directive, 2011/65/EU RoHS Directive, 2012/19/EU WEEE Directive 1 Typical power usage varies by application workload 2 Airflow must be front to back 3 All standards and certifications referenced are to the latest official version at the time the data sheet was written. Other country regulations/certifications may apply. In some cases, as applicable, regulatory and certification compliance were obtained at the component level. CONTACT US For more information about Big Data Cloud Service, visit cloud.oracle.com/bigdata or call ORACLE1 to speak to an Oracle representative. CONNECT WITH US blogs.oracle.com/oracle facebook.com/oracle twitter.com/oracle oracle.com Copyright 2017, Oracle and/or its affiliates. All rights reserved. This document is provided for information purposes only, and the contents hereof are subject to change without notice. This document is not warranted to be error-free, nor subject to any other warranties or conditions, whether expressed orally or implied in law, including implied warranties and conditions of merchantability or fitness for a particular purpose. We specifically disclaim any liability with respect to this document, and no contractual obligations are formed either directly or indirectly by this document. This document may not be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose, without our prior written permission. Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners. Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. UNIX is a registered trademark of The Open Group. 12 ORACLE BIG DATA CLOUD AT CUSTOMER DATASHEET