FUJITSU Technical Computing Solution UNCAI

Transcription

1 FUJITSU Technical Computing Solution UNCAI UNCAI=Unified Clouds' Advanced Infrastructure UNCAI( 雲海 ) means the cloud sea in Japanese.

2 UNCAI at a Glance Cloud management software for HPC UNCAI enables your HPC systems to be used as a private cloud. Easy customizable tenant templates Various tenant templates help you to create optimized tenants. Ex.) CAE, Deep Learning, Big Data, Easy Web Portal User can get his own tenant as a My HPC without any skills to build HPC systems. 雲海

3 Cloud Management Software for HPC UNCAI is a software package which your HPC systems to use as a private cloud. User can create a hybrid tenant which consists of VM and bare-metal nodes. InfiniBand is supported. Customer s site UNCAI HPC system System Administrator PaaS Portal Services for Adminis Tenant Management Template Function UNCAI Core Resource Management Tenant-A Tenant-B Tenant Administrator/ End users CAE Portal Portals Accounting/ Billing Services for users Job Management Shared Storage Remote Desktop Deploying Media Library System Monitoring (VM) / ISM (bare-metal) Tenant-C Resource Bare-metal VM Resource pool Storage

4 Template Function (1/2) Various tenants can be deployed by 3 layered templates. Tenant Templates configurations for the tenant (type of node, networks, ) (YAML) Node Templates resource definitions of the node (YAML) Application Templates installation procedure of applications, OS settings (Ansible role) caetenant01 caetenant01 Login CentOS 6.6 vmm 1 Compute CentOS 6.6 bml 5 Pre-post Windows 10 vml 1 NFS Server RHEL 7.2 1TB 1 PBS Server CentOS 6.6 vmm 1 Deploy Tenant templates (CAE, Big Data, Deep Learning, ) Node templates (Login, Compute, Pre-post, ) Application templates (NFS, PBSPro, system settings, ) OS images, Applications

5 Template Functions (2/2) The tenant template also realizes the easy customization of tenant designing GUI without any programing skills. x-i18n: en: enum_label: node_size: login: - Virtual-SSS (1core, 2G Mem) - "Virtual-SS (2core, 4G Mem)" - "Virtual-S (4core, 8G Mem)" - "Virtual-M (8core, 32G Mem) ~ login_node: &login_table title: '{$ i18n.label.login $}' description: '{$ i18n.comment.login $}' type: array format: table items: type: object properties: size: title: '{$ i18n.label.size $}' type: string enum: *login_size options: enum_titles: '{$ i18n.enum_label.node_size.login $}' default: "vmss" os: *os_list_redhat numberof: *number_of

6 Easy Web Portal (1/2) PaaS Portal for administrators Simplified user interface helps you to easily deploy a tenant without skills to install HPC system. PaaS Portal also has following functions: display resource usage / start & stop tenant and node / report accounting & billing / user registration/ role management / password management/ allocating floating IP / firewall settings / media library (templates, OS images, applications, licenses) / backup tenant / queue settings (PBS Professional ) / error monitoring & notice

7 Easy Web Portal (2/2) CAE Portal (HPC Portal) for CAE users CAE Portal has following functions: file management/ upload & download files / job submission/ monitoring job status / canceling job / monitoring queue status/ searching job histories / calling remote desktop (FTCP Remote Desktop) / job submission for CAE applications (easy customizable GUI)

8 Flexible resource expansion On demand auto scaling Scale-in/out tenant resource automatically by workload of batch jobs. Multi-tenant Management Deploy, manage and monitor the whole resources of multi-tenants (on both private and public clouds) from a single view of PaaS Portal. UNCAI Resource pool Auto Scaling tenant-a Multi-tenant Management Other Sites UNCAI Auto Scaling Public Clouds Multi-tenant Management UNCAI FUJITSU Cloud Service K5 Multi-tenant Management UNCAI tenant-b

9 Flexible customizability by plug-in framework Following functions have high flexibilities by templates or plug-ins. So UNCAI can provide the environment optimized for customer s policies. Tenant information Template of fill-in form to register the tenant informations(tenant administrator, mail address, and so on ) User registration Template of fill-in form to add users Plug-in program to check the user management policies (ex. user name, UID and GID). Billing Plug-in program for daily/monthly billing. Plug-in program to check the usage and stop the tenant when it exceeds the limit. Queue management templates of queue setting form Auto scaling plug-in program to check the workload of batch jobs and estimate nodes required for scale-in/out.

10 [Option] Container Management Template Container management template includes Apache Mesos / Kubernetes. Currently Marathon and Chronos are supported on Apache Mesos. Capable of being supported other framework of Apache Mesos and other eco system. Docker images Tenant Select Container Management Template. Framework (Marathon, Chronos) Docker-Engine

11 [Option] Deep Learning Template Deep learning template has bare-metal nodes which has GPU. The Docker container which communicates GPU has been installed. It also includes the essential software for deep learning such as CUDA, cudnn, frameworks and tools. We support Caffe, Tensorflow, Keras and Chainer. Docker Images Jupyter Notebook Select Deep Learning Template Bare-metal Node GPU Deep Learning Frameworks Middleware CUDA / cudnn

12 [Option] Big Data Template Big data template implements Cloudera software stack and build ready-to-use data processing cluster. Able to expand worker nodes corresponding to increase of workload. Tenant Master Node Select Big Data Template New nodes participate in. Worker Node

13 Tenant Type CAE tenant Container Management tenant Deep Leaning tenant Big Data tenant CAE applications Framework (Marathon, Chronos) Jupyter Notebook SaaS PBSPro Cloudera Intel Compiler/MPI Docker-Engine Docker-Engine CUDA / cudnn PaaS (UNCAI) IaaS Application template (Ansible role for installation and settings) Node template (Resource definitions of each node type) Tenant template (Tenant configuration of each tenant type) OpenStack/ISM,OS and hardwares

14 13