GLOBAL SPONSORS Cop Co y p ri r gh g t EMC M Co C r Co p r o p r o at r ion o.. A l A l r i r gh g ts r s e r serv ser ed.

Transcription

1 GLOBAL SPONSORS 1

2 打造您專屬的 IOT 分析平台 EMC TAIWAN 資深技術顧問徐志良 2

3 IOT 時代來臨 BIG DATA 有那些應用類型? EMC Data Technology 優勢 : 大量平行處理 (MPP) 能力 + 網格式 (Grid) 架構 + 橫向擴充 (Scale-out) + No Data Silo + Cost Down Search-based (Hadoop) Transaction-based (In-Memory Data Grid) IoT Analytics-based (EDW) * Source: IDC Big Data study 3

4 Pivotal 巨量資料分析專業大廠 Pivotal Labs Xtreme Labs Greenplum Hadoop Cloud Foundry Spring vfabric March 2013 GemFire Redis RabbitMQ Industrial Internet / I4.0 ( 美國 - 工業互聯網 / 德國 - 工業 4.0) $105m Apr 2013 Pivotal s Leadership and Focus: - Open Source - Enterprise PaaS - Big Data Platform - Agile App Labs May 2016 $253m Internet of Vehicle/ IoT ( 車用互聯網 / 物聯網 ) 4

5 EMC 聯邦 IOT 物聯網解決方案 LOGICAL ARCHITECTURE THINGS Data Creation & Response REMOTE/EDGE SITE Filter, Stream Analytics, Network Protocol Normalization V-Gateways V-CPE COMMUNICATIONS TRANSPORT Send & Receive Transport Cloud Hybrid Cloud DATA CENTER Transform, Analyze, Process Workflow, Monitor, Infrastructure Management & Archive HUMAN/MACHINE INTERACTION Business Outcomes & Data Monetization \ SECURE ENVIRONMENT 5

6 EMC 聯邦 IOT 物聯網解決方案 EMC FEDERATION ARCHITECTURE - PRODUCTS THINGS REMOTE/EDGE SITE COMMUNICATIONS TRANSPORT DATA CENTER HUMAN/MACHINE INTERACTION Device Management Converged/ Hyperconverged Cloud Gateway Connectivity Batch Processing, Workflow Management & Archiving Applications Pivotal Greenplum Pivotal HD Pivotal GemFire Pivotal HAWQ ECS Isilon Pivotal tc Server Pivotal Cloud Foundry FEDERATION SERVICES/MANAGEMENT PARTNER ECOSYSTEM (Partners can plug-in at any point in the architecture) 6

7 EMC IoT 物聯網大數據平台設計理念 適用 IoT 各式場景 : Real Time, Semi-batch, Batch 標準 x86 硬體平台 : Commodity x86 server and LAN Switch 開源式架構 - 增加無限未來性與有效降低成本 Hadoop, MADib, R, PostGIS, Python, OpenStack, Cloud Foundry, 高度擴展性 : Grid-MPP-based Solution ( from Small to very Huge ) 作業系統平台 : on top Linux-based Cloud environment 支援多租戶 : Multi-tenancy for Resource and Business Optimization Support SLA variety, No Data Silo, Ease to Upgrade (HW&SW) 7

8 Isilon Hadoop Storage: 資料就地儲存 & 就地分析 GW GW GW Sensors Object Object SMB HTTP 整合 Isilon 與 vhadoop 打造 Hadoop-as-a-Service 環境 NFS FTP FTP NFS Data Ingestion LAN or WAN SMB NFS HTTPS FTP Object N-N Active name node name node name node name node Node reply NameNode Data 1 Data Copy data node HDFS LAN 提升 Hadoop solution: 1. 多種應用可能性 2. 加速創新 3. 更快 & 更便宜 Apache HPC NFS NFS FTP Data 就地儲存 & 就地分析 Multi-tenancy, Autotiering for Cloud Biz Easy for Hadoop data Snapshot, Backup, DR 8

9 EMC ITaaS Solution: 最佳工程整合新世代 IT 架構 (Engineered) Big Data without Data Silo + Agile App + Hybrid Cloud IoT HPC PACS OA Backup Snapshot DR ip Object ftp NFS/SMB NAS Simple mgt Big Data Lake Apache HDFS Same file SSD SAS NL-SAS ILM 50PB Pivotal BDS (Big Data Suite) ScaleIO ECS IsilonSD Pivotal CF VxRail DevOps AFA or HFA Storage Pivotal App Suite Other Open Source vfabric EMC 2 Backup & CA/DR AWS AP Development PaaS IaaS 9

10 EMC & Pivotal 物聯網大數據平台解決方案 Data Application MOBILE SERVICES MICROSERVICES COLLABORATION Pivotal CF Pivotal CF Dashboard Simulator Management IoT APPS Chorus Data Ingestion REAL-TIME DATA INSIGHTS Pattern DATA WAREHOUSE ANALYTICS APPS Data Feeds INGESTION Enrich (Decode) GemFire STREAM PROCESSING Transform Rabbit MQ Spring XD Sink Greenplum Database DATA LAKE ADVANCED ANALYTICS HAWQ/HDB INGESTION FTP, HTTPS, NFS, SMB, HDFS, Object Sink Isilon Hadoop Storage Data Stored Data Analytics 10

11 Powered by Fastest Path to the Cloud Instant access to the hybrid cloud, with industryleading Converged Infrastructure and Hyper- Converged Infrastructure Best-in-Class, Together Best-of-breed solutions from each of the Federation companies, engineered to work together as tightly integrated solutions 1st Class Support Unified support and service experience across different Federation companies Choice and Flexibility No vendor lock-in means customer choice, confidence, and future flexibility 11

12 西門子智慧工廠設備環境監控 ( PREDICTION ) The goal of condition monitoring is to catch hardware failures or operational anomalies before they reach the existing control system alarm limits. Early detection of these types of events or conditions can potentially prevent engine trips, forced outages, and additional impacts. The alarm limits are customized to each unit by analyzing the specific characteristics of the engine in an evaluation period. Continuously monitoring machinery is fundamental to plant asset management. Understanding the mechanical behaviour of rotating machinery brings many benefits. Source I: Online Monitoring of Gas Turbine Power Plants (Technical Document Siemens Power Generation 2005) 12

13 設備狀態傳感器 監測 MEASUREMENT CAPABILITIES SAMPLE: TURBINE & GENERATOR All rotating machines 1 absolute vibration 2 relative shaft vibration (x,y) 1, 2 absolute shaft vibration 3 shaft position, displacement 4 displacement (valves, gates, cylinders) static (oil) pressure 5 temperature 6 speed 10 generator partial discharge Gas turbines 7 dynamic (combustor) pressure 8 blade health 9 emissions Steam turbines shaft eccentricity (x,y) absolute expansion differential expansion casing expansion Source: MAGGITT Pesentation about VM600 systems Integrated machinery protection, condition and performance monitoring (July 2013) Pictures Siemens AG 2015 All rights reserved 4 13

14 巨量資料驅動設備品質提升 SMART DATA FOR MORE BUSINESS INTELLIGENCE, CONDITION MONITORING AND PREDICTIVE MAINTENANCE crsp / ISB* VPN WAN Sensor-/Log-Data Greenplum / Hadoop Scale-Out & Commodity Unified Analytics Platform Customer INTERNET Siemens Customer Service (*) crsp = Common Remote Service Platform ISB = Industry Service Backbone 14

15 案例 : 德國西門子 智能電網 IOT 基礎架構 EMC TECHNICAL PERSPECTIVE Control Center / SubStation Operation Energy Management Power Generation, Transmission, Distribution Energy Markets, Operations, Service Provider Industry Ethernet, Terminal Bus or Internet WAN Gateway Firewall WAN Gateway Firewall (*) EMS AMIS Security MDM WMS SCADA Archive Analytics OPM Alarm GIS VCE vblock CISCO Server EMC Storage VMware ESX ISILON VNX/VNXe DataDomain Greenplum EMC Storage for individual on-premis data storage and data analytics requirements (*) Because of the equalization of existing market structures (monopoly utilties), new vendors, existing IT hardware companies and service provider will join this new market. Therefore the location and the responsibility of the different applications and services can vary. 15

16 案例 : 德國西門子 智能電網 IOT 基礎架構 EMC FEDERATION CLOUD PERSPECTIVE (LAYER & CONTAINER) & PROVIDER PAAS-SOLUTION PaaS GP vhadoop Data Domain = Encrypted Data Storage (optional) (*) Sample Application Set. Depending on the usecase, the type and amount of applications can vary. 16

17 案例 : GE Wind & Power Real-time IoT 100K+ Sensor Events / Second Continuous Real-time Analysis 100K+ Data Points per Second Fast Data Asynchronous Write GemFire Millisecond to sub-millisecond client latency Real-time distributed event processing In-memory HA for high performance Pivotal HD Reporting Deep Analytics Big Data Billing Greenplum/ HAWQ Operations 17

18 案例 : 某車聯網應用案例 Rabbit MQ MOBILE APP JSON + Timestamp & GUID STREAM PROCESSING + MPG, range & route Spring XD Sink DATA LAKE Tap Pivotal HD/Isilon ENRICHER PREDICTIVE ANALYTICS ADVANCED ANALYTICS CAR SENSOR Horizontally Scalable Fault Tolerant Extensible Open-Source REAL-TIME DATA INSIGHTS GemFire Greenplum/HDB DASHBOARD 18

19 Key Takeaways IT s A DARWINIAN EVOLUTION IT s A TEAM SPORT INTEGRATION MATTERS TREAT DATA LIKE YOUR PRODUCT USER EXPERIENCE IS KING COLLECT EVERYTHING It s a journey worth the sacrifice YOUR DATA DIFFERENTIATES YOU DEMOCRATIZE YOUR DATA PERFECTION IS NOT REQUIRED 19

20