Internet of Things (IoT) Are traditional architectures good enough?

Transcription

1 Internet of Things (IoT) Are traditional architectures good enough? Guido Schmutz BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH

2 Guido Schmutz Working for Trivadis for more than 18 years Oracle ACE Director for Fusion Middleware and SOA Co-Author of different books Consultant, Trainer Software Architect for Java, Oracle, SOA and Big Data / Fast Data Member of Trivadis Architecture Board Technology Trivadis More than 25 years of software development experience Contact: guido.schmutz@trivadis.com Blog: Twitter: gschmutz

3 Unser Unternehmen. Trivadis ist führend bei der IT-Beratung, der Systemintegration, dem Solution Engineering und der Erbringung von IT-Services mit Fokussierung auf - und -Technologien in der Schweiz, Deutschland, Österreich und Dänemark. Trivadis erbringt ihre Leistungen aus den strategischen Geschäftsfeldern: B E T R I E B Trivadis Services übernimmt den korrespondierenden Betrieb Ihrer IT Systeme.

4 Mit über 600 IT- und Fachexperten bei Ihnen vor Ort. KOPENHAGEN HAMBURG 14 Trivadis Niederlassungen mit über 600 Mitarbeitenden. Über 200 Service Level Agreements. Mehr als 4'000 Trainingsteilnehmer. DÜSSELDORF Forschungs- und Entwicklungsbudget: CHF 5.0 Mio. FRANKFURT Finanziell unabhängig und nachhaltig profitabel. GENF BASEL BERN LAUSANNE FREIBURG BRUGG ZÜRICH STUTTGART MÜNCHEN WIEN Erfahrung aus mehr als 1'900 Projekten pro Jahr bei über 800 Kunden.

5 Agenda 1. Introduction 2. Are Traditional Solution architectures good enough? 3. IoT Architecture & Components 4. IoT Platforms 5. Summary

6 Introduction

7 Internet of Things Wave Internet of Things (IoT): Enabling communication between devices, people & processes to exchange useful information & knowledge that create value for humans Term was first proposed by Kevin Ashton in 1999 The concept of IoT first became popular at the Auto-ID center and MIT IoT can also be named M2M

8 Reasons why IoT opportunity is occurring now? Affordable hardware Availability of supporting tools Costs of actuators & sensors have been cut in half over last 10 years Big data tools & cloud based infrastructure have become widely available and fairly sophisticated Smaller, but more powerful hardware Mass market awareness Form factors of hardware have shrunk to millimeter or even nanometer levels Ubiquitous & cheap mobility Cost for mobile devices, bandwidth and data processing has declined as much as 97% over last 10 years IoT has surpassed a critical tipping point Vision of a connected world has reached such a followership that companies have initiated IoT developments Commitment is irreversible

9 IoT Solution Types Thing Thing-centric Gateway-centric Smartphone-centric Cloud-centric -centric Gateway Cloud-based / On-Premise Sensor User Interface Application Analytics Data Adapted from Gartner

10 IoT Solution Types Thing-centric q Things are smart on their own q store most of their data on-board q Things are self-sufficient and communicate to the Internet only for centralized coordination Gateway-centric q gateway houses the application logic, stores data and communicates with the Internet for the things that are connected to it q Things don t have to be as smart, because the gateway provides these resources

11 IoT Solution Types Smartphone-centric q The smartphone (or any mobile device) houses the application logic, stores data and communicates with the Internet for the things that are connected to it q Things don t have to be as smart, because the smartphone provides these resources Cloud-centric q The cloud will act as the central connection hub, power analytics and provision data storage q Things don t have to be as smart, because the cloud will provide these resources -centric q Things are behind a firewall and are geographically co-located q There is little need to extend out to the external Internet

12 Are Traditional Solution architectures good enough?

13 A little story of a real-life customer situation 16 Rich (Web) Client Apps Mobile Apps schedule delivery Logistic System Logic (PL/SQL) Traditional system interact with its clients and does its work Implemented using legacy technologies (i.e. PL/SQL) Sensor ship sort delivery Oracle New requirement: Offer notification service to notify customer when goods are shipped Subscription and inform over different channels Existing technology doesn t fit

14 A little story of a real-life customer situation 17 Rich (Web) Client Apps schedule Logistic System Logic (PL/SQL) Mobile Apps delivery Sensor ship sort delivery Oracle Notification Logic (Java) SMS s are owned by traditional application (as well as the channels they are transported over) Implement notification as a new Java-based application/system But we need the events! => so let s integrate

15 A little story of a real-life customer situation 18 Rich (Web) Client Apps Mobile Apps schedule delivery Logistic System Logic (PL/SQL) Filter Rule Engine (Java) Sensor ship sort delivery Oracle AQ delivery delivery true SMS Oracle Service Bus ship JMS Notification Logic (Java) integrate in order to get the information! Oracle Service Bus was already there Rule Engine implemented in Java and invoked from OSB message flow Notification system informed via queue Higher Latency introduced (good enough in this case)

16 A little story of a real-life customer situation 19 Rich (Web) Client Apps Mobile Apps schedule delivery Logistic System Logic (PL/SQL) Filter Rule Engine (Java) Sensor ship sort delivery Oracle AQ delivery delivery true SMS Oracle Service Bus ship JMS Notification Logic (Java) Treat events as first-class citizens s belong to the enterprise and not an individual system => Catalog of s similar to Catalog of Services/APIs!! (stream) processing can be introduced and by that latency reduced!

17 Treat s as s and make them globally available 20 Rich (Web) Client Apps schedule Logistic System Logic (PL/SQL) Mobile Apps delivery Bus/Hub Oracle Sensor ship delivery sort Filter Rule Engine (Java) delivery true SMS Oracle Service Bus ship JMS Notification Logic (Java) Stream/ Processing

18 IoT Architecture

19 Key Challenges for building an IoTapplication Connect: How to collect data from intelligent devices? Abstract complexity associated with device connectivity Standardize integration of devices with enterprise Analyze: How to analyze IoT data? Reduce noise and detect business event at real-time Enable historical big-data analysis Integrate: How to integrate IoT data & events with enterprise infrastructure? Make enterprise processes IoT friendly Allow enterprise & mobile applications to control devices

20 Distribute runtime portion of IoTAnalytics to the edge Some IoT Analytics applications need to be distributed, so that processing can take place in devices, gateways, smart routers, servers at the site where sensor data is generated Three main reasons: The factory, vehicle, home or other edge location needs to stay in operation, even when the corporate data center or cloud is down or not reachable Wide-are communication is generally to slow Transmitting all sensor data to corporate or cloud data center may be impractical or impossible if the volume of data is high or if reliable, high-bandwidth networks are unavailable

21 Data and IoT Several types of data play a role in an IoT deployment: Continuous environmental and positional data Multidimensional time series data Descriptive data (metadata) about objects, systems and processes Historical data Analytical models Radio frequency identification (RFID) data Assess the variety of data used in your IoT architecture to refine your datastore requirements => NoSQL Understand the unique optimizations for time series data and analysis => NoSQL

22 1) IoT with Simple Processing Mobile Apps External Cloud Service Providers BPM and SOA Platform 25 Rich (Web) Client Apps IoT Smart Device API Gateway Service Bus (ESB) Processes Services Applications Business Logic/Rules IoT Device Gateway Business Intelligence Viszualization Analytics = one way = request/response

23 1) IoT with Simple Processing Oracle Mobile Apps External Cloud Service Providers 26 Rich (Web) Client Apps IoT Smart Device API Gateway API Gateway Serivce Service Bus Bus (ESB) BPM and SOA Platform SOA Suite Processes BPM Suite Services Applications Business Logic/Rules IoT Device Gateway Business Intelligence Stream Explorer Viszualization Business Activity Analytics Monitoring = one way = request/response

24 2) IoT with Stream/ Processing Mobile Apps External Cloud Service Providers 27 Rich (Web) Client Apps IoT Smart Device IoT Device Social Media Streams Gateway ESP/CEP API Gateway Bus (Ingress) ESP/CEP Stream Processing Infrastructure Service Bus (ESB) Bus BPM and SOA Platform Processes Services Applications Business Logic/Rules Business Intelligence Viszualization Analytics = one way = request/response

25 2) IoT with Stream/ Processing Open Source Mobile Apps External Cloud Service Providers 28 Rich (Web) Client Apps IoT Smart Device IoT Device Social Media Streams Gateway ESP/CEP API Gateway Bus (Ingress) ESP/CEP Stream Processing Infrastructure Service Bus (ESB) Bus BPM and SOA Platform Processes Services Applications Business Logic/Rules Business Intelligence Viszualization Analytics = one way = request/response

26 2) IoT with Stream/ Processing - Oracle Mobile Apps External Cloud Service Providers 29 Rich (Web) Client Apps IoT Smart Device Oracle Processing For Embedded IoT Device Social Media Streams Gateway Oracle Processing ESP/CEP For Embedded Serivce Bus Bus (Ingress) API API Gateway Coherence Stream Processing Infrastructure Oracle NoSQL Oracle ESP/CEP Processing Stream Explorer Serivce Service Bus Bus (ESB) Bus BPM and SOA Platform SOA Suite Processes BPM Suite Services Applications Business Logic/Rules Business Intelligence Stream Explorer Viszualization Business Activity Analytics Monitoring = one way = request/response

27 3) IoT with Big Data Analytics Mobile Apps External Cloud Service Providers 30 Rich (Web) Client Apps IoT Smart Device IoT Device Social Media Streams Gateway ESP/CEP API Gateway Bus (Ingress) HDFS Hadoop Big Data Infrastructure Batch Processing Service Bus (ESB) Bus BPM and SOA Platform Processes Services Applications Business Logic/Rules Business Intelligence Viszualization Analytics = one way = request/response

28 3) IoT with Big Data Analytics Open Source Mobile Apps External Cloud Service Providers 31 Rich (Web) Client Apps IoT Smart Device IoT Device Social Media Streams Gateway ESP/CEP API Gateway Bus (Ingress) HDFS Hadoop Big Data Infrastructure Batch Processing Service Bus (ESB) Bus BPM and SOA Platform Processes Services Applications Business Logic/Rules Business Intelligence Viszualization Analytics = one way = request/response

29 3) IoT with Big Data Analytics - Oracle Mobile Apps External Cloud Service Providers 32 Rich (Web) Client Apps IoT Smart Device Oracle Processing For Embedded IoT Device Social Media Streams Gateway Oracle Processing ESP/CEP For Embedded API API Gateway Bus (Ingress) Oracle BigDataHadoop Appliance Big Data Infrastructure Oracle HDFS Data Integrator Batch Processing Oracle NoSQL Serivce Service Bus Bus (ESB) Bus BPM and SOA Platform SOA Suite Processes BPM Suite Services Applications Business Logic/Rules Business Intelligence Stream Explorer Viszualization Business Activity Analytics Monitoring = one way = request/response

30 4) IoT with Lambda Architecture Mobile Apps External Cloud Service Providers 33 Rich (Web) Client Apps IoT Smart Device IoT Device Social Media Streams Gateway ESP/CEP API Gateway Bus (Ingress) HDFS Hadoop Big Data Infrastructure Batch Processing ESP/CEP Stream Processing Infrastructure Service Bus (ESB) Bus BPM and SOA Platform Processes Services Applications Business Logic/Rules Business Intelligence Viszualization Analytics = one way = request/response

31 5) IoT with Kappa Architecture Mobile Apps External Cloud Service Providers 34 Rich (Web) Client Apps IoT Smart Device IoT Device Social Media Streams Gateway ESP/CEP API Gateway Bus (Ingress) HDFS Hadoop Big Data Infrastructure Replay to reprocess ESP/CEP Stream Processing Infrastructure Service Bus (ESB) Bus BPM and SOA Platform Processes Services Applications Business Logic/Rules Business Intelligence Viszualization Analytics = one way = request/response

32 6) IoT with Big Data Advanced Analytics Mobile Apps External Cloud Service Providers 35 Rich (Web) Client Apps IoT Smart Device IoT Device Social Media Streams Gateway ESP/CEP API Gateway Bus (Ingress) HDFS Hadoop Big Data Infrastructure Batch Processing ESP/CEP Stream Processing Infrastructure Service Bus (ESB) Bus BPM and SOA Platform Processes Services Applications Business Logic/Rules Business Intelligence Viszualization Analytics = one way = request/response

33 IoT Reference Architecture Mobile Apps External Cloud Service Providers 36 Rich (Web) Client Apps IoT Smart Device IoT Device Social Media Streams Gateway ESP/CEP API Gateway Bus (Ingress) HDFS Hadoop Big Data Infrastructure Batch Processing ESP/CEP Stream Processing Infrastructure Service Bus (ESB) Bus BPM and SOA Platform Processes Services Applications Business Logic/Rules Business Intelligence Viszualization Analytics = one way = request/response

34 IoT Reference Architecture Open Source Platform Mobile Apps External Cloud Service Providers 37 Rich (Web) Client Apps IoT Smart Device IoT Device Social Media Streams Gateway ESP/CEP API Gateway Bus (Ingress) HDFS Hadoop Big Data Infrastructure Batch Processing ESP/CEP Stream Processing Infrastructure Service Bus (ESB) Bus BPM and SOA Platform Processes Services Applications Business Logic/Rules Business Intelligence Viszualization Analytics Internet of Things - Sind traditionelle Architekturen gut genug? = one way = request/response

35 IoT Reference Architecture Oracle Platform Mobile Apps External Cloud Service Providers 38 Rich (Web) Client Apps IoT Smart Device Oracle Processing For Embedded IoT Device Social Media Streams Gateway Oracle Processing ESP/CEP For Embedded Serivce Bus Bus (Ingress) API API Gateway Oracle BigDataHadoop Appliance Big Data Infrastructure Oracle HDFSData Integrator Batch Processing Oracle NoSQL Coherence Stream Processing Infrastructure Oracle NoSQL Oracle ESP/CEP Processing Stream Explorer Serivce Service Bus Bus (ESB) Bus BPM and SOA Platform SOA Suite Processes BPM Suite Services Applications Business Logic/Rules Business Intelligence Stream Explorer Viszualization Business Activity Analytics Monitoring Internet of Things - Sind traditionelle Architekturen gut genug? = one way = request/response

36 IoT Platform

37 IoT Platforms: backbone to manage IoT business cases Mayor building blocks of an IoT Platform

38 Oracle Internet of Things Cloud Service IoT Cloud Service Oracle Cloud Services Apps Cloud or On Premise Integrate Connect Analyze Device Virtualization Stream Processing Connectivity BI & Big Data Cloud Service Manufacturing 3 rd party apps Reduce Make enterprise noise and processes detect business IoT Abstract events complexity friendly at real-time associated with device connectivity Enable Allow historical enterprise big-data & mobile analysis applications to control devices Standardize integration of devices with enterprise High Speed Messaging Endpoint Management Data Enrichment Store REST APIs Control Integration Cloud Service Mobile Cloud Service Service Mgmt Transportation Industry Vertical Apps Asset Mgmt

39

40

41 Summary

42 Summary Treat events as events! Infrastructures for handling lots of events are available! IoT tends to make Big Data / Fast Data infrastructures necessary Know your use case/requirements to choose the right architecture! Can my existing backend landscape handle the new IoT load? Do I have to handle huge amount of events in real-time? Do I need to filter/aggregate data before invoking existing backend systems? Do I want to do Advanced Analytics (predictive analytics) where historical information is necessary? What is the network bandwidth between device/gateway and cloud/backend? Centralized or Decentralized IoT solution?

43 Trivadis an der DOAG 2015 Ebene 3 - gleich neben der Rolltreppe Wir freuen uns auf Ihren Besuch. Denn mit Trivadis gewinnen Sie immer.

44 Guido Schmutz Technology Manager