Software Transformation for Cloud Video Services

Size: px

Start display at page:

Download "Software Transformation for Cloud Video Services"

Rachel Peters
6 years ago
Views:

2 Software Transformation for Cloud Video Services Randell Hand

3 Agenda What are we trying to solve? How did we get here? Emergence of Container Technology for Video What does this mean for Apps? Case Study Where are we going? Wrap up

4 What are we trying to solve?

5 What is Infrastructure Transformation for Video? Unified platform COTS Segment Routing Cloud Orchestration Abstraction Service Awareness Software-defined (networks, workflows, apps) Can you spot the hole? 5

6 When HBO Go crashes during the season premiere of Game of Thrones, it s not because the internet can t handle all the traffic, it s because the software solution can t handle sudden spikes in traffic. Alan Wolk Industry Analyst 6

7 Focus for Today Many steps to fix. Collapse infrastructure Introduce Cloud strategy Abstract workflows Public and private clouds Deploy and operate tooling Software App Architecture All software the same? Spectrum of Cloudiness Virtualization and Containers Case Study Future Transformed Video Architecture 7

8 Speaking the Same Language UCS Unified Computing System COTS Commercial-Off-the-Shelf NMS Network Management System LXC Linux Container CMS Content Management System CDN Content Distribution Network ABR Adaptive Bit Rate HLS HTTP Live Streaming DASH Dynamic Adaptive Streaming over HTTP SDN Software Defined Networking SLA Service Level Agreement OS Operating System HA High Availability JITP Just-in-Time Packaging VMR Virtual Media Recorder 8

9 How did we get here?

10 Family Vacation! 10

11 Packing for the trip! 11

12 Does your video network look like this? 12

13 True Story of D Bespoke NMS Bespoke A/V 13

14 True Story of D Bespoke NMS Bespoke A/V 14

15 True Story of D Bespoke NMS Software? Cloud? How am I supposed to manage this? Who knows how to configure xyz? Bespoke A/V 15

16 True Story of D Bespoke NMS Software? Cloud? How am I supposed to manage this? Who knows how to configure xyz? Bespoke A/V 16

17 True Story of D Bespoke NMS Software? Cloud? How am I supposed to manage this? Who knows how to configure xyz? Bespoke A/V 17

18 Infrastructure Systems Example Desired Transition - vms architecture Service 1 Service 2 Service N BSS 1 BSS 2 BSS N OSS / BSS OSS 1 OSS 2 OSS N Silos VNF 1 VNF 2 VNF 3 NMS / EMS NMS / EMS NMS / EMS Transition E2E Orchestration SDN NFV HW HW HW HW SW x86 18

19 DC vs Media DC Trends Virtualization Programmable Infra Converged Infra Microservices Containerization Any Cloud Future Mixed HW Silos Consolidate Platforms/Apps? Cloud Environment Hybrid Cloud 19

Application Architecture Progression Silos / Appliances

Clusters App 1 App 3 App 2 App 1 App 3 App 1 App 2 App 2

App 2 App 3 App 3 Hypervisor Containers Independent,

built to peak Not a material driver for app

as cheap and expendable IT driven Server consolidation

the stack All is programmable Shared resources VM as

20 Application Architecture Progression Silos / Appliances Virtualization Cloud Micro Services PaaS, Container Clusters App 1 App 3 App 2 App 1 App 3 App 1 App 2 App 2 Cloud PaaS Hypervisor Hypervisor Hypervisor Cloud App 1 App 2 App 3 App 3 Hypervisor Containers Independent, dedicated app silos Dependent SW + HW relationship Silos built to peak Not a material driver for app rearchitecture; however enabled app teams to view servers as cheap and expendable IT driven Server consolidation Scale out SW / HW separation HW responsibilities move up the stack All is programmable Shared resources VM as deployment unit Dev centric Lightweight container as deployment unit Similar architectural tenants as cloud 20

21 Spectrum of Software Cloudiness Bespoke Appliance Bare Metal COTS Virtualized Apps Cloud-Native Apps Operational Flexibility Performance? 21

22 A story of 3 cloud software products Lift and shift = Cloud Tolerant Cloud ready virtualized Cloud Native microservices, stateless and decoupled atomic functions 22

23 Emergence of Container Technology for Video

24 All Video roads lead to Virtual Machines? Contribution Studio and Post Production Distribution Control Plane Scheduling NMS MAM CMS Automation Master Control Security Scheduler Billing User Mgmt Middleware Data Plane Encoding Content Factory Routing Switching Editing QC Transcoding Packaging Recording CDN 24

25 Best of Both Worlds? 25

26 Benefit Confluence Bare Metal is great because: Able to access HW directly Performant (no HW emulation) Full use of resources VMs are great because: Portability between hosts Elasticity Flexibility and Isolation of Apps CONTAINERS 26

27 Virtual Machines are Fundamentally Different than Containers App App App App Bins / libs Operating System Virtual Machine Hypervisor Operating System Hardware Bins / libs Operating System Virtual Machine Each App has its own OS App App App App Bins / libs Container Container Bins / libs Operating System Hardware Apps Share OS Hypervisor Linux Containers 27

28 Application Development Old Way: Applications on Host New Way: Deploy Containers App App App App Libraries Libraries App App App App Libraries Libraries Libraries Kernel Kernel 28

29 Virtual Machine vs Container Virtual Machine Container What is Virtualized? Hardware OS Portability Between hardware Software Overhead Medium Low Time to Spin up Slow Very Fast Best for: Design Philosophy of application Persistence Running multiple OS on Host Full application on VM Stateful, coupled with filesystem When performance, web-scale, and density is important Micro-services per container, DevOps friendly Stateless, decoupled with filesystem 29

30 Container Technology Primer

Linux Container (LXC) Technology Stack LXCs are built on modern kernel features cgroups; limits, prioritization, accounting & control namespaces; process based

31 Linux Container (LXC) Technology Stack LXCs are built on modern kernel features cgroups; limits, prioritization, accounting & control namespaces; process based resource isolation chroot; apparent root FS directory Linux Security Modules (LSM); Mandatory Access Control (MAC) User space interfaces for kernel functions 31

32 Linux cgroups: CPU Pinning Pin containers / jobs to CPU cores Carry out complex scheduling schemes Reduce core switching costs Adhere to SLAs 32

33 Docker Build, Store, and Run Containers. 33

34 Momentum for Containers (Docker) 34

35 Docker Architecture Overview 35

36 Docker Engine Lifecycle Overview Image Pull Creates a new container Allocates a filesystem Allocates a network and IP Executes Captures and provides output 36

37 Union File System App Layer OS Libraries Host OS Layer 37

38 Kubernetes (K8s) manages Docker Containers Provides control plane for container environment 38

39 Kubernetes Architecture Worker Node 1 Docker Pod Container Container Container Pod Container Container Container Pod Container Container Container K8s Master Worker Node 2 Pod Container Container Container Pod Container Container Container Docker Pod Container Container Container Worker Node 3 Docker Pod Container Container Container Pod Container Container Container Pod Container Container Container 39

40 K8S Key Components Kube-API-server Validates and configures data for API objects Pods Master Services Replication Controllers Kube-Controller Control Loop Kube-Proxy Network interface Kube-Scheduler Resource manager and policy Kubelet Monitor and Enforcer (kubelet agent on nodes) API-server Controller Proxy Scheduler Node 1 Node 2 Node N 40

41 Containers, Pods, Nodes Node K8s Master Pod Container 41

42 Service and Labels Worker Node Docker Pods Running Containers Service Construct Labels Service ABC Pod App 1 - SQL Pod App 2 - Nginx 42

43 Worker Node Worker Node Worker Node Worker Node Replication Controller Maintains Pod Structure Node 1 Node 1 Node 1 Node 1 Pod App 1 - SQL Pod App 1 - SQL Pod App 1 - SQL Pod Pod App 1 - SQL App 2 - Nginx Node 2 Pod App 2 - Nginx Node 2 XPod App 2 - Nginx Node 2 X OR Node 2 X Node 3 Node 3 Node 3 Node 3 Pod App 2 - Nginx 43

44 Kubernetes HA Cluster Load-Balanced Nodes Master Node Cluster 44

45 Redundancy is Now Native to Solution Old way New way 45

46 DevOps the new normal? Only replace the micro-service needed Enabled by layered container architecture Fail fast philosophy Deploy, test small scale Rollback Deploy Feature Velocity 46

47 What does this mean for Apps?

48 Recent Video App Development Trends App teams skip OpenStack for containers Migration from VMWare to container platforms Multi DC / hybrid / multi provider app deployment Top down approach / App CD tooling Container frameworks as the enabling platform Managed Platforms and Services Vendor solutions have matured Little appetite for DIY (time, talent, cost, risk) Let the app developers drive platform decisions Have an overarching platform to allow orchestration across any platform 48

49 Video Processing Transformation IBC 2015: Virtualized Main Screen Functions CES 2016: Video Headend Innovation Live TV VOD IOS VOD cdvr Bandwidth Optimization Encoding Packaging Applications xcode Mux/Stat Mux Orchestration Orchestration DPI IP Video Infrastructure Compute Storage Network 49

50 Video Processing Transformation CES 2016: Video Headend Innovation Bandwidth Optimization Encoding Packaging 50

51 Video Processing Transformation CES 2016: Video Headend Innovation NAB 2016: Hybrid Cloud Orchestration Bandwidth Optimization Encoding Packaging Service Provider Cloud Content Provider Cloud Hosted Cloud 51

52 Container as Cloud Native Building Block for Data Plane Requirement Container Answer Web Scale Dynamic Resiliency Agility Loosely coupled Discovery Overhead Hybrid solutions Independent scaling Microservices Quickly spin up and down Load-balanced, stateless design Fits squarely into CI/CD model Micro-services for independent atomic functions Labeling of services Minimal OS and libraries, no hypervisor layer Portability, APIs are first class citizens Apps Libs Guest OS Guest OS Hypervisor Host OS Infrastructure VM Apps Libs Apps Libs Docker Engine Host OS Apps Libs Infrastructure Containers 52

53 Case Study Virtual Media Recorder (VMR)

54 High Level cdvr Reference Architecture Scheduler Back Office Control Plane DRM Packager Recorder JITP CDN Data Plane 54

55 cdvr is Excellent Use Case for Containers Old Way with Virtual Machines or Bare Metal BM or VMs per application Pod dimensioning and deployment model Not Dynamic Recorder bound by multiple constraints Redundancy model Users vs channels Upgrade/Maintenance downtime Scales By Channels Sources Recorder Playout Scales By Users Scales By Channels Storage 55

56 cdvr is Excellent Use Case for Containers New Way with Containers Micro-services Granular model Dynamic, On-Demand services Atomic components of cdvr scale independently in stateless, selfhealing container cluster Extreme feature velocity - CI/CD pipeline Scales By Channels Sources Recorder Playout Scales By Users Scales By Channels Storage 56

Agents 1000+ Agents ZooKeeper (ESB) Archive Arch1 Agent Arch2

57 cdvr Better with micro-services Sources Manifest HBO Agent ESPN Agent In- Memory DB Recorder Stream1 Stream Agents Agents ZooKeeper (ESB) Archive Arch1 Agent Arch2 Agent Agents Origin Play1 Agent Play2 Agent Agents JITP 57

58 VMR cdvr Micro-services Architecture AUX Control Plane INGEST RECORD PLAYBACK RM DO AA CoreOS Container OS DASH Unicast SR RA MA API ZK UI DASH DASH Unicast Kubernetes (K8) Docker Container S3 API 58

59 Scaling Out VMR Control Plane Host 1 Host N.... Object Storage 59

60 Where are we going?

61 D s Journey Bespoke NMS Step 1: Infrastructure Convergence Remove Bespoke Single HW Platform Bespoke A/V 61

62 D s Journey Step 1: Infrastructure Convergence Remove Bespoke Single HW Platform 62

63 D s Journey Step 1: Infrastructure Convergence Remove Bespoke Single HW Platform 63

64 D s Journey Step 2: Application Convergence Orchestration Layer is Key Hybrid Clouds and SW Platforms Multi-Vendor Converged Tooling Converged Infrastructure 64

65 D s Journey Step 2: Application Convergence Orchestration Layer is Key Hybrid Clouds and SW Platforms Multi-Vendor Converged Tooling Converged Infrastructure 65

66 D s Journey Step 2: Application Convergence Orchestration Layer is Key Hybrid Clouds and SW Platforms Multi-Vendor Converged Tooling Converged Infrastructure 66

67 D s Video Architecture Solution Stack V2PC WorkFlow Orchestration On-Premise Containerized VMP Containerized vdcm 3 rd Party Docker UCS + Nexus 67

68 D s Video Architecture Hybrid Solution V2PC WorkFlow Orchestration VMR 68

69 ABR Transcoder JITP & JITE Multicast ABR vcmts Content Providers Alternate Content SS ABR TS VOD Pump Statmux Scramble ABR Transcoder Linear Packager ABR TS Linear Future: Fully Converged Micro-services Solution Micro-Service Edge ABR Core Unicast via CDN cdvr CDN VOD Library Any Cloud General Purpose Public or Private Cloud Compute 69

70 Openstack and Containers - Can they work together? 70

71 OpenStack on Kubernetes (SAP use case) Control and Data Plane Split Openstack Kubernetes Nova Neutron Cinder LBaaS CoreOS VMware KVM Cisco UCS Bare Metal Cisco ACI NetApp F5 71

72 Hurdles Still to Overcome Networking Complexity in Container Environment Security App Isolation Access to Host Adoption by Video Vendor Community Skill Set in Market Container Management Platform Evolution 72

73 What to do about it? I encourage you to : 1. Focus on software architecture, and not just the feature set. 2. Include SW architecture as a critical part of your decision-making process for future video solutions. 3. Make sure that containers are represented as a key piece of that architecture. 4. Ensure that the architecture will support hybrid cloud architectures.? 73

74 Wrap up

75 Key Messages Not all cloud software is the same! Cloud-native opens up new architecture and business possibilities Containers provide technology for true cloud delivery of services, because of: Web-scale design (resiliency, scale, elasticity) Micro-service apps enable true CI/CD and DevOps Cisco building solutions for orchestrated container-based, hybrid workflows Content Provider Cloud Service Provider Cloud Hosted Cloud 75

Complete Your Online Session Evaluation Please complete your Online Session Evaluations after each session Complete 4 Session Evaluations & the Overall Conference Evaluation (available from Thursday)

76 Complete Your Online Session Evaluation Please complete your Online Session Evaluations after each session Complete 4 Session Evaluations & the Overall Conference Evaluation (available from Thursday) to receive your Cisco Live T-shirt All surveys can be completed via the Cisco Live Mobile App or the Communication Stations Don t forget: Cisco Live sessions will be available for viewing on-demand after the event at CiscoLive.com/Online 76

77 Continue Your Education Demos in the Cisco campus Walk-in Self-Paced Labs Lunch & Learn Meet the Engineer 1:1 meetings 77

78 Continue Your Education Related sessions DEVNET-2203: DevNet Workshop - Building a DevOps CICD Pipeline from Scratch: Wednesday, Feb 22, 2:00 p.m. or Thursday, Feb 23, 10:00 a.m. DEVNET-2030/2123: Container Networking with Project Contiv Wednesday, Feb 22, 5:00 p.m. or Thursday, Feb 23, 5:00 p.m. DEVNET-2058: Cisco Zeus: Monitoring as a Service Thursday, Feb 23, 9:00 a.m. BRKSPM-2333: Leveraging Microservices and Containers to Fulfill the Promise of Autoscale and Continuous Delivery in Service Provider Networks: Thursday, Feb 23, 2:30 p.m. DEVNET-2042: DevNet Workshop - Getting Started with Containers Thursday, Feb 23, 4:00 p.m. 78

79 Q & A

80 Thank You

JOURNEY TO AS A SERVICE

JOURNEY TO AS A SERVICE CONTAINERIZATION JULY 2017 THE DIGITAL ERA EVOLVED IT TO BUSINESS STRATEGY Siloed, legacy, de-centralized, multi vendor setup. IT product focused. AO Operations IO Operations Wall