Monitoring OpenShift and Detection Performance Anomalies with CoScale

Transcription

1 Monitoring OpenShift and Detection Performance Anomalies with CoScale Peter Arijs Product & Marketing Samuel Vandamme Customer Success

2 About CoScale Full stack performance monitoring Built for microservices environments Lightweight for production monitoring Powered by anomaly detection Offered as a SaaS and on-premises solution OpenShift Primed and Docker ETP partner

3 OpenShift & CoScale

4 Business drivers, changing IT delivery

5 Containers, technology to help

6 Scale problem for containers in production What about Orchestration and Automation? Networking and Storage? Security and Signing? Container Hosting? Disaster Recovery? Logging and Monitoring? Application Performance?

7 OpenShift container platform

8 Adding in CoScale

9 CoScale is an OpenShift Primed partner

10 Monitoring Containers and Microservices

11 Top container challenges in production Source: Hope vs. reality, Containers in 2016, Global perception study by CloudFoundry, June 2016

12

13 Container monitoring challenges Scale & dynamic behavior Number of containers >> number of servers Containers come and go at a much faster pace Technology diversity Different application technologies Overload of metrics to monitor and alert on

14 Monolithic application monitoring End user Real user monitoring (RUM) Application Application performance monitoring (APM) (Virtualized) OS System / Infrastructure monitoring

15 Monitoring microservices End user Real user monitoring Page loads, errors, resources,... Application component Application component Application component In-container / Application monitoring Web service, database, caching,... Container Container Container Container resource monitoring CPU, memory, storage, network,... Orchestrator Orchestration monitoring Services, volumes, replication controllers,... (Virtualized) OS System / Infrastructure monitoring CPU, Memory, Storage, Network,...

16 Monitoring microservices "The pace of scale and dynamism of the infrastructure and application environment are accelerating, with the advent of containers, microservices, autoscaling and softwaredefined 'everything' stressing the capabilities of existing APM tools" Cameron Haight VP Gartner s IT Systems, Security and Risk research group From APM Needs to Prepare for the Future, June 2016

17 Monitoring microservices APM tools were designed for monolithic apps written in Java,.NET, etc. Containers run a large variety of smaller-sized microservices Containers are lightweight, so monitoring should also be lightweight Putting an agent inside a container is an anti-pattern Too many dynamic metrics to handle with static alerts

18 What metrics to monitor? Hosts (CPU, memory, disk, network) Orchestrator (containers, services, volumes, replication controllers) Containers (CPU, memory, I/O, container start/stop times) Containers interactions (HTTP request, API calls) Container internals (web services, caching, queueing, databases) Impact on user and application performance

19 The CoScale approach One lightweight agent per host Server resource metrics from OS Container and cluster resource metrics from OpenShift and Docker In-container monitoring with application specific plugins Real user monitoring shows impact on end user Business and custom metrics from various sources Anomaly detection on all metrics Event integration to understand changes in infrastructure

20 METRICS & EVENTS INTUITIVE CLICK-THROUGH DASHBOARDS IMPACT ON CUSTOM AND BUSINESS METRICS MICROSERVICES, CONTAINER, AND CLUSTER MONITORING AUTOMATIC ANOMALY DETECTION

21 CoScale Architecture

22 Installation on OpenShift 1. Create a CoScale account 2. Create a CoScale agent a) Select the OpenShift plugin b) Select the Docker plugin c) Configure application specific plugins d) Install the agent 3. Set up RUM or other integrations For more details:

23 Anomaly Detection

24 Metrics explosion Traditional environment Container environment Component Metrics Component Metrics OS 50 per host OS 50 per host Application 50 per host Orchestrator 50 per host Container 50 per container Application 50 per container Total number of metrics 100 per host Total number of metrics > 1000 per host (assuming 10 containers/host)

25 Static alerts! TODO : more realistic business examples!!

26 Static alert limitations data explosion changing or dynamic environment seasonality? correlations

27 Anomaly detection

28 Anomaly detection on time series metrics

29 Correlation of anomalous metrics

30 Outlier detection on cluster metrics

31 Demo

32 OpenShift dashboard

33 OpenShift cluster overview

34 Container metrics

35 In-container monitoring

36 Anomaly detection on containers

37 Questions? Register now for your 30- day FREE trial Contact: