Using Systems Capacity Data for Business Intelligence

Using Systems Capacity Data for Business Intelligence

Informed decisions are critical for success Forrester definition of Business Intelligence: Business Intelligence is a set of methodologies, processes, architectures, and technologies that transform raw data into meaningful and useful information used to enable more effective strategic, tactical, and operational insights and decision-making. So let s start by splitting that down and begin with a look at methodology and process relating to capacity management. Methodology and Process What is a process? A process is a collection of related, structured activities or tasks that produce a specific service or product, for a particular customer or customers. 2 Using Systems Capacity Data for Business Intelligence

What are the first steps in creating a process for capacity management? Establish stakeholders Identify the customers Determine what the customers need and want Gather requirements for what is needed to deliver Perform a structured analysis on how to deliver This is really the planning stage, where you are getting this upfront information gathered and documented so that you have a good path forward when you go to create the solution. The next step will be to look at the architecture and technologies that you are going to use. Architectures and Technologies What technologies are used for capacity management? Data collection techniques you are going to need some way of collecting data and bringing the data in to a database in a way that you are able to utilize it. Using Systems Capacity Data for Business Intelligence 3

Centralized storage and management of data data needs to be easily accessible. Your data also needs to be managed effectively. You will need to keep large quantities of historical data if you wish to model, trend and chart effectively and if this isn t managed correctly it can become unwieldy very quickly. Reporting and alarming facilities notification is important as you want to know when you may need to do something in your environment. Set thresholds and receive notification when they are breached or about to breach. Predictive modeling capabilities forecasting (see bottom right of reports above for an example forecast report), you can use these to predict Service Level Agreement (SLA) requirements, determine what service levels will be in the future and when service levels will be exceeded. Best practices for Capacity Management Use a single repository and tool Effectively manage historical data Automate where possible Utilize proactive notification of events Report on data from different perspectives Start small and grow Ensure realization of value Evolution and Creation of Capacity Data Nowadays there is a lot of data out there but I have chosen to show a simple chart which is an example of a traditional high level capacity plan. Below is an example of the diversity of metrics out there today and available to the Capacity Manager. 4 Using Systems Capacity Data for Business Intelligence

Key Performance Indicators The advent of virtualization has added to the types of system metrics over the years, once upon a time we would never have had to worry about ballooning or dynamic memory balancing. CPU Avg. CPU Usage in MHz CPU Ready Time Hypervisor Logical Processor % Hypervisor Virtual Processor % Memory Avg. Memory Usage in KB Balloon KB Swap Used KB Consumed Active Dynamic Memory Balancer Dynamic Memory Pressure VM Vid Partition Using Systems Capacity Data for Business Intelligence 5

I/O Queue Latency Kernel Latency Device Latency Virtual Storage Device Virtual Network Adapter KPIs can be any time series data that provides valuable information and it is for you to determine which are the most valuable to your organization. The metric chosen for the chart above is not a system related metric it is a business metric based on revenue, this could just as easily be based on something like transaction count. Bringing in business data gives you the advantage as you can then view business metrics in the context of your system data. The integrator feature in athene allows you to integrate all sorts of time series data so when you choose your metrics you are not just restricted to basing your KPI s on pure system data this allows you to introduce metrics that are also important to your stakeholders. The next example is storage for IBM SAN controller running on SQL servers 6 Using Systems Capacity Data for Business Intelligence

This information shows metrics bought in as a stacked chart so that you can see the total storage used for this group and you can then use this information for trending, to see when your storage is going to be a problem. Next I ve use the same storage example as a trend. I have aggregated all of the sequel servers up and you can see how this will look when you trend it. This type of information allows us to be proactive as an organization, identifying ahead of time when and where the problems will occur so that we can take action and avoid the issues. Whilst firefighting may grab people s attention it is in the best interests of your organization to stop major incidents occurring, and far less costly. It is a much better option to be well planned but remember to ensure that your successes and value remain visible within the organization by reporting on them and making people aware of the consequences that have been averted. Show your value. Where to look for KPIs Business and application transactions, response times Transaction response Infrastructure costs Budget and planning forecasts System and application metrics SAN storage metrics Network metrics Virtualization statistics Calculated metrics These are a few examples but as I said previously you need to determine what is going to be of most value and importance to you within your organization and look for KPI s based around those. Using Systems Capacity Data for Business Intelligence 7

Costs and Capacity Data A lot of people get very nervous when you start to discuss chargeback, as chargeback can be very complicated and often times is not easily implemented. You can start simply, without accounting, and it is useful for both you and the users/departments to know exactly who is using what from the total resources. I ve given an example below which looks at the top 10 applications and how much of our total storage they are using. Storage by application In this instance the large chunk of lilac at the bottom traced back to IT and this is something that you must also factor in chances are with things like data warehousing and testing IT are heavy consumers in their own right. Simple chargeback schemes can encourage savings but be sure to include the IT department in your calculations. Multiple cost tiers for resources can encourage further savings as high end storage carries a much higher cost. Storage cost by Tier 8 Using Systems Capacity Data for Business Intelligence

In this scenario our client encouraged users of high end storage to migrate to lower cost storage if it was not really necessary and made significant savings. Visibility into the cost of consuming resources can be simple In this example the resource is shown as the turquoise bar chart and the actual cost is shown as the dark blue line. A simple chart but very effective when talking to your users as you can start to talk in monetary terms about the IT resources that they are consuming. Creating a Plan Step 1 A plan starts by first evaluating where you are currently Who is currently responsible for managing capacity? What process and tools are used? Is anything being done proactively? Are system resources accounted for with costs? Is management informed and interested? How visible is the activity of capacity management? Has the subject been evaluated to determine opportunities? What are potential returns on investment (ROI)? Using Systems Capacity Data for Business Intelligence 9

Step 2 Begin defining processes: Establish stakeholders Identify the customers Determine what the customers need and want Perform an ROI study Gather requirements for what is needed to deliver Perform structured analysis on how to deliver Step 3 Final step is to implement and deliver and the implementation is driven by requirements: Determine what software and services are needed Formally define deliverables Implement software solution Architect deliverables with selected software and services Automate as much of the process as possible Validate operations with review of working environment Confirm planned value is being realized by customers Use standard project management techniques to help you 10 Using Systems Capacity Data for Business Intelligence

Implementation Determine what software and services are needed Formally define deliverables Dashboard Analysis Advice Virtualization Using Systems Capacity Data for Business Intelligence 11

Business Trending Modeling Modeling Implement software solution Architect deliverables with selected software and services Automate as much of the process as possible 12 Using Systems Capacity Data for Business Intelligence

Validate operations with a review of working environment Check that what you have architected is actually working. Here is a sample Return On Investment (ROI) model which can be used to confirm that planned value is being realized by your customers. ROI s are of particular importance nowadays as they determine the value that is going to be provided and how long it will take to reap financial benefits, as a software provider we will be happy to assist you with an ROI. Using Systems Capacity Data for Business Intelligence 13

Summary and final thoughts Business intelligence for capacity management does not need to involve special data warehouses, ETL operations, or OLAP cubes. Transforming capacity data into useful information for decision making can be easy, with the right processes and software. Without a solid plan, buy-in from management, and a well-defined process, no amount of software will deliver the value everyone hopes for. Effectively managing capacity is intelligent business. 14 Using Systems Capacity Data for Business Intelligence

Using Systems Capacity Data for Business Intelligence 15

Metron Metron, Metron-Athene and the Metron logo as well as athene and other names of products referred to herein are trade marks or registered trade marks of Metron Technology Limited. Other products and company names mentioned herein may be trade marks of the respective owners. Any rights not expressly granted herein are reserved. www.metron-athene.com