Resources and Services Virtualization without Boundaries (ReSerVoir)

Transcription

1 Resources and Services Virtualization without Boundaries (ReSerVoir) Benny Rochwerger IBM Haifa Research Lab. IBM Labs in Haifa

2 The RESERVOIR Vision The Next Generation Infrastructure for Service Delivery Provide revolutionary foundation for a new European infrastructure where resources and services can be transparently and dynamically managed, provisioned and relocated like utilities virtually without borders No single facility/provider can create a seemingly infinite infrastructure capable of serving massive amounts of users at all times, from all locations Federation of clouds Leverage the diversity factor to achieve economies of scale Leverage locality Analogies exists in areas outside IT services: Electrical power delivery: capacity can be shifted to guarantee supply and lower costs Roaming cellular communications: Talk wherever you are Impact Enable utility-like deployment of services, relieving the service consumer from awareness of the IT attributes while assuring QoS and security guarantees Aim to create the basis for future service products 2 NEXOF-RA AB Meeting, April RESERVOIR

3 RESERVOIR Partners and Competencies Partner Role Comment IBM HRL Telefonica I+D UCM Thales SAP Sun Microsystems DATAMAT University Lugano University UMEA University Messina UC London CETIC OGF Use-Cases Use-Cases + Tech Standardization Project Lead, Virtualization/SOA Infrastructure Service, Billing Infrastructure Grid, Dynamic Allocation Security, Virtualization Infrastructure, Hosting Use-Cases, Contribution to Requirement an Standards Contribution to Standards, Java Services, Monitoring Service Management Technologies Partner, Monitoring and Management Monitoring, Measuring and Billing Grid Experience, Testbed Development, Virtualization Security Grid and Virtualization Standards 3 NEXOF-RA AB Meeting, April RESERVOIR

4 The Reservoir Architecture Service Provider SD+ Service Manager VEE Management System VEE Management Enablement Layer Virtualized Physical Resource (e.g., Hypervisor) Infrastructure Provider = Site/Domain/Cloud 4 NEXOF-RA AB Meeting, April RESERVOIR

5 The Reservoir Architecture Service Provider Monitor service and enforce compliance by managing capacity of Service Components (VEEs) or/ and size of Service Tiers Deals with translation/mapping of service concepts/metrics (response time) to infrastructure concepts/ metrics (VEE size) SD+ Service Manager VEE Management System VEE Management Enablement Layer Virtualized Physical Resource (e.g., Hypervisor) Infrastructure Provider = Site/Domain/Cloud 5 NEXOF-RA AB Meeting, April RESERVOIR

6 The Reservoir Architecture Service Provider Monitor service and enforce compliance by managing capacity of Service Components (VEEs) or/ and size of Service Tiers Deals with translation/mapping of service concepts/metrics (response time) to infrastructure concepts/ metrics (VEE size) SD+ Service Manager VEE Management System Monitor VEEs and find best VEE placement that meet constraint satisfaction problem Deals federation of domains VEE Management Enablement Layer Virtualized Physical Resource (e.g., Hypervisor) Infrastructure Provider = Site/Domain/Cloud 6 NEXOF-RA AB Meeting, April RESERVOIR

7 Project Structure A1: Architecture (IBM) A4: Service Management (TID) A3: VEE Management (UCM) A2: VEE Infrastructure (IBM) A5: Testbed and Scenarios (UniMe) A6: Dissemination (CETIC) 7 NEXOF-RA AB Meeting, April RESERVOIR

8 A2: VEE Infrastructure Virtual Machine Technologies (IBM) Improve performance of VEE execution for typical RESERVOIR workloads Provide VEEMS enablement layer for virtual machines Relocation Enablement (IBM) Network Virtualization Storage Virtualization Java Service Containers (Sun) Provide VEEMS enablement layer for virtual java service containers 8 NEXOF-RA AB Meeting, April RESERVOIR

9 A3: VEE Management VEE Provisioning and Supervision (UCM) Image management Monitoring Allocation Policy Management (Datamat) Policy based placement and migration Federation of Management Domains (UCM) Built atop WSRF interfaces to access remote VEE Supervisors Push new and leverage existing OGF/DMTF/OASIS standards Interoperability between administrative domains and scheduling heuristics on federated and utility architectures. 9 NEXOF-RA AB Meeting, April RESERVOIR

10 A4: Service Management Service Definition (UCL) Design a new service description language that will allow the description of service interfaces, service lifecycle, interface bindings to implementations, service deployment, requirements for a service, rules for VEEs (re)configuration and (re)organisation and service components distribution and configuration Revisit the service lifecycle definition and extend it to accommodate the influence of virtualisation Extend tools available for service design (for example the Eclipse Web Tools Platform) Standardize the service description language Service Management (TID) monitoring across administrative domains settings and service-oriented architectures. Integrate monitoring with resource allocation and scheduling and take explicit account of the potentially synchronous nature of service invocations. Automatic deployment of services based on complex service definition Accounting, Billing and Payment (TID) Accounting and billing arrangements for outsourced services are based on raw machine resource consumption (CPU-time, storage capacity etc) RESERVOIR will pursue the definition of a framework that allows accounting and billing in terms of the services that were completed, taking into consideration the quality of service that was provided. 10 NEXOF-RA AB Meeting, April RESERVOIR

11 A5: Experimentation and Validation Testbed (UniMe) Create the necessary environment for testing and validation Support the execution of use cases Scenario 1: egov application (Thales) Automatic adjustment of resources and domains cooperation. Scenario 2: SAP business application (SAP) Business application oriented use cases and the opportunities to execute them on a flexible infrastructure. Scenario 3: Utility computing (Sun) Deploy arbitrary operating system and application stacks on remote resources. Provide secure and seamless access to them. Adjust resource allocation on-demand without the end user noticing disruption of service Scenario 4: Telco application (TID) Hosting web sites that deals with massive access (e.g., the Olympics games) High degree of personalization and support for mashups 11 NEXOF-RA AB Meeting, April RESERVOIR

12 First Year Major Deliverables Deliverable Date Architecture Specification M4 (May 2008) Market Analysis Report M6 (July 2008) High Level Design Document M9 (October 2008) Initial Prototype M12 (January 2009) Scientific Report M12 (January 2009) 12 NEXOF-RA AB Meeting, April RESERVOIR

13 Summary State of work of the NSP Kickoff meeting held in Haifa at the beginning of February Architecture work-package fully at work First version of architectural spec. expected at the end of May Started working on building the testbed 15 machines at UniMe, 4 machines at IBM (2 more on the way) and 8 machines on the way to UCM Web site up and running Come visit us at Next F2F meeting planned for beginning of June To be hosted by Telefonica in Barcelona Coincide with OGF23 Expectations on NEXOF-RA The channel for validation of concepts and extend reach of work and influence Input/guidance/collaboration in areas relevant to the project but not covered by it (i.e., interfaces between service provider and infrastructure provider) Contributions on NEXOF-RA Contributions mainly in the area of Adaptive Service Aware Infrastructure (WP3), but also in the area of scalability (WP4), and possible Service-centric System Engineering (WP2) Architecture WPs (WP6 and WP7) and to the proof of concept (WP8) 13 NEXOF-RA AB Meeting, April RESERVOIR