The NextGRID Architecture

Transcription

1 The NextGRID Architecture Guy Lonsdale C&C Research Laboratories, NEC Europe Ltd. OGF-20, Grid Means Business,, Collaborative Grids Session, The financial support of the European Commission is gratefully acknowledged. Material in this presentation reflects only the author s views and the Commission is not liable for any use that may be made of the information contained herein.

2 2 Presentation Overview Intro to the NextGRID project Summary of Key Architectural Features Examples of use/impact in NextGRID application experiments

3 3 The Grid Today Is a huge success for both business and science Significant business adoption of cluster Grids - mature technology Merrill Lynch But we see different facets The scientific community has embraced collaboration and new applications The business community has embraced resource management and provision Since 2002 the research community has been working on combining the above

4 4 Grid Research Vision Transparent and reliable Persistent, pervasive and ubiquitous Open to wide user & provider communities Secure, with trust across multiple domains Easy to use, configure and manage Person-centric yet Scalable Standards based Next Generation Grid Experts group: ftp://ftp.cordis.lu/pub/ist/docs/ngg_eg_final.pdf European citizens Grid service providers Grid offering services Public sector Private sector

5 5

6 Tomorrow s (Next)GRID 6 NextGRID focuses on Grid for business Vision is of future Grids: that are economically viable; in which new and existing business models are possible; in which development, deployment and maintenance are easy; and in which the provisions for security and privacy give confidence to businesses, consumers and the general public.

7 7 Creating the next generation Grid NextGRID Project Cycles conceptualisation design experimentation analysis Conceptualisation Analysis Design Experimentation Identification of Fundamental Requirements NextGRID architectural principles

8 Requirements Architectural Principles 8 Flexible Business Models Specific Quality of Service Terms Open to extension, flexible and able to allow business relationship management Dynamic Security Comms & operational security + dynamically changing trust relationships. Dynamic Composition late in the service provisioning lifecycle, linked to dynamic security Economic Sustainability Privacy Facilitated Management semi-automatic and at minimal cost, integration with business infrastructure Interactive Support impacting both the service level agreements & basic infrastructure Primary Principles -Driven Dynamics Dynamic Federation Minimal Grid Infrastructure: Balancing simplicity with sufficient features to support viable business models Secondary Principles Dynamic Service Lifetime Dynamic Content Support Service content able to evolve during service lifetime Manageability Autonomously, encompassing large-scale Grids Discovery Open Design and Development Process: Interoperable Grids, subject to some commonalities of design. For further details NextGRID White Paper

9 9 Presenting/representing the Architecture NextGRID is a Service Oriented Architecture Some NextGRID Approaches User Business layer Technology layer? service provider service NextGRID Service Configuration Policy Event Event Monitoring Policy Highly Compositional All the pieces are not needed all the time The interactions are not (statically) defined Flat Rather than Hierarchal Encapsulation rather than layering

10 Enabling Dynamics: s 10 Business layer service provider Business Context Technology layer service Business layer service provider Service Context Technology layer Applications Context service Business layer Technology layer Systems Context service provider service

11 Bi-partite s: Key NextGRID Innovation supports the full service provisioning lifecycle Corner Stone of the Architecture Evolution of existing structures Key business and market enabler Bi-partite s More Collaborative in Nature Product and service development Negotiation and sales Implementation Execution Assessment Decommission Linked to high level business goals Develop Templates, Parametric boundaries Negotiate Individual contracts Take orders Provision Monitor Surveillance Maintain, Bill Reassess Terminate Continuous Feedback

12 12 Negotiation Example NGE <id>1</id> <requirements> <capabilities> NextGRID Entity T <id>nge1t</id> <publish> <discover> offer() NGE <id>1</id> <requirements> <capabilities> NGE <id>2</id> <requirements> <capabilities> <instantiate> accept() <instantiate> <id>nge1</id> Fn <id>nge1fn</id> <id>nge2</id> Fn <id>nge2fn</id>

13 13 Business Value: Dual Use Management Efficiency Improved Data Center Automation Frequent management functions can be automated more easily through driven dynamics Greater Flexibility in Deploying Resources Underutilized resources are easily detected New Business Models Persistent On Demand Services With managed QoS Dynamic, Distributed, Transient Partnerships Through integration of dynamic security and s.

14 Architectural components 14 Allows composed services to deliver business value Defines services provided over bipartite relationships Provides basic facilities and interoperability Dynamic Orchestrators (discovery, workflow, invocation, etc) Management Systems and s Data-centric Functional Systems Dynamic Trust and Security Base standards (http, wsdl, soap, naming, notification, addressing, policy, security ) Protects services and bipartite relationships Allows consistent description and management of all applications

15 Primary Relationships 15 Registry Register / Discover Register Discover Get token assertions Functional Invoke Orchestration Resolve Mint Naming and Addressing Monitor/ Control Negotiate Get token assertions Get tokens Get token assertions Management Get token assertions Administer policy Trust and Security Schemas

16 Key outputs 16 Architectural Component Designs Generalised Specifications Software Components Grid Standards resulting from and influenced by NextGRID Generalised Specifications Case Studies Download Generalised Specifications at:

17 Generalized Specifications 17

18 Cookbook Example: Grid Virtual Infrastructure Model 18 <<component>> Prioritiser <<component>> Discoverer <<component>> Selector <<component>> VIM Enactor <<component>> Grounding <<component>> Security Token Service <<component>> QoS History <<component>> VIM Enactor <<component>> Grounding <<component>> VIM Enactor <<component>> Grounding <<component>> Application service

19 NextGRID Application Areas Financial Applications: 19 Digital Media (DM) Supply Chain Management (SCM) Electronic Data Record (EDR) Processing Images provided by Dreamstime.com, SAP, Kino, GridSystems

20 Financial Applications: Implied Volatility Scenario Application Benefits A Financial Services Grid involving 4 parties: Compute resource provider Financial service provider Financial data provider Financial service customer Objectives: orchestrate interactions between these parties allow them to centrally register and discover resources. Uniform method of describing numerous heterogeneous resources Common interface allows parties using different languages, tools, software to interact and simplifies the process System flexibility allowing new schemas and intermediaries to be added without affecting existing operation 20

21 21 Financial Applications: Derivative Pricing Scenario Pricing of complex options Results should be available within seconds or less in order to adapt prices, hedging strategies to market changes allow fast and reliable pricing of products tailored to the needs/demands of potential customers Application Benefits & Experiment Feedback Viability of NextGRID-relevant security components & interoperability across Windows-Linux/OSS systems Secure data transfer: a necessary condition for use of external services A bank could dynamically manage and enforce who is able to access the service under which. Feedback on handling security (token re-use) for interactivity

22 22 Electronic Data Record (EDR) Processing Scenario Customer with huge data sets to be processed under time-constraints (not possible locally) Data set published as a NextGRID secure service & service provider (for processing) sought. Service provider receives a job submission & URL of the customer data service. The service provider distributes jobs across machines, each to receive only subset for processing. Application Benefits End to End data transmission highly improves scalability and performance. NextGRID provides a coherent set of specifications to manage security, trust, service discovery, negotiation and QoS management (covers the whole transaction life-cycle).

23 Supply Chain Management Scenario Customer: Runs an SAP SCM solution & seeks to outsource Dialogue instances running on SAP WebAS. Seeks Provider offering hosting of Dialogue Instances while the business data remains at the customer site. Given an existing, initiates the use of the service by sending application specific configuration data. Provider: Offers hosting of Dialogue Instances & utilizes NextGRID Operational Mngmt Framework. Installs SAP binaries and the SAP Application Management Framework. SAP Dialogue Instances are deployed dynamically based on NextGRID policies with a threshold on the mean response time of the system. Application Benefits Dynamic management of Dialogue Instance will reduce TCO. Policy controlled management introduces high flexibility. Event driven operations of business applications Security 23

24 24 Digital Media Production Scenario Selection of service providers for a job submission Decision supported by analysis of QoE (Quality of Experience) data from previous job executions Rating of the service providers Application Benefits Rating of service providers based on QoE parameters Different/customized rating for each job type Effective expenditure of consumer s budget ( providers) Achieving higher QoS for the consumers

25 25 The Grid of the future Service orientation brings collaborative Grids within reach of business In NextGRID we ve focussed on Flexible Business Models Dynamic Security Economic Sustainability Facilitated Management Specific QoS Terms Dynamic Composition Privacy Interactivity Support Next steps are to create Service Oriented Knowledge Utilities - SOKUs

26 The Future 26 See

27 27 Acknowledgements All NextGRID Partners For direct contributions to the presentation: Applications teams at First Derivatives, GridSystems, KINO, NEC, NTUA, QUB,SAP Paul McKee (BT), Mark Parsons (epcc), Dave Snelling (Fujitsu Labs Europe) The financial support of the European Commission is gratefully acknowledged. Material in this presentation reflects only the author s views and the Commission is not liable for any use that may be made of the information contained herein.