NSIDC NASA DAAC UWG TIM Meeting 33 Boulder, CO August 12-13, Pre-Meeting Materials

Transcription

1 NSIDC NASA DAAC UWG TIM Meeting 33 Boulder, CO August 12-13, 2015 Pre-Meeting Materials

2 Outline Meeting Goals Meeting Agenda Pre-Meeting Homework NSIDC Organization Vision and Organization DAAC: Trends DAAC Workflow Management Materials

3 Meeting Goals Develop additional NSIDC DAAC best practices in data stewardship based on input from the UWG regarding important metrics and data citations, and improve upon the information related to data management requirements in NASA solicitations. Determine the role of the NSIDC DAAC in better supporting the relationship between science and data management. Understand the user community needs and expectations in working with NSIDC data, including discovery, accessibility, and usability.

4 Meeting Agenda For more information see the detailed Agenda Wednesday, August 12, :30-8:45 Welcome, Introductions 8:45-9:00 UWG meeting introduction 9:00-10:00 DAAC & ESDIS status reporting 10:00-10:30 Virtual Collections 10:30-10:45 Break 10:45-11:15 Inter-Comparison Studies 11:15-12:15 Increasing DAAC Expertise 12:15-1:30 Catered Lunch 1:30-2:45 Personas 2:45-3:15 Data Accession 3:15-3:30 Break 3:30-4:00 Parking Lot Day 1 4:00-4:30 Action Item/Recommendations Day 1 6:30- Group Dinner - Fate Thursday, September 4, :30-8:40 Quick Logistics 8:40-9:15 Visualization/Analysis 9:15-10:00 Fit for Use 10:00-10:15 Break 10:15-11:00 Data Stewardship Guidelines 11:00-11:40 Metrics 11:40-12:15 Data Citations 12:15-1:15 Lunch 1:15-1:45 A Day-in-the-Life of a User 1:45-2:15 Parking Lot Day 2 2:15-2:30 UWG Membership 2:30-3:00 DAAC Action Item Administration 3:00-3:15 Break 3:15-3:45 UWG Recommendations 3:45-4:00 Wrap

5 UWG Pre-Meeting Homework

6 Homework Increasing NSIDC DAAC Expertise Before the meeting consider how the DAAC might better support our snow community. A listing of DAAC snow data sets can be reviewed from There are gaps in having adequate science data support across our product teams. Consider you own expectations of data support, so you may draw upon these expectations as we discuss ideas the DAAC has for improving science data support A Day-in-the-Life of a User We will discuss your experiences as a data user (preferably an NSIDC DAAC data user). Consider the steps you take and the experiences you have when searching, downloading, and using data for your research. What does it really take to do your job? How are you making decisions about the data you need? What steps do you take to actually apply it to your research? We are interested in learning more about the realities of a data user.

7 Homework Cont... The following is a listing of different NSIDC DAAC related services. Please (re)acquaint yourself with these services, as they will likely come up throughout the different sessions. NSIDC Search - Atlas of the Cryosphere - The Antarctic Cryosphere Atlas Portal - (Development of a Greenland version has been discussed) GLIMS Worldview - (NASA is utilizing for GIBS) EarthData Search - SMAP Cal/Val Client (username:map, password:search, not for external distribution) Operation IceBridge Portal

8 NSIDC s Organization

9 NSIDC s Vision To be the internationally respected leader for the stewardship of cryospheric and related environmental data, and for excellence in scientific research, in the service of humanity and Earth. Our day-to-day mission supports this vision by: Knowing and responding to the wants and needs of our worldwide users and agency sponsors Providing the tools and technology to make data access and usage productive, efficient, and seamless Exploiting the synergies of our diverse portfolio to deliver more value for users and agencies Working on the leading edge of data management and technology

10 NSIDC s Strengths In meeting its Vision, NSIDC draws its strength from: Collaboration between its data management and research activities that helps us to better understand data, its applications and shortcomings, and the needs of the community. Its growing portfolio in informatics research aimed at providing more data and information to more people and in better ways. Its innovative contributions to education and outreach (e.g., ASINA). A work environment that places high value on responsibility, teamwork, and ethics within a collaborative group. NSIDC: An overview

11 The Major Arms of NSIDC Managing and distributing scientific data Engaging in scientific research Supporting data users Creating tools for data access and discovery Educating the public about the cryosphere

12 CIRES Organizational Chart

13 NSIDC Organization Chart

14

15 NSIDC NASA DAAC A summary of the trends and themes that we believe will direct our activities during the contract (June 1, 2013 May 31, 2018)

16 Observed Trends Trend 1: Research and Data The cryosphere is rapidly changing, and scientists data needs are also evolving rapidly. While it is impossible to provide exact statements as to the science support that NSIDC will lead, we identify a number of key areas: Arctic sea ice trends and environmental impacts. Arctic sea ice extent and thickness will continue to decline. The changing mass balance of ice sheets and glaciers. We expect continued high interest in understanding dynamic ice sheet dynamics and acceleration of outlet glacier flows. In general, glaciers are losing mass worldwide; some areas, notably the Himalayas, show very complex behavior change. Permafrost and frozen ground. There is growing concern that as the planet continues to warm, thaw of permafrost will lead to release of stored carbon to the atmosphere, leading to a further global temperature. Snow cover. There will be continued activity in the area of snow cover monitoring via passive microwave and optical sensors.

17 Observed Trends Trend 2: Users and Data User trends can be categorized in two ways: user types and workflow patterns. User Types. We see a growing trend in the expansion of non-expert users. User Workflow. The increasing amount of data available to users, the broader base of people interested in cryospheric data, and technological advances have altered the needs and expectations of users in finding and obtaining data.. The process flow of data selection, data processing, and data consumption will be more tightly integrated. Mobile Device Interfaces:. User expectations for content available on mobile phones, tablets, and full-featured browsers differ; these differences point to opportunities to increase our user base as well as offer content targeted to those audiences. Finding and selecting data: Users will need increasingly sophisticated tools that help them target the most appropriate data for their research. Search needs will likely move beyond traditional temporal, spatial, and parameter searches into discovery based on data value thresholds, anomalies, and quality flags. Processing and using data: Users are increasingly looking for data to be delivered in their preferred format, for their preferred region. When doing scientific trend analysis, users commonly need parameter data captured over time for very specific locations. DAAC we can minimize the burden placed on the user; and increase their available time for conducting scientific research.

18 Observed Trends Trend 3: Information Technology and Data In order to keep pace with requirements driven by research and user expectations, it is imperative that we continually assess our IT trajectory. These trends are categorized into the areas of software, hardware, networking and services. Software. Software development continues to increase in complexity and users continue to request more advanced features, more complex software and better quality. Hardware. Demand-driven computing will be possible through advances in computer virtualization, networking, and data storage that allow us to adapt and deploy resources more effectively. Use of cloud computing and external processing centers such as university-provided supercomputing systems will grow. Networking. Network capacity and speed will continue to grow, although they will continue to be a bottleneck in delivering data to users. Systems and Services. There is increasing focus on commodity services within the realm of information technology. By gaining efficiencies in infrastructure services, time and resources can be focused on user-specific functionality. By standardizing data formats and geographic grids, and incorporating new solid state storage technologies with minimal latency for data access, it becomes possible to create Analysis as a Service (AaaS) which will enable a suite of analysis tools for on-the-fly reprojection, reformatting, time series analysis, inter-sensor comparison, and other user-requested functions. Using the community of data centers, data providers, data users, and open source providers, new functionality can be collaboratively developed or acquired in much shorter time frames.

19 Approach The overall message of the trends indicates growing complexity and a need for agility. Engage the Community. To ensure that we remain focused on priorities, it is critical that we continuously reach out to our user community whether cryospheric researchers or the broader base of non-expert users. Simplify Workflow. We can support users by offering targeted data and tools; by minimizing the effort users must exert to get appropriate data they are freed to focus on their key research activities. Similarly, within our organization we continually strive to improve ongoing operational and developmental processes to include as much automation and consistency as possible. This frees staff to work on new tasks that bring more value to our user community. Use Existing Capabilities. Within NASA s Earth Science community, there now exists a wealth of available functionality that can be leveraged. Leverage Our University Ties. The University of Colorado encompasses world-class research and supporting infrastructure at all levels. The science resources of CIRES and other university organizations augment our science support through formal and informal collaborations.

20 Financial Period of Performance: June 1, 2013 May 31, 2018 Budget targets set for each yearly option Total contract value: $ 41.6 MY

21 NSIDC NASA DAAC Work Management

22 DAAC Work Priorities 1. Data management and user support for Mission data. OIB, Passive Microwave, EOS and Decadal mission are priorities 2. Development efforts which promote value for data users and efficiency of our workflow. 3. Outreach which educates users and the general public about our data and the cryosphere and providers about the value of sound data management. 4. Sustain and evolve IT infrastructure in support of our data and services.

23 Assigned Work Comes From Annual Workplan negotiation Drives specific work priorities in current and next year Introduces strategic 3-5 year plan Situational modifications driven by ESDIS and HQ directives User needs from user feedback Data set status (data/sensor changes) UWG inputs

24 Managing the Work Using a formalized approach to project planning and resource management to meet DAAC commitments Gantt chart and resource plan NSIDC Center-wide coordination Weekly meetings to discuss NSIDC Program and Project Bi-weekly meetings to address NSIDC-wide development priorities, staff skill alignments and resource needs

25 DAAC Work Categories Mission Support External Coordination Engineering & Development User Support Infrastructure Operations Derived from ESDIS DAAC work plan instructions FY2016 FTE Allocations Expected Work Categories

26 DAAC Work Categories Mission Support External Coordination Engineering & Development User Support Infrastructure Operations FY2016 Expected FTE Allocations to Missions All remotely-sensed and in-situ data Liaison with science and user communities Science Support for data users Data management coordination

27 DAAC Work Categories Mission Support External Coordination Engineering & Development User Support Infrastructure Operations Aqua/AMSR-E Aqua & Terra/MODIS Nimbus Operation Icebridge (OIB) Aquarius Passive Microwave (SMMR, SSM/I, SSMIS) ICESat/GLAS ICESat SMAP MEaSUREs A high-level status for these missions/projects will be presented during the meeting.

28 DAAC Work Categories Mission Support External Coordination Engineering & Development User Support Infrastructure Operations Active in multiple ESDSWG subgroups ESIP Federation - leading Data Management Training; past Executive Committee member; active in multiple groups Participation in ISO IEEE Standards Committees Coordinate with NSF polar data management Members in WDS and CODATA

29 DAAC Work Categories Mission Support External Coordination Engineering & Development User Support Infrastructure Operations Guide overall system architecture Develop and maintain production code, applications, and interfaces for science and data management needs Adhere to core NSIDC development values: accountability, flexibility, predictability, and quality

30 DAAC Work Categories Mission Support External Coordination Engineering & Development User Support Infrastructure Operations First point of user contact Educate users on data holdings, updates and utilization Provide feedback loop on user needs Conduct public outreach via Earth Observatory, Sensing our Planet, EarthData

31 DAAC Work Categories Mission Support External Coordination Engineering & Development User Support Infrastructure Operations Provide overall systems administration Support database administration Maintain and upgrade hardware Maintain facilities including green data center Protect the infrastructure through IT security

32 DAAC Work Categories Mission Support External Coordination Engineering & Development User Support Infrastructure Operations Operate all DAAC data systems Produce, ingest, archive, and distribute data Perform metadata and data management Provide production code support

33 How We Manage DAAC Work Director DAAC Manager Deputy DAAC Manager Mission Support External Coordination Engineering & Development User Support Infrastructure Operations

34 How We Manage DAAC Work Director DAAC Manager User Support Infrastructure Operations Managed by Service Groups IT Manager System Admin Operations IT Security Deputy DAAC Manager Science Comm. Manager User Support Outreach Web Mission Support External Coordination Engineering & Development User Support Infrastructure Operations Development Manager Systems Arch. Metadata Coord. Sustaining Eng.

35 How We Manage DAAC Work Director DAAC Manager Mission Support Product Team Lead - Operations - Developers - Scientists Mission Support External Coordination Engineering & Development User Support Infrastructure Operations - Technical Writers - Scientists Acquire or Produce Support - User Services - Scientists Deputy DAAC Manager Describe Managed by Product Teams Distribute - Operations - Developers

36 How We Manage DAAC Work Director Engineering & Development DAAC Manager Product Owner Deputy DAAC Manager Mission Support External Coordination Engineering & Development User Support Infrastructure Operations Define - Product Owner - Stakeholders Evaluate Build - Users - Stakeholders - Developers Release Managed by Agile Teams