ArcGIS Data Reviewer Planning and Deploying Data Quality Services

Transcription

1

2 ArcGIS Data Reviewer Planning and Deploying Data Quality Services Edwin Waite & Shankar Chandrasekaran

3 A few examples of why data validation matters

4 Leaning Tower of Pisa

5 Mars Climate Orbiter

6 Garbage in Garbage Out Buildings Water Bodies Roads

7 Garbage in Quality Out Buildings Water Bodies Roads

8 What is ArcGIS Data Reviewer for Server? System to support data quality management for ArcGIS Automates quality control process Monitor and Measure data quality Validate Review Summarize

9 Enterprise Quality Management System Data Reviewer GIS Data Server

10 Monitoring your data with validation

11 Automated Validation Different Type of Issues in GIS Data Attribution Feature Integrity Metadata Spatial Relationships

12 Automated Validation Checks validate data based on conditions you define. Over 40 rules out of the box Ability to extend validation with custom rules Results are written to the Reviewer workspace.

13 Automated validation Group checks into batch jobs

14 Automated Validation Architecture ArcGIS Server Reviewer Service Scheduler Javascript Flex Execution Details REST API Validation Service Reviewer Workspace Data Workspace

15 Automated Review Demo Organization Contributor

16 Questions?

17 Analyzing Validation Results

18 Summarize data quality Dashboard - Provides transparency to stakeholders on data quality - Ability for stakeholders to make informed and accurate decisions - Interactively summarize results based on different perspectives - Summaries are derived from results

19 Summarize data quality Dashboard - Perspectives What are the issues on a geographic extent? How severe are the issues with my data? How many types of issues do I have in my data? How many issues do I have by feature class? How many issues have been reviewed and fixed?

20 Dashboard ArcGIS Server Reviewer Service Data Reviewer Web API REST API Dashboard Reviewer Workspace

21 Results Results are records that are stored in Reviewer workspace Contains information about a feature or a row which failed QC standard Query Results - Apply filters - Sort/Page Automated Validation Results

22 Results Spatial and non-spatial Attributes describe check, problem, and validation information Object ID provides link back to feature that failed validation

23 Results ArcGIS Server Reviewer Service Data Reviewer Web API REST API Results Reviewer Workspace

24 Analyze Results Demo Data Stewards Contributor

25 Questions?

26 Visual Quality Control

27 Visual Review Process Reviewer Service Write Results Reviewer Editor Geodatabase ArcGIS Server

28 Benefits of Visual Quality Control Get feedback from Subject Matter Experts (SME) Find issues not detectable by automated validation Track issues reported

29 Visual Quality Control Demo

30 Questions?

31 Deploying Data Quality Services

32 Deploying Data Reviewer Services Single machine deployment Desktop Web Device Reviewer Workspace Server Data Workspace

33 Deploying Data Reviewer Services Single machine Deployment Validate GP Service ArcGIS Server Single Machine Validate Validate GP Service GP Service Inspect and Analyze Map Service Inspect and Analyze Map Service Inspect and Analyze Map Service

34 Deploying Data Reviewer Services Multi-machine deployment Desktop Web Device Reviewer Workspace Servers Data Workspace

35 Deploying Data Reviewer Services Multi-machine deployment ArcGIS Servers Validate GP Service Inspect and Analyze Map Service Validate GP Service Inspect and Analyze Map Service Validate GP Service Inspect and Analyze Map Service

36 Deploying Data Reviewer Services Amazon Elastic Cloud Deployment Desktop Web Device Reviewer Workspace Data Workspace

37 Deploying Data Reviewer Services Amazon Elastic Cloud Deployment Validate GP Service AGS - Amazon EC Inspect and Analyze Map Service Validate GP Service AGS - Amazon EC Inspect and Analyze Map Service

38 ArcGIS Data Reviewer Server System Architecture Batch Validation Validation Service Data Workspace Dashboard HTTP/REST Results Reviewer Workspace Visual Review

39 Data Reviewer Platform ArcGIS Data Reviewer for Desktop - Define and author Quality Control Standards - Configure Reviewer Workspace to store results ArcGIS Data Reviewer for Server - Schedule and run automated validations - Analyze result stored in Reviewer workspace - Submit SME feedback for Reviewer workspace for visual review Client API s - Develop applications to access data quality services

40 Data Reviewer Server Out of the Box Server components - Execute Batch Job GP Service - Reviewer Service - REST API Execute BatchJob GP Service Reviewer Service Web components - Client API Reference (JavaScript & Flex) - Starter Applications (Batch Validation Manager) - Widgets (Flex & JavaScript)

41 Resource Center Data Reviewer Gallery - Apps - Templates - Tutorials API Documentation Live Samples

42 Rate This Session

43 Questions?

44