ArcGIS Data Reviewer. Planning and Deploying Data Quality Services. Edwin Waite & Shankar Chandrasekaran. Esri UC 2014 Technical Workshop

Similar documents
Esri Roads and Highways: Integrating and Developing LRS Business Systems

GeoPlanner SM for ArcGIS : An Introduction

Enterprise GIS Architecture Deployment Options

Live, Work, Locate and Site Selector

Esri Maps for MicroStrategy: Tips and tricks Chaka Clarke & Constantinos Papantoniou

User Advocacy Group. Rohit Gupta

Editing & Maintaining Parcels with ArcMap

Welcome to Esri's Software Export Control Classification Number (ECCN) Matrix August 2017

Indoor Location, Tracking, and Routing

Improved Lifecycle Management for BI. David Brockington SAP Business Objects, Product Management June, 2009

The Esri Public Works Platform. More Than Mapping

2015 Honeywell Users Group Europe, Middle East and Africa. Incident Response at your Fingertips Adrian Fielding, Honeywell

Put Yourself on the Map: The Fusion of the PI System & Esri ArcGIS

ArcGIS Server Flex API

DynAMo Alarm & Operations Management

Serving Fremont Employees with a One Stop Shop Enterprise Web App

About Esri NeA. Esri NeA Training Profile 2012

Esri Roads and Highways & ArcGIS Platform

Campus Map Applications

MapObjects. Embeddable Mapping and GIS Components for Application Developers

The Language of Geography. Health and Human Services

Water Resources and Policy Initiatives CSU Campus Water Use Calculations Standard Operating Procedures February 26, 2016

ESB Tools Reference Guide. Version: CR2

Location-aware Mobile Devices & Landscape Reading

Big Data Use Cases. Thomas Paschke Product Specialist Real-Time & Big Data. EDC Forum - Big Data Analytics in Geographic Information Systems

ESB Tools Reference Guide. Version: GA

Esri Partner Network. Program Guide April For Partners Worldwide Developing GIS Solutions and Services on the Esri Software Platform

Aquarius - Spectrum. multi-layer acoustic water pipe monitoring solutions. Game changer in water network management

2019 Esri Partner Conference GIS SOLUTIONS EXPO. Palm Springs Convention Center. 277 N. Avenida Caballeros Palm Springs, CA usa

EMEA USERS CONFERENCE BERLIN, GERMANY. Copyright 2016 OSIsoft, LLC

ArcGIS Online at Philadelphia Water Department

EXPORTING ALARM SETPOINTS IN SIEMENS PCS7

Practices and Challenges in Adopting Esri Roads and Highways in the U.S.

Summary of Action Strategies

2018 County Engineer s Workshop

A Better Way to Support Wildland Fire Suppression

Getting The Most Out of a Plant Map

Skyresponse ThingWorx Extension. Version 1.0. User Guide

Being Prepared and Providing Situational Awareness, through the use of Web GIS

MATLAB & Simulink for Cyber Physical Systems

THE VALUE IS IN THE SOFTWARE

GPS-based Dig-In Prevention System. Gas Technology Institute and PG&E August 8 th 2017

ITS Concept Development Activity Descriptions

The tool developers Tool-Stack. Mike Fechner, Consultingwerk Ltd.

GIS Training of Undergraduates: Campus Stormwater Mapping. Joanne Logan, University of Tennessee. Gordie Bennett, University of Tennessee

Green Infrastructure Resources for Coastal Flood Risk Management

UBC Social Ecological Economic Development Studies (SEEDS) Sustainability Program. Student Research Report

Interconnecting egovernment and INSPIRE

BC Soil Information Finder Tool. Questions

How Woodside Properties is Using GIS to Manage its Facilities

How to Improve Production Efficiency and Safety with Digital Intelligence

Patriot Systems Limited

Oracle Retail Insights. Overview. Features. Release Notes Release This document highlights the Release 15.0 of Oracle Retail Insights.

Certified Solution for Milestone

Digitization For Long-Distance Oil Pipeline Leakage Detection. Liang Wei China University of Petroleum, Beijing

Doctor - Fault Management

Copyright 2017, Oracle and/or its affiliates. All rights reserved.

2014 Bentley Systems, Incorporated. Bentley Map V8i SELECT series 4

13 Extending the Esri Enterprise Licence Agreement

Land Use Regional Planning in Alberta Collaborating with Stakeholders

Using ANM Mobile CHAPTER

The ArcGIS Botanical Garden & Zoological Park Data Model

Action Recommendation: Budget Impact:

Frameworx 16.0 Product Conformance Certification Report CENX V6.1

J2J 1A CANADA

BC Soil Information Finder Tool

PRESENTS AQUADUCT AUTOMATED WATER-LEAK MONITORING SYSTEM A KINGPIN TECHNOLOGY

Carrie Berard, Lead Analyst, Gas R&D Steve Hope, Project Manager, GIS. ESRI GeoConX Conference October 17-20, 2016 Phoenix, AZ.

FG-750 Client API SDN-READY INTELLIGENT OTDR

Creating 3D Interior Maps for Campus Planning

Fairfax County Community Services Board Emergency Response System: Notifier

Have any questions or comments that we didn t get to here? Please let us know! support.airthings.com

Patriot Systems Limited

Oracle Retail Merchandising System Release Notes Release 12.0 May 2006

Why and How to Migrate from Oracle Reports to JasperReports [WEBINAR]

EVERY SECOND COUNTS CONNECTED SAFETY SOLUTIONS

Itron Water Loss Management Solutions. Advanced Digital Leak Detection Overview Session

Session VI Smart safety systems

BMP Designer: Empowering Residents to Control Stormwater, One House at a Time. Presented by: Stephen Bourne, P.E.

IMS Operation Manual. Version 1.1. Phonetics, Inc.

Next Generation Alarm Management With DynAMo Alarm and Operations Management

Highlands Region Stormwater Management Program Guidance

Copyright 2014 Oracle and/or its affiliates. All rights reserved.

Tracking spatiotemporal patterns of building vulnerabilities and evacuations during flood hazards

HMI of the Future with Experion Orion Console and Experion Collaboration Station Andrew Stuart & Annemarie Diepenbroek, Honeywell

Oracle ESB Lesson03: ESB CustomerData SOAP

Milsoft Amelia Island June 12-14, 2018

L o u i s N o r i e g a A u tomated Po r t S o l u t i o n s P hy s i ca l S e c u r i t y Te c h n o l o g y C o n s u l ta nt

Operational Concept Description (OCD)

EMKG Easy-to-use workplace control scheme for hazardous substances

Arkansas River Corridor

2018 Esri GeoConX Prospectus. November 5 8, 2018 Omni Dallas, Texas

Integrating Transportation Planning with Land Use and Conservation Through Decision Support Tools

Position Description

Enhance Alarm Management

Digital Adventures. Carrie Sturts Dossick. Bringing together GIS, COBie and BIM for Facilities Construction and Maintenance.

RADON SCREENING SURVEY FOLLOW-UP WHITTIER WOODS CENTER Whittier Boulevard, Bethesda, Maryland 20817

INTERACTIVE MAP OF SOFIA LANDSCAPE ARCHITECTURE PART OF NATIONAL CULTURAL HERITAGE OF BULGARIA

Leak Detection Program Management (RP 1175) April 24-26, 2018 St. Louis, Missouri

Interactive 3D Wellbore Viewer

Transcription:

ArcGIS Data Reviewer Planning and Deploying Data Quality Services Edwin Waite & Shankar Chandrasekaran Esri UC 2014 Technical Workshop

A few examples of why data validation matters Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Leaning Tower of Pisa Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Mars Climate Orbiter (1999) Esri UC 2014 Technical Workshop

Garbage in Garbage Out (GIGO) Buildings Water Bodies Roads Esri UC 2014 Technical Workshop Type Presentation Title Here

Garbage in Quality Out Buildings Water Bodies Roads Esri UC 2014 Technical Workshop Type Presentation Title Here

What is ArcGIS Data Reviewer for Server? System to support data quality management for ArcGIS Automates quality control process Monitor and Measure data quality Validate Review Summarize Esri UC 2014 Technical Workshop

Enterprise Quality Management System Data Reviewer GIS Data Server Esri UC 2014 Technical Workshop Type Presentation Title Here

Benefits of Data Reviewer for Server Provides accurate data for your applications Measure and report data quality Eliminate costs associated with poor data quality Esri UC 2014 Technical Workshop

Monitoring your data with validation Validate Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Automated Validation Different Type of Issues in GIS Data Attribution Feature Integrity Metadata Spatial Relationships Esri UC 2014 Technical Workshop Type Presentation Title Here

Automated Validation Checks validate data based on conditions you define. Results are written to the Reviewer workspace. Esri UC 2014 Technical Workshop

Automated Validation Over 40 rules out of the box Ability to extend validation with custom rules Rules are authored using ArcGIS Data Reviewer for Desktop Attribute/Table Feature integrity Spatial Relationships Item Metadata Esri UC 2014 Technical Workshop

Automated validation Group checks into batch jobs Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Automated Validation Architecture ArcGIS Server Reviewer Service Scheduler Data Reviewer Web API Execution Details REST API Validation Service Reviewer Workspace Data Workspace Esri UC 2014 Technical Workshop Type Presentation Title Here

Automated Review Demo Organization Contributor Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Questions? Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Analyzing Validation Results Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Summarize data quality Dashboard - Provides transparency to stakeholders on data quality - Ability for stakeholders to make informed and accurate decisions - Interactively summarize results based on different perspectives - Summaries are derived from results Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Summarize data quality Dashboard - Perspectives How many issues do I have by feature class? How severe are the issues with my data? How many types of issues do I have in my data? How many issues have been reviewed and fixed? What are the issues on a geographic extent? Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Dashboard ArcGIS Server Reviewer Service Data Reviewer Web API REST API Dashboard Reviewer Workspace Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Results Results are records that are stored in Reviewer workspace Contains information about a feature or a row which failed QC standard Query Results - Apply filters - Sort/Page Automated Validation Results Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Results Spatial and non-spatial Attributes describe check, problem, and validation information Object ID provides link back to feature that failed validation Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Results ArcGIS Server Reviewer Service Data Reviewer Web API REST API Results Reviewer Workspace Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Analyze Results demo Data Stewards Contributor Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Questions? Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Esri UC 2014 Technical Workshop Visual Quality Control

Visual Review Process Reviewer Service Write Results Reviewer Editor Geodatabase ArcGIS Server Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Benefits of Visual Review Get feedback from Subject Matter Experts (SME) Identify missing or incomplete data Track issues reported Esri UC 2014 Technical Workshop Type Presentation Title Here

Visual Quality Control Demo Esri UC 2014 Technical Workshop

Questions? Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Deploying Data Quality Services Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Deploying Data Reviewer Services Single machine deployment Desktop Web Device Reviewer Workspace Server Data Workspace Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Deploying Data Reviewer Services Single machine Deployment Validate GP Service ArcGIS Server Single Machine Validate Validate GP Service GP Service Inspect and Analyze Map Service Inspect and Analyze Map Service Inspect and Analyze Map Service Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Deploying Data Reviewer Services Multi-machine deployment Desktop Web Device Reviewer Workspace Servers Data Workspace Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Deploying Data Reviewer Services Multi-machine deployment ArcGIS Servers Validate GP Service Inspect and Analyze Map Service Validate GP Service Inspect and Analyze Map Service Validate GP Service Inspect and Analyze Map Service Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Deploying Data Reviewer Services Amazon Elastic Cloud Deployment Desktop Web Device Reviewer Workspace Data Workspace Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Deploying Data Reviewer Services Amazon Elastic Cloud Deployment Validate GP Service AGS - Amazon EC Inspect and Analyze Map Service Validate GP Service AGS - Amazon EC Inspect and Analyze Map Service Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Data Reviewer Server Out of the Box Server components - Execute Batch Job GP Service - Reviewer Service - REST API Execute BatchJob GP Service Reviewer Service Web components - Client API Reference (JavaScript & Flex) - Starter Applications (Batch Validation Manager) - Widgets (Flex & JavaScript) Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Data Reviewer Platform ArcGIS Data Reviewer for Desktop - Define and author Quality Control Standards - Configure Reviewer Workspace to store results ArcGIS Data Reviewer for Server - Schedule and run automated validations - Analyze result stored in Reviewer workspace - Submit SME feedback for Reviewer workspace for visual review Client API s - Develop applications to access data quality services Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Widgets and Starter Apps - Demo Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

ArcGIS Data Reviewer Server System Architecture Batch Validation Validation Service Data Workspace Dashboard HTTP/REST Results Reviewer Workspace Visual Review Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Resources Product page - www.esri.com/datareviewer Resource Center - http://resources.arcgis.com/en/communities/data-reviewer/ Training - www.esri.com/training Questions & comments - datareviewer@esri.com Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Resource Center Data Reviewer Gallery - Apps - Templates - Tutorials API Documentation Live Samples Esri UC 2014 Technical Workshop

Day and Description Type Time Location Tuesday July 15 ArcGIS Data Reviewer: An Introduction Technical Workshop ArcGIS Data Reviewer: Extending the Validation Framework Demo Theater 9:30 10:00am ArcGIS Data Reviewer: Leveraging Geoprocessing for Data Validation Demo Theater 8:30 9:45am Room 14A 10:30 11:00am ArcGIS Data Reviewer: Assessing Positional Accuracy Demo Theater 1:00 1:30pm ArcGIS Data Reviewer: Plans for Quality Assessment of Raster Datasets Wednesday July 16 ArcGIS Data Reviewer: An Introduction ArcGIS Data Reviewer: Integrating ArcGIS Data Reviewer and ArcGIS Workflow Manager to Automate Data Quality Control Workflows Demo Theater Technical Workshop Demo Theater 5:30 6:00pm Geodata Mgmt Theater Geodata Mgmt Theater Geodata Mgmt Theater Geodata Mgmt Theater 8:30 9:45am Room 14A 11:30 12:00am Geodata Mgmt Theater ArcGIS Data Reviewer: Special Interest Group Meeting SIG 12:00 1:00pm Room 15B ArcGIS Data Reviewer: Planning and Deploying Data Quality Services Thursday July 17 ArcGIS Data Reviewer: Integrating Data Validation Capabilities Into Web Applications ArcGIS Data Reviewer: Implementing Data Quality Reporting in Web Clients Technical Workshop Demo Theater Demo Theater 3:15 4:30pm Room 15B 9:30 10:00am 10:30 11:00am Web & Server Theater Web & Server Theater

Questions? Planning and Deploying Data Quality Services

Thank you Please fill out the session survey: Offering ID: 1313 Online www.esri.com/ucsessionsurveys Paper pick up and put in drop box Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services

Esri UC 2014 Technical Workshop Planning and Deploying Data Quality Services