Integration of Surveying and GIS
ESRI Survey Summit August 2006 Clint Brown Director of ESRI Software Products
Cadastral Fabric
How does Cadastral fit with Survey? • Surveyors process raw field observations • Survey measurements define high-order coordinate control • Cadastral least2 adjustment works with parcels, rather than surveying measurements • Survey Control points can be imported into Fabrics Æ used in cadastral least2 adjustment
Cadastral Editor • Data model for a Cadastral Information System • Specialized editor and workflow for parcel editing – The parcel is the "unit of work“ – Maintains and works with record data from subdivision plans
• Uses least squares to get high-accuracy parcel coordinates, using: – Control points (from GPS and field surveys) – Parcel Line record values
• Integrated with GIS – Geodatabase extension and editor environment
What is a cadastral fabric dataset? • Lines – Store and preserve original, recorded boundary dimensions
• Points – Store coordinates derived from a Least Squares Adjustment
• Polygons – Comprised of parcel lines
• Line points – Parcel corner points that lie on parcel boundary lines
• Control points – Accurate, published coordinates for a physical location
• Plans (table) – Store information about the original survey document
• Fabric jobs (table) – Track edits to the cadastral fabric
Cadastral Editor
• Fabrics are used as base layers for editing (snapping, etc) • Updates GIS feature layers that coincide with the fabric. – Improvements to the fabric (via LSA) can be applied to related feature layers.
Outline of talk
• GIS Trends • Spatial Data Concepts and the Geodatabase • The Role of Surveying in GIS – How GIS and Surveying will evolve together
• GIS Utopia
GIS Integrates All Types of Data Geography is a “Key” Social Factors Roads/Infrastructure Water
Key Concepts • Georeferencing
Land Use/Land Cover Imagery
• Digital Processing
Environment
• Map Overlay
Base Maps
• Spatial Analysis
Survey
• Visualization
...
Control
Integrating Disciplines, Organizations, and Activities
GIS is an Information Technology Three parts Geoprocessing and Analytical Tools
Applications (“Views”) Geospatial Data
Based on geography – the science of our world
A city of 1,000,000 spends $50 to $100M per year Community investment in maintaining, applying, and managing Geographic Information A key asset
GIS industry growth • Over 400,000 organizations
• Top 3 Tech Employment – Biotech, Nanotech, and Geotech
• “… 1 of the top 10 occupational groups projected to have the fastest growth in employment between 2002 and 2012 …” -- U.S. Bureau of Labor Statistics
• Student demand for GIS coursework in colleges is not being met
GIS is becoming a Kind of Sensor Network Pervasive Mobile and Wireless Technology
• • • • • • • • • • • •
Traffic Weather Monitors Satellites Aircraft Mobile Census Demographic Business Infrastructure Surveying Design
• • • • • • •
Streams Seismic Tsunami Crime Disease Surveillance RFID Etc.
“A Digital Nervous System”
GIS Server Integrated with Services --
Jack Dangermond
Mobile GIS • Full Maps – Tablet PC
• Professional GPS – Windows CE / Pocket PC
• Smart Phones • Smart Clients • Survey Total Stations
Scalable Hardware is becoming Networked . . . . . . And Information is being Synchronized Blade Server
Server Cluster
Server
• Orchestrated computing Web Services
Desktop
• Network of servers • Connected on the web
Laptop
. . . and Services Oriented
Tablet PC PDA
Cell Phone
GIS Server
General users Explorer
Desktop
Mobile
Use Web
Custom (Engine)
Serve
Desktop Author Geographic Knowledge
Data, Maps, Images, Globes, Models, Automations, Interpretations, Metadata
Professionals
Services Oriented Architecture—Enabling the GeoWeb 3-D Viewers
Presentation (Multiple viewers)
COP 2-D Viewers
Enterprise Service Bus
Catalog Services
Globe Services
GeoImageGeoImageMap & Processing Processing Chart Services Services Services
Open Web Services
Tracking & RSS Services
Serving/ Publishing
Authoring
“GIS Data Centers” . . . National States States
States
Locals Locals Locals Locals
… Collaborative data building
. . . Providing Integration, Collaboration, and Data Compilation
GIS Trends – Locational accuracy is increasing Moving to more accurate GIS content • Resolution and accuracy is increasing • New sensors are getting better • High resolution imagery, LIDAR, Geoprocessing, Surveying • GPS accuracy is increasing and becoming ubiquitous • Richer, more-detailed content • Increasing collection frequency
ArcGIS 9.2 provides a high-precision framework for data integration and management • High precision geodatabase • Cadastral workflows • Raster georeferencing • Geoprocessing support • Terrain datasets
Ability to manage large-volume, transactional databases
ArcGIS 9.2 Enhancements for High Precision • High coordinate precision in geodatabases • Accurate map projections and coordinate management for raster and CAD – Local coordinates to global reference system
• New Cadastral Editor in Survey Analyst – A new workflow system and methodology
• Ability to manage massive sets of measurements – LIDAR and 3D Surveys to create high-resolution Terrain Datasets – Image server – File geodatabase
• Geoprocessing on Servers – To automate and capture business rules for geographic data – Using rich geodatabase datasets and logic – Repeatable workflows – Centrally managed
GISÅÆ Surveying Trends • GIS needs are evolving to include survey-aware information – Demand for spatial accuracy is increasing – More detailed data is being collected
• GIS data is being collected at a faster rate (increasing frequency) • Surveying is moving to GPS – Increased feature measurement
• Surveying will move to a GIS framework – Survey information will be integrated into comprehensive databases – For communities, states, and nations
Surveying will require a comprehensive GIS
Spatial data concepts
The role of survey information
Layers GIS information is a bunch of data themes Geo-referencing means that can be integrated
The Geodatabase An ordered collection of GIS datasets used with ArcGIS
Held as an Access file, a File folder, or within a Relational Database.
The native data structure of ArcGIS
Geodatabase Storage Open support for full information model
1. Personal Geodatabase
Stored in Access. 2 GB Limit, but effective size is 250 to 500 MB. Windows only. Single editor and a few readers. No versioning.
2. File Geodatabase
Stored in file folder. Up to 1 TB per dataset. Any platform. Single editor and a few readers. No versioning.
New at 9.2 3. ArcSDE Geodatabase
Stored in RDBMS (Oracle, SQL Server, DB2, Informix). Uses ArcSDE. Versioning and Multi-user Support. Highly Scalable.
New at 9.2: Personal and Workgroup ArcSDE 4. Geodatabase XML
Open representation of full geodatabase schema and data as XML. Used for open data interchange with external systems.
Common GIS Dataset Types
Feature Classes
Rasters
Tables
Simple geometry storage plus rich operators
GIS provides a framework for managing all geographic information All Spatial Data Types
Topology
Cadastral Datasets
Features
107’ 107’
Surveys Networks Domains, Subtypes Relationships
Rasters
Geodatabase ABC
Annotation 27 Main St.
3D Objects Address Locators
Terrain
Attribute Tables
Topology Manage spatial relationships and coincident geometries
Networks For managing navigation and connectivity
Terrains To model surfaces using triangulated networks and manage LIDAR
Points
Breaklines
Multi-resolution terrain dataset (TIN structure)
The Geodatabase provides a framework for managing geospatial information
A high precision geodata management framework for all spatial data types
Vision: Survey and GPS will provide the framework for high precision information management
Most GIS layers register to Parcels, Transportation, and the Orthophoto Base
Cadastre, Roads, Orthophoto Additional data layers register onto these themes Roads
Parcels Water Landcover Terrain Photogrammetry
Orthophoto
GIS provides the tools and workflows for integrating other GIS layers
Cadastre, Roads, Orthophoto Three primary GIS base layers Parcels
Subdiv 1
Orthophoto
Subdiv 2
Transportation
Prj 1
Prj 2
Survey A
Survey B
Etc. Etc. Survey 1
Survey 2
A framework onto which other GIS layers are integrated
Survey is the primary element in the high precision framework for geographic data
Survey information and control will become an integral part of the geodatabase
Individual surveys will be integrated into a common geodatabase
New workflows for managing integrated survey information
GIS Trends – Enterprise spatial data management Open integration of external information into intelligent geodatabase
Editing External data sources Geoprocessing
External Sources
Data Interoperability
Processing Chain
Geodatabase
Open Spatial Data Management Server
ETL Integration and Aggregation
Geoprocessing
Data management
Geodatabase business rules and logic
Data aggregation -- Automated scripts to apply geodatabase business rules and logic
GIS Trends – Enterprise spatial data management ArcGIS server provides information management and publishing
Editing External data sources Geoprocessing
External Sources
Data Interoperability
ETL Integration and Aggregation
Processing Chain
Geodatabase
Data management
Distributed replicas Enterprise
ArcSDE
Regions
Synchronization
Departments
ArcGIS Server Maps
Publishing
Globes
Models
Data
GIS Utopia
What’s possible five years from now?
GIS Utopia
• “It’s all GIS” – Imagery – Surveying – Weather – Design & construction – GPS – RFID – Google Earth, Microsoft, Open Source, Commercial
GIS Utopia
• A network of GIS’s becomes the Digital Nervous System for the Planet
– Integrates the sensor networks (weather, disease, surveillance, traffic, utilities, GPS, RFID, survey, gauges, observations)
– Data flows to where it’s needed and is automatically transformed into the required formats
– Survey control provides the farmework
GIS Utopia
• National Geodetic Survey and the National Cadastre are openly available as web services – Getting there (NGS and BLM NILS)
• State and Local Systems are part of this network – Integrates local and contract surveyors – Local survey projects are integrated in a series of common geo-databases
GIS Utopia
• GIS software will be bug free and just work
GIS Utopia
• Construction Life Cycle / Infrastructure will be based on GIS – Planning – Surveying – Design – Permitting – Construction – Inspection – Management and maintenance
GIS Utopia
• The Public will be able to access high quality public data with high levels of accuracy, detail, and precision – High quality – Up-to-the minute – High accuracy – Very large scale (>1:500) – Multiple Levels of Detail
Government stewardship will be required
Thank you
Cadastral Fabric
How does Cadastral fit with Survey? • Surveyors process raw field observations • Survey measurements define high-order coordinate control • Cadastral least2 adjustment works with parcels, rather than surveying measurements • Survey Control points can be imported into Fabrics Æ used in cadastral least2 adjustment
Cadastral Editor • Data model for a Cadastral Information System • Specialized editor and workflow for parcel editing – The parcel is the "unit of work“ – Maintains and works with record data from subdivision plans
• Uses least squares to get high-accuracy parcel coordinates, using: – Control points (from GPS and field surveys) – Parcel Line record values
• Integrated with GIS – Geodatabase extension and editor environment
What is a cadastral fabric dataset? • Lines – Store and preserve original, recorded boundary dimensions
• Points – Store coordinates derived from a Least Squares Adjustment
• Polygons – Comprised of parcel lines
• Line points – Parcel corner points that lie on parcel boundary lines
• Control points – Accurate, published coordinates for a physical location
• Plans (table) – Store information about the original survey document
• Fabric jobs (table) – Track edits to the cadastral fabric
Cadastral Editor
• Fabrics are used as base layers for editing (snapping, etc) • Updates GIS feature layers that coincide with the fabric. – Improvements to the fabric (via LSA) can be applied to related feature layers.
Outline of talk
• GIS Trends • Spatial Data Concepts and the Geodatabase • The Role of Surveying in GIS – How GIS and Surveying will evolve together
• GIS Utopia
GIS Integrates All Types of Data Geography is a “Key” Social Factors Roads/Infrastructure Water
Key Concepts • Georeferencing
Land Use/Land Cover Imagery
• Digital Processing
Environment
• Map Overlay
Base Maps
• Spatial Analysis
Survey
• Visualization
...
Control
Integrating Disciplines, Organizations, and Activities
GIS is an Information Technology Three parts Geoprocessing and Analytical Tools
Applications (“Views”) Geospatial Data
Based on geography – the science of our world
A city of 1,000,000 spends $50 to $100M per year Community investment in maintaining, applying, and managing Geographic Information A key asset
GIS industry growth • Over 400,000 organizations
• Top 3 Tech Employment – Biotech, Nanotech, and Geotech
• “… 1 of the top 10 occupational groups projected to have the fastest growth in employment between 2002 and 2012 …” -- U.S. Bureau of Labor Statistics
• Student demand for GIS coursework in colleges is not being met
GIS is becoming a Kind of Sensor Network Pervasive Mobile and Wireless Technology
• • • • • • • • • • • •
Traffic Weather Monitors Satellites Aircraft Mobile Census Demographic Business Infrastructure Surveying Design
• • • • • • •
Streams Seismic Tsunami Crime Disease Surveillance RFID Etc.
“A Digital Nervous System”
GIS Server Integrated with Services --
Jack Dangermond
Mobile GIS • Full Maps – Tablet PC
• Professional GPS – Windows CE / Pocket PC
• Smart Phones • Smart Clients • Survey Total Stations
Scalable Hardware is becoming Networked . . . . . . And Information is being Synchronized Blade Server
Server Cluster
Server
• Orchestrated computing Web Services
Desktop
• Network of servers • Connected on the web
Laptop
. . . and Services Oriented
Tablet PC PDA
Cell Phone
GIS Server
General users Explorer
Desktop
Mobile
Use Web
Custom (Engine)
Serve
Desktop Author Geographic Knowledge
Data, Maps, Images, Globes, Models, Automations, Interpretations, Metadata
Professionals
Services Oriented Architecture—Enabling the GeoWeb 3-D Viewers
Presentation (Multiple viewers)
COP 2-D Viewers
Enterprise Service Bus
Catalog Services
Globe Services
GeoImageGeoImageMap & Processing Processing Chart Services Services Services
Open Web Services
Tracking & RSS Services
Serving/ Publishing
Authoring
“GIS Data Centers” . . . National States States
States
Locals Locals Locals Locals
… Collaborative data building
. . . Providing Integration, Collaboration, and Data Compilation
GIS Trends – Locational accuracy is increasing Moving to more accurate GIS content • Resolution and accuracy is increasing • New sensors are getting better • High resolution imagery, LIDAR, Geoprocessing, Surveying • GPS accuracy is increasing and becoming ubiquitous • Richer, more-detailed content • Increasing collection frequency
ArcGIS 9.2 provides a high-precision framework for data integration and management • High precision geodatabase • Cadastral workflows • Raster georeferencing • Geoprocessing support • Terrain datasets
Ability to manage large-volume, transactional databases
ArcGIS 9.2 Enhancements for High Precision • High coordinate precision in geodatabases • Accurate map projections and coordinate management for raster and CAD – Local coordinates to global reference system
• New Cadastral Editor in Survey Analyst – A new workflow system and methodology
• Ability to manage massive sets of measurements – LIDAR and 3D Surveys to create high-resolution Terrain Datasets – Image server – File geodatabase
• Geoprocessing on Servers – To automate and capture business rules for geographic data – Using rich geodatabase datasets and logic – Repeatable workflows – Centrally managed
GISÅÆ Surveying Trends • GIS needs are evolving to include survey-aware information – Demand for spatial accuracy is increasing – More detailed data is being collected
• GIS data is being collected at a faster rate (increasing frequency) • Surveying is moving to GPS – Increased feature measurement
• Surveying will move to a GIS framework – Survey information will be integrated into comprehensive databases – For communities, states, and nations
Surveying will require a comprehensive GIS
Spatial data concepts
The role of survey information
Layers GIS information is a bunch of data themes Geo-referencing means that can be integrated
The Geodatabase An ordered collection of GIS datasets used with ArcGIS
Held as an Access file, a File folder, or within a Relational Database.
The native data structure of ArcGIS
Geodatabase Storage Open support for full information model
1. Personal Geodatabase
Stored in Access. 2 GB Limit, but effective size is 250 to 500 MB. Windows only. Single editor and a few readers. No versioning.
2. File Geodatabase
Stored in file folder. Up to 1 TB per dataset. Any platform. Single editor and a few readers. No versioning.
New at 9.2 3. ArcSDE Geodatabase
Stored in RDBMS (Oracle, SQL Server, DB2, Informix). Uses ArcSDE. Versioning and Multi-user Support. Highly Scalable.
New at 9.2: Personal and Workgroup ArcSDE 4. Geodatabase XML
Open representation of full geodatabase schema and data as XML. Used for open data interchange with external systems.
Common GIS Dataset Types
Feature Classes
Rasters
Tables
Simple geometry storage plus rich operators
GIS provides a framework for managing all geographic information All Spatial Data Types
Topology
Cadastral Datasets
Features
107’ 107’
Surveys Networks Domains, Subtypes Relationships
Rasters
Geodatabase ABC
Annotation 27 Main St.
3D Objects Address Locators
Terrain
Attribute Tables
Topology Manage spatial relationships and coincident geometries
Networks For managing navigation and connectivity
Terrains To model surfaces using triangulated networks and manage LIDAR
Points
Breaklines
Multi-resolution terrain dataset (TIN structure)
The Geodatabase provides a framework for managing geospatial information
A high precision geodata management framework for all spatial data types
Vision: Survey and GPS will provide the framework for high precision information management
Most GIS layers register to Parcels, Transportation, and the Orthophoto Base
Cadastre, Roads, Orthophoto Additional data layers register onto these themes Roads
Parcels Water Landcover Terrain Photogrammetry
Orthophoto
GIS provides the tools and workflows for integrating other GIS layers
Cadastre, Roads, Orthophoto Three primary GIS base layers Parcels
Subdiv 1
Orthophoto
Subdiv 2
Transportation
Prj 1
Prj 2
Survey A
Survey B
Etc. Etc. Survey 1
Survey 2
A framework onto which other GIS layers are integrated
Survey is the primary element in the high precision framework for geographic data
Survey information and control will become an integral part of the geodatabase
Individual surveys will be integrated into a common geodatabase
New workflows for managing integrated survey information
GIS Trends – Enterprise spatial data management Open integration of external information into intelligent geodatabase
Editing External data sources Geoprocessing
External Sources
Data Interoperability
Processing Chain
Geodatabase
Open Spatial Data Management Server
ETL Integration and Aggregation
Geoprocessing
Data management
Geodatabase business rules and logic
Data aggregation -- Automated scripts to apply geodatabase business rules and logic
GIS Trends – Enterprise spatial data management ArcGIS server provides information management and publishing
Editing External data sources Geoprocessing
External Sources
Data Interoperability
ETL Integration and Aggregation
Processing Chain
Geodatabase
Data management
Distributed replicas Enterprise
ArcSDE
Regions
Synchronization
Departments
ArcGIS Server Maps
Publishing
Globes
Models
Data
GIS Utopia
What’s possible five years from now?
GIS Utopia
• “It’s all GIS” – Imagery – Surveying – Weather – Design & construction – GPS – RFID – Google Earth, Microsoft, Open Source, Commercial
GIS Utopia
• A network of GIS’s becomes the Digital Nervous System for the Planet
– Integrates the sensor networks (weather, disease, surveillance, traffic, utilities, GPS, RFID, survey, gauges, observations)
– Data flows to where it’s needed and is automatically transformed into the required formats
– Survey control provides the farmework
GIS Utopia
• National Geodetic Survey and the National Cadastre are openly available as web services – Getting there (NGS and BLM NILS)
• State and Local Systems are part of this network – Integrates local and contract surveyors – Local survey projects are integrated in a series of common geo-databases
GIS Utopia
• GIS software will be bug free and just work
GIS Utopia
• Construction Life Cycle / Infrastructure will be based on GIS – Planning – Surveying – Design – Permitting – Construction – Inspection – Management and maintenance
GIS Utopia
• The Public will be able to access high quality public data with high levels of accuracy, detail, and precision – High quality – Up-to-the minute – High accuracy – Very large scale (>1:500) – Multiple Levels of Detail
Government stewardship will be required
Thank you
