Introduction to the Multiuser Geodatabase

Report 7 Downloads 201 Views
Introduction to the Multiuser Geodatabase Emily Apsey ESRI Instructor

Session Path • The Geodatabase • Inside the Geodatabase • Advanced Behavior – Geodatabase Topology – Geometric Networks – Network Datasets

• Raster data in the Geodatabase • Editing the Geodatabase • Optimizing Client-Side Performance

Defining the geodatabase • Collection of geographic datasets – Feature classes, raster data, attribute tables

• Native data structure for ArcGIS

Surveys Addresses

Networks

• Provides the ability to:

Vectors

– Leverage data relationships – Enforce data integrity – Create intelligent features

Annotation

3D Objects

Attribute

Topology Dimensions Terrain

Cadastral

Cartography

CAD Images

Advantages of geodatabase • Central location for features and attributes • Ability to create behavior – Grouping features into subtypes – Creating spatial and attribute validation rules

• Persistent relationships between records • Stored connectivity between lines and points • Many users editing database at one time – Dependant on geodatabase type

• Scaleable

Geodatabase options • Personal for Microsoft Access • File • ArcSDE technology at three levels: – Desktop – Workgroup – Enterprise

ArcGIS Server

ArcGIS Desktop Enterprise Personal Personal (Access) Access

File

File

Desktop

Workgroup

Capacity Number of users

ArcGIS Desktop geodatabases • All are single editor – Desktop (ArcSDE technology) is limited to four connections

Personal (Access)

File

Desktop (ArcSDE technology)

Functionality

Original Desktop format

Improved Desktop format

Designed for replication or project level use

Storage mechanism

Microsoft Access database (.mdb)

File folder;

Microsoft SQL Server Express

Storage limit

2 GB per geodatabase;

1 TB per object;

Effective limit ~500 MB

Configurable up to 256 TB

Platform

Windows

Any

ArcCatalog displays .gdb

4 GB per database server

Windows

ArcGIS Server licensing • Three editions of ArcGIS Server functionality Spatial Analysis & Editing Visualization & Mapping Data Management

Advanced Standard Basic

• Functionality scaled by capacity

Enterprise Workgroup

– Workgroup or enterprise

• ArcSDE technology bundled with all editions

ArcSDE geodatabase editions Supports large capacity geodatabases • Requires regular maintenance • Unlimited connections • Enterprise

Managed by ArcCatalog

• Employed Workgroup

for departmental projects • Does not require a DBA or DBA experience • 10 concurrent user connections • Replication

Desktop

and individual projects • No additional cost with ArcEditor or ArcInfo • Connections: Three viewer and one editor *Support same geodatabase functionality

A

ArcGIS Desktop licensing • Geodatabase functionality based on license –ArcView • Personal Access and File Geodatabase creation and editing • Some behavior creation (subtypes, domains)

–ArcEditor/ArcInfo (includes all from ArcView) • Desktop ArcSDE Geodatabase creation and editing • ArcGIS Server Workgroup and Enterprise editing and managing • Create additional elements (topology, networks, relationship classes) • Additional behavior creation (connectivity rules, relationship rules)

Central Maryland GIS User Group

9

Session Path • The Geodatabase • Inside the Geodatabase • Advanced Behavior – Geodatabase Topology – Geometric Networks – Network Datasets

• Raster data in the Geodatabase • Editing the Geodatabase • Optimizing Client-Side Performance

Geodatabase elements Tables Feature dataset

Raster datasets

Spatial reference

Raster catalogs

Feature classes Polygon Line Point Annotation

Route Dimension Representations

Relationship classes Geometric networks

Behavior Connectivity rules Relationship rules Topology rules

Attribute defaults Attribute domains

Toolboxes Tool

Model

Script

Topology

Additional geodatabase elements Survey datasets

Terrain datasets

Network datasets

Schematics

Network datasets

Central Maryland GIS User Group

11

Feature classes • Table that stores geographic features and attributes – One type of geometry (point, line, polygon, annotation) – Allows for XY coordinates and Z and M measures – Has associated spatial reference ‹Geographic

coordinate system (GCS), projected coordinate system (PCS), and spatial extents – Each record represents a feature

Feature datasets • Contain feature classes – All share same spatial reference – No tables (no geometry)

• Required to model spatial relationships • Can be used for organization – Group feature classes for management – Not ideal

• Permissions given to all feature classes within dataset

Geodatabase behavior • Specific to geodatabase – Subtypes ‹Categorize features into groups – Domains Create Create real-world real-world ‹Attribute validation on a field feature feature behavior behavior – Topology rules in in geodatabase geodatabase ‹Spatial validation rules – Relationship class rules ‹Determine proper associations between records – Connectivity rules ‹Determine proper connections between network features

Geodatabase properties and behavior • Properties stored in a relational database (DBMS) – Feature geometry and attributes stored in tables – Rules and relationships stored in system tables

• Behavior implemented by client (ArcObjects) – ArcGIS software operates according to properties – Geodatabase integrity enforced by client

ArcObjects interprets properties as behavior

Subtypes • Categorize records into groups – Manage groups of records – Within one feature class or table – Integer field required

• Property of feature class or table • Codes based on table values – Requires knowledge of data

• Use for editing and other geodatabase behavior

Advantages of subtypes • Data automation – Default attributes updated as you add new features

• Manage groups of features separately • More efficient editing – Edit directly into subtype

No No subtypes subtypes

Subtypes Subtypes

ArcMap ArcMap table table of of contents contents

Domains • Validation of values in a field • Two types: –Range –Coded values • Geodatabase property –Apply to many fields and subtypes • Allow for data standardization

Types of domains • Range – Locate errors in attribute data – Manual validation – Validate in edit session – Invalid features remain selected

• Coded values – Valid list of values for a field – Editors pick from list – Automatic validation – Reduce typos Domain Domain list list appears appears while while editing editing

Advantages of domains • Prevent and locate attribute errors • Maintain consistent coding schemes • Facilitate data entry • Available to all feature classes or tables in geodatabase

Validation Validation in in attribute attribute table table

Validation Validation in in Attributes Attributes dialog dialog box box

Relationship Classes • An association between two object classes – A class may participate in multiple relationship classes

• Simple relationships • Composite relationships – Related objects can message each other – Can trigger behavior (cascade delete, move to follow, custom, etc.)

• Associate rules with relationship classes – Each Parcel can have between 1 to 3 Buildings ParcelToBuilding

Demo • Subtypes • Relationship class

Session Path • The Geodatabase • Inside the Geodatabase • Advanced Behavior – Geodatabase Topology – Geometric Networks – Network Datasets

• Raster data in the Geodatabase • Editing the Geodatabase • Optimizing Client-Side Performance

Geodatabase Topology • Topology is used to – – – – –

Integrate feature geometry Validate features Control editing tools Define relationships between features Ensure the quality of your data

Topology Error Examples • Rules enforced to maintain topological integrity – 25+ topology rules in ArcGIS

Topological Integrity • Topology defines integrity rules for associated feature classes – Participating feature classes / subtypes – Cluster tolerance, ranks and rules • Cluster Tolerance for XY and Z

• Rules are evaluated during Validation – Define rules when creating the Topology

• Violations of these rules are expressed as error features managed in the database as a part of the topology – Error and Exceptions – Examine and Fix errors in ArcMap

Editing with a Topology • Editing creates a dirty area – Area has been edited and may contain errors – Can be symbolized

• Errors are found during validation – Errors have properties • What rule was violated • Which feature(s) created the error

• Your options: – Ignore the error – Mark as exception – Fix the error

Parcels Parcelsoverlap overlap

Networks in ArcGIS • Two network system data structures available: − Geometric networks Š Directed flow system applications (e.g., natural resources, utilities) Š Lines & points Æ Geometric network Š Use with Utility Network Analyst toolbar in ArcMap

– Network datasets Š Undirected flow system applications (e.g., transportation) Š Lines, points, & turns Æ Network dataset Š Use with ArcGIS Network Analyst extension

• Feature classes can participate in either a geometric network or a network dataset – not both A

Session Path • The Geodatabase • Inside the Geodatabase • Advanced Behavior – Geodatabase Topology – Geometric Networks – Network Datasets

• Raster data in the Geodatabase • Editing the Geodatabase • Optimizing Client-Side Performance

Raster data • Stored in geodatabase in ArcSDE raster format

Real world

– Divide space into a matrix of equally sized cells (or pixels) ‹Each has a numeric value ‹Store a sample of geography As raster

• Each pixel is independent – No discrete features – Pixels arranged in columns/rows

Pixel

Raster data in the geodatabase • Raster dataset – Any valid raster format that organizes data into bands – Includes mosaics

• Raster catalog – A collection of raster datasets stored in a table

• Raster data type attribute – An attribute of a feature with a raster data type

When to use raster catalogs WILSON.GISADMIN.SCANNED_MAPS OID NAME SHAPE RASTER 1 Bailey 1 1 2 Winstead 2 2 3 Lucama 3 3 4 Wilson 4 4 Files Spatial column

Raster ID

• Data properties – Need to preserve overlapping inputs – Need to maintain separate VAT, color map, renderer, etc.

• Query access – By individual raster dataset – By user-defined attribute (date, percent cloud cover, etc.)

1010-32

Mosaicking raster datasets • All images must have the same: – Number of bands – Pixel size

• Spatial reference of first image is retained in output • GP tools – Use Mosaic to add to an existing raster dataset – Create a new, mosaicked raster dataset • Mosaic to New Raster • Workspace to New Raster

1010-33

Raster attributes • Raster column data type • One raster column per table – Multiple rasters can be supported through related tables

• Rasters converted to ArcSDE raster format

Raster dataset schema overview Vector tables

Ortho

OBJECTID NAME 1 IMAGE24

SHAPE 1

RASTER 1 Supporting raster tables

• Business table – Relates to the supporting vector and raster tables

• Raster supporting tables – Store pixel data, band metadata, raster statistics, color maps

• Vector supporting tables – Vector footprint

Session Path • The Geodatabase • Inside the Geodatabase • Advanced Behavior – Geodatabase Topology – Geometric Networks – Network Datasets

• Raster data in the Geodatabase • Editing the Geodatabase • Optimizing Client-side Performance

Editing in a geodatabase • Use tools to maintain data integrity while editing • Personal, file, desktop geodatabases: Single editor • Multiuser geodatabase: Many editors

Editing in a multiuser geodatabase • Non-versioned – No undo/redo functionality – Edits are visible to all geodatabase users once saved ‹No conflict detection mechanism

• Versioned – Undo/redo capability – Edits are isolated in the edit session or version – Many users edit the same feature class at the same time* ‹Same version or different versions ‹Built-in mechanism to detect and resolve conflicts

Overview of non-versioned editing • Uses DBMS transaction model – Save – saves all edits, updates visible to the outside world – Exit without saving – loses all edits made since the last save

• Changes visible to geodatabase users upon refresh – Zoom, pan, map refresh

• Benefits – Non-ESRI applications can read/modify same data – Very simple to implement

Overview of versioned editing USER1 version

Original version

USER2 version

• Method of presenting and tracking changes to tables – Groups of changes accessed as self-consistent versions

• Multiple, alternate versions may coexist – Appears to users that they have their own copy of table

• Includes mechanisms for reconciling versions – Integrates changes into one version – Clients offered tools to resolve conflicts

Definition: Version • Snapshot of the geodatabase – Entire geodatabase is visible through every version

• Persistent record of changes – Disconnect/reconnect to version

• A unit of work – E.g., design alternative, work order, geometry modification

• Basis of multiuser editing of the same data

Overview of geodatabase archiving • Maintain record of edit transactions 31

• Edits are preserved in a history class – Denoted with FROM and TO dates ‹ Transaction

time is recorded ‹ May not be the time of event

16

• Built on versioning architecture 1

Geodatabase replication and versioning • Copies of data distributed among geodatabases – Users at different locations can edit the same data – Founded on versioning

• Changes can be synchronized across geodatabases Federal

USA

MI

Regional

State

CA

Napa

Fresno

Keweenaw

Huron

Session Path • The Geodatabase • Inside the Geodatabase • Advanced Behavior – Geodatabase Topology – Geometric Networks – Network Datasets

• Raster data in the Geodatabase • Editing the Geodatabase • Optimizing Client-Side Performance

Performance bottlenecks • Server hardware – Ensure storage, processor, memory can meet user demand

• Network can easily bottleneck • DBMS must be adequately tuned for geodatabase – Maintenance is essential

• Client interaction and geodatabase design ArcMap TCP/IP

User interaction

SQL

Server processing Results presented

Multiuser Multiuser geodatabase geodatabase SQL

TCP/IP ArcMap

DBMS server

Application optimization overview • Avoid full feature class display – Use the power of spatial indexing

• Employ best practices – ArcCatalog tools ‹Thumbnails – ArcMap tools ‹Scale dependencies ‹Navigation tools and windows ‹Symbology ‹Labels vs. annotation

Maintaining performance • Your actions affect your performance! • Critical DBA or SDE manager job functions – Version management/workflow – Compress – Analyze – Index maintenance – Storage planning – DBMS tuning and configuration – Server resource monitoring

Conclusion • The Geodatabase • Inside the Geodatabase • Advanced Behavior – Geodatabase Topology – Geometric Networks – Network Datasets

• Raster data in the Geodatabase • Editing the Geodatabase • Optimizing Client-Side Performance

Other FedUC Sessions and Activities • Technical Sessions – Managing Distributed Data with Geodatabase Replication – Multiuser Geodatabase Editing Workflows

• Hands-On Learning Lab, West Registration area – Basics of Geodatabase Model – Workflow Management with JTX – Using the GIS Data ReViewer

Thank you for attending! [email protected]

Central Maryland GIS User Group

50