Utilizing FME for Utility Mapping at PNM
Utilizing FME for Utility Mapping at PNM Rene Carrillo Aaron Allen
Common Data Issues Conversion Format - AutoCad DWG, MicroStation DGN, Shapefiles, etc Geometry - Lines to Polygons, duplicate point data, etc Projection - Missing or conversion from one to another
Maintaining data quality Attributes - Missing attributes, updates, renaming attributes Spatial - Enhance spatial accuracy
Manipulation Project specific data - Custom output Attributes - Generate new attributes
What is FME?
•
Stands for “Feature Manipulation Engine” – Similar to ESRI’s ModelBuilder
•
It can read/write many vector, database, and tabular formats as well as some raster formats
•
Performs coordinate conversion using a variety of different projections, ellipsoids, and datums
•
Contains a large set of tools (transformers) that allow the user to manipulate data such as – cleaning geometry, updating/adding attributes, and calculating values
•
Can read from multiple files of different types, combine the data, and break it out to several files of different types
•
Can read a feature’s characteristic attributes. This includes its source name, source path location, x,y, line weight, font name, cell name, etc.
FME Options with ESRI •
ArcGIS Data Interoperability extension – Developed in conjunction with Safe Software and built on the FME product. Includes 150 transformers, 70+ supported data formats. Users can directly read, display, and analyze this data using all the tools available within the ArcGIS Desktop environment.
•
FME ESRI Edition – Includes everything in the Data Interoperability extension plus batching capability, 120+ supported data formats, and 220+ transformers. Also includes the FME Viewer, the FME Universal Translator and allows clients to translate data without taking up an ArcGIS license.
FME Workbench
FME Universal Viewer
FME Universal Translator
FRAMME to ESRI synchronization
Intergraph to ESRI sync • Purpose Custom PNM Gas Compliance application developed to work with SDE data Data source (Gas Distribution data) resides in Intergraph’s FRAMME GIS Need to have current data available daily for personnel using application
FRAMME to ESRI FME Script
New Mexico One Call
Previous process NM One Call requests data in shapefile format separated out by PNM service areas. Process to extract data Manually extract data - extract data out of FRAMME and ESRI databases Manually convert data - convert DGN data to shape files and re-project data Manually clip data based on One Call service area (25 areas) Manually assign any necessary attributes to data Manually buffer data based on line type (500ft for Distribution, 1000ft for Transmission)
Because of the amount of time it took to do the above work, we could only provide quarterly updates to NM One Call.
Attribute Transfer Mapping
Purpose •
In 2004 PNM acquired improved spatial data of gas transmission system, but without attributes (i.e. – “dumb lines”)
•
Existing gas transmission data contains a rich set of attributes
•
Needed to get existing attributes onto new spatial data
Back-populate SDE
Purpose •
CAD station detail drawings had updated attributes added to title block – GIS and CAD data are no longer in sync.
•
GIS station data needs to have the updated CAD attributes added to the attributes.
•
Don’t easily know which CAD files have updated attributes, so previously all station data would need to be checked manually and, if needed, updated in the GIS.
FRM8VB-VB16.DWG
FARMINGTON BACK-
FEED REGULATOR
STATION
FARMINGTON – FEED REGULATOR STATION
Summary •
What is does Reading and Writing Data – design files, shapefiles, coverages, GeoMedia warehouses, ESRI geodatabases, tabular data, even some image formats – Manipulation and Analysis of Data – combining, reprojecting, clipping, buffering, testing, filtering, etc. –
•
Components Universal Viewer – Quickly view data without the need of the native application. – Universal Translator – For quick translation and reprojection without the need of transformers. – Workbench – GUI environment for creating your own scripts (a.k.a. workspaces) –
Questions?
Common Data Issues Conversion Format - AutoCad DWG, MicroStation DGN, Shapefiles, etc Geometry - Lines to Polygons, duplicate point data, etc Projection - Missing or conversion from one to another
Maintaining data quality Attributes - Missing attributes, updates, renaming attributes Spatial - Enhance spatial accuracy
Manipulation Project specific data - Custom output Attributes - Generate new attributes
What is FME?
•
Stands for “Feature Manipulation Engine” – Similar to ESRI’s ModelBuilder
•
It can read/write many vector, database, and tabular formats as well as some raster formats
•
Performs coordinate conversion using a variety of different projections, ellipsoids, and datums
•
Contains a large set of tools (transformers) that allow the user to manipulate data such as – cleaning geometry, updating/adding attributes, and calculating values
•
Can read from multiple files of different types, combine the data, and break it out to several files of different types
•
Can read a feature’s characteristic attributes. This includes its source name, source path location, x,y, line weight, font name, cell name, etc.
FME Options with ESRI •
ArcGIS Data Interoperability extension – Developed in conjunction with Safe Software and built on the FME product. Includes 150 transformers, 70+ supported data formats. Users can directly read, display, and analyze this data using all the tools available within the ArcGIS Desktop environment.
•
FME ESRI Edition – Includes everything in the Data Interoperability extension plus batching capability, 120+ supported data formats, and 220+ transformers. Also includes the FME Viewer, the FME Universal Translator and allows clients to translate data without taking up an ArcGIS license.
FME Workbench
FME Universal Viewer
FME Universal Translator
FRAMME to ESRI synchronization
Intergraph to ESRI sync • Purpose Custom PNM Gas Compliance application developed to work with SDE data Data source (Gas Distribution data) resides in Intergraph’s FRAMME GIS Need to have current data available daily for personnel using application
FRAMME to ESRI FME Script
New Mexico One Call
Previous process NM One Call requests data in shapefile format separated out by PNM service areas. Process to extract data Manually extract data - extract data out of FRAMME and ESRI databases Manually convert data - convert DGN data to shape files and re-project data Manually clip data based on One Call service area (25 areas) Manually assign any necessary attributes to data Manually buffer data based on line type (500ft for Distribution, 1000ft for Transmission)
Because of the amount of time it took to do the above work, we could only provide quarterly updates to NM One Call.
Attribute Transfer Mapping
Purpose •
In 2004 PNM acquired improved spatial data of gas transmission system, but without attributes (i.e. – “dumb lines”)
•
Existing gas transmission data contains a rich set of attributes
•
Needed to get existing attributes onto new spatial data
Back-populate SDE
Purpose •
CAD station detail drawings had updated attributes added to title block – GIS and CAD data are no longer in sync.
•
GIS station data needs to have the updated CAD attributes added to the attributes.
•
Don’t easily know which CAD files have updated attributes, so previously all station data would need to be checked manually and, if needed, updated in the GIS.
FRM8VB-VB16.DWG
FARMINGTON BACK-
FEED REGULATOR
STATION
FARMINGTON – FEED REGULATOR STATION
Summary •
What is does Reading and Writing Data – design files, shapefiles, coverages, GeoMedia warehouses, ESRI geodatabases, tabular data, even some image formats – Manipulation and Analysis of Data – combining, reprojecting, clipping, buffering, testing, filtering, etc. –
•
Components Universal Viewer – Quickly view data without the need of the native application. – Universal Translator – For quick translation and reprojection without the need of transformers. – Workbench – GUI environment for creating your own scripts (a.k.a. workspaces) –
Questions?
