Applying Real-Time Analytics Using GeoEvent Processor
Applying Real-Time Analytics using GeoEvent Processor
RJ Sunderman |
Product Engineer ArcGIS GeoEvent Processor for Server [email protected]
C. Adam Mollenkopf |
Product Lead ArcGIS GeoEvent Processor for Server [email protected] | @amollenkopf
ArcGIS GeoEvent Processor for Server Integrates and exploits real-time data •
Integrates real-time streaming data into ArcGIS
•
Performs continuous processing and real-time analytics
•
Sends updates and alerts to those who need it where they need it GeoEvent Services
GeoEvent Processor ws://
ArcGIS Server Inputs
Outputs
Applying real-time analytics GeoEvent Services •
A GeoEvent Service configures the flow of GeoEvents, the Filtering and GeoEvent Processing steps to perform, - what input(s) to apply them to, - and what outputs(s) to send the results to. -
Applying real-time analytics Filtering •
A filter eliminates GeoEvents based on an expression.
= -
Attribute expression
= -
Spatial Expression
= -
Combined Expression
=
Demo
Filtering Attribute, Spatial and Combined Expressions
Receiving real-time data Connectors
You can easily integrate real-time streaming data with ArcGIS by using an input connector. GeoEvent Processor Inputs
Outputs
GeoEvent Services
You can create your own connectors.
Twitter
GNIP
Receive text from a TCP Socket
Instagram
Geofeedia
Receive text from a UDP Socket
CAP
exactEarth
http:// Receive Features on a REST endpoint http:// Receive JSON on a REST endpoint ws:// Receive JSON on a Web Socket ws:// Receive JSON on external Web Socket Poll an ArcGIS Server for Features http:// Poll an external website for JSON
Cursor-on-Target VMF GeoMessage ActiveMQ RabbitMQ
Partner Gallery
Receive RSS
Esri Gallery
Out of the Box
•
ASDI (FAA) OSIsoft Valarm Harris CompassCom
NMEA
NetworkFleet Zonar
.csv
Watch a folder for new .csv files
TAIP (Trimble)
.json
Watch a folder for new .json files
RAP (Sierra Wireless)
Yoctopuce Yocto-Meteo Yoctopuce Yocto-VOC
Sensors used in this workshop Reports volatile organic compounds
Reports ambient temperature, relative humidity & barometric pressure
Yoctopuce Yocto-Light Yoctopuce Yocto-CO2
Reports luminosity
Reports carbon dioxide Valarm & Yocto-Meteo with Solar Power
Demo
Integrating sensors with ArcGIS Valarm for GeoEvent Processor external network (amazon ec2)
…
…
internal network (my laptop)
GeoEvent Processor
GeoEvent Processor
GeoEvent Service
GeoEvent Service
Light Meteo
REST
JSON VOC
ws:// server
JSON
ws://
…
client
CO2
…
…
ArcGIS Server
ArcGIS Server
Receive Valarm ws://
Publish JSON to a Web Socket ws:// Receive JSON on external Web Socket
Applying real-time analytics GeoEvent Processing
You can perform continuous analytics on GeoEvents as they are received using a processor. GeoEvent Processor
Inputs
Outputs
GeoEvent Services
Field Enricher
Out of the Box
•
Field Reducer Field Calculator GeoTagger Field Mapper Track Gap Detector Incident Detector
GeoEvent Processing Processors – modify a GeoEvent •
A Field Enricher processor -
Uses information inside the GeoEvent to retrieve data from a data source.
-
After the Field Enricher retrieves the required data from a data source, it enriches (augments) the GeoEvent with new fields derived from the source.
Event
Event
Enriched Event
Enriched Event File
Feature Service
•
A Field Reducer processor -
Removes specified fields from a GeoEvent
-
derives a new GeoEvent Definition based on the resulting schema
Reduced Event
GeoEvent Processing Processors – calculate new fields on a GeoEvent •
A Field Calculator processor uses an expression to calculate a new field or update an existing field. - Expressions can be mathematical expressions, string operations, or regular expressions. -
GeoEvent
Expression Enriched GeoEvent
•
A GeoTagger processor -
uses a spatial condition to tag the event with related geometries.
GeoEvent
Expression Enriched GeoEvent
GeoEvent Processing Processors – derive new GeoEvents •
A Field Mapper processor -
Translates from one GeoEvent Definition to another
-
Specifying how fields map across the GeoEvent Definitions
Incoming Event
Translated Event
Demo
GeoEvent Processing Field Enricher, Field Mapper, Field Calculator
GeoEvent Processing Processors – derive new GeoEvents •
An Incident Detector Processor -
creates an Incident upon an opening expression being met,
-
maintains state for the duration of an incident,
-
closes the incident based on a closing expression, or expiration.
802 1326 2981 4913 7827 9102 7138 5122 2323 783
•
CO2 >= 5000
Close Incident
Open Incident
A Track Gap Detector processor -
Detects the absence of events and alerts about the situation.
Gap Closed
Gap Detected
Demo
GeoEvent Processing Incident Detector, Track Gap Detector
Applying real-time analytics GeoEvent Processing
You can perform continuous analytics on GeoEvents as they are received using a processor. GeoEvent Processor GeoEvent Services
Track Idle Detector
Field Calculator GeoTagger Field Mapper
Esri Gallery
Field Reducer
ETA Calculator Service Area Buffer Ellipse
Track Gap Detector
Range Fan
Incident Detector
Visibility Query Report
SDK
Inputs
Outputs
You can create your own processors.
Field Enricher
Out of the Box
•
Slope Calculator Volume Control
ArcGIS GeoEvent Processor Additional Workshops •
ArcGIS GeoEvent Processor – An Introduction -
•
Use Cases for Applying Real-Time Analytics using GeoEvent Processor -
•
Wed 4:00pm-5:00pm (Primrose C/D)
Extending ArcGIS GeoEvent Processor with New Processors -
•
Wed 1:00pm-2:00pm (Pasadena/Ventura/Sierra)
The Internet of Things (IoT) and ArcGIS GeoEvent Processor -
•
Thu 2:30pm-3:30pm (Primrose C/D)
Extending ArcGIS GeoEvent Processor with New Connectors -
•
Wed 10:30am-11:30am (Primrose B)
Wed 5:30pm-6:30pm (Primrose C/D)
The Road Ahead: ArcGIS for Server and Portal -
Thu 10:00am-11:00am (Primrose B)
Applying Real-Time Analytics using GeoEvent Processor Summary •
ArcGIS is a dynamic platform that enables real-time visualization and continuous analytics to better understanding of our world.
•
GeoEvent Processor allows you to:
•
-
to know what is happening, as it happens
-
be alerted when interesting events occur
-
react and make smarter decisions faster
To learn more, visit the tutorials in the Gallery: -
http://links.esri.com/geoevent-processor
Questions / Feedback? To learn more: http://links.esri.com/geoevent-processor Please submit a session survey: http://www.esri.com/events/devsummit/session-rater
RJ Sunderman |
Product Engineer ArcGIS GeoEvent Processor for Server [email protected]
C. Adam Mollenkopf |
Product Lead ArcGIS GeoEvent Processor for Server [email protected] | @amollenkopf
RJ Sunderman |
Product Engineer ArcGIS GeoEvent Processor for Server [email protected]
C. Adam Mollenkopf |
Product Lead ArcGIS GeoEvent Processor for Server [email protected] | @amollenkopf
ArcGIS GeoEvent Processor for Server Integrates and exploits real-time data •
Integrates real-time streaming data into ArcGIS
•
Performs continuous processing and real-time analytics
•
Sends updates and alerts to those who need it where they need it GeoEvent Services
GeoEvent Processor ws://
ArcGIS Server Inputs
Outputs
Applying real-time analytics GeoEvent Services •
A GeoEvent Service configures the flow of GeoEvents, the Filtering and GeoEvent Processing steps to perform, - what input(s) to apply them to, - and what outputs(s) to send the results to. -
Applying real-time analytics Filtering •
A filter eliminates GeoEvents based on an expression.
= -
Attribute expression
= -
Spatial Expression
= -
Combined Expression
=
Demo
Filtering Attribute, Spatial and Combined Expressions
Receiving real-time data Connectors
You can easily integrate real-time streaming data with ArcGIS by using an input connector. GeoEvent Processor Inputs
Outputs
GeoEvent Services
You can create your own connectors.
GNIP
Receive text from a TCP Socket
Geofeedia
Receive text from a UDP Socket
CAP
exactEarth
http:// Receive Features on a REST endpoint http:// Receive JSON on a REST endpoint ws:// Receive JSON on a Web Socket ws:// Receive JSON on external Web Socket Poll an ArcGIS Server for Features http:// Poll an external website for JSON
Cursor-on-Target VMF GeoMessage ActiveMQ RabbitMQ
Partner Gallery
Receive RSS
Esri Gallery
Out of the Box
•
ASDI (FAA) OSIsoft Valarm Harris CompassCom
NMEA
NetworkFleet Zonar
.csv
Watch a folder for new .csv files
TAIP (Trimble)
.json
Watch a folder for new .json files
RAP (Sierra Wireless)
Yoctopuce Yocto-Meteo Yoctopuce Yocto-VOC
Sensors used in this workshop Reports volatile organic compounds
Reports ambient temperature, relative humidity & barometric pressure
Yoctopuce Yocto-Light Yoctopuce Yocto-CO2
Reports luminosity
Reports carbon dioxide Valarm & Yocto-Meteo with Solar Power
Demo
Integrating sensors with ArcGIS Valarm for GeoEvent Processor external network (amazon ec2)
…
…
internal network (my laptop)
GeoEvent Processor
GeoEvent Processor
GeoEvent Service
GeoEvent Service
Light Meteo
REST
JSON VOC
ws:// server
JSON
ws://
…
client
CO2
…
…
ArcGIS Server
ArcGIS Server
Receive Valarm ws://
Publish JSON to a Web Socket ws:// Receive JSON on external Web Socket
Applying real-time analytics GeoEvent Processing
You can perform continuous analytics on GeoEvents as they are received using a processor. GeoEvent Processor
Inputs
Outputs
GeoEvent Services
Field Enricher
Out of the Box
•
Field Reducer Field Calculator GeoTagger Field Mapper Track Gap Detector Incident Detector
GeoEvent Processing Processors – modify a GeoEvent •
A Field Enricher processor -
Uses information inside the GeoEvent to retrieve data from a data source.
-
After the Field Enricher retrieves the required data from a data source, it enriches (augments) the GeoEvent with new fields derived from the source.
Event
Event
Enriched Event
Enriched Event File
Feature Service
•
A Field Reducer processor -
Removes specified fields from a GeoEvent
-
derives a new GeoEvent Definition based on the resulting schema
Reduced Event
GeoEvent Processing Processors – calculate new fields on a GeoEvent •
A Field Calculator processor uses an expression to calculate a new field or update an existing field. - Expressions can be mathematical expressions, string operations, or regular expressions. -
GeoEvent
Expression Enriched GeoEvent
•
A GeoTagger processor -
uses a spatial condition to tag the event with related geometries.
GeoEvent
Expression Enriched GeoEvent
GeoEvent Processing Processors – derive new GeoEvents •
A Field Mapper processor -
Translates from one GeoEvent Definition to another
-
Specifying how fields map across the GeoEvent Definitions
Incoming Event
Translated Event
Demo
GeoEvent Processing Field Enricher, Field Mapper, Field Calculator
GeoEvent Processing Processors – derive new GeoEvents •
An Incident Detector Processor -
creates an Incident upon an opening expression being met,
-
maintains state for the duration of an incident,
-
closes the incident based on a closing expression, or expiration.
802 1326 2981 4913 7827 9102 7138 5122 2323 783
•
CO2 >= 5000
Close Incident
Open Incident
A Track Gap Detector processor -
Detects the absence of events and alerts about the situation.
Gap Closed
Gap Detected
Demo
GeoEvent Processing Incident Detector, Track Gap Detector
Applying real-time analytics GeoEvent Processing
You can perform continuous analytics on GeoEvents as they are received using a processor. GeoEvent Processor GeoEvent Services
Track Idle Detector
Field Calculator GeoTagger Field Mapper
Esri Gallery
Field Reducer
ETA Calculator Service Area Buffer Ellipse
Track Gap Detector
Range Fan
Incident Detector
Visibility Query Report
SDK
Inputs
Outputs
You can create your own processors.
Field Enricher
Out of the Box
•
Slope Calculator Volume Control
ArcGIS GeoEvent Processor Additional Workshops •
ArcGIS GeoEvent Processor – An Introduction -
•
Use Cases for Applying Real-Time Analytics using GeoEvent Processor -
•
Wed 4:00pm-5:00pm (Primrose C/D)
Extending ArcGIS GeoEvent Processor with New Processors -
•
Wed 1:00pm-2:00pm (Pasadena/Ventura/Sierra)
The Internet of Things (IoT) and ArcGIS GeoEvent Processor -
•
Thu 2:30pm-3:30pm (Primrose C/D)
Extending ArcGIS GeoEvent Processor with New Connectors -
•
Wed 10:30am-11:30am (Primrose B)
Wed 5:30pm-6:30pm (Primrose C/D)
The Road Ahead: ArcGIS for Server and Portal -
Thu 10:00am-11:00am (Primrose B)
Applying Real-Time Analytics using GeoEvent Processor Summary •
ArcGIS is a dynamic platform that enables real-time visualization and continuous analytics to better understanding of our world.
•
GeoEvent Processor allows you to:
•
-
to know what is happening, as it happens
-
be alerted when interesting events occur
-
react and make smarter decisions faster
To learn more, visit the tutorials in the Gallery: -
http://links.esri.com/geoevent-processor
Questions / Feedback? To learn more: http://links.esri.com/geoevent-processor Please submit a session survey: http://www.esri.com/events/devsummit/session-rater
RJ Sunderman |
Product Engineer ArcGIS GeoEvent Processor for Server [email protected]
C. Adam Mollenkopf |
Product Lead ArcGIS GeoEvent Processor for Server [email protected] | @amollenkopf
