GeoEvent Processor
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications Yehia Hassan , [email protected], @yehiahassan
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
GeoEvent Processor – An Introduction Agenda •
Real-time GIS Overview
•
Working with Real-time Data
•
Performing Continuous Processing and Analysis
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Real-time GIS Overview
Using U sing ArcGIS ArcGIS GeoEvent GeoEvent Processor Processor for for Server Server tto oP Power ower R Real-Time eal Time A Applications pplicati at ons
GIS Data •
GIS data typically represents state at a specific moment in time: “historic”, “current”, or “future”.
Credit: iStockphoto/chris_lemmens
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Real-time GIS Data •
Real-time GIS data is a continuous stream of events flowing from sensors where each event represents the latest state of the sensor. Emergency Response - Utility Networks and Warehouses - Environmental Features Challenge #1 -
Police Car
Police Person Ambulance
Applications Network Sensor Warehouse Item Storm Wind
110㼻
Temperature Earthquake Wild Fire
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Mobile Desktop Web Runtime
Analyzing Real-time GIS Data •
Are my field personnel working within the designated project area?
Challenge #2 Continuous Analysis
Features Equipment
Outside Boundary
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Alert
Applications Mobile Desktop Web Runtime
Analyzing Real-time GIS Data •
Tell customer when their delivery truck is 15 minutes away.
Challenge #3
Continuous Analysis
Features Delivery Vehicle
Enter Customer Area
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Notification
Applications Mobile Desktop Web Runtime
ArcGIS Supports Real-time GIS Operations Dashboard
Collector
ArcGIS Online / Portal al for A ArcGIS
ArcGIS Server
GeoEvent Processor Real-time data
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
ArcGIS GeoEvent Processor for Server •
Receives real-time streaming data
•
Performs continuous processing and analysis
•
Sends updates and alerts to those who need it where they need it Real-Time Data
Applications
ArcGIS Server
Features
GeoEvent Processor Alerts
Mobile Desktop Web Runtime
im ws://
Continuous Processing and Analysis Connectors
Connectors
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Working with Real-time Data
Using U sing ArcGIS ArcGIS GeoEvent GeoEvent Processor Processor for for Server Server tto oP Power ower R Real-Time eal Time A Applications pplicati at ons
Receiving Real-time Data Input Connectors •
You can easily integrate real-time data with ArcGIS by using a connector that meets your needs. ArcGIS for Server GeoEvent Processor Real-time data
Receive from a Socket Receive Tweets
ws://
Receive Instagram
http:// Receive on a REST Endpoint
Receive from a Web Socket Receive Air Traffic Control
Receive Trimble
Receive RSS
CoT
Receive Cursor-on-Target
Receive Sierra Wireless
Watch a folder for new Files
VMF
Receive VMF
NMEA Receive NMEA
Poll an ArcGIS Server
GPX Receive GPX
Geo Message
http:// Poll an external website
You can add your own connectors. Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Receive Geomessages
Receive Vessels
Demo
Demonstration Twitter Monitoring
Using U sing ArcGIS ArcGIS GeoEvent GeoEvent Processor Processor for for Server Server tto oP Power ower R Real-Time eal Time A Applications pplicati at ons
Sending Real-time Data Output Connectors •
You can easily send resulting streams to those who need it where they need it using a connector. ArcGIS for Server
Mobile Desktop Web Runtime
GeoEvent Processor im
Real-time data
ws:// Update a Feature
You can add your own connectors
im
Add a Feature
Send a Tweet
Send an email
Send to RabbitMQ
Send an Instant Message
Send to ActiveMQ
Send a Text Message
Send to HornetQ
Publish to REST Endpoint
Write to Hadoop
ws:// Send to a Web Socket Send to a Socket Write to a File Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Write to MongoDB Send to CESIUM
Sending Real-time Data to Features Using local feature services Your Dashboards Operations Dashboard for ArcGIS
Your Applications
ArcGIS for Server
ArcGIS Online / Portal
Web APIs
operation view
JavaScript
web map
Flex Silverlight/WPF
GeoEvent Processor
Inputs
Real-time data
Outputs
GeoEvent Services
Filters
Mobile GIS iOS feature layers Android
Windows Phone
Processors
Runtimes Update a Feature Add a Feature
Windows Store Java Mac OS X Qt
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Sending Real-time Data to Features Using remote feature services Your Dashboards Operations Dashboard for ArcGIS
Your Applications
ArcGIS for Server
ArcGIS Online / Portal
Web APIs
operation view
JavaScript
web map
Flex Silverlight/WPF
GeoEvent Processor
Inputs
Real-time data
Outputs
GeoEvent Services
Filters
Mobile GIS
ArcGIS for Server
iOS
feature layers
Android
Windows Phone
Processors
Runtimes Update a Feature Add a Feature
Windows Store Java Mac OS X Qt
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Sending Real-time Data to Features Using ArcGIS Online feature services Your Dashboards Operations Dashboard for ArcGIS
Your Applications Web APIs JavaScript
ArcGIS for Server
Flex Silverlight/WPF
GeoEvent Processor ArcGIS Online / Portal
Inputs
Real-time data
Outputs
GeoEvent Services
Filters
operation view web map feature layers
Mobile GIS iOS Android
Windows Phone
Processors
Runtimes Update a Feature Add a Feature
Windows Store Java Mac OS X Qt
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Sending Real-time Data to Big Data Stores Write to a Hadoop Distributed File System (HDFS) Write to a MongoDB Document Store •
GIS Tools for Hadoop -
http://github.com/Esri/gis-tools-for-hadoop ArcGIS for Desktop Geoprocessing GIS Tools for Hadoop
ArcGIS for Server GeoEvent Processor
Inputs
Real-time data
Outputs
GeoEvent Services
Filters
2013/03/06/10/vehicles-2013-03-06-10.json 2013/03/06/10/vehicles 2013 03 06 10.json j 2013/03/06/11/vehicles 2013 03 06 11.json 2013/03/06/11/vehicles-2013-03-06-11.json jso 2013/03/06/12/vehicles 2013 03 06 12.json 2013/03/06/12/vehicles-2013-03-06-12.json j 2013/03/06/13/vehicles-2013-03-06-13.json
Processors
Write to Hadoop Write to MongoDB
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
2013/03/06/10/vehicles-2013-03-06-10.tsv 2013/03/06/10/vehicles 2013 03 06 10.tsv 2013/03/06/11/vehicles 2013 03 06 11.tsv 2013/03/06/11/vehicles-2013-03-06-11.tsv 2013/03/06/12/vehicles 2013 03 06 12.tsv 2013/03/06/12/vehicles-2013-03-06-12.tsv 2013/03/06/13/vehicles-2013-03-06-13.tsv
Performing Continuous Processing and Analysis
Using U sing ArcGIS ArcGIS GeoEvent GeoEvent Processor Processor for for Server Server tto oP Power ower R Real-Time eal Time A Applications pplicati at ons
Continuous Processing and Analysis GeoEvent Services •
A GeoEvent Service configures the flow of geoevents, the Filtering and GeoEvent Processing steps to perform, - what input(s) to apply them to, - and what outputs(s) to send the results to. -
ArcGIS for Server
Mobile Desktop Web Runtime
GeoEvent Processor im Real-time data ws://
Twitter Monitor (GeoEvent Service) Twitter Input
Geolocated Filter
Add Tweet Feature Write Tweets to Hadoop
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Continuous Processing and Analysis Processors •
Calculate new fields on a geoevent: GeoTagger, Field Calculator
•
Modify a geoevent: Field Enricher, Field Reducer
•
Derive a new geoevent: Field Mapper, Incident Detector ArcGIS Server
with GeoEvent Processor
GeoEvent Service GeoTagger
Field Calculator
Field Enricher
Input 1
Output 1 Field Reducer
Field Mapper
Incident Detector
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Continuous Processing and Analysis Derive a new geoevent •
An Incident Detector processor creates an incident upon an opening condition being met, - maintains state for the duration of the incident, - closes the incident based on a closing condition or expiration. -
GeoEvent Service
66
68
73
Output 1
Incident Detector
Input 1
81
92
90
91
90
68
65
noiseDecibel >= 90 Opening Condition
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
81
92
Close Incident
90
91
90 Open Incident
Demo
Demonstration Noise Incident Detection external
internal
ArcGIS for Server
ArcGIS for Server
GeoEvent Processor
GeoEvent Processor GeoEvent Service
GeoEvent Service JSON ws://
Noise App
Using U sing ArcGIS ArcGIS GeoEvent GeoEvent Processor Processor for for Server Server tto oP Power ower R Real-Time eal Time A Applications pplicati at ons
ws://
feature
ws:// incident detector
feature
Solutions and Sample Applications Applying real-time GIS •
A number of solutions and sample applications leverage GeoEvent Processor to enable real-time GIS capabilities within them including: -
Defense and Intelligence:
http://resources.arcgis.com/en/communities/defense-and-intelligence/
-
ArcGIS for the Military
-
ArcGIS for the National Guard
-
ArcGIS for Intelligence
-
Asset Monitor
-
Route Monitor
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Asset Monitor
Route Monitor
ArcGIS for the Military
ArcGIS for Intelligence
Demo
Demonstration Asset Monitoring
Using U sing ArcGIS ArcGIS GeoEvent GeoEvent Processor Processor for for Server Server tto oP Power ower R Real-Time eal Time A Applications pplicati at ons
What’s Coming? •
High Availability Support
•
More Connectors
•
Solutions Templates
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
GeoEvent Processor – An Introduction Summary •
ArcGIS is a dynamic platform that enables real-time visualization, continuous analysis, and understanding of our world.
•
GeoEvent Processor allows you to:
•
-
know what is happening, as it happens
-
react and make smarter decisions faster
-
be alerted when interesting events occur
Product Page -
•
http://pro.arcgis.com/share/geoevent-processor
Twitter for GeoEvent -
https://github.com/Esri/twitter-for-geoevent
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Yehia Hassan | Solutions Engineer Technical Marketing [email protected] | @yehiahassan
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
GeoEvent Processor – An Introduction Agenda •
Real-time GIS Overview
•
Working with Real-time Data
•
Performing Continuous Processing and Analysis
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Real-time GIS Overview
Using U sing ArcGIS ArcGIS GeoEvent GeoEvent Processor Processor for for Server Server tto oP Power ower R Real-Time eal Time A Applications pplicati at ons
GIS Data •
GIS data typically represents state at a specific moment in time: “historic”, “current”, or “future”.
Credit: iStockphoto/chris_lemmens
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Real-time GIS Data •
Real-time GIS data is a continuous stream of events flowing from sensors where each event represents the latest state of the sensor. Emergency Response - Utility Networks and Warehouses - Environmental Features Challenge #1 -
Police Car
Police Person Ambulance
Applications Network Sensor Warehouse Item Storm Wind
110㼻
Temperature Earthquake Wild Fire
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Mobile Desktop Web Runtime
Analyzing Real-time GIS Data •
Are my field personnel working within the designated project area?
Challenge #2 Continuous Analysis
Features Equipment
Outside Boundary
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Alert
Applications Mobile Desktop Web Runtime
Analyzing Real-time GIS Data •
Tell customer when their delivery truck is 15 minutes away.
Challenge #3
Continuous Analysis
Features Delivery Vehicle
Enter Customer Area
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Notification
Applications Mobile Desktop Web Runtime
ArcGIS Supports Real-time GIS Operations Dashboard
Collector
ArcGIS Online / Portal al for A ArcGIS
ArcGIS Server
GeoEvent Processor Real-time data
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
ArcGIS GeoEvent Processor for Server •
Receives real-time streaming data
•
Performs continuous processing and analysis
•
Sends updates and alerts to those who need it where they need it Real-Time Data
Applications
ArcGIS Server
Features
GeoEvent Processor Alerts
Mobile Desktop Web Runtime
im ws://
Continuous Processing and Analysis Connectors
Connectors
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Working with Real-time Data
Using U sing ArcGIS ArcGIS GeoEvent GeoEvent Processor Processor for for Server Server tto oP Power ower R Real-Time eal Time A Applications pplicati at ons
Receiving Real-time Data Input Connectors •
You can easily integrate real-time data with ArcGIS by using a connector that meets your needs. ArcGIS for Server GeoEvent Processor Real-time data
Receive from a Socket Receive Tweets
ws://
Receive Instagram
http:// Receive on a REST Endpoint
Receive from a Web Socket Receive Air Traffic Control
Receive Trimble
Receive RSS
CoT
Receive Cursor-on-Target
Receive Sierra Wireless
Watch a folder for new Files
VMF
Receive VMF
NMEA Receive NMEA
Poll an ArcGIS Server
GPX Receive GPX
Geo Message
http:// Poll an external website
You can add your own connectors. Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Receive Geomessages
Receive Vessels
Demo
Demonstration Twitter Monitoring
Using U sing ArcGIS ArcGIS GeoEvent GeoEvent Processor Processor for for Server Server tto oP Power ower R Real-Time eal Time A Applications pplicati at ons
Sending Real-time Data Output Connectors •
You can easily send resulting streams to those who need it where they need it using a connector. ArcGIS for Server
Mobile Desktop Web Runtime
GeoEvent Processor im
Real-time data
ws:// Update a Feature
You can add your own connectors
im
Add a Feature
Send a Tweet
Send an email
Send to RabbitMQ
Send an Instant Message
Send to ActiveMQ
Send a Text Message
Send to HornetQ
Publish to REST Endpoint
Write to Hadoop
ws:// Send to a Web Socket Send to a Socket Write to a File Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Write to MongoDB Send to CESIUM
Sending Real-time Data to Features Using local feature services Your Dashboards Operations Dashboard for ArcGIS
Your Applications
ArcGIS for Server
ArcGIS Online / Portal
Web APIs
operation view
JavaScript
web map
Flex Silverlight/WPF
GeoEvent Processor
Inputs
Real-time data
Outputs
GeoEvent Services
Filters
Mobile GIS iOS feature layers Android
Windows Phone
Processors
Runtimes Update a Feature Add a Feature
Windows Store Java Mac OS X Qt
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Sending Real-time Data to Features Using remote feature services Your Dashboards Operations Dashboard for ArcGIS
Your Applications
ArcGIS for Server
ArcGIS Online / Portal
Web APIs
operation view
JavaScript
web map
Flex Silverlight/WPF
GeoEvent Processor
Inputs
Real-time data
Outputs
GeoEvent Services
Filters
Mobile GIS
ArcGIS for Server
iOS
feature layers
Android
Windows Phone
Processors
Runtimes Update a Feature Add a Feature
Windows Store Java Mac OS X Qt
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Sending Real-time Data to Features Using ArcGIS Online feature services Your Dashboards Operations Dashboard for ArcGIS
Your Applications Web APIs JavaScript
ArcGIS for Server
Flex Silverlight/WPF
GeoEvent Processor ArcGIS Online / Portal
Inputs
Real-time data
Outputs
GeoEvent Services
Filters
operation view web map feature layers
Mobile GIS iOS Android
Windows Phone
Processors
Runtimes Update a Feature Add a Feature
Windows Store Java Mac OS X Qt
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Sending Real-time Data to Big Data Stores Write to a Hadoop Distributed File System (HDFS) Write to a MongoDB Document Store •
GIS Tools for Hadoop -
http://github.com/Esri/gis-tools-for-hadoop ArcGIS for Desktop Geoprocessing GIS Tools for Hadoop
ArcGIS for Server GeoEvent Processor
Inputs
Real-time data
Outputs
GeoEvent Services
Filters
2013/03/06/10/vehicles-2013-03-06-10.json 2013/03/06/10/vehicles 2013 03 06 10.json j 2013/03/06/11/vehicles 2013 03 06 11.json 2013/03/06/11/vehicles-2013-03-06-11.json jso 2013/03/06/12/vehicles 2013 03 06 12.json 2013/03/06/12/vehicles-2013-03-06-12.json j 2013/03/06/13/vehicles-2013-03-06-13.json
Processors
Write to Hadoop Write to MongoDB
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
2013/03/06/10/vehicles-2013-03-06-10.tsv 2013/03/06/10/vehicles 2013 03 06 10.tsv 2013/03/06/11/vehicles 2013 03 06 11.tsv 2013/03/06/11/vehicles-2013-03-06-11.tsv 2013/03/06/12/vehicles 2013 03 06 12.tsv 2013/03/06/12/vehicles-2013-03-06-12.tsv 2013/03/06/13/vehicles-2013-03-06-13.tsv
Performing Continuous Processing and Analysis
Using U sing ArcGIS ArcGIS GeoEvent GeoEvent Processor Processor for for Server Server tto oP Power ower R Real-Time eal Time A Applications pplicati at ons
Continuous Processing and Analysis GeoEvent Services •
A GeoEvent Service configures the flow of geoevents, the Filtering and GeoEvent Processing steps to perform, - what input(s) to apply them to, - and what outputs(s) to send the results to. -
ArcGIS for Server
Mobile Desktop Web Runtime
GeoEvent Processor im Real-time data ws://
Twitter Monitor (GeoEvent Service) Twitter Input
Geolocated Filter
Add Tweet Feature Write Tweets to Hadoop
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Continuous Processing and Analysis Processors •
Calculate new fields on a geoevent: GeoTagger, Field Calculator
•
Modify a geoevent: Field Enricher, Field Reducer
•
Derive a new geoevent: Field Mapper, Incident Detector ArcGIS Server
with GeoEvent Processor
GeoEvent Service GeoTagger
Field Calculator
Field Enricher
Input 1
Output 1 Field Reducer
Field Mapper
Incident Detector
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Continuous Processing and Analysis Derive a new geoevent •
An Incident Detector processor creates an incident upon an opening condition being met, - maintains state for the duration of the incident, - closes the incident based on a closing condition or expiration. -
GeoEvent Service
66
68
73
Output 1
Incident Detector
Input 1
81
92
90
91
90
68
65
noiseDecibel >= 90 Opening Condition
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
81
92
Close Incident
90
91
90 Open Incident
Demo
Demonstration Noise Incident Detection external
internal
ArcGIS for Server
ArcGIS for Server
GeoEvent Processor
GeoEvent Processor GeoEvent Service
GeoEvent Service JSON ws://
Noise App
Using U sing ArcGIS ArcGIS GeoEvent GeoEvent Processor Processor for for Server Server tto oP Power ower R Real-Time eal Time A Applications pplicati at ons
ws://
feature
ws:// incident detector
feature
Solutions and Sample Applications Applying real-time GIS •
A number of solutions and sample applications leverage GeoEvent Processor to enable real-time GIS capabilities within them including: -
Defense and Intelligence:
http://resources.arcgis.com/en/communities/defense-and-intelligence/
-
ArcGIS for the Military
-
ArcGIS for the National Guard
-
ArcGIS for Intelligence
-
Asset Monitor
-
Route Monitor
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Asset Monitor
Route Monitor
ArcGIS for the Military
ArcGIS for Intelligence
Demo
Demonstration Asset Monitoring
Using U sing ArcGIS ArcGIS GeoEvent GeoEvent Processor Processor for for Server Server tto oP Power ower R Real-Time eal Time A Applications pplicati at ons
What’s Coming? •
High Availability Support
•
More Connectors
•
Solutions Templates
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
GeoEvent Processor – An Introduction Summary •
ArcGIS is a dynamic platform that enables real-time visualization, continuous analysis, and understanding of our world.
•
GeoEvent Processor allows you to:
•
-
know what is happening, as it happens
-
react and make smarter decisions faster
-
be alerted when interesting events occur
Product Page -
•
http://pro.arcgis.com/share/geoevent-processor
Twitter for GeoEvent -
https://github.com/Esri/twitter-for-geoevent
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
Yehia Hassan | Solutions Engineer Technical Marketing [email protected] | @yehiahassan
Using ArcGIS GeoEvent Processor for Server to Power Real-Time Applications
