Work with data sources
A data source loads static or near real-time data into a real-time or big data analytic.
In real-time analytics, data sources load data used with tools that require an ancillary spatial or tabular dataset to enrich, filter, join to, or calculate distance from events. By default, a real-time analytic loads data from a data source when it starts. You can optionally configure the data source to reload on a recurring schedule. To use dynamic data for these operations, configure a feed and use it as join data in analytic tools.
In big data analytics, data sources load the data that will be processed by the tools and written to outputs.
The following data source types are available in ArcGIS Velocity:
Standard Geographies:
United States
World
ArcGIS:
Cloud:
Web and Messaging:
Examples
The following are examples of using a data source:
An environmental scientist configures an Amazon S3 source in a big data analytic to load hundreds of delimited
.csvfiles for analysis.A GIS analyst configures a Feature Layer source in a real-time analytic to load United States Census Bureau census tract data to enrich incoming sensor observations with information about the census tract they intersect.
Add a source in a real-time analytic
You can add a source only to an existing real-time analytic. Complete the following steps to add a source to an existing real-time analytic:
Open the ArcGIS Velocity app.
Click Real-Time from the menu to access the Real-Time Analytics page.
Click the Create real-time analytic button, and then click Existing feed.
Select an existing feed and click Confirm to open the analytic.
Expand the configuration pane and click Sources.
Choose a source type from the following categories:
Standard Geographies
ArcGIS
Cloud
Web and Messaging
Provide source configuration details.
The configuration parameters vary depending on the source type.
Configure the schema, key fields, and polling settings in the same way for all source types.
Optionally, on the Source Reload Schedule page, check the Reload source data on a schedule option, and then select the days and time that you want the source data to reload.
The configured source is available in an existing real-time analytic. You can now add and configure tools to analyze the data and send the results to various outputs.
Add a source when creating a new big data analytic
Complete the following steps to add a source when creating a new big data analytic:
Open the ArcGIS Velocity app.
Click Big Data from the menu to access the Big Data Analytics page.
Click the Create big data analytic button to create a new analytic.
Search or choose a source type from the following categories for big data analytic:
ArcGIS
Cloud
Web and Messaging
Provide source configuration details.
The configuration parameters vary depending on the source type.
Configure the schema, key fields, and polling settings in the same way for all source types.
The configured source is available in a new big data analytic. You can now add and configure tools to analyze the data and send the results to various outputs.
Add a source to an existing big data analytic
Complete the following steps to add a source to an existing big data analytic:
Open the ArcGIS Velocity app.
Click Big Data from the menu to access the Big Data Analytics page.
Choose an existing big data analytic available under the My Content page.
Click the Edit button to update an existing analytic.
Expand the configuration pane and click Sources.
Choose a source type from the following categories:
Standard Geographies
ArcGIS
Cloud
Web and Messaging
Provide source configuration details.
The configuration parameters vary depending on the source type.
Configure the schema, key fields, and polling settings in the same way for all source types.
The configured source is available in an existing real-time analytic. You can now add and configure tools to analyze the data and send the results to various outputs.
Edit a source
You can edit an existing source in a real-time or big data analytic to adjust connection parameters, schema configuration, key fields, and its reload schedule. To edit a source in an analytic, double-click the source node to see additional details or click the edit button to access the source configuration wizard.