Skip to main content

Ingest historical data

ArcGIS Velocity uses data sources to load historical observation data or other stored features into an analytic for processing.

  • In big data analytics, data sources are the primary source of data to be processed or analyzed.

  • In real-time analytics, data sources load historical data that functions as ancillary data to enrich or filter observations with tools such as Join Features, Calculate Distance, and more. By default, data from a data source is loaded once when a real-time analytic starts. You can optionally configure the data source to reload on a recurring schedule. To use dynamic data for these operations, configure a feed and use it as join data in analytic tools.

Historical data characteristics

Historical data is static, ranging from near real-time data, such as records collected in the past two minutes, to billions of records and observations collected over the past few decades. The client or consumer of the information (in this case, a big data or real-time analytic) is not actively subscribed to it or receiving data from it in real time. This means that the analytic only loads the data each time it runs.

You can use a feed and a real-time analytic together to ingest and store observational data in a feature layer or another output. You can configure a big data analytic to load and process this stored observational data at a defined interval.

The following are examples of historical data highlighting the diversity of datasets used in spatial analysis:

  • A feature layer containing hurricane path polylines between 2000 and 2010.

  • Shapefiles containing vehicle location observation points over time.

  • A GeoJSON file of the 2010 census tract polygons.

  • An RSS website with earthquakes in 2017.

  • Delimited text files representing point data for police traffic stops in 2019.