Skip to main content

Use Snowflake records

Use records from a Snowflake table as input to ArcGIS Data Pipelines.

Usage notes

Keep the following in mind when working with Snowflake:

  • To use a dataset from Snowflake, you must first create a data store item. Data store items securely store credentials and connection information so the data can be read by Data Pipelines. To create a Snowflake data store, see Add a database data store item.
  • To change the data store item you configured, use the Data store item parameter to remove the currently selected item, and use the Select item button to browse your content and select an existing data store item.
  • Use the Table parameter to specify the dataset you want to use. Table names are case sensitive. For example, if the table is named MyTable, you must specify it using the exact capitalization.

  • To improve the performance of reading input datasets, consider the following options:

    • Use the Use caching parameter to store a copy of the dataset. The cached copy is only maintained while at least one browser tab open to the editor is connected. This may make it faster to access the data during processing. If the source data has been updated since it was cached, uncheck this parameter and preview or run the tool again.

    • After configuring an input dataset, configure any of the following tools that limit the amount of data being processed:

      • Filter by attribute—Maintain a subset of records that contain certain attribute values.

      • Filter by extent—Maintain a subset of records within a certain spatial extent.

      • Select fields—Maintain only the fields of interest.

      • Clip—Maintain a subset of records that intersect with specific geometries.

Limitations

The following are known limitations:

  • Data Pipelines only supports the Key-pair and User authentication types for Snowflake. If your data store is configured to use another authentication type, it will not work as input to Data Pipelines.

  • User accounts that have multi-factor authentication (MFA) enabled cannot be used in Data Pipelines.

Licensing requirements

The following licensing and configurations are required:

  • Creator or Professional user type

  • Publisher, Facilitator, or Administrator role, or an equivalent custom role

To learn more about Data Pipelines requirements, see Requirements.

Additionally, Data Pipelines is only available if you have an ArcGIS Data Pipelines Server configured with ArcGIS Enterprise.

To learn more about adding data store items to your content, see Add a data store item.

Back to top