Tutorial: Create 3D digital aerial imagery products in ArcGIS Pro using ArcGIS Reality Server

Available with Standard or Advanced license.

In ArcGIS Pro, you can connect to ArcGIS Reality Server and photogrammetry correct digital aerial imagery collected by a professional mapping camera to remove geometric distortions caused by the sensor and terrain displacement. After correcting these effects, you can generate Reality mapping products. With ArcGIS Reality Server, this processing can be performed remotely on your self-hosted enterprise infrastructure, enabling you to leverage multi-machine configuration for distributed processing.

In this tutorial, you will set up a Reality mapping workspace to manage an aerial imagery collection for processing on the server. You will perform a block adjustment and review the results. Then you'll generate point cloud and 3D mesh products.

Computing the photogrammetric solution for aerial imagery is determined by its exterior orientation (EO), which represents a transformation from the ground to the camera and its interior orientation (IO), which represents a transformation from camera to image. Required EO parameters include perspective center (x,y,z) coordinates, and omega, phi, and kappa angles are provided in a frames table. Interior orientation parameters include focal length, pixel size, principal point, and lens distortion. This information is available in the camera calibration report associated with the imagery and must be provided in a camera table.

Note:

ArcGIS Reality Server is needed to complete this tutorial. To configure a Reality Server, please refer to the Reality Server installation.

Connect to ArcGIS Reality Server

To utilize Reality Server processing your data in ArcGIS Pro, you need to first connect to the Reality Server.

1. Open ArcGIS Pro, Click the Project tab on the ribbon and click the Portals page.

   You can also access the portals page from the Manage Portals link in the Sign In menu .

2. Click Add Portal.

3. Enter the URL (https://webadaptorhost.domain.com/webadaptorname) for the portal on the Add Portal dialog box and click OK.

4. Sign in to the portal by clicking the Options button or right-click the portal and click Sign in. Enter your username and password.

5. To make the new connection your active portal, right-click the URL and click Set As Active Portal.

6. Once you successfully connect to your portal, your username will show up in the top right corner of ArcGIS Pro.

   

Create a Reality mapping workspace

A Reality mapping workspace is an ArcGIS Pro subproject that is dedicated to Reality mapping workflows. It is a container in an ArcGIS Pro project folder that stores the resources and derived files that belong to a single image collection.

A collection of digital aerial images is provided for this tutorial. The tutorial data also contains frame and camera tables.

To create a Reality mapping workspace, complete the following steps:

1. Download the tutorial dataset and save it to C:\SampleData\Aerial Imagery.

   1. Unzip the package in the C:\SampleData\Aerial Imagery directory.

   If you save the data to a different location on your computer, update the path in each of the entries in the Oblique_FramesCam.csv file.

2. In ArcGIS Pro, create a project using the Map template.

3. On the Imagery tab, in the Reality Mapping group, click the New Workspace drop-down menu and choose New Workspace.

4. In the Workspace Configuration window, provide a name for the workspace.

5. Set Workspace Type to Reality Mapping.

6. In the Sensor Data Type drop-down menu, choose Aerial - Digital.

7. Set Scenario Type to Oblique.

   This setting is recommended when working with a combination of oblique and nadir imagery.

8. In the Basemap drop-down menu, choose Topographic.

9. Set the Parallel Processing Factor (PPF). This controls the maximum computational resource for distributed processing. It is recommended to use percentage expression. For example, if you have 2 Reality Server nodes, set PPF to 50% to utilize one machine for block adjustment and reality mapping product generation.

10. Check Process this image collection on server if you want to use Reality Server.

    

11. Accept all other default values and Click Next.

12. In the Image Collection window, under Exterior Orientation File / Esri Frames Table, browse to the tutorial data folder on your computer and the Nadir_Oblique_FramesCam.csv frames table file.

    This table, which contains the frames and cameras information, specifies parameters that are used to compute both the IO and EO for the camera and the imagery. In the block adjustment process, these approximate values are refined for greater accuracy.

    Ensure that the data paths listed in the raster column in the frame table file match the location of the image files on your computer.

13. Under Cameras, click the Import button , browse to the tutorial data folder on your computer, and select the Nadir_Oblique_FramesCam.csv file.

    For this tutorial, the Esri frame and camera tables are provided as a single file in the proper format. For other datasets, you may need to build and format the tables. For more information, see Frames table schema.

14. Ensure that the Spatial Reference and camera model values are correct.

    The default projection for the workspace is defined based on the imagery. This projection must match the coordinates used in the frames table, and it determines the spatial reference for the Reality products you create. For this dataset, you’ll use the projection defined in the frames and cameras table: XY – NAD83 2011 StatePlane California V FIPS 0405, VCS NAVD88 (meters).

15. Accept the other default values and click Next.

    

16. In the Lidar Collection window, accept default values and click Next.

    

17. In the Data Loader Options window, under DEM, click the browse button, browse to the tutorial data folder on your computer, and select the DEM_USGS_1m.tif file.

18. Accept the other default values and click Finish.

    

19. In the Remote Process window, provide description and tags for the image service and click Finish.

    

Once the workspace has been created, a Reality Mapping category will be added to the Contents pane, where the image collection image service and derived Reality mapping products service will be stored.

To see the image footprints, you can right click on the Image Collection in the Contents pane > Properties > Display > Check on Display Footprints.

The initial display of imagery in the workspace confirms that all images and necessary metadata were provided to initiate the workspace. The images have not been aligned or adjusted, so the mosaic may not appear geometrically correct. Note: You may need to zoom in close enough to see the image.

A new Reality Mapping tab will be added to the ArcGIS Pro main menu. Clicking this tab will expose a series of tools and workflows dedicated to Reality mapping. In the Product category, all the buttons are unavailable because the images are not yet adjusted.

Perform a block adjustment

After you create a Reality mapping workspace, the next step is to perform a block adjustment using the tools in the Adjust and Refine groups. The block adjustment will calculate tie points, which are common points in areas of image overlap. The tie points will then be used to calculate the orientation of each image, known as exterior orientation in photogrammetry.

To perform a block adjustment, complete the following steps:

1. On the Reality Mapping tab, in the Adjust group, click Adjust .

2. Ensure that all the Perform Camera Calibration options are checked.

   This indicates that the input focal length and lens distortion parameters are approximate and will be calculated during adjustment.

3. Expand the Advanced Options section.

4. Expand Tie Point Matching section.

5. Check the Full Pairwise Matching box.

   This option leverages Scale-Invariant Feature Transform (SIFT) algorithm to improve correlation accuracy when processing imagery with a high variability in scale, overlap, or low-quality initial orientation parameters.

6. Set the Tie Point Similarity to High.

7. Accept the default values for all the other settings, and click Run.

   

8. On the Reality Mapping tab, in the Review group, click Logs View to access this file.

   

   The units for tie point RSME is pixels.

Review the adjustment results

After performing a block adjustment, review the adjustment results and assess the quality of the adjustment. On the Reality Mapping tab, in the Review group, click Adjustment Report to generate adjustment statistics. The adjustment report provides a record of the adjustment and overall quality measures of the process.

Tip:

Using ground control points (GCPs) to improve the absolute accuracy is a best practice. However, GCPs were not available and are not included in this adjustment.

Generate Reality mapping products

Once the block adjustment is complete, 2D and 3D imagery products can be generated using the tools in the Product group on the Reality Mapping tab. Multiple products can be generated simultaneously using the Reality Mapping Products wizard or individually by selecting the applicable product tool from the Product group. The types of products that can be generated depends on various factors including the sensor, data flight configuration, and scenario type. The flight configuration of the sample dataset is a combination of oblique and nadir, which is ideal for 3D products such as point clouds and 3D meshes.

Note:

In this tutorial, two approaches to generate derived products are described below. One approach uses the Multiple Products wizard and the second uses the individually named product wizards listed in the Product group. It is recommended that you follow one or the other workflow approach, since doing both workflows is not required for this tutorial.

Note:

The Gaussian Splats product is not generated in this tutorial. See Generate Gaussian splats using ArcGIS Reality for ArcGIS Pro for requirements and details about generating the Gaussian Splats product.

Generate products using the Reality Mapping Multiple Products wizard

The Reality Mapping Products wizard guides you through the workflow to create one or multiple Reality mapping products in a single process. All generated products are stored in product folders of the same name under the Reality Mapping category in the Catalog pane.

To generate products using the Reality Mapping Multiple Products wizard, complete the following steps:

1. On the Reality Mapping tab, click the Multiple Products button in the Product group.

   The Reality Mapping Products Wizard window appears. In the Product Generation Settings pane, uncheck the 2D check box. In this tutorial, only 3D products are generated.

2. Click the Shared Advanced Settings button.

   The Advanced Products Settings dialog box appears, where you can define parameters that will impact the Reality mapping products to be generated. For details of the advanced product settings, see Shared Advanced Settings option.

3. Ensure that Quality is set to Ultra.

4. Ensure that Scenario is set to Oblique to match the image flight configuration.

5. Accept the Pixel Size default settings to generate products at source image resolution.

6. For Product Boundary, click the Browse button , browse to the tutorial data location, select Mesh_bdry feature data, and click OK.

   It is recommended that you provide a product boundary for the following reasons:

   • Define the proper output extent—When you do not define a product boundary, the application automatically defines an extent based on various dataset parameters that may not match the project extent.

   • Reduce processing time—If the required product extent is smaller than the image collection extent, defining a product boundary reduces the processing duration and automatically clips the output to the boundary extent.

   

7. Accept all the other default values and click OK.

   The Advanced Products Settings dialog box closes, and you return to the Product Generation Settings pane in the Reality Mapping Products wizard.

8. Click Next to go to the 3D Mesh Settings pane. Ensure SLPK is selected for Format.

9. Click Finish to start the product generation process.

   Once product generation is complete, the point cloud and 3D mesh products are added to the Reality Mapping container in the Point Cloud and Meshes folders, respectively. These are the scene layer services created at the server end.

10. To visualize the generated 3D mesh, right-click the Mesh for RM_3D_AerialTutorial file in the Meshes folder, and click Add to New > Local Scene in the drop-down menu.

11. To visualize the generated point cloud in a 3D perspective, right-click the Point Cloud for RM_3D_AerialTutorial in the Point Clouds folder in Catalog pane and click Add to New > Local Scene in the drop-down menu.

You can end the tutorial now or continue to generate derived products using the individual product options in the Product group. If you continue, previously generated products will be overwritten. To maintain previously created products, follow the instructions in the Create a Reality mapping workspace section above to create a new Reality mapping workspace before proceeding.

Generate product using the individual product option

Generate a point cloud

A point cloud is a model of the project area defined by high-density, RGB colorized 3D LAS points that are extracted from overlapping images in the block or project.

To generate a point cloud using the Reality Mapping Products wizard, complete the following steps:

1. On the Reality Mapping tab, click the 3D Point Cloud button in the Product group.

   The Reality Mapping Products Wizard window appears.

2. Click Shared Advanced Settings.

   The Advanced Product Settings dialog box appears, where you can define parameters that will impact the Reality mapping products to be generated. For details of the advanced product settings, see Shared Advanced Settings option.

3. Complete steps 3 through 7 in the Generate products using the Reality Mapping Multiple Products wizard section above.

4. Click Finish to start the point cloud generation process.

   Once product generation is complete, the point cloud product is added to the Catalog pane and the Reality Mapping container in the Point Cloud folder.

5. To visualize the generated point cloud in a 3D perspective, right-click the Point Cloud for RM_3D_AerialTutorial in the Point Clouds folder in the Contents pane and add it to a local scene or a global scene.

   

Generate a 3D Mesh

A 3D mesh is 3D textured model of the project area where the ground and above-ground feature facades are densely and accurately reconstructed. The 3D mesh can be viewed from any angle to get a realistic and accurate depiction of the project area.

To generate a 3D mesh using the Reality Mapping Products wizard, complete the following steps:

1. On the Reality Mapping tab, click the 3D Mesh button in the Product group.

   The Reality Mapping Products Wizard window appears.

2. Click Shared Advanced Settings.

   The Advanced Product Settings dialog box appears, where you can define parameters that will impact the Reality mapping products that you generate. For a detailed description of the advanced product settings, see Shared Advanced Settings option.

3. Complete steps 3 through 7 in the Generate products using the Reality Mapping Multiple Products wizard section above.

4. Click Next to go to the 3D Mesh Settings pane, and ensure that the parameter values match the following:

   • Format—SLPK

5. Click Finish to start the 3D mesh generation process.

   Once processing is complete, the 3D mesh product is added to the Catalog pane, the Reality Mapping container, and the Meshes folder.

6. To visualize the generated 3D mesh product, right-click the Mesh for RM_3D_AerialTutorial file in the Meshes folder, and from the drop-down menu, click Add to New > Local Scene.

   

Summary

In this tutorial, you connected to Reality Server and created a Reality mapping workspace for oblique digital aerial imagery and used tools on the Reality Mapping tab to apply a photogrammetric adjustment with ground control points. You then used tools in the Products group to generate point cloud and 3D mesh products.

Related topics

• Reality mapping in ArcGIS Pro using Reality Server

• Tutorial: Create drone imagery products in ArcGIS Pro using Reality Server

• Tutorial: Create 2D digital aerial imagery products in ArcGIS Pro using Reality Server

• Tutorial: Create a DSM product from satellite imagery in ArcGIS Pro using Reality Server