Bootstrap fails when including an "all-contents" file (Azure)

[Sean_Mackey]

I'm using the bootstrap module from here: PaloAltoNetworks/terraform-azurerm-vmseries-modules: Terraform Reusable Modules for VM-Series on Azu...

When deploying the bootstrap module in Azure with both bootstrap.xml and an "all-contents" file (e.g., panupv2-all-contents-8616-7550 downloaded from the support portal), the bootstrap fails, but the content update is successful. Deploying with bootstrap.xml alone, the bootstrap is successful.

Oddly, the earlier bootstrap logs suggest that the bootstrap files can all be found. Eventually it fails with "No bootstrap media detected." The Apps/Threats and Wildfire content succeeds, but the running config isn't fully updated. (some things are intact, like policies and address objects, but other things, like my interfaces, aren't fully configured)

Any idea what I should be double-checking here? The only suggestions I've found from searching online is to ensure that the management interface has a route to the Internet that does not go through the FW's other interfaces--and I've confirmed this is true here. The Vnet also has access to the storage account.

Output of debug logview component bts_details:

s1mp bts_details 2022-09-07 12:55:58: INFO: Running command: status []
s1mp bts_details 2022-09-07 12:43:33: ERROR: btsErrorSoftware: /mnt/install_media: have no mounted storage device.(7)
s1mp bts_details 2022-09-07 12:43:33: INFO: Running command: log ['5', 'Bootstrap failed']
s1mp bts_details 2022-09-07 12:43:18: ERROR: btsErrorSoftware: /mnt/install_media: have no mounted storage device.(7)
s1mp bts_details 2022-09-07 12:43:18: INFO: Running command: log ['5', 'Bootstrap failed']
s1mp bts_details 2022-09-07 12:43:03: ERROR: btsErrorSoftware: /mnt/install_media: have no mounted storage device.(7)
s1mp bts_details 2022-09-07 12:43:03: INFO: Running command: log ['5', 'Bootstrap failed']
s1mp bts_details 2022-09-07 12:42:49: ERROR: btsErrorSoftware: /mnt/install_media: have no mounted storage device.(7)
s1mp bts_details 2022-09-07 12:42:49: INFO: Running command: log ['5', 'Bootstrap failed']
s1mp bts_details 2022-09-07 12:42:33: ERROR: btsErrorSoftware: /mnt/install_media: have no mounted storage device.(7)
s1mp bts_details 2022-09-07 12:42:33: INFO: Running command: log ['5', 'Bootstrap failed']
s1mp bts_details 2022-09-07 12:42:15: ERROR: btsErrorSoftware: /mnt/install_media: have no mounted storage device.(7)
s1mp bts_details 2022-09-07 12:42:15: INFO: Running command: log ['5', 'Bootstrap failed']
s1mp bts_details 2022-09-07 12:41:47: ERROR: btsErrorSoftware: /mnt/install_media: have no mounted storage device.(7)
s1mp bts_details 2022-09-07 12:41:47: INFO: Running command: log ['2', 'Successfully installed Wildfire content']
s1mp bts_details 2022-09-07 12:41:40: ERROR: btsErrorSoftware: /mnt/install_media: have no mounted storage device.(7)
s1mp bts_details 2022-09-07 12:41:40: INFO: Running command: log ['2', 'Successfully installed Content']
s1mp bts_details 2022-09-07 09:40:10: ERROR: btsErrorSoftware: /mnt/install_media: have no mounted storage device.(7)
s1mp bts_details 2022-09-07 09:40:10: INFO: Running command: log ['2', 'Initial configuration processed from init cfg file.']
s1mp bts_details 2022-09-07 09:38:39: ERROR: btsErrorNoMedia: No Install media detected.(2)
s1mp bts_details 2022-09-07 09:38:38: DEBUG: Adding status: Media Detection Failed No bootstrap media detected.
s1mp bts_details 2022-09-07 09:38:38: DEBUG: Syslogging: /usr/local/bin/pan_elog -u 12 -e 201326619 -s critical -m "No bootstrap media detected." -x
s1mp bts_details 2022-09-07 09:38:38: ERROR: btsErrorNoMedia: No Install media detected.(2)
s1mp bts_details 2022-09-07 09:38:38: INFO: Failed to mount install media: 1 [] [] 3691
s1mp bts_details 2022-09-07 09:37:14: DEBUG: /mnt/install_media: already exists
s1mp bts_details 2022-09-07 09:37:14: INFO: Running command: detect []
s1mp bts_details 2022-09-07 09:34:13: ERROR: btsErrorMgmtReady: System upgrade state: management_ready, skip upgrade mode(9)
s1mp bts_details 2022-09-07 09:34:13: ERROR: btsErrorMgmtReady: System upgrade state: management_ready, skip upgrade mode(9)
s1mp bts_details 2022-09-07 09:34:13: DEBUG: Merging the init-cfg.txt for VM
s1mp bts_details 2022-09-07 09:34:13: DEBUG: Found generic meta file: /mnt/install_media/config/init-cfg.txt
s1mp bts_details 2022-09-07 09:34:13: INFO: Copying over latest init-cfg.txt for cloud
s1mp bts_details 2022-09-07 09:34:13: DEBUG: VM in cloud mode, skipping config
s1mp bts_details 2022-09-07 09:34:13: INFO: Bootstrap media sanity check passed
s1mp bts_details 2022-09-07 09:34:13: DEBUG: Adding status: Media Sanity Check Success Media sanity check successful
s1mp bts_details 2022-09-07 09:34:13: DEBUG: Syslogging: /usr/local/bin/pan_elog -u 12 -e 201326628 -s informational -m "Media sanity check successful" -x
s1mp bts_details 2022-09-07 09:34:13: DEBUG: VM in cloud mode, skipping config
s1mp bts_details 2022-09-07 09:34:13: DEBUG: Found generic meta file: /mnt/install_media/config/init-cfg.txt
s1mp bts_details 2022-09-07 09:34:13: DEBUG: (/bin/mount | /bin/grep /mnt/install_media): Install media detected: (['/dev/sda2 on /mnt/install_media type ext3 (rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=writeback)\n'] [])
s1mp bts_details 2022-09-07 09:34:13: DEBUG: Adding status: Media Detection Success Media detected successfully
s1mp bts_details 2022-09-07 09:34:13: DEBUG: Syslogging: /usr/local/bin/pan_elog -u 12 -e 201326627 -s informational -m "Media detected successfully" -x
s1mp bts_details 2022-09-07 09:34:13: INFO: Media detected, Starting media sanity check
s1mp bts_details 2022-09-07 09:34:13: DEBUG: Valid mounted media found.
s1mp bts_details 2022-09-07 09:34:13: DEBUG: Setup media logging
s1mp bts_details 2022-09-07 09:34:13: DEBUG: Successfully mounted the VM install media
s1mp bts_details 2022-09-07 09:34:13: DEBUG: (/bin/mount | /bin/grep /mnt/install_media): Install media detected: (['/dev/sda2 on /mnt/install_media type ext3 (rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=writeback)\n'] [])
s1mp bts_details 2022-09-07 09:34:11: DEBUG: /mnt/install_media: already exists
s1mp bts_details 2022-09-07 09:34:11: INFO: Running command: detect []
s1mp bts_details 2022-09-07 09:33:05: INFO: Device upgrade completed, performing software restart
s1mp bts_details 2022-09-07 09:33:00: DEBUG: Performing system sync for 5 seconds.
s1mp bts_details 2022-09-07 09:32:57: INFO: Infra bootstrapping completed successfully
s1mp bts_details 2022-09-07 09:32:57: INFO: Marking box configuration ready
s1mp bts_details 2022-09-07 09:32:57: DEBUG: All operational commands executed. Requesting system restart: False.
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Adding status: Operational Commands Success Operational command set jumbo mode completed successfully
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Syslogging: /usr/local/bin/pan_elog -u 12 -e 201326630 -s informational -m "Operational command set jumbo mode completed successfully" -x
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Setting up jumbo mode
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Runnig operational commands in init-cfg.txt
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Management prepare completed successfully.
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Content file copying: ['/mnt/install_media/content/panupv2-all-wildfire-696507-699850']
s1mp bts_details 2022-09-07 09:32:57: DEBUG: panup*-all-apps-* file not found on media
s1mp bts_details 2022-09-07 09:32:57: DEBUG: panup*-all-antivirus-* file not found on media
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Content file copying: ['/mnt/install_media/content/panupv2-all-contents-8616-7550']
s1mp bts_details 2022-09-07 09:32:57: DEBUG: authcodes file not found on media
s1mp bts_details 2022-09-07 09:32:57: DEBUG: decrypt.key file not found on media
s1mp bts_details 2022-09-07 09:32:57: DEBUG: vsys.key file not found on media
s1mp bts_details 2022-09-07 09:32:57: DEBUG: pa-vm.key file not found on media
s1mp bts_details 2022-09-07 09:32:57: DEBUG: url3.key file not found on media
s1mp bts_details 2022-09-07 09:32:57: DEBUG: url.key file not found on media
s1mp bts_details 2022-09-07 09:32:57: DEBUG: wildfire.key file not found on media
s1mp bts_details 2022-09-07 09:32:57: DEBUG: threats.key file not found on media
s1mp bts_details 2022-09-07 09:32:57: DEBUG: gpgateway.key file not found on media
s1mp bts_details 2022-09-07 09:32:57: DEBUG: gpportal.key file not found on media
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Copied /mnt/install_media/config/bootstrap.xml to /opt/pancfg/mgmt/saved-configs/running-config.xml
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Created directory: /opt/pancfg/mgmt/saved-configs
s1mp bts_details 2022-09-07 09:32:57: DEBUG: /opt/pancfg/mgmt/bootstrap/content/: created
s1mp bts_details 2022-09-07 09:32:57: DEBUG: /opt/pancfg/mgmt/bootstrap/: already exists
s1mp bts_details 2022-09-07 09:32:57: INFO: Copying over configuration files
s1mp bts_details 2022-09-07 09:32:57: DEBUG: VM in cloud mode, skipping config
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Merging the init-cfg.txt for VM
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Found generic meta file: /mnt/install_media/config/init-cfg.txt
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Starting management setup preparation
s1mp bts_details 2022-09-07 09:32:57: INFO: Preparing system of management ready state
s1mp bts_details 2022-09-07 09:32:57: INFO: Starting device bootstrapping
s1mp bts_details 2022-09-07 09:32:57: INFO: No valid software image is found on media.
s1mp bts_details 2022-09-07 09:32:57: INFO: Starting bootstrap...
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Valid mounted media found.
s1mp bts_details 2022-09-07 09:32:57: DEBUG: Setup media logging
s1mp bts_details 2022-09-07 09:32:57: INFO: Running command: upgrade []
s1mp bts_details 2022-09-07 09:32:57: INFO: Bootstrap log initialized
--------------------------------------------------------------------------------
s1mp bts_details 2022-09-07 09:32:45: INFO: Bootstrap media detection completed.

--------------------------------------------------------------------------------
s1mp bts_details 2022-09-07 09:32:45: INFO: System upgrade state: firstboot, starting upgrade mode
s1mp bts_details 2022-09-07 09:32:45: INFO: Bootstrap media sanity check passed
s1mp bts_details 2022-09-07 09:32:45: DEBUG: Adding status: Media Sanity Check Success Media sanity check successful
s1mp bts_details 2022-09-07 09:32:45: DEBUG: Syslogging: /usr/local/bin/pan_elog -u 12 -e 201326628 -s informational -m "Media sanity check successful" -x
s1mp bts_details 2022-09-07 09:32:45: INFO: No valid software image is found on media.
s1mp bts_details 2022-09-07 09:32:45: DEBUG: Performing image list validation
s1mp bts_details 2022-09-07 09:32:45: DEBUG: VM in cloud mode, skipping config
s1mp bts_details 2022-09-07 09:32:45: DEBUG: Found generic meta file: /mnt/install_media/config/init-cfg.txt
s1mp bts_details 2022-09-07 09:32:45: DEBUG: (/bin/mount | /bin/grep /mnt/install_media): Install media detected: (['/dev/sda2 on /mnt/install_media type ext3 (rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=writeback)\n'] [])
s1mp bts_details 2022-09-07 09:32:45: DEBUG: Adding status: Media Detection Success Media detected successfully
s1mp bts_details 2022-09-07 09:32:45: DEBUG: Syslogging: /usr/local/bin/pan_elog -u 12 -e 201326627 -s informational -m "Media detected successfully" -x
s1mp bts_details 2022-09-07 09:32:45: INFO: Media detected, Starting media sanity check
s1mp bts_details 2022-09-07 09:32:45: DEBUG: Valid mounted media found.
s1mp bts_details 2022-09-07 09:32:45: DEBUG: Setup media logging
s1mp bts_details 2022-09-07 09:32:45: DEBUG: Successfully mounted the VM install media
s1mp bts_details 2022-09-07 09:32:45: DEBUG: (/bin/mount | /bin/grep /mnt/install_media): Install media detected: (['/dev/sda2 on /mnt/install_media type ext3 (rw,relatime,errors=continue,user_xattr,acl,barrier=1,data=writeback)\n'] [])
s1mp bts_details 2022-09-07 09:32:43: DEBUG: /mnt/install_media: created
s1mp bts_details 2022-09-07 09:32:43: INFO: Running command: detect []
s1mp bts_details 2022-09-07 09:32:43: INFO: Bootstrap log initialized
--------------------------------------------------------------------------------