topic Re: Is the conversionupdate server having an issue? in Expedition Discussions

Is the conversionupdate server having an issue?

JeremyEdge — Fri, 22 Oct 2021 14:54:59 GMT

I attempted to do a fresh install last night and when the script attempts to install the GPG key, it's receiving a 404.

####################
Installing Expedition debian repository

--2021-10-21 23:36:37-- https://conversionupdates.paloaltonetworks.com/ex-repo.gpg
Resolving conversionupdates.paloaltonetworks.com (conversionupdates.paloaltonetworks.com)... 199.167.52.71
Connecting to conversionupdates.paloaltonetworks.com (conversionupdates.paloaltonetworks.com)|199.167.52.71|:443... connected.
HTTP request sent, awaiting response... 404 Not Found

####################

A little further down, it attempts to install the .deb file from the same server and it's unable to extract the components it needs.

####################

<snip>
--2021-10-21 23:37:37-- https://conversionupdates.paloaltonetworks.com/ex-repo.gpg
Resolving conversionupdates.paloaltonetworks.com (conversionupdates.paloaltonetworks.com)... 199.167.52.71
Connecting to conversionupdates.paloaltonetworks.com (conversionupdates.paloaltonetworks.com)|199.167.52.71|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2021-10-21 23:37:38 ERROR 404: Not Found.

spawn apt-get install -y --allow-unauthenticated expedition-beta
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following NEW packages will be installed:
expedition-beta
0 upgraded, 1 newly installed, 0 to remove and 34 not upgraded.
Need to get 0 B/17.5 MB of archives.
After this operation, 0 B of additional disk space will be used.
E: Invalid archive member header
E: Prior errors apply to /var/cache/apt/archives/expedition-beta_1.2.0_amd64.deb
debconf: apt-extracttemplates failed: No such file or directory
(Reading database ... 89693 files and directories currently installed.)
Preparing to unpack .../expedition-beta_1.2.0_amd64.deb ...
Unpacking expedition-beta (1.2.0) ...
dpkg-deb (subprocess): cannot copy archive member from '/var/cache/apt/archives/expedition-beta_1.2.0_amd64.deb' to decompressor pipe: unexpected end of file or stream
dpkg-deb (subprocess): decompressing archive member: lzma error: unexpected end of input
dpkg-deb: error: <decompress> subprocess returned error exit status 2
dpkg: error processing archive /var/cache/apt/archives/expedition-beta_1.2.0_amd64.deb (--unpack):
cannot copy extracted data for './var/www/html/OS/spark/extraLibraries/kafka-clients-0.10.2.1.jar' to '/var/www/html/OS/spark/extraLibraries/kafka-clients-0.10.2.1.jar.dpkg-new': unexpected end of file or stream
Errors were encountered while processing:
/var/cache/apt/archives/expedition-beta_1.2.0_amd64.deb
E: Sub-process /usr/bin/dpkg returned an error code (1)
<snip>

####################

The script doesn't detect this error but the results end up being that there isn't any content in the Apache server when you hit the web page. Based on the error, i went and deleted the '/var/cache/apt/archives/expedition-beta_1.2.0_amd64.deb' and tried to manually 'apt-get install expedition-beta', but it also produced the same result.

Re: Is the conversionupdate server having an issue?

JeremyEdge — Fri, 22 Oct 2021 15:01:19 GMT

As a side note, my current partner account and previous partner account isn't able to authenticate to the LIVEcommunity site. It's giving HTTP 500 errors after the password step. I ended up creating this guest account just to get this question posted.

Re: Is the conversionupdate server having an issue?

lychiang — Fri, 22 Oct 2021 15:21:59 GMT

Hi ,

This issue should be resolved now, please try again.

Re: Is the conversionupdate server having an issue?

JeremyEdge — Fri, 22 Oct 2021 16:30:21 GMT

Is the mirror still syncing from your changes? I tried to import the GPG using the command from the install script. Then attempted to delete the .deb. Finally tried to do the install. No dice on any of it but the error seems different now.
#############

root@expedition:~# wget https://conversionupdates.paloaltonetworks.com/ex-repo.gpg > /etc/apt/trusted.gpg.d/ex-repo.gpg
--2021-10-22 16:26:19-- https://conversionupdates.paloaltonetworks.com/ex-repo.gpg
Resolving conversionupdates.paloaltonetworks.com (conversionupdates.paloaltonetworks.com)... 199.167.52.71
Connecting to conversionupdates.paloaltonetworks.com (conversionupdates.paloaltonetworks.com)|199.167.52.71|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2021-10-22 16:26:19 ERROR 404: Not Found.

root@expedition:~#
root@expedition:~#
root@expedition:~# rm /var/cache/apt/archives/expedition-beta_1.2.0_amd64.deb
rm: cannot remove '/var/cache/apt/archives/expedition-beta_1.2.0_amd64.deb': No such file or directory
root@expedition:~#
root@expedition:~#
root@expedition:~# apt-get install expedition-beta
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following NEW packages will be installed:
expedition-beta
0 upgraded, 1 newly installed, 0 to remove and 34 not upgraded.
Need to get 17.5 MB of archives.
After this operation, 0 B of additional disk space will be used.
Get:1 https://conversionupdates.paloaltonetworks.com expedition-updates/ expedition-beta 1.2.0 [17.5 MB]
Err:1 https://conversionupdates.paloaltonetworks.com expedition-updates/ expedition-beta 1.2.0
File has unexpected size (44070858 != 17465344). Mirror sync in progress? [IP: 199.167.52.71 443]
Hashes of expected file:
- SHA256:b7401812743f37d170da4a72985bd4c6ee045b0e19f41a026862a2d8481185c1
- SHA1:fd14fd7bd107c585137f6631c4d8fa92716d1785 [weak]
- MD5Sum:608b9b18bc20af3a8f2c7cc51f83b620 [weak]
- Filesize:17465344 [weak]
E: Failed to fetch https://conversionupdates.paloaltonetworks.com/expedition-updates//expedition_1.2.0.all.deb File has unexpected size (44070858 != 17465344). Mirror sync in progress? [IP: 199.167.52.71 443]
Hashes of expected file:
- SHA256:b7401812743f37d170da4a72985bd4c6ee045b0e19f41a026862a2d8481185c1
- SHA1:fd14fd7bd107c585137f6631c4d8fa92716d1785 [weak]
- MD5Sum:608b9b18bc20af3a8f2c7cc51f83b620 [weak]
- Filesize:17465344 [weak]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

Re: Is the conversionupdate server having an issue?

azuniga — Fri, 22 Oct 2021 17:28:18 GMT

Hello @JeremyEdge

Why not just run "sudo apt-get install expedition-beta" since it has the latest package anyways?

Re: Is the conversionupdate server having an issue?

azuniga — Fri, 22 Oct 2021 17:34:52 GMT

You can also use the following url.

sudo wget https://conversionupdates.paloaltonetworks.com/expedition-updates/expedition_1.2.0.all.deb

Re: Is the conversionupdate server having an issue?

JeremyEdge — Fri, 22 Oct 2021 18:24:50 GMT

If you refer to my command output above after @lychiang said it was resolved, you'll notice that's the command I'm running that is generating the new error. I'm also running it as root so i don't have to use sudo.

Re: Is the conversionupdate server having an issue?

JeremyEdge — Fri, 22 Oct 2021 18:28:08 GMT

I attempted that method last night and used dpkg to attempt to install it. The method generated the same error that i originally reported. I'll reattempt it and report back if it generates a different behavior than previously observed.

Re: Is the conversionupdate server having an issue?

JeremyEdge — Fri, 22 Oct 2021 19:08:11 GMT

Manual install of the deb file appears to be successful after using the command you mentioned below to download it.

"cd /tmp"

"sudo wget https://conversionupdates.paloaltonetworks.com/expedition-updates/expedition_1.2.0.all.deb"

"sudo dpkg -i expedition_1.2.0.all.deb"

Afterwards, in the web interface, it was complaining about a python os dependency, but i used the below command that it referenced to deploy.

"sh /var/www/html/OS/BPA/updateBPA306.sh"

Hopefully the conversionupdates server can be straightened out so that no one else has to go through these hoops.

Re: Is the conversionupdate server having an issue?

azuniga — Fri, 22 Oct 2021 20:01:14 GMT

Hello @JeremyEdge

Yes we are looking into it.