ITAT086E Failed to execute configure distributed queues.

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Announcements

Welcome Idira to LIVEcommunity!

Our community just got stronger! Explore new identity security resources, connect with experts, and discover more ways to learn and collaborate.

Meet Idira

ITAT086E Failed to execute configure distributed queues.

L4 Transporter

I am trying to install the Primary vault of Distributed vault system. I am getting this error when I run the below command as per the documentation.

0682J00000HBZR9QAP.jpgCAVaultManager ConfigureAsMaster /ConfigureDistributedQueues /CACertPath "c:\desktop\root.cer"

 

What could be the reason? TIA

10 REPLIES 10

L7 Applicator

vaultp.cer is directly signed by certnew.cer? No intermediates?

 

Personally I've never seen the error with "rabbitmqctl.bat" before, but I know that Distributed Queues is a PITA to troubleshoot. I would check all of the RabbitMQ-specific logfiles and then work your way back from there:

  • C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\logs\
  • C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\RabbitMQ Configurator\Logs\
  • C:\ProgramData\RabbitMQ\log\
  • C:\ProgramData\RabbitMQ\log\log\

Yes vaultp.cer is signed by certnew.cer. When I check the Queue service, it is disabled in both Primary and Satellite Vaults and not running. Is it the normal behavior? I will check this logs. Thanks

L4 Transporter

I also check the log files you mentioned. only C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\logs\ is there. other logs files not available or empty. Here I attached the available log but there is no error in that.

 

L4 Transporter
[CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : Command Line is = [C:\Program Files (x86)\PrivateArk\Server\RabbitMQTempDir\rabbitMQConfig.ini] [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : Setting 'CONFIG_FILE' to [C:\Program Files (x86)\PrivateArk\Server\RabbitMQTempDir\rabbitMQConfig.ini] [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : MSI version: 12.02.00.14 [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : MSI package: Erlang 10.2 [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : MSI package: RabbitMQ 3.7.14 [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : Value for parent \SOFTWARE\Wow6432Node\CyberArk\PrivateArk\Server\: 12.02.00 [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : Found installed Vault version 12.02.00 [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : Base Installation Directory = [C:\Program Files (x86)\PrivateArk\Server] [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : Changed TARGETDIR => [C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework] [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : Didn't locate existing key in \SOFTWARE\Wow6432Node\Ericsson\Erlang\ [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : Installing Erlang 10.2. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : Starting OTP Installation... [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:00:53] : Installing OPT-ERLNG Framework... [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:23] : Validating that ERLG server is installed at => C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\erl10.2\ [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:23] : ERLG framework installed successfully. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:23] : Finished OTP Installation. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:23] : Successfully copied [C:\Users\ADMINI~1\AppData\Local\Temp\{DF863C7B-9F63-459C-9575-0BA75C94C91D}\{6BEAB9A4-E21A-4433-ABB7-33EA40FE237D}\calibeay64102o.dll] to [C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\erl10.2\erts-10.2\bin\calibeay64102o.dll] [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:23] : Successfully copied [C:\Users\ADMINI~1\AppData\Local\Temp\{DF863C7B-9F63-459C-9575-0BA75C94C91D}\{6BEAB9A4-E21A-4433-ABB7-33EA40FE237D}\cassleay64102o.dll] to [C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\erl10.2\erts-10.2\bin\cassleay64102o.dll] [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:23] : Before Erlang environment variables refresh. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:23] : setting ERLANG_HOME to C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\erl10.2 [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:23] : excuting command 'cmd.exe /c "setx /m ERLANG_HOME "C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\erl10.2" "' [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:23] : After Erlang environment variables refresh. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:23] : Before re-installing RabbitMQ service [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:23] : Error: Unable to get RabbitMQ installed version from registry [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:23] : Erlang installed successfully. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:24] : Coping rabbitmq configuration files.. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:24] : Running command => [cmd.exe /c "mkdir.exe %ALLUSERSPROFILE%\RabbitMQ\ & exit" & timeout /5 & exit] [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:25] : Running command => [xcopy.exe /c "xcopy.exe /Y /R "C:\Users\ADMINI~1\AppData\Local\Temp\{DF863C7B-9F63-459C-9575-0BA75C94C91D}\{6BEAB9A4-E21A-4433-ABB7-33EA40FE237D}\"rabbitmq.conf %ALLUSERSPROFILE%\RabbitMQ\ >> %ALLUSERSPROFILE%\RabbitMQ\filecopy_1.tmp"] [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:25] : Running command => [xcopy.exe /c "xcopy.exe /Y /R "C:\Users\ADMINI~1\AppData\Local\Temp\{DF863C7B-9F63-459C-9575-0BA75C94C91D}\{6BEAB9A4-E21A-4433-ABB7-33EA40FE237D}\"advanced.config %ALLUSERSPROFILE%\RabbitMQ\ >> %ALLUSERSPROFILE%\RabbitMQ\filecopy_1.tmp"] [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:25] : Done copying files. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:25] : Installing RabbitMQ 3.7.14. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:25] : Starting RabbitMQ Installation... [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:25] : Installing RabbitMQ... [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:49] : Validating that RabbitMQ service 'RabbitMQ' exists. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:50] : Current 'RabbitMQ' service state is : service stopped [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:50] : RabbitMQ installed successfully. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:50] : Finished RabbitMQ Installation. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:50] : Before RabbitMQ environment variables refresh. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:50] : excuting command 'cmd.exe /c "setx /m RABBITMQ_HOME "C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\RabbitMQ Server\rabbitmq_server-3.7.14\\" "' [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:50] : excuting command 'cmd.exe /c "setx /m RABBITMQ_CONFIGURATION_FOLDER "C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\configuration\\" "' [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:50] : After RabbitMQ environment variables refresh. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:50] : RabbitMQ installed successfully. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:52] : Installing RabbitMQ Configurator... [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:55] : Finished RabbitMQ Configurator Installation. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:55] : Running post installation actions... [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:57] : Adding values to '\HKEY_LOCAL_MACHINE\\SOFTWARE\Wow6432Node\CyberArk\PrivateArk\Rabbit MQ Installer\\' [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : RegDBSetKeyValue added. -> [RabbitMQInstallPath] = [C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\RabbitMQ Server\] [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : RegDBSetKeyValue added. -> [ERLGInstallPath] = [C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\erl10.2\] [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : RegDBSetKeyValue added. -> [RabbitMQFrameworkInstallPath] = [C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework] [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : Creating RabbitMQ Configurator service [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : Disabling RabbitMQ Configurator service [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : Stopping RabbitMQ service... [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : Current 'RabbitMQ' service state is : service stopped [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : 'RabbitMQ' stopped. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : Finished stopping 'RabbitMQ' [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : Creating RabbitMQ Configurator service [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : Disabling RabbitMQ Configurator service [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : Coping erlg cookie, command -> xcopy.exe '/Y /R "C:\Windows\SysWOW64\config\systemprofile\.erlang.cookie" %USERPROFILE%\.erlang.cookie' [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : Reading properties from registry... '\HKEY_LOCAL_MACHINE\\SYSTEM\ControlSet001\Services\RabbitMQ\\' [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : RabbitMQ dependency cleared. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : Disabling RabbitMQ service... [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:01:59] : sc.exe config RabbitMQ START= disabled [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:02:00] : Clear dependencies for 'RabbitMQ' [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:02:00] : sc.exe config RabbitMQ depend= "" [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:02:00] : Clear dependencies for 'RabbitMQConfigurator' [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:02:00] : sc.exe config RabbitMQConfigurator depend= "" [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:02:00] : Adding dependencies for 'RabbitMQConfigurator' to 'CyberArk Logic Container' [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:02:00] : sc.exe config RabbitMQConfigurator depend= "CyberArk Logic Container" [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:02:00] : Changing service description... [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:02:00] : Finished successfully installing RabbitMQ framework. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:02:00] : setReturnValues: CONFIG_FILE='C:\Program Files (x86)\PrivateArk\Server\RabbitMQTempDir\rabbitMQConfig.ini' [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:02:00] : Setting return values: returnCode =0 returnMessage='Finished successfully installing RabbitMQ framework.' [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:02:00] : Post installation actions completed successfully. [CyberArk-RabbitMQInstaller] 12-8-2021 - 12:02:02] : Running command => [xcopy.exe /Y /R "C:\Program Files (x86)\CyberArk\Rabbit MQ Installer\logs\"install_rabbitmq_installer_log_12-8-2021_12_00_53.log "C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\logs\"]

 

L4 Transporter

I also enabled queue services in both primary and satellite and start but after some time both services were stopped. Below I attached the logs for each server.

L4 Transporter

Pimary

\config.ini: [Main] Mode=Master MasterAddress=10.0.0.5 MyAddress=10.0.0.5 MyID=1638944699-1638954810 TopologyStatusIntervalInSec=30   08-12-2021 17:53:52 | 3096 | DEBUG | CAR: Starting periodic key rotation for user RBTMQC-1638944699 08-12-2021 17:53:52 | 3096 | DEBUG | CAR: Starting periodic key rotation for user Shovel-1638944699 08-12-2021 17:53:52 | 3096 | DEBUG | CAR: Generating JWT token for user RBTMQC-1638944699, valid from 12/8/2021 12:23:52 PM until 12/8/2021 12:28:52 PM 08-12-2021 17:53:52 | 3096 | DEBUG | CAR: Signing JWT token for user RBTMQC-1638944699 with New key version 08-12-2021 17:53:53 | 3096 | DEBUG | CAR: Generating JWT token for user RBTMQC-1638944699, valid from 12/8/2021 12:23:53 PM until 12/8/2021 12:28:53 PM 08-12-2021 17:53:53 | 3096 | DEBUG | CAR: Signing JWT token for user RBTMQC-1638944699 with Old key version 08-12-2021 17:53:53 | 3096 | INFO | RBTMQCCS029I: RabbitMQ Configurator Controller Server started, listening on port 56721 08-12-2021 17:53:55 | 3096 | INFO | RBTMQCCS001I: Starting the CyberArk Queue Configuration Service service 08-12-2021 17:53:55 | 3096 | INFO | RBTMQCCS003I: Service configured in Master mode 08-12-2021 17:53:55 | 3096 | DEBUG | RBTMQCTR034D: RabbitMQ certificate passphrase file was read successfully 08-12-2021 17:53:55 | 3096 | DEBUG | RBTMQCTR035D: RabbitMQ certificate passphrase file was decrypted successfully 08-12-2021 17:53:55 | 3096 | DEBUG | RBTMQCTR038D: File 'C:\ProgramData\RabbitMQ\rabbitmq.conf' was protected successfully 08-12-2021 17:53:55 | 3096 | DEBUG | RBTMQCTR044D: Directory 'C:\ProgramData\RabbitMQ\config' was protected successfully 08-12-2021 17:53:55 | 3096 | DEBUG | RBTMQCTR038D: File 'C:\ProgramData\RabbitMQ\RabbitMQCert-protected.pvk' was protected successfully 08-12-2021 17:53:55 | 3096 | DEBUG | RBTMQCTR036D: RabbitMQ certificate was written successfully 08-12-2021 17:53:55 | 3096 | DEBUG | RBTMQCTR037D: RabbitMQ certificate passphrase was written successfully 08-12-2021 17:53:55 | 3096 | INFO | RBTMQCTR040D: Making RabbitMQ certificate accessible completed successfully 08-12-2021 17:53:55 | 3096 | INFO | RBTMQCTR042I: Starting RabbitMQ service... 08-12-2021 17:53:55 | 3096 | ERROR | RBTMQCCS058E: Failed to start RabbitMQ service. Reason: Cannot start service RabbitMQ on computer '.'. 08-12-2021 17:53:55 | 3096 | INFO | RBTMQCTR033I: Waiting for connection with RabbitMQ broker to be established... 08-12-2021 17:53:55 | 3096 | INFO | EasyNetQ: Trying to connect to message queue... 08-12-2021 17:53:55 | 3096 | INFO | EasyNetQ: Message broker parameters are: MessageBrokerParameters: Hosts: localhost CredentialProvider: valid Port: 5672 UseTLS: False HeartBeatRequestsSec: 60 NumConnectionRetries: 1 VirtualHost:/ TimeoutSec:10 RabbitClientName:CyberArk Queue Configuration Service 08-12-2021 17:53:56 | 3096 | DEBUG | EasyNetQ: Trying to connect 08-12-2021 17:53:56 | 3096 | INFO | EasyNetQ: Context: Main Context, Entring Reset 08-12-2021 17:53:56 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:0 , Using Old Pass :False 08-12-2021 17:53:56 | 3096 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:53:56 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:0 , Using Old Pass :False 08-12-2021 17:53:56 | 3096 | INFO | CAR: Key rotation for user RBTMQC-1638944699 completed successfully. 08-12-2021 17:53:56 | 3096 | DEBUG | CAR: Waiting 86400 seconds until the next periodic key rotation 08-12-2021 17:53:57 | 3096 | INFO | CAR: Key rotation for user Shovel-1638944699 completed successfully. 08-12-2021 17:53:57 | 3096 | DEBUG | RBTMQCTR051I: Shovel key rotated, new token will be generated when declaring the shovel 08-12-2021 17:53:57 | 3096 | DEBUG | CAR: Waiting 86400 seconds until the next periodic key rotation 08-12-2021 17:53:58 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:0 , Using Old Pass :False 08-12-2021 17:53:58 | 3096 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:53:58 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:0 , Using Old Pass :False 08-12-2021 17:53:58 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:0 , Using Old Pass :False 08-12-2021 17:53:58 | 3096 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:53:58 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:0 , Using Old Pass :False 08-12-2021 17:53:59 | 3096 | ERROR | EasyNetQ: Failed to connect to broker localhost, port 5672, vhost / Additional information: None of the specified endpoints were reachable 08-12-2021 17:53:59 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Loop # 1,Entring Next -->>> Item:0,Using Old Pass:False 08-12-2021 17:53:59 | 3096 | INFO | EasyNetQ: Context: Main Context, Failing over to host: localhost 08-12-2021 17:53:59 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Exiting Next -->>> Item:0 , Using Old Pass : True 08-12-2021 17:53:59 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:0 , Using Old Pass :True 08-12-2021 17:53:59 | 3096 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:53:59 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:0 , Using Old Pass :True 08-12-2021 17:54:01 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:0 , Using Old Pass :True 08-12-2021 17:54:01 | 3096 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:54:01 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:0 , Using Old Pass :True 08-12-2021 17:54:01 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:0 , Using Old Pass :True 08-12-2021 17:54:01 | 3096 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:54:01 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:0 , Using Old Pass :True 08-12-2021 17:54:01 | 3096 | ERROR | EasyNetQ: Failed to connect to broker localhost, port 5672, vhost / Additional information: None of the specified endpoints were reachable 08-12-2021 17:54:01 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Loop # 1,Entring Next -->>> Item:0,Using Old Pass:True 08-12-2021 17:54:01 | 3096 | INFO | EasyNetQ: Context: Main Context, Failing over to host: localhost

 

L4 Transporter
08-12-2021 17:58:30 | 3096 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:58:30 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:1 , Using Old Pass :False 08-12-2021 17:58:30 | 3096 | ERROR | EasyNetQ: Failed to connect to broker localhost, port 5672, vhost / Additional information: None of the specified endpoints were reachable 08-12-2021 17:58:30 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Loop # 8,Entring Next -->>> Item:1,Using Old Pass:False 08-12-2021 17:58:30 | 3096 | INFO | EasyNetQ: Context: Main Context, Failing over to host: localhost 08-12-2021 17:58:30 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Exiting Next -->>> Item:1 , Using Old Pass : True 08-12-2021 17:58:30 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:1 , Using Old Pass :True 08-12-2021 17:58:30 | 3096 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:58:30 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:1 , Using Old Pass :True 08-12-2021 17:58:32 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:1 , Using Old Pass :True 08-12-2021 17:58:32 | 3096 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:58:32 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:1 , Using Old Pass :True 08-12-2021 17:58:32 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:1 , Using Old Pass :True 08-12-2021 17:58:32 | 3096 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:58:32 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:1 , Using Old Pass :True 08-12-2021 17:58:32 | 3096 | ERROR | EasyNetQ: Failed to connect to broker localhost, port 5672, vhost / Additional information: None of the specified endpoints were reachable 08-12-2021 17:58:32 | 3096 | DEBUG | EasyNetQ: Context: Main Context, Loop # 8,Entring Next -->>> Item:1,Using Old Pass:True 08-12-2021 17:58:32 | 3096 | ERROR | EasyNetQ: Failed to connect to any Broker. Retrying in 00:00:30 08-12-2021 17:58:55 | 3096 | FATAL | RBTMQCCS026F: Failed to establish a connection to RabbitMQ: System.TimeoutException: The operation has timed out. at RAC.RabbitAPI.RabbitClient.RabbitClient.WaitForConnection(TimeSpan timeout) at RAC.RabbitAPI.RabbitClient.RabbitClient.ConnectToBroker() 08-12-2021 17:58:55 | 3096 | FATAL | RBTMQCCS049F: Stopping service due to Advanced Bus initiation error 08-12-2021 17:58:55 | 3096 | FATAL | RBTMQCTR052F: Initializing RabbitMQ connection failed. Reason: System.AggregateException: One or more errors occurred. ---> System.TimeoutException: The operation has timed out. at RAC.RabbitAPI.RabbitClient.RabbitClient.WaitForConnection(TimeSpan timeout) at RAC.RabbitAPI.RabbitClient.RabbitClient.ConnectToBroker() at RAC.RabbitAPI.RabbitManager.InitializePrimaryRabbitSetup(Action`1 handler) at RAC.Setup.RACRoleBase.Start() at System.Threading.Tasks.Task.Execute() --- End of inner exception stack trace --- ---> (Inner Exception #0) System.TimeoutException: The operation has timed out. at RAC.RabbitAPI.RabbitClient.RabbitClient.WaitForConnection(TimeSpan timeout) at RAC.RabbitAPI.RabbitClient.RabbitClient.ConnectToBroker() at RAC.RabbitAPI.RabbitManager.InitializePrimaryRabbitSetup(Action`1 handler) at RAC.Setup.RACRoleBase.Start() at System.Threading.Tasks.Task.Execute()<---   08-12-2021 17:58:55 | 3096 | INFO | RBTMQCCS002I: Stopping the CyberArk Queue Configuration Service service 08-12-2021 17:58:55 | 3096 | INFO | RBTMQCCS038I: RabbitMQ Configurator Controller Server stopped 08-12-2021 17:58:55 | 3096 | INFO | RBTMQCCS013I: Stopping the 'RabbitMQConfigurator' application 08-12-2021 17:58:55 | 3096 | DEBUG | RBTMQCTR039D: File 'C:\ProgramData\RabbitMQ\rabbitmq.conf' was deleted successfully 08-12-2021 17:58:55 | 3096 | DEBUG | RBTMQCTR047D: Reverting basic configuration to rabbitmq.conf completed successfully 08-12-2021 17:58:55 | 3096 | DEBUG | RBTMQCTR039D: File 'C:\ProgramData\RabbitMQ\RabbitMQCert-protected.pvk' was deleted successfully 08-12-2021 17:58:55 | 3096 | INFO | RBTMQCCS039I: Service stopped

 

L4 Transporter

Satellite

08-12-2021 17:52:13 | 1972 | INFO | RBTMQCCS019I: Reading RabbitMQ Configurator configuration from C:\Program Files (x86)\PrivateArk\Server\Rabbit MQ Framework\RabbitMQ Configurator\Conf\config.ini: [Main] Mode=Slave MasterAddress=10.0.0.5 MyAddress=10.0.0.6 MyID=1638814502-1638957268 TopologyStatusIntervalInSec=30   08-12-2021 17:52:14 | 1972 | DEBUG | CAR: Starting periodic key rotation for user RBTMQC-1638814502 08-12-2021 17:52:14 | 1972 | DEBUG | CAR: Starting periodic key rotation for user Shovel-1638814502 08-12-2021 17:52:14 | 1972 | INFO | RBTMQCCS048I: Key rotation process was initiated for user 'RBTMQC-1638814502' 08-12-2021 17:52:14 | 1972 | INFO | RBTMQCTR029I: Updating authentication key for user RBTMQC-1638814502 with public key 'MIIBSzCCAQMGByqGSM49AgEwgfcCAQEwLAYHKoZIzj0BAQIhAP////8AAAABAAAAAAAAAAAAAAAA////////////////MFsEIP////8AAAABAAAAAAAAAAAAAAAA///////////////8BCBaxjXYqjqT57PrvVV2mIa8ZR0GsMxTsPY7zjw+J9JgSwMVAMSdNgiG5wSTamZ44ROdJreBn36QBEEEaxfR8uEsQkf4vOblY6RA8ncDfYEt6zOg9KE5RdiYwpZP40Li/hp/m47n60p8D54WK84zV2sxXs7LtkBoN79R9QIhAP////8AAAAA//////////+85vqtpxeehPO5ysL8YyVRAgEBA0IABJj/0j1SEJCfOnZ+GqxOylXoOexjNtoqXbveXp99bBlbunjmjIcROUnTwe4ZFzVFXrcQ+dOj9JyrM+JIAOut7OE=' and public key algorithm 'ES256' 08-12-2021 17:52:14 | 1972 | DEBUG | CAR: Generating JWT token for user RBTMQC-1638814502, valid from 12/8/2021 12:22:14 PM until 12/8/2021 12:27:14 PM 08-12-2021 17:52:14 | 1972 | DEBUG | CAR: Signing JWT token for user RBTMQC-1638814502 with New key version 08-12-2021 17:52:15 | 1972 | DEBUG | CAR: Generating JWT token for user RBTMQC-1638814502, valid from 12/8/2021 12:22:15 PM until 12/8/2021 12:27:15 PM 08-12-2021 17:52:15 | 1972 | DEBUG | CAR: Signing JWT token for user RBTMQC-1638814502 with Old key version 08-12-2021 17:52:15 | 1972 | INFO | RBTMQCCS029I: RabbitMQ Configurator Controller Server started, listening on port 56721 08-12-2021 17:52:19 | 1972 | INFO | RBTMQCCS001I: Starting the CyberArk Queue Configuration Service service 08-12-2021 17:52:19 | 1972 | INFO | RBTMQCCS003I: Service configured in Slave mode 08-12-2021 17:52:19 | 1972 | DEBUG | RBTMQCTR034D: RabbitMQ certificate passphrase file was read successfully 08-12-2021 17:52:19 | 1972 | DEBUG | RBTMQCTR035D: RabbitMQ certificate passphrase file was decrypted successfully 08-12-2021 17:52:19 | 1972 | DEBUG | RBTMQCTR038D: File 'C:\ProgramData\RabbitMQ\rabbitmq.conf' was protected successfully 08-12-2021 17:52:19 | 1972 | DEBUG | RBTMQCTR044D: Directory 'C:\ProgramData\RabbitMQ\config' was protected successfully 08-12-2021 17:52:19 | 1972 | DEBUG | RBTMQCTR038D: File 'C:\ProgramData\RabbitMQ\RabbitMQCert-protected.pvk' was protected successfully 08-12-2021 17:52:19 | 1972 | DEBUG | RBTMQCTR036D: RabbitMQ certificate was written successfully 08-12-2021 17:52:19 | 1972 | DEBUG | RBTMQCTR037D: RabbitMQ certificate passphrase was written successfully 08-12-2021 17:52:19 | 1972 | INFO | RBTMQCTR040D: Making RabbitMQ certificate accessible completed successfully 08-12-2021 17:52:19 | 1972 | INFO | RBTMQCTR042I: Starting RabbitMQ service... 08-12-2021 17:52:19 | 1972 | ERROR | RBTMQCCS058E: Failed to start RabbitMQ service. Reason: Cannot start service RabbitMQ on computer '.'. 08-12-2021 17:52:19 | 1972 | INFO | RBTMQCTR033I: Waiting for connection with RabbitMQ broker to be established... 08-12-2021 17:52:20 | 1972 | INFO | EasyNetQ: Trying to connect to message queue... 08-12-2021 17:52:20 | 1972 | INFO | EasyNetQ: Message broker parameters are: MessageBrokerParameters: Hosts: localhost CredentialProvider: valid Port: 5672 UseTLS: False HeartBeatRequestsSec: 60 NumConnectionRetries: 1 VirtualHost:/ TimeoutSec:10 RabbitClientName:CyberArk Queue Configuration Service 08-12-2021 17:52:24 | 1972 | DEBUG | EasyNetQ: Trying to connect 08-12-2021 17:52:24 | 1972 | INFO | EasyNetQ: Context: Main Context, Entring Reset 08-12-2021 17:52:24 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:0 , Using Old Pass :False 08-12-2021 17:52:24 | 1972 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:52:24 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:0 , Using Old Pass :False 08-12-2021 17:52:27 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:0 , Using Old Pass :False 08-12-2021 17:52:27 | 1972 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:52:27 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:0 , Using Old Pass :False 08-12-2021 17:52:27 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:0 , Using Old Pass :False 08-12-2021 17:52:27 | 1972 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:52:27 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:0 , Using Old Pass :False 08-12-2021 17:52:27 | 1972 | ERROR | EasyNetQ: Failed to connect to broker localhost, port 5672, vhost / Additional information: None of the specified endpoints were reachable 08-12-2021 17:52:27 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Loop # 1,Entring Next -->>> Item:0,Using Old Pass:False 08-12-2021 17:52:27 | 1972 | INFO | EasyNetQ: Context: Main Context, Failing over to host: localhost 08-12-2021 17:52:27 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Exiting Next -->>> Item:0 , Using Old Pass : True 08-12-2021 17:52:27 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:0 , Using Old Pass :True 08-12-2021 17:52:27 | 1972 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:52:27 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Exiting Current -->>> Item:0 , Using Old Pass :True 08-12-2021 17:52:29 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Entering Current -->>> Item:0 , Using Old Pass :True 08-12-2021 17:52:29 | 1972 | INFO | EasyNetQ: Context: Main Context, Trying to connect to host: localhost 08-12-2021 17:52:29 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Exiti

 

L4 Transporter
8-12-2021 17:57:02 | 1972 | ERROR | EasyNetQ: Failed to connect to broker localhost, port 5672, vhost / Additional information: None of the specified endpoints were reachable 08-12-2021 17:57:02 | 1972 | DEBUG | EasyNetQ: Context: Main Context, Loop # 8,Entring Next -->>> Item:1,Using Old Pass:True 08-12-2021 17:57:02 | 1972 | ERROR | EasyNetQ: Failed to connect to any Broker. Retrying in 00:00:30 08-12-2021 17:57:20 | 1972 | FATAL | RBTMQCCS026F: Failed to establish a connection to RabbitMQ: System.TimeoutException: The operation has timed out. at RAC.RabbitAPI.RabbitClient.RabbitClient.WaitForConnection(TimeSpan timeout) at RAC.RabbitAPI.RabbitClient.RabbitClient.ConnectToBroker() 08-12-2021 17:57:20 | 1972 | FATAL | RBTMQCCS049F: Stopping service due to Advanced Bus initiation error 08-12-2021 17:57:20 | 1972 | FATAL | RBTMQCTR052F: Initializing RabbitMQ connection failed. Reason: System.AggregateException: One or more errors occurred. ---> System.TimeoutException: The operation has timed out. at RAC.RabbitAPI.RabbitClient.RabbitClient.WaitForConnection(TimeSpan timeout) at RAC.RabbitAPI.RabbitClient.RabbitClient.ConnectToBroker() at RAC.RabbitAPI.RabbitManager.InitializePrimaryRabbitSetup(Action`1 handler) at RAC.Setup.RACRoleBase.Start() at System.Threading.Tasks.Task.Execute() --- End of inner exception stack trace --- ---> (Inner Exception #0) System.TimeoutException: The operation has timed out. at RAC.RabbitAPI.RabbitClient.RabbitClient.WaitForConnection(TimeSpan timeout) at RAC.RabbitAPI.RabbitClient.RabbitClient.ConnectToBroker() at RAC.RabbitAPI.RabbitManager.InitializePrimaryRabbitSetup(Action`1 handler) at RAC.Setup.RACRoleBase.Start() at System.Threading.Tasks.Task.Execute()<---   08-12-2021 17:57:20 | 1972 | INFO | RBTMQCCS002I: Stopping the CyberArk Queue Configuration Service service 08-12-2021 17:57:20 | 1972 | INFO | RBTMQCCS038I: RabbitMQ Configurator Controller Server stopped 08-12-2021 17:57:20 | 1972 | INFO | RBTMQCCS013I: Stopping the 'RabbitMQConfigurator' application 08-12-2021 17:57:20 | 1972 | DEBUG | RBTMQCTR039D: File 'C:\ProgramData\RabbitMQ\rabbitmq.conf' was deleted successfully 08-12-2021 17:57:20 | 1972 | DEBUG | RBTMQCTR047D: Reverting basic configuration to rabbitmq.conf completed successfully 08-12-2021 17:57:20 | 1972 | DEBUG | RBTMQCTR039D: File 'C:\ProgramData\RabbitMQ\RabbitMQCert-protected.pvk' was deleted successfully 08-12-2021 17:57:20 | 1972 | WARN | RBTMQCCS050W: Public key rotation for user 'RBTMQC-1638814502' was cancelled 08-12-2021 17:57:20 | 1972 | WARN | CAR: Key rotation request for user RBTMQC-1638814502 failed. Error: System.Threading.Tasks.TaskCanceledException: A task was canceled. at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) at RAC.Authentication.SlavePublicKeyUpdater.<WaitForKeyToCommitAsync>d__4.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at RAC.Authentication.SlavePublicKeyUpdater.<UpdatePublicKey>d__5.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at CyberArk.Infra.BackendClient.Security.KeyRotation.<SendRotateRequestAsync>d__20.MoveNext() 08-12-2021 17:57:20 | 1972 | INFO | RBTMQCCS048I: Key rotation process was initiated for user 'Shovel-1638814502' 08-12-2021 17:57:20 | 1972 | INFO | RBTMQCTR029I: Updating authentication key for user Shovel-1638814502 with public key 'MIIBSzCCAQMGByqGSM49AgEwgfcCAQEwLAYHKoZIzj0BAQIhAP////8AAAABAAAAAAAAAAAAAAAA////////////////MFsEIP////8AAAABAAAAAAAAAAAAAAAA///////////////8BCBaxjXYqjqT57PrvVV2mIa8ZR0GsMxTsPY7zjw+J9JgSwMVAMSdNgiG5wSTamZ44ROdJreBn36QBEEEaxfR8uEsQkf4vOblY6RA8ncDfYEt6zOg9KE5RdiYwpZP40Li/hp/m47n60p8D54WK84zV2sxXs7LtkBoN79R9QIhAP////8AAAAA//////////+85vqtpxeehPO5ysL8YyVRAgEBA0IABEwIXTYEXdHgrbm2mL7Q9Ug4ak2Teko70kJzEz5qMSJ0kQWRrBBflr430ZH4zM54UCNMwIm7Wn9m6OFsjINHW9E=' and public key algorithm 'ES256' 08-12-2021 17:57:20 | 1972 | WARN | RBTMQCCS050W: Public key rotation for user 'Shovel-1638814502' was cancelled 08-12-2021 17:57:20 | 1972 | WARN | CAR: Key rotation request for user Shovel-1638814502 failed. Error: System.OperationCanceledException: The operation was canceled. at System.Threading.CancellationToken.ThrowOperationCanceledException() at RAC.Authentication.SlavePublicKeyUpdater.<WaitForKeyToCommitAsync>d__4.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at RAC.Authentication.SlavePublicKeyUpdater.<UpdatePublicKey>d__5.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at CyberArk.Infra.BackendClient.Security.KeyRotation.<SendRotateRequestAsync>d__20.MoveNext() 08-12-2021 17:57:20 | 1972 | INFO | RBTMQCCS039I: Service stopped

 

L4 Transporter

@Bernhard Brückler​  Any thoughts why this happens?

  • 910 Views
  • 10 replies
  • 0 Likes
Like what you see?

Show your appreciation!

Click Like if a post is helpful to you or if you just want to show your support.

Click Accept as Solution to acknowledge that the answer to your question has been provided.

The button appears next to the replies on topics you’ve started. The member who gave the solution and all future visitors to this topic will appreciate it!

These simple actions take just seconds of your time, but go a long way in showing appreciation for community members and the LIVEcommunity as a whole!

The LIVEcommunity thanks you for your participation!