2024-04-09T05:00:01.415 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-09T05:00:01.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:00:01.581 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feb0912dc10>, signals=[15]) 2024-04-09T05:00:01.581 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-04-09T05:00:01.582 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-04-09T05:00:01.582 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-04-09T05:00:01.599 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2024-04-09T05:00:01.600 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2024-04-09T05:00:01.600 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-04-09T05:00:01.624 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2024-04-09T05:00:01.625 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2024-04-09T05:00:01.625 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-04-09T05:00:01.709 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-09T05:00:01.734 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-09T05:00:01.752 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of ubuntu 22.04 2024-04-09T05:00:01.755 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-09T05:00:01.778 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of ubuntu 22.04 2024-04-09T05:00:01.804 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of ubuntu 22.04 2024-04-09T05:00:02.014 INFO:teuthology.orchestra.console.smithi161:Power off 2024-04-09T05:00:02.014 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T05:00:02.025 INFO:teuthology.orchestra.console.smithi179:Power off 2024-04-09T05:00:02.026 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T05:00:02.038 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-04-09T05:00:02.038 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T05:00:02.046 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-04-09T05:00:02.046 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T05:00:02.058 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-04-09T05:00:02.068 INFO:teuthology.orchestra.console.smithi187:Power off 2024-04-09T05:00:02.068 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-09T05:00:02.076 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-04-09T05:00:02.090 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2024-04-09T05:00:02.090 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T05:00:02.110 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-04-09T05:00:02.159 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-04-09T05:00:02.177 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-04-09T05:00:02.211 INFO:teuthology.orchestra.console.smithi187:Power off completed 2024-04-09T05:00:02.260 INFO:teuthology.orchestra.console.smithi161:Power on 2024-04-09T05:00:02.260 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-09T05:00:02.278 INFO:teuthology.orchestra.console.smithi179:Power on 2024-04-09T05:00:02.278 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-09T05:00:02.287 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-04-09T05:00:02.287 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T05:00:02.299 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2024-04-09T05:00:02.300 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T05:00:02.308 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-04-09T05:00:02.312 INFO:teuthology.orchestra.console.smithi187:Power on 2024-04-09T05:00:02.312 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-09T05:00:02.321 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-04-09T05:00:02.334 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2024-04-09T05:00:02.334 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T05:00:02.355 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-04-09T05:00:06.313 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T05:00:06.322 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T05:00:06.357 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T05:00:06.422 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-04-09T05:00:06.430 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-09T05:00:06.464 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-04-09T05:00:06.531 INFO:teuthology.orchestra.console.smithi179:Power on completed 2024-04-09T05:00:06.565 INFO:teuthology.orchestra.console.smithi187:Power on completed 2024-04-09T05:00:06.632 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2024-04-09T05:00:06.666 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2024-04-09T05:00:10.426 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-09T05:00:10.535 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-04-09T05:00:10.636 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-04-09T05:00:10.736 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-04-09T05:03:23.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:03:23.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:03:26.110 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-09T05:03:26.111 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-09T05:03:27.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:03:32.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:03:32.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:03:35.166 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-09T05:03:35.167 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-09T05:03:41.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:03:41.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:03:44.222 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-09T05:03:44.254 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-09T05:03:50.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:03:50.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:03:53.278 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-09T05:03:53.310 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-09T05:03:59.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:03:59.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:04:02.334 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-09T05:04:02.370 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-09T05:04:08.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:04:08.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:04:11.394 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-09T05:04:11.422 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-09T05:04:17.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:04:17.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:04:27.352 ERROR:teuthology.orchestra.connection:Error authenticating with smithi161.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 457, in connect server_key = t.get_remote_server_key() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 918, in get_remote_server_key raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-04-09T05:04:35.454 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-09T05:04:35.870 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-09T05:04:41.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:04:41.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:04:44.926 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-09T05:04:50.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:04:51.934 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-09T05:04:57.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:04:57.939 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-09T05:04:59.938 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-09T05:05:03.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:03.943 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-09T05:05:05.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:08.990 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-09T05:05:09.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:09.947 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-09T05:05:14.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:14.994 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-09T05:05:15.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:16.101 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-09T05:05:16.102 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-09T05:05:17.136 INFO:teuthology.provision.fog.smithi179:Node is ready 2024-04-09T05:05:17.137 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2024-04-09T05:05:17.183 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2024-04-09T05:05:17.183 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2024-04-09T05:05:17.231 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2024-04-09T05:05:17.231 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-04-09T05:05:17.348 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2024-04-09T05:05:17.361 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2024-04-09T05:05:17.415 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2024-04-09T05:05:17.426 WARNING:teuthology.provision.fog.smithi187:timed out 2024-04-09T05:05:17.472 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-04-09T05:05:17.526 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-04-09T05:05:17.575 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-09T05:05:17.575 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Ubuntu" 2024-04-09T05:05:17.575 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="22.04" 2024-04-09T05:05:17.575 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-09T05:05:17.575 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_CODENAME=jammy 2024-04-09T05:05:17.575 INFO:teuthology.orchestra.run.smithi179.stdout:ID=ubuntu 2024-04-09T05:05:17.575 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE=debian 2024-04-09T05:05:17.576 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-09T05:05:17.576 INFO:teuthology.orchestra.run.smithi179.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-09T05:05:17.576 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-09T05:05:17.576 INFO:teuthology.orchestra.run.smithi179.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-09T05:05:17.576 INFO:teuthology.orchestra.run.smithi179.stdout:UBUNTU_CODENAME=jammy 2024-04-09T05:05:17.576 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2024-04-09T05:05:17.578 DEBUG:teuthology.parallel:result is None 2024-04-09T05:05:19.134 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-04-09T05:05:20.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:20.999 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-09T05:05:23.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:23.729 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-09T05:05:23.730 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-09T05:05:24.171 INFO:teuthology.provision.fog.smithi187:Node is ready 2024-04-09T05:05:24.171 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2024-04-09T05:05:24.220 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2024-04-09T05:05:24.220 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2024-04-09T05:05:24.268 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2024-04-09T05:05:24.269 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-04-09T05:05:24.427 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2024-04-09T05:05:24.441 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2024-04-09T05:05:24.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2024-04-09T05:05:24.561 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-04-09T05:05:24.619 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-04-09T05:05:24.669 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-09T05:05:24.669 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2024-04-09T05:05:24.669 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="22.04" 2024-04-09T05:05:24.669 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-09T05:05:24.669 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=jammy 2024-04-09T05:05:24.669 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2024-04-09T05:05:24.669 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2024-04-09T05:05:24.669 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-09T05:05:24.669 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-09T05:05:24.669 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-09T05:05:24.670 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-09T05:05:24.670 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=jammy 2024-04-09T05:05:24.670 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2024-04-09T05:05:24.670 DEBUG:teuthology.parallel:result is None 2024-04-09T05:05:27.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:27.007 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-09T05:05:33.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:33.016 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-09T05:05:39.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:39.316 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-09T05:05:39.316 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-09T05:05:39.773 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-04-09T05:05:39.773 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-04-09T05:05:39.820 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2024-04-09T05:05:39.821 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2024-04-09T05:05:39.869 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2024-04-09T05:05:39.869 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-04-09T05:05:39.980 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2024-04-09T05:05:39.992 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2024-04-09T05:05:40.048 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2024-04-09T05:05:40.102 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-04-09T05:05:40.156 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-04-09T05:05:40.201 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-09T05:05:40.201 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2024-04-09T05:05:40.201 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2024-04-09T05:05:40.201 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-09T05:05:40.201 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2024-04-09T05:05:40.202 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2024-04-09T05:05:40.202 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2024-04-09T05:05:40.202 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-09T05:05:40.202 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-09T05:05:40.202 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-09T05:05:40.202 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-09T05:05:40.202 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2024-04-09T05:05:40.202 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-04-09T05:05:40.203 DEBUG:teuthology.parallel:result is None 2024-04-09T05:05:40.435 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-04-09T05:05:40.435 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-09T05:05:40.454 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2024-04-09T05:05:40.454 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-09T05:05:40.471 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2024-04-09T05:05:40.471 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-09T05:05:40.489 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-04-09T05:05:40.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-04-09T05:05:40.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:40.567 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-04-09T05:05:40.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-04-09T05:05:40.670 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-04-09T05:05:40.716 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-04-09T05:05:40.717 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-04-09T05:05:40.764 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-09T05:05:40.765 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2024-04-09T05:05:40.765 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2024-04-09T05:05:40.765 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-09T05:05:40.765 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2024-04-09T05:05:40.765 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2024-04-09T05:05:40.765 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2024-04-09T05:05:40.765 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-09T05:05:40.765 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-09T05:05:40.765 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-09T05:05:40.765 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-09T05:05:40.765 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2024-04-09T05:05:40.766 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-04-09T05:05:40.788 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2024-04-09T05:05:40.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-09T05:05:40.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:40.868 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-04-09T05:05:41.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-09T05:05:41.098 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-04-09T05:05:41.146 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-04-09T05:05:41.146 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-04-09T05:05:41.196 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-09T05:05:41.196 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Ubuntu" 2024-04-09T05:05:41.196 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="22.04" 2024-04-09T05:05:41.196 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-09T05:05:41.196 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_CODENAME=jammy 2024-04-09T05:05:41.196 INFO:teuthology.orchestra.run.smithi179.stdout:ID=ubuntu 2024-04-09T05:05:41.196 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE=debian 2024-04-09T05:05:41.196 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-09T05:05:41.196 INFO:teuthology.orchestra.run.smithi179.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-09T05:05:41.196 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-09T05:05:41.197 INFO:teuthology.orchestra.run.smithi179.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-09T05:05:41.197 INFO:teuthology.orchestra.run.smithi179.stdout:UBUNTU_CODENAME=jammy 2024-04-09T05:05:41.197 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-04-09T05:05:41.222 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2024-04-09T05:05:41.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-09T05:05:41.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-09T05:05:41.300 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-04-09T05:05:41.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-09T05:05:41.546 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-04-09T05:05:41.592 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-04-09T05:05:41.592 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-04-09T05:05:41.639 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-09T05:05:41.640 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2024-04-09T05:05:41.640 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="22.04" 2024-04-09T05:05:41.640 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-09T05:05:41.640 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=jammy 2024-04-09T05:05:41.640 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2024-04-09T05:05:41.640 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2024-04-09T05:05:41.640 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-09T05:05:41.640 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-09T05:05:41.640 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-09T05:05:41.640 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-09T05:05:41.640 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=jammy 2024-04-09T05:05:41.641 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-04-09T05:05:41.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:05:41.749 INFO:teuthology.dispatcher.supervisor:Running job 7648057 2024-04-09T05:05:41.749 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2024-04-09_04:09:23-orch:cephadm-wip-adk-testing-2024-04-08-1615-distro-default-smithi/7648057 --name adking-2024-04-09_04:09:23-orch:cephadm-wip-adk-testing-2024-04-08-1615-distro-default-smithi --description orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_rgw_multisite} -- /home/teuthworker/archive/adking-2024-04-09_04:09:23-orch:cephadm-wip-adk-testing-2024-04-08-1615-distro-default-smithi/7648057/orig.config.yaml 2024-04-09T05:05:41.752 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2024-04-09_04:09:23-orch:cephadm-wip-adk-testing-2024-04-08-1615-distro-default-smithi/7648057 2024-04-09T05:05:41.752 INFO:teuthology.dispatcher.supervisor:Job PID: 336138 2024-04-09T05:05:41.752 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-09T05:07:41.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:09:42.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:11:42.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:13:42.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:15:42.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:17:42.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:19:42.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:21:43.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:23:43.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:25:43.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:27:43.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:29:43.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T05:29:43.833 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1