2024-04-10T17:34:41.097 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-10T17:34:41.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T17:34:41.277 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fad3406cf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fad350cdc10>, signals=[15])
2024-04-10T17:34:41.277 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging
2024-04-10T17:34:41.277 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T17:34:41.278 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-04-10T17:34:41.298 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2024-04-10T17:34:41.298 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T17:34:41.298 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2024-04-10T17:34:41.323 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging
2024-04-10T17:34:41.324 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T17:34:41.324 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-04-10T17:34:41.410 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-04-10T17:34:41.431 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-04-10T17:34:41.470 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of ubuntu 22.04
2024-04-10T17:34:41.471 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-04-10T17:34:41.475 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of ubuntu 22.04
2024-04-10T17:34:41.525 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 22.04
2024-04-10T17:34:41.760 INFO:teuthology.orchestra.console.smithi027:Power off
2024-04-10T17:34:41.760 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T17:34:41.772 INFO:teuthology.orchestra.console.smithi043:Power off
2024-04-10T17:34:41.772 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T17:34:41.780 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2024-04-10T17:34:41.780 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:34:41.792 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2024-04-10T17:34:41.792 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:34:41.802 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-10T17:34:41.813 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2024-04-10T17:34:41.835 INFO:teuthology.orchestra.console.smithi163:Power off
2024-04-10T17:34:41.835 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T17:34:41.853 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off
2024-04-10T17:34:41.854 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:34:41.874 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-04-10T17:34:41.903 INFO:teuthology.orchestra.console.smithi027:Power off completed
2024-04-10T17:34:41.914 INFO:teuthology.orchestra.console.smithi043:Power off completed
2024-04-10T17:34:41.976 INFO:teuthology.orchestra.console.smithi163:Power off completed
2024-04-10T17:34:42.004 INFO:teuthology.orchestra.console.smithi027:Power on
2024-04-10T17:34:42.004 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T17:34:42.015 INFO:teuthology.orchestra.console.smithi043:Power on
2024-04-10T17:34:42.015 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T17:34:42.026 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On
2024-04-10T17:34:42.026 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:34:42.036 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On
2024-04-10T17:34:42.037 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:34:42.048 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-10T17:34:42.056 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2024-04-10T17:34:42.078 INFO:teuthology.orchestra.console.smithi163:Power on
2024-04-10T17:34:42.078 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T17:34:42.098 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On
2024-04-10T17:34:42.099 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:34:42.119 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-04-10T17:34:46.053 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:34:46.060 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:34:46.120 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:34:46.163 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-10T17:34:46.169 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2024-04-10T17:34:46.230 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-04-10T17:34:46.330 INFO:teuthology.orchestra.console.smithi163:Power on completed
2024-04-10T17:34:46.431 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2024-04-10T17:34:50.166 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:34:50.174 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:34:50.277 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-04-10T17:34:50.314 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2024-04-10T17:34:50.378 INFO:teuthology.orchestra.console.smithi027:Power on completed
2024-04-10T17:34:50.415 INFO:teuthology.orchestra.console.smithi043:Power on completed
2024-04-10T17:34:50.479 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2024-04-10T17:34:50.516 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2024-04-10T17:38:08.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:38:11.518 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-04-10T17:38:17.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:38:20.574 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-04-10T17:38:26.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:38:29.630 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-04-10T17:38:35.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:38:38.686 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-04-10T17:38:44.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:38:47.742 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-04-10T17:38:53.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:39:34.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:39:37.822 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:39:43.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:39:46.878 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:39:52.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:39:53.747 WARNING:teuthology.provision.fog.smithi043:timed out
2024-04-10T17:39:55.966 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:39:59.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:39:59.752 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-04-10T17:40:01.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:40:05.022 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:40:05.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:40:06.005 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T17:40:06.006 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T17:40:06.464 INFO:teuthology.provision.fog.smithi043:Node is ready
2024-04-10T17:40:06.465 DEBUG:teuthology.orchestra.run.smithi043:> hostname
2024-04-10T17:40:06.511 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2024-04-10T17:40:06.511 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts
2024-04-10T17:40:06.559 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2024-04-10T17:40:06.560 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2024-04-10T17:40:06.673 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts
2024-04-10T17:40:06.687 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts
2024-04-10T17:40:06.743 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname
2024-04-10T17:40:06.799 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2024-04-10T17:40:06.855 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2024-04-10T17:40:06.904 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T17:40:06.904 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Ubuntu"
2024-04-10T17:40:06.904 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="22.04"
2024-04-10T17:40:06.904 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T17:40:06.904 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_CODENAME=jammy
2024-04-10T17:40:06.904 INFO:teuthology.orchestra.run.smithi043.stdout:ID=ubuntu
2024-04-10T17:40:06.904 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE=debian
2024-04-10T17:40:06.904 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T17:40:06.905 INFO:teuthology.orchestra.run.smithi043.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T17:40:06.905 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T17:40:06.905 INFO:teuthology.orchestra.run.smithi043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T17:40:06.905 INFO:teuthology.orchestra.run.smithi043.stdout:UBUNTU_CODENAME=jammy
2024-04-10T17:40:06.905 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2024-04-10T17:40:06.907 DEBUG:teuthology.parallel:result is None
2024-04-10T17:40:11.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:40:14.078 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:40:20.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:40:23.166 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:40:24.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:40:24.421 ERROR:teuthology.orchestra.connection:Error authenticating with smithi027.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:40:29.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:40:32.222 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:40:38.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:40:41.282 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:40:47.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:40:50.335 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:40:56.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:41:14.654 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:41:20.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:41:23.806 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:41:28.424 WARNING:teuthology.provision.fog.smithi027:timed out
2024-04-10T17:41:29.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:41:31.966 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:41:34.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:41:37.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:41:38.058 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:41:44.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:41:44.136 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:41:50.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:41:50.212 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:41:53.058 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-10T17:41:56.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:41:56.580 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T17:41:56.580 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T17:41:57.535 INFO:teuthology.provision.fog.smithi163:Node is ready
2024-04-10T17:41:57.535 DEBUG:teuthology.orchestra.run.smithi163:> hostname
2024-04-10T17:41:57.583 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2024-04-10T17:41:57.584 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts
2024-04-10T17:41:57.631 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2024-04-10T17:41:57.632 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-04-10T17:41:57.750 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts
2024-04-10T17:41:57.763 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts
2024-04-10T17:41:57.819 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname
2024-04-10T17:41:57.875 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-04-10T17:41:57.934 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-04-10T17:41:57.983 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T17:41:57.983 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu"
2024-04-10T17:41:57.983 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="22.04"
2024-04-10T17:41:57.983 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T17:41:57.983 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=jammy
2024-04-10T17:41:57.983 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu
2024-04-10T17:41:57.984 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian
2024-04-10T17:41:57.984 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T17:41:57.984 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T17:41:57.984 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T17:41:57.984 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T17:41:57.984 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=jammy
2024-04-10T17:41:57.984 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2024-04-10T17:41:57.985 DEBUG:teuthology.parallel:result is None
2024-04-10T17:41:59.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:42:59.141 WARNING:teuthology.provision.fog.smithi027:timed out
2024-04-10T17:43:05.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:43:06.239 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-10T17:43:12.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:43:12.491 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T17:43:12.491 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T17:43:13.019 INFO:teuthology.provision.fog.smithi027:Node is ready
2024-04-10T17:43:13.019 DEBUG:teuthology.orchestra.run.smithi027:> hostname
2024-04-10T17:43:13.067 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2024-04-10T17:43:13.068 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts
2024-04-10T17:43:13.116 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2024-04-10T17:43:13.116 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-04-10T17:43:13.228 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts
2024-04-10T17:43:13.243 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts
2024-04-10T17:43:13.300 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname
2024-04-10T17:43:13.356 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-04-10T17:43:13.411 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-04-10T17:43:13.463 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T17:43:13.463 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Ubuntu"
2024-04-10T17:43:13.463 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="22.04"
2024-04-10T17:43:13.463 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T17:43:13.464 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_CODENAME=jammy
2024-04-10T17:43:13.464 INFO:teuthology.orchestra.run.smithi027.stdout:ID=ubuntu
2024-04-10T17:43:13.464 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE=debian
2024-04-10T17:43:13.464 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T17:43:13.464 INFO:teuthology.orchestra.run.smithi027.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T17:43:13.464 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T17:43:13.464 INFO:teuthology.orchestra.run.smithi027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T17:43:13.464 INFO:teuthology.orchestra.run.smithi027.stdout:UBUNTU_CODENAME=jammy
2024-04-10T17:43:13.464 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2024-04-10T17:43:13.464 DEBUG:teuthology.parallel:result is None
2024-04-10T17:43:14.976 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2024-04-10T17:43:14.976 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-10T17:43:15.057 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2024-04-10T17:43:15.057 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-10T17:43:15.140 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2024-04-10T17:43:15.140 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-10T17:43:15.208 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2024-04-10T17:43:15.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-04-10T17:43:15.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:43:15.329 DEBUG:teuthology.orchestra.run.smithi027:> true
2024-04-10T17:43:15.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-04-10T17:43:15.432 DEBUG:teuthology.orchestra.run.smithi027:> uname -m
2024-04-10T17:43:15.483 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2024-04-10T17:43:15.483 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-04-10T17:43:15.531 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T17:43:15.531 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Ubuntu"
2024-04-10T17:43:15.531 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="22.04"
2024-04-10T17:43:15.531 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T17:43:15.531 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_CODENAME=jammy
2024-04-10T17:43:15.531 INFO:teuthology.orchestra.run.smithi027.stdout:ID=ubuntu
2024-04-10T17:43:15.531 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE=debian
2024-04-10T17:43:15.532 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T17:43:15.532 INFO:teuthology.orchestra.run.smithi027.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T17:43:15.532 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T17:43:15.532 INFO:teuthology.orchestra.run.smithi027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T17:43:15.532 INFO:teuthology.orchestra.run.smithi027.stdout:UBUNTU_CODENAME=jammy
2024-04-10T17:43:15.532 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-04-10T17:43:15.607 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2024-04-10T17:43:15.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2024-04-10T17:43:15.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:43:15.742 DEBUG:teuthology.orchestra.run.smithi043:> true
2024-04-10T17:43:15.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com'
2024-04-10T17:43:15.978 DEBUG:teuthology.orchestra.run.smithi043:> uname -m
2024-04-10T17:43:16.025 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2024-04-10T17:43:16.025 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2024-04-10T17:43:16.073 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T17:43:16.073 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Ubuntu"
2024-04-10T17:43:16.073 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="22.04"
2024-04-10T17:43:16.073 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T17:43:16.073 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_CODENAME=jammy
2024-04-10T17:43:16.073 INFO:teuthology.orchestra.run.smithi043.stdout:ID=ubuntu
2024-04-10T17:43:16.073 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE=debian
2024-04-10T17:43:16.073 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T17:43:16.073 INFO:teuthology.orchestra.run.smithi043.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T17:43:16.073 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T17:43:16.073 INFO:teuthology.orchestra.run.smithi043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T17:43:16.073 INFO:teuthology.orchestra.run.smithi043.stdout:UBUNTU_CODENAME=jammy
2024-04-10T17:43:16.074 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2024-04-10T17:43:16.149 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2024-04-10T17:43:16.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-04-10T17:43:16.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:43:16.279 DEBUG:teuthology.orchestra.run.smithi163:> true
2024-04-10T17:43:16.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com'
2024-04-10T17:43:16.378 DEBUG:teuthology.orchestra.run.smithi163:> uname -m
2024-04-10T17:43:16.430 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2024-04-10T17:43:16.431 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-04-10T17:43:16.479 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T17:43:16.479 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu"
2024-04-10T17:43:16.479 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="22.04"
2024-04-10T17:43:16.479 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T17:43:16.479 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=jammy
2024-04-10T17:43:16.479 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu
2024-04-10T17:43:16.479 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian
2024-04-10T17:43:16.479 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T17:43:16.479 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T17:43:16.479 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T17:43:16.479 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T17:43:16.480 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=jammy
2024-04-10T17:43:16.480 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-04-10T17:43:16.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T17:43:16.676 INFO:teuthology.dispatcher.supervisor:Running job 7650858
2024-04-10T17:43:16.677 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-10_14:17:51-rados-wip-yuri6-testing-2024-04-02-1310-distro-default-smithi/7650858 --name yuriw-2024-04-10_14:17:51-rados-wip-yuri6-testing-2024-04-02-1310-distro-default-smithi --description rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} -- /home/teuthworker/archive/yuriw-2024-04-10_14:17:51-rados-wip-yuri6-testing-2024-04-02-1310-distro-default-smithi/7650858/orig.config.yaml
2024-04-10T17:43:16.680 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-10_14:17:51-rados-wip-yuri6-testing-2024-04-02-1310-distro-default-smithi/7650858
2024-04-10T17:43:16.680 INFO:teuthology.dispatcher.supervisor:Job PID: 3136576
2024-04-10T17:43:16.680 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-10T17:45:16.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T17:47:16.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T17:47:16.822 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1