2023-12-16T19:08:15.145 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T19:08:15.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:08:15.283 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1a5cb4f940>, signals=[15]) 2023-12-16T19:08:15.283 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2023-12-16T19:08:15.283 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T19:08:15.284 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-12-16T19:08:15.308 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2023-12-16T19:08:15.308 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T19:08:15.308 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-12-16T19:08:15.428 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_centos_9.stream (ID 10) 2023-12-16T19:08:15.461 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_9.stream (ID 10) 2023-12-16T19:08:15.481 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 9.stream 2023-12-16T19:08:15.508 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 9.stream 2023-12-16T19:08:15.808 INFO:teuthology.orchestra.console.smithi002:Power off 2023-12-16T19:08:15.809 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T19:08:15.822 INFO:teuthology.orchestra.console.smithi043:Power off 2023-12-16T19:08:15.822 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T19:08:15.831 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-12-16T19:08:15.831 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:08:15.843 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2023-12-16T19:08:15.843 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:08:15.853 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-12-16T19:08:15.867 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2023-12-16T19:08:19.857 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:08:19.867 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:08:19.968 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-12-16T19:08:19.976 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2023-12-16T19:08:23.973 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:08:23.981 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:08:24.083 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-12-16T19:08:24.092 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-12-16T19:08:24.184 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-12-16T19:08:24.193 INFO:teuthology.orchestra.console.smithi043:Power off completed 2023-12-16T19:08:24.285 INFO:teuthology.orchestra.console.smithi002:Power on 2023-12-16T19:08:24.285 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T19:08:24.293 INFO:teuthology.orchestra.console.smithi043:Power on 2023-12-16T19:08:24.293 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T19:08:24.307 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On 2023-12-16T19:08:24.307 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:08:24.317 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On 2023-12-16T19:08:24.317 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:08:24.330 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-12-16T19:08:24.338 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-12-16T19:08:28.334 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:08:28.341 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:08:28.444 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-12-16T19:08:28.450 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-12-16T19:08:32.449 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:08:32.457 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T19:08:32.566 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2023-12-16T19:08:32.654 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-12-16T19:08:32.667 INFO:teuthology.orchestra.console.smithi043:Power on completed 2023-12-16T19:08:32.755 INFO:teuthology.orchestra.console.smithi002:Power on completed 2023-12-16T19:08:32.769 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2023-12-16T19:08:32.856 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2023-12-16T19:11:03.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:11:03.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:11:06.834 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-12-16T19:11:06.834 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-12-16T19:11:12.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:11:12.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:11:15.922 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-12-16T19:11:15.922 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-12-16T19:11:21.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:11:21.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:11:25.013 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-12-16T19:11:25.014 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-12-16T19:11:31.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:11:31.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:11:34.097 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-12-16T19:11:34.098 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-12-16T19:11:40.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:11:40.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:11:43.157 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-12-16T19:11:43.185 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-12-16T19:11:49.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:11:49.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:12:49.227 WARNING:teuthology.provision.fog.smithi043:timed out 2023-12-16T19:12:49.227 WARNING:teuthology.provision.fog.smithi002:timed out 2023-12-16T19:12:55.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:12:55.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:12:55.479 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T19:12:55.480 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T19:12:55.505 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T19:12:55.505 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T19:12:55.843 INFO:teuthology.provision.fog.smithi043:Node is ready 2023-12-16T19:12:55.844 DEBUG:teuthology.orchestra.run.smithi043:> hostname 2023-12-16T19:12:55.850 INFO:teuthology.provision.fog.smithi002:Node is ready 2023-12-16T19:12:55.850 DEBUG:teuthology.orchestra.run.smithi002:> hostname 2023-12-16T19:12:55.860 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2023-12-16T19:12:55.860 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts 2023-12-16T19:12:55.865 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2023-12-16T19:12:55.865 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts 2023-12-16T19:12:55.916 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2023-12-16T19:12:55.916 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-12-16T19:12:55.920 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2023-12-16T19:12:55.920 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-12-16T19:12:56.027 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts 2023-12-16T19:12:56.059 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts 2023-12-16T19:12:56.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts 2023-12-16T19:12:56.099 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts 2023-12-16T19:12:56.130 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname 2023-12-16T19:12:56.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname 2023-12-16T19:12:56.200 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-12-16T19:12:56.241 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-12-16T19:12:56.271 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-12-16T19:12:56.311 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-12-16T19:12:56.325 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2023-12-16T19:12:56.325 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2023-12-16T19:12:56.325 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2023-12-16T19:12:56.326 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2023-12-16T19:12:56.326 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2023-12-16T19:12:56.326 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2023-12-16T19:12:56.326 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T19:12:56.326 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-12-16T19:12:56.326 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2023-12-16T19:12:56.326 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T19:12:56.326 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2023-12-16T19:12:56.326 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T19:12:56.326 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T19:12:56.326 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T19:12:56.327 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2023-12-16T19:12:56.328 DEBUG:teuthology.parallel:result is None 2023-12-16T19:12:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2023-12-16T19:12:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2023-12-16T19:12:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2023-12-16T19:12:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2023-12-16T19:12:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2023-12-16T19:12:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2023-12-16T19:12:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T19:12:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-12-16T19:12:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2023-12-16T19:12:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T19:12:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2023-12-16T19:12:56.367 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T19:12:56.367 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T19:12:56.367 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T19:12:56.367 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2023-12-16T19:12:56.367 DEBUG:teuthology.parallel:result is None 2023-12-16T19:12:56.544 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2023-12-16T19:12:56.544 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T19:12:56.572 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2023-12-16T19:12:56.572 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T19:12:56.590 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2023-12-16T19:12:56.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-12-16T19:12:56.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:12:56.685 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-12-16T19:12:56.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-12-16T19:12:56.752 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-12-16T19:12:56.806 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-12-16T19:12:56.807 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-12-16T19:12:56.861 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2023-12-16T19:12:56.862 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2023-12-16T19:12:56.862 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2023-12-16T19:12:56.862 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2023-12-16T19:12:56.862 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2023-12-16T19:12:56.862 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2023-12-16T19:12:56.862 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T19:12:56.862 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-12-16T19:12:56.862 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2023-12-16T19:12:56.862 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T19:12:56.863 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2023-12-16T19:12:56.863 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T19:12:56.863 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T19:12:56.863 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T19:12:56.863 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-12-16T19:12:56.889 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2023-12-16T19:12:56.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-12-16T19:12:56.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T19:12:56.989 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-12-16T19:12:57.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-12-16T19:12:57.056 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2023-12-16T19:12:57.111 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2023-12-16T19:12:57.112 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-12-16T19:12:57.167 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2023-12-16T19:12:57.167 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2023-12-16T19:12:57.167 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2023-12-16T19:12:57.168 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2023-12-16T19:12:57.168 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2023-12-16T19:12:57.168 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2023-12-16T19:12:57.168 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-16T19:12:57.168 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-12-16T19:12:57.168 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2023-12-16T19:12:57.168 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-16T19:12:57.168 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2023-12-16T19:12:57.168 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T19:12:57.168 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-16T19:12:57.168 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-16T19:12:57.169 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-12-16T19:12:57.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:12:57.296 INFO:teuthology.dispatcher.supervisor:Running job 7494656 2023-12-16T19:12:57.296 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494656 --name yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi --description rados/upgrade/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494656/orig.config.yaml 2023-12-16T19:12:57.299 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494656 2023-12-16T19:12:57.300 INFO:teuthology.dispatcher.supervisor:Job PID: 2146761 2023-12-16T19:12:57.300 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-16T19:14:57.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:16:57.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:18:57.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:20:57.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:22:58.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:24:58.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:26:58.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:28:58.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:30:58.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:32:58.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:34:59.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:36:59.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:38:59.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:40:59.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:42:59.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:44:59.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:47:00.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:49:00.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:51:00.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:53:00.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:55:00.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:57:01.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T19:59:01.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:01:01.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:03:01.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:05:01.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:07:01.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:09:02.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:11:02.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:13:02.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:15:02.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:17:02.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:19:02.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:21:03.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:23:03.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:25:03.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:27:03.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:29:04.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:31:04.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T20:31:04.267 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-16T20:31:04.430 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-16T20:31:04.431 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T20:31:04.480 DEBUG:teuthology.nuke:shortname: smithi002 2023-12-16T20:31:04.481 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T20:31:04.505 DEBUG:teuthology.nuke:shortname: smithi043 2023-12-16T20:31:04.505 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T20:31:04.508 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494656', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 19:08:14.322089', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFBGwfpq4z4zKG2mXYld+p4o8BPxB9mFpkJI0BGqeuIv/hCrfcp+To9Z75K9NVfLL/tD4rpUelrnMTO6yePu7pc='} 2023-12-16T20:31:04.531 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:39:44-rados-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7494656', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 19:08:14.324032', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG5vWvMzXfrT12kZp+VEBtZ3q7c4sL0ExFkDLhXDdIQniic1XeR3jgFU+kwWTpJYacoGJBskWyleq1D/ABneVEs='} 2023-12-16T20:31:04.561 INFO:teuthology.orchestra.console.smithi002:Power off 2023-12-16T20:31:04.562 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T20:31:04.580 INFO:teuthology.orchestra.console.smithi043:Power off 2023-12-16T20:31:04.580 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T20:31:04.588 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-12-16T20:31:04.588 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:31:04.607 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2023-12-16T20:31:04.607 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T20:31:04.615 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-12-16T20:31:04.628 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-12-16T20:31:04.716 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-12-16T20:31:04.729 INFO:teuthology.orchestra.console.smithi043:Power off completed 2023-12-16T20:31:04.866 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2023-12-16T20:31:04.875 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com