2024-01-23T05:25:18.859 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-23T05:25:18.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:25:19.001 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb858e78c10>, signals=[15]) 2024-01-23T05:25:19.002 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2024-01-23T05:25:19.002 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T05:25:19.002 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-01-23T05:25:19.025 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2024-01-23T05:25:19.025 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T05:25:19.026 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-01-23T05:25:19.137 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_8.stream (ID 3) 2024-01-23T05:25:19.157 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_8.stream (ID 3) 2024-01-23T05:25:19.195 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream 2024-01-23T05:25:19.211 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.stream 2024-01-23T05:25:19.426 INFO:teuthology.orchestra.console.smithi152:Power off 2024-01-23T05:25:19.427 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T05:25:19.442 INFO:teuthology.orchestra.console.smithi133:Power off 2024-01-23T05:25:19.442 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T05:25:19.456 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-01-23T05:25:19.456 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T05:25:19.464 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-01-23T05:25:19.464 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T05:25:19.479 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-01-23T05:25:19.496 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-23T05:25:23.484 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T05:25:23.497 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T05:25:23.595 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-01-23T05:25:23.610 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-23T05:25:27.599 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T05:25:27.610 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T05:25:27.708 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-01-23T05:25:27.720 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-23T05:25:27.820 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-01-23T05:25:27.921 INFO:teuthology.orchestra.console.smithi133:Power on 2024-01-23T05:25:27.921 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T05:25:27.946 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2024-01-23T05:25:27.947 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T05:25:27.968 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-23T05:25:31.714 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T05:25:31.823 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-01-23T05:25:31.923 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-01-23T05:25:31.970 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T05:25:32.024 INFO:teuthology.orchestra.console.smithi152:Power on 2024-01-23T05:25:32.024 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T05:25:32.047 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2024-01-23T05:25:32.047 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T05:25:32.067 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-01-23T05:25:32.079 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-23T05:25:32.180 INFO:teuthology.orchestra.console.smithi133:Power on completed 2024-01-23T05:25:32.280 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2024-01-23T05:25:36.070 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T05:25:36.180 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-01-23T05:25:40.185 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T05:25:40.294 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-01-23T05:25:40.394 INFO:teuthology.orchestra.console.smithi152:Power on completed 2024-01-23T05:25:40.495 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2024-01-23T05:28:18.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:28:21.212 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-23T05:28:26.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:28:27.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:28:29.372 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-23T05:28:30.268 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-23T05:28:35.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:28:36.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:28:38.432 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-23T05:28:39.324 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-23T05:28:44.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:28:45.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:28:47.520 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-23T05:28:48.380 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-23T05:28:53.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:28:54.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:28:56.608 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-23T05:28:57.436 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-23T05:29:02.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:29:03.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:29:05.696 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-23T05:29:06.492 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-01-23T05:29:11.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:29:12.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:29:14.780 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-23T05:29:20.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:29:23.868 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-23T05:29:29.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:30:12.536 WARNING:teuthology.provision.fog.smithi133:timed out 2024-01-23T05:30:18.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:30:18.820 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T05:30:18.820 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T05:30:19.087 INFO:teuthology.provision.fog.smithi133:Node is ready 2024-01-23T05:30:19.088 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2024-01-23T05:30:19.107 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2024-01-23T05:30:19.108 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2024-01-23T05:30:19.168 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2024-01-23T05:30:19.168 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-01-23T05:30:19.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2024-01-23T05:30:19.285 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2024-01-23T05:30:19.354 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2024-01-23T05:30:19.422 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-01-23T05:30:19.489 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-01-23T05:30:19.547 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-01-23T05:30:19.548 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2024-01-23T05:30:19.548 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-01-23T05:30:19.548 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-01-23T05:30:19.548 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2024-01-23T05:30:19.548 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-01-23T05:30:19.548 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-23T05:30:19.549 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-01-23T05:30:19.549 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-23T05:30:19.549 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-01-23T05:30:19.549 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T05:30:19.549 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-23T05:30:19.549 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T05:30:19.550 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2024-01-23T05:30:19.551 DEBUG:teuthology.parallel:result is None 2024-01-23T05:30:29.888 WARNING:teuthology.provision.fog.smithi152:timed out 2024-01-23T05:30:35.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:30:36.161 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T05:30:36.162 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T05:30:36.418 INFO:teuthology.provision.fog.smithi152:Node is ready 2024-01-23T05:30:36.418 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2024-01-23T05:30:36.437 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2024-01-23T05:30:36.437 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2024-01-23T05:30:36.497 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2024-01-23T05:30:36.497 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2024-01-23T05:30:36.606 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2024-01-23T05:30:36.636 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2024-01-23T05:30:36.705 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2024-01-23T05:30:36.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2024-01-23T05:30:36.843 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-01-23T05:30:36.902 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-01-23T05:30:36.902 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2024-01-23T05:30:36.902 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-01-23T05:30:36.903 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-01-23T05:30:36.903 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2024-01-23T05:30:36.903 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2024-01-23T05:30:36.903 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-23T05:30:36.903 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-01-23T05:30:36.903 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-23T05:30:36.903 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-01-23T05:30:36.903 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T05:30:36.903 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-23T05:30:36.903 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T05:30:36.903 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2024-01-23T05:30:36.904 DEBUG:teuthology.parallel:result is None 2024-01-23T05:30:37.056 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2024-01-23T05:30:37.056 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T05:30:37.081 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2024-01-23T05:30:37.081 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T05:30:37.099 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2024-01-23T05:30:37.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-23T05:30:37.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:30:37.171 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-01-23T05:30:37.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-23T05:30:37.308 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-01-23T05:30:37.367 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-01-23T05:30:37.368 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-01-23T05:30:37.426 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-01-23T05:30:37.427 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2024-01-23T05:30:37.427 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-01-23T05:30:37.427 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-01-23T05:30:37.427 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2024-01-23T05:30:37.427 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-01-23T05:30:37.427 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-23T05:30:37.427 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-01-23T05:30:37.427 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-23T05:30:37.427 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-01-23T05:30:37.427 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T05:30:37.427 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-23T05:30:37.427 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T05:30:37.428 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-01-23T05:30:37.448 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2024-01-23T05:30:37.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-01-23T05:30:37.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T05:30:37.522 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-01-23T05:30:37.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-01-23T05:30:37.592 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-01-23T05:30:37.651 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-01-23T05:30:37.652 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-01-23T05:30:37.711 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-01-23T05:30:37.712 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2024-01-23T05:30:37.712 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-01-23T05:30:37.712 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-01-23T05:30:37.712 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2024-01-23T05:30:37.712 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2024-01-23T05:30:37.712 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-23T05:30:37.712 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-01-23T05:30:37.712 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-23T05:30:37.712 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-01-23T05:30:37.712 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T05:30:37.712 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-23T05:30:37.713 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T05:30:37.713 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-01-23T05:30:37.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:30:37.967 INFO:teuthology.dispatcher.supervisor:Running job 7527133 2024-01-23T05:30:37.967 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-22_16:04:40-rados-wip-yuri2-testing-2024-01-18-1314-pacific-distro-default-smithi/7527133 --name yuriw-2024-01-22_16:04:40-rados-wip-yuri2-testing-2024-01-18-1314-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2024-01-22_16:04:40-rados-wip-yuri2-testing-2024-01-18-1314-pacific-distro-default-smithi/7527133/orig.config.yaml 2024-01-23T05:30:37.970 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-22_16:04:40-rados-wip-yuri2-testing-2024-01-18-1314-pacific-distro-default-smithi/7527133 2024-01-23T05:30:37.971 INFO:teuthology.dispatcher.supervisor:Job PID: 1520051 2024-01-23T05:30:37.971 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-23T05:32:38.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:34:38.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:36:38.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:38:38.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:40:39.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:42:39.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:44:39.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:46:39.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:48:39.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:50:39.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:52:39.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:54:40.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:56:40.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T05:58:40.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T06:00:40.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T06:02:40.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T06:04:40.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T06:06:41.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T06:08:41.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T06:10:41.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T06:10:41.443 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-23T06:10:41.552 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-23T06:10:41.552 INFO:teuthology.nuke:Checking targets against current locks 2024-01-23T06:10:41.609 DEBUG:teuthology.nuke:shortname: smithi133 2024-01-23T06:10:41.610 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T06:10:41.628 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-22_16:04:40-rados-wip-yuri2-testing-2024-01-18-1314-pacific-distro-default-smithi/7527133', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 05:25:17.736670', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBueXZ6C2yY9B4Qor0q+WjF9wqGgWL3z5WprUjRVxKJMh6IjYpdqEfVdmWyWQrS3jArwGR2wWu1gMjTUHNuu5hc='} 2024-01-23T06:10:41.633 DEBUG:teuthology.nuke:shortname: smithi152 2024-01-23T06:10:41.633 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T06:10:41.658 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-22_16:04:40-rados-wip-yuri2-testing-2024-01-18-1314-pacific-distro-default-smithi/7527133', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 05:25:17.734948', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBHYZLBl6l1hZr+h279GcPrnPsPMc4Ee1XbStdZl8VTuZ2jLYAvhlnidElol2u4MlNGfBo4pcCQzhznsVRU5Ko0='} 2024-01-23T06:10:41.689 INFO:teuthology.orchestra.console.smithi133:Power off 2024-01-23T06:10:41.689 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T06:10:41.711 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-01-23T06:10:41.711 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:10:41.728 INFO:teuthology.orchestra.console.smithi152:Power off 2024-01-23T06:10:41.729 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T06:10:41.737 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-23T06:10:41.750 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-01-23T06:10:41.750 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T06:10:41.772 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-01-23T06:10:41.839 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-01-23T06:10:41.874 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-01-23T06:10:41.989 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com 2024-01-23T06:10:42.022 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com