2023-12-01T21:41:45.473 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-01T21:41:45.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:41:45.607 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0939937550>, signals=[15]) 2023-12-01T21:41:45.608 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-12-01T21:41:45.608 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T21:41:45.608 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-12-01T21:41:45.639 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging 2023-12-01T21:41:45.640 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T21:41:45.640 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-12-01T21:41:45.769 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_8.stream (ID 3) 2023-12-01T21:41:45.788 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_centos_8.stream (ID 3) 2023-12-01T21:41:45.813 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 8.stream 2023-12-01T21:41:45.833 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of centos 8.stream 2023-12-01T21:41:46.120 INFO:teuthology.orchestra.console.smithi070:Power off 2023-12-01T21:41:46.120 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T21:41:46.133 INFO:teuthology.orchestra.console.smithi026:Power off 2023-12-01T21:41:46.134 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T21:41:46.143 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-12-01T21:41:46.143 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T21:41:46.156 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-12-01T21:41:46.156 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T21:41:46.164 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-12-01T21:41:46.177 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-12-01T21:41:50.166 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T21:41:50.178 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T21:41:50.276 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-12-01T21:41:50.290 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-12-01T21:41:54.278 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T21:41:54.291 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T21:41:54.387 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-12-01T21:41:54.400 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-12-01T21:41:54.488 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-12-01T21:41:54.501 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-12-01T21:41:54.589 INFO:teuthology.orchestra.console.smithi070:Power on 2023-12-01T21:41:54.589 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T21:41:54.602 INFO:teuthology.orchestra.console.smithi026:Power on 2023-12-01T21:41:54.602 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T21:41:54.611 DEBUG:teuthology.orchestra.console.smithi070:power on output: Chassis Power Control: Up/On 2023-12-01T21:41:54.612 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T21:41:54.621 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On 2023-12-01T21:41:54.622 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T21:41:54.631 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-12-01T21:41:54.642 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-12-01T21:41:58.634 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T21:41:58.643 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T21:41:58.743 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-12-01T21:41:58.752 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-12-01T21:42:02.747 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T21:42:02.754 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T21:42:02.856 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-12-01T21:42:02.861 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-12-01T21:42:02.957 INFO:teuthology.orchestra.console.smithi070:Power on completed 2023-12-01T21:42:02.962 INFO:teuthology.orchestra.console.smithi026:Power on completed 2023-12-01T21:42:03.058 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2023-12-01T21:42:03.063 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-12-01T21:44:33.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:44:36.934 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-12-01T21:44:42.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:44:46.018 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-12-01T21:44:48.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:44:51.974 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-12-01T21:44:52.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:44:55.074 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-12-01T21:44:57.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:45:01.062 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-12-01T21:45:01.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:45:04.134 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-12-01T21:45:07.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:45:10.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:45:10.150 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-12-01T21:45:13.222 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-12-01T21:45:16.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:45:19.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:45:19.238 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-12-01T21:45:25.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:45:28.322 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-12-01T21:45:34.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:46:19.274 WARNING:teuthology.provision.fog.smithi026:timed out 2023-12-01T21:46:25.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:46:25.534 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T21:46:25.535 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T21:46:25.795 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-12-01T21:46:25.796 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-12-01T21:46:25.817 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-12-01T21:46:25.817 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-12-01T21:46:25.878 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-12-01T21:46:25.879 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-12-01T21:46:25.988 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-12-01T21:46:26.020 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-12-01T21:46:26.091 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-12-01T21:46:26.161 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-12-01T21:46:26.230 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-12-01T21:46:26.289 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-12-01T21:46:26.289 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-12-01T21:46:26.289 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-12-01T21:46:26.289 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-12-01T21:46:26.289 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-12-01T21:46:26.290 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-12-01T21:46:26.290 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-01T21:46:26.290 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-12-01T21:46:26.290 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-01T21:46:26.290 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-12-01T21:46:26.290 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T21:46:26.290 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T21:46:26.290 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-01T21:46:26.291 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-12-01T21:46:26.292 DEBUG:teuthology.parallel:result is None 2023-12-01T21:46:34.337 WARNING:teuthology.provision.fog.smithi070:timed out 2023-12-01T21:46:40.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:46:40.596 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T21:46:40.596 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T21:46:40.849 INFO:teuthology.provision.fog.smithi070:Node is ready 2023-12-01T21:46:40.849 DEBUG:teuthology.orchestra.run.smithi070:> hostname 2023-12-01T21:46:40.868 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2023-12-01T21:46:40.868 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts 2023-12-01T21:46:40.929 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2023-12-01T21:46:40.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2023-12-01T21:46:41.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts 2023-12-01T21:46:41.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts 2023-12-01T21:46:41.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname 2023-12-01T21:46:41.205 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2023-12-01T21:46:41.273 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-12-01T21:46:41.332 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2023-12-01T21:46:41.332 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8" 2023-12-01T21:46:41.332 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2023-12-01T21:46:41.332 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2023-12-01T21:46:41.332 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8" 2023-12-01T21:46:41.332 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-12-01T21:46:41.332 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-01T21:46:41.332 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-12-01T21:46:41.332 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-01T21:46:41.333 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2023-12-01T21:46:41.333 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T21:46:41.333 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T21:46:41.333 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-01T21:46:41.333 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2023-12-01T21:46:41.334 DEBUG:teuthology.parallel:result is None 2023-12-01T21:46:41.513 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-12-01T21:46:41.514 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T21:46:41.538 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2023-12-01T21:46:41.538 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T21:46:41.556 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-12-01T21:46:41.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-12-01T21:46:41.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:46:41.627 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-12-01T21:46:41.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-12-01T21:46:41.766 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-12-01T21:46:41.828 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-12-01T21:46:41.828 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-12-01T21:46:41.887 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-12-01T21:46:41.887 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-12-01T21:46:41.887 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-12-01T21:46:41.887 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-12-01T21:46:41.887 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-12-01T21:46:41.887 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-12-01T21:46:41.887 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-01T21:46:41.887 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-12-01T21:46:41.887 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-01T21:46:41.887 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-12-01T21:46:41.888 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T21:46:41.888 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T21:46:41.888 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-01T21:46:41.888 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-12-01T21:46:41.913 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2023-12-01T21:46:41.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-12-01T21:46:41.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T21:46:41.983 DEBUG:teuthology.orchestra.run.smithi070:> true 2023-12-01T21:46:42.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-12-01T21:46:42.055 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2023-12-01T21:46:42.115 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2023-12-01T21:46:42.116 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-12-01T21:46:42.174 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2023-12-01T21:46:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8" 2023-12-01T21:46:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2023-12-01T21:46:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2023-12-01T21:46:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8" 2023-12-01T21:46:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-12-01T21:46:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-01T21:46:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-12-01T21:46:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-01T21:46:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2023-12-01T21:46:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T21:46:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T21:46:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-01T21:46:42.176 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-12-01T21:46:42.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:46:42.288 INFO:teuthology.dispatcher.supervisor:Running job 7474309 2023-12-01T21:46:42.288 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474309 --name yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474309/orig.config.yaml 2023-12-01T21:46:42.291 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474309 2023-12-01T21:46:42.291 INFO:teuthology.dispatcher.supervisor:Job PID: 2608713 2023-12-01T21:46:42.291 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-01T21:48:42.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:50:42.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:52:42.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:54:42.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:56:43.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T21:58:43.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:00:43.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:02:43.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:04:43.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:06:43.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:08:44.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:10:44.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:12:44.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:14:44.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:16:44.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T22:16:44.807 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-01T22:16:44.965 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-01T22:16:44.965 INFO:teuthology.nuke:Checking targets against current locks 2023-12-01T22:16:45.008 DEBUG:teuthology.nuke:shortname: smithi026 2023-12-01T22:16:45.009 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T22:16:45.030 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474309', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 21:41:44.602646', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ93q2uJSqFC7zIo/A1aHMYLZ0Ud5byGKC3fUyAxsO8UlZPbMVCMRjQCMTjJJODqjPy1eZQGVSikcnTmH93uGVA='} 2023-12-01T22:16:45.033 DEBUG:teuthology.nuke:shortname: smithi070 2023-12-01T22:16:45.033 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T22:16:45.056 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474309', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 21:41:44.604503', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMLxcX8jrPhlq8U8ZAApaEAqOfgkl7LLJEh88zRrAfJIO0liHNSIInRtupO18DvcLWKF99DcRM2E+/1Xsk8x2v4='} 2023-12-01T22:16:45.076 INFO:teuthology.orchestra.console.smithi026:Power off 2023-12-01T22:16:45.077 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T22:16:45.098 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-12-01T22:16:45.098 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T22:16:45.113 INFO:teuthology.orchestra.console.smithi070:Power off 2023-12-01T22:16:45.113 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T22:16:45.121 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-12-01T22:16:45.133 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-12-01T22:16:45.134 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T22:16:45.185 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-12-01T22:16:45.222 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-12-01T22:16:45.286 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-12-01T22:16:45.381 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2023-12-01T22:16:45.431 INFO:teuthology.lock.ops:unlocked: smithi070.front.sepia.ceph.com