2023-12-13T23:20:42.712 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-13T23:20:42.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:20:42.899 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f729cab2940>, signals=[15]) 2023-12-13T23:20:42.900 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging 2023-12-13T23:20:42.900 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T23:20:42.900 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2023-12-13T23:20:42.922 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-12-13T23:20:42.922 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T23:20:42.922 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-12-13T23:20:42.947 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2023-12-13T23:20:42.947 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T23:20:42.947 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-12-13T23:20:43.059 DEBUG:teuthology.provision.fog.smithi047:Requesting image smithi_centos_8.stream (ID 3) 2023-12-13T23:20:43.071 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_centos_8.stream (ID 3) 2023-12-13T23:20:43.074 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_centos_8.stream (ID 3) 2023-12-13T23:20:43.111 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of centos 8.stream 2023-12-13T23:20:43.118 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of centos 8.stream 2023-12-13T23:20:43.127 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 8.stream 2023-12-13T23:20:43.363 INFO:teuthology.orchestra.console.smithi162:Power off 2023-12-13T23:20:43.363 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:20:43.375 INFO:teuthology.orchestra.console.smithi047:Power off 2023-12-13T23:20:43.376 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:20:43.384 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2023-12-13T23:20:43.385 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:20:43.398 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2023-12-13T23:20:43.398 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:20:43.420 INFO:teuthology.orchestra.console.smithi057:Power off 2023-12-13T23:20:43.420 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:20:43.429 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-12-13T23:20:43.431 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2023-12-13T23:20:43.442 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-12-13T23:20:43.442 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:20:43.465 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-12-13T23:20:43.531 INFO:teuthology.orchestra.console.smithi162:Power off completed 2023-12-13T23:20:43.531 INFO:teuthology.orchestra.console.smithi047:Power off completed 2023-12-13T23:20:43.566 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-12-13T23:20:43.632 INFO:teuthology.orchestra.console.smithi162:Power on 2023-12-13T23:20:43.633 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T23:20:43.640 INFO:teuthology.orchestra.console.smithi047:Power on 2023-12-13T23:20:43.641 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T23:20:43.654 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On 2023-12-13T23:20:43.654 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:20:43.663 DEBUG:teuthology.orchestra.console.smithi047:power on output: Chassis Power Control: Up/On 2023-12-13T23:20:43.664 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:20:43.671 INFO:teuthology.orchestra.console.smithi057:Power on 2023-12-13T23:20:43.672 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T23:20:43.680 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-12-13T23:20:43.686 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2023-12-13T23:20:43.693 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2023-12-13T23:20:43.693 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:20:43.715 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-12-13T23:20:47.682 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:20:47.689 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:20:47.716 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:20:47.792 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-12-13T23:20:47.799 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2023-12-13T23:20:47.826 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-12-13T23:20:47.893 INFO:teuthology.orchestra.console.smithi162:Power on completed 2023-12-13T23:20:47.994 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2023-12-13T23:20:51.803 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:20:51.827 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:20:51.913 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2023-12-13T23:20:51.936 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-12-13T23:20:52.014 INFO:teuthology.orchestra.console.smithi047:Power on completed 2023-12-13T23:20:52.037 INFO:teuthology.orchestra.console.smithi057:Power on completed 2023-12-13T23:20:52.116 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish 2023-12-13T23:20:52.138 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-12-13T23:23:23.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:23:26.134 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-12-13T23:23:32.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:23:33.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:23:34.281 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-13T23:23:35.221 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-12-13T23:23:38.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:23:41.205 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-13T23:23:41.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:23:44.273 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-12-13T23:23:47.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:23:50.257 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-13T23:23:50.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:23:53.333 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-12-13T23:23:56.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:23:59.313 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-13T23:23:59.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:24:02.389 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-12-13T23:24:05.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:24:08.369 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-13T23:24:08.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:24:14.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:24:17.429 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-13T23:24:23.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:24:26.513 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-13T23:24:32.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:24:38.285 WARNING:teuthology.provision.fog.smithi162:timed out 2023-12-13T23:24:44.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:25:08.393 WARNING:teuthology.provision.fog.smithi047:timed out 2023-12-13T23:25:14.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:25:14.651 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T23:25:14.652 DEBUG:teuthology.orchestra.run.smithi047:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T23:25:14.930 INFO:teuthology.provision.fog.smithi047:Node is ready 2023-12-13T23:25:14.930 DEBUG:teuthology.orchestra.run.smithi047:> hostname 2023-12-13T23:25:14.950 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com 2023-12-13T23:25:14.951 DEBUG:teuthology.orchestra.run.smithi047:> grep smithi047.front.sepia.ceph.com /etc/hosts 2023-12-13T23:25:15.012 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047 2023-12-13T23:25:15.012 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2023-12-13T23:25:15.135 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hosts 2023-12-13T23:25:15.166 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/172.21.15.47/172.21.15.47/g' /etc/hosts 2023-12-13T23:25:15.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hostname 2023-12-13T23:25:15.307 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047 2023-12-13T23:25:15.376 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2023-12-13T23:25:15.435 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2023-12-13T23:25:15.435 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8" 2023-12-13T23:25:15.435 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2023-12-13T23:25:15.435 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2023-12-13T23:25:15.435 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8" 2023-12-13T23:25:15.435 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:25:15.435 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T23:25:15.435 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2023-12-13T23:25:15.435 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T23:25:15.435 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2023-12-13T23:25:15.435 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:25:15.436 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:25:15.436 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T23:25:15.436 INFO:teuthology.provision.fog.smithi047:Deploy complete! 2023-12-13T23:25:15.438 DEBUG:teuthology.parallel:result is None 2023-12-13T23:25:32.517 WARNING:teuthology.provision.fog.smithi057:timed out 2023-12-13T23:25:38.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:25:38.803 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T23:25:38.803 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T23:25:39.062 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-12-13T23:25:39.063 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-12-13T23:25:39.126 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-12-13T23:25:39.127 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-12-13T23:25:39.189 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-12-13T23:25:39.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-12-13T23:25:39.312 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-12-13T23:25:39.342 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-12-13T23:25:39.415 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-12-13T23:25:39.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-12-13T23:25:39.559 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-12-13T23:25:39.623 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2023-12-13T23:25:39.623 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8" 2023-12-13T23:25:39.623 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2023-12-13T23:25:39.623 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2023-12-13T23:25:39.623 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8" 2023-12-13T23:25:39.623 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:25:39.623 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T23:25:39.624 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-12-13T23:25:39.624 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T23:25:39.624 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2023-12-13T23:25:39.624 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:25:39.624 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:25:39.624 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T23:25:39.624 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-12-13T23:25:39.625 DEBUG:teuthology.parallel:result is None 2023-12-13T23:25:44.288 WARNING:teuthology.provision.fog.smithi162:timed out 2023-12-13T23:25:50.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:25:50.525 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T23:25:50.526 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T23:25:50.761 INFO:teuthology.provision.fog.smithi162:Node is ready 2023-12-13T23:25:50.762 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2023-12-13T23:25:50.821 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162 2023-12-13T23:25:50.822 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162 /etc/hosts 2023-12-13T23:25:50.881 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2023-12-13T23:25:50.882 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2023-12-13T23:25:50.976 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162/smithi162/g' /etc/hosts 2023-12-13T23:25:51.006 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2023-12-13T23:25:51.073 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162/smithi162/g' /etc/hostname 2023-12-13T23:25:51.141 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2023-12-13T23:25:51.208 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-12-13T23:25:51.266 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2023-12-13T23:25:51.266 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8" 2023-12-13T23:25:51.267 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2023-12-13T23:25:51.267 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2023-12-13T23:25:51.267 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8" 2023-12-13T23:25:51.267 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:25:51.267 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T23:25:51.267 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2023-12-13T23:25:51.267 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T23:25:51.267 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2023-12-13T23:25:51.267 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:25:51.267 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:25:51.267 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T23:25:51.268 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2023-12-13T23:25:51.268 DEBUG:teuthology.parallel:result is None 2023-12-13T23:25:51.464 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com 2023-12-13T23:25:51.465 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T23:25:51.490 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-12-13T23:25:51.490 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T23:25:51.515 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2023-12-13T23:25:51.515 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T23:25:51.533 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server 2023-12-13T23:25:51.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2023-12-13T23:25:51.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:25:51.602 DEBUG:teuthology.orchestra.run.smithi047:> true 2023-12-13T23:25:51.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2023-12-13T23:25:51.745 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2023-12-13T23:25:51.805 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2023-12-13T23:25:51.805 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2023-12-13T23:25:51.865 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2023-12-13T23:25:51.865 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8" 2023-12-13T23:25:51.865 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2023-12-13T23:25:51.866 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2023-12-13T23:25:51.866 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8" 2023-12-13T23:25:51.866 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:25:51.866 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T23:25:51.866 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2023-12-13T23:25:51.866 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T23:25:51.867 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2023-12-13T23:25:51.867 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:25:51.867 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:25:51.867 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T23:25:51.868 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2023-12-13T23:25:51.890 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-12-13T23:25:51.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-12-13T23:25:51.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:25:51.960 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-12-13T23:25:52.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-12-13T23:25:52.102 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-12-13T23:25:52.163 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-12-13T23:25:52.163 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-12-13T23:25:52.224 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2023-12-13T23:25:52.224 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8" 2023-12-13T23:25:52.224 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2023-12-13T23:25:52.224 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2023-12-13T23:25:52.224 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8" 2023-12-13T23:25:52.224 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:25:52.224 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T23:25:52.224 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-12-13T23:25:52.224 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T23:25:52.225 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2023-12-13T23:25:52.225 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:25:52.225 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:25:52.225 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T23:25:52.225 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-12-13T23:25:52.248 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2023-12-13T23:25:52.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-12-13T23:25:52.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:25:52.318 DEBUG:teuthology.orchestra.run.smithi162:> true 2023-12-13T23:25:52.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-12-13T23:25:52.391 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2023-12-13T23:25:52.452 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2023-12-13T23:25:52.453 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-12-13T23:25:52.513 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2023-12-13T23:25:52.513 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8" 2023-12-13T23:25:52.513 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2023-12-13T23:25:52.513 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2023-12-13T23:25:52.513 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8" 2023-12-13T23:25:52.513 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:25:52.514 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-13T23:25:52.514 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2023-12-13T23:25:52.514 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-13T23:25:52.514 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2023-12-13T23:25:52.515 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:25:52.515 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:25:52.515 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-13T23:25:52.515 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-12-13T23:25:52.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:25:52.648 INFO:teuthology.dispatcher.supervisor:Running job 7490642 2023-12-13T23:25:52.648 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490642 --name yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490642/orig.config.yaml 2023-12-13T23:25:52.653 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490642 2023-12-13T23:25:52.653 INFO:teuthology.dispatcher.supervisor:Job PID: 1989201 2023-12-13T23:25:52.653 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-13T23:27:52.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:29:52.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:31:52.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:33:52.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:35:52.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:37:53.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:39:53.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:39:53.186 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-13T23:39:53.333 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-13T23:39:53.333 INFO:teuthology.nuke:Checking targets against current locks 2023-12-13T23:39:53.381 DEBUG:teuthology.nuke:shortname: smithi047 2023-12-13T23:39:53.381 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T23:39:53.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490642', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 23:20:41.814468', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH/gZUrtSoKKxy6WmbR3qnU2OifuQjuVC7eq6xiFzlfFBJf7BVZeqAbqTZsEljFN3ikzCghJPmvV8EN526ka4gA='} 2023-12-13T23:39:53.403 DEBUG:teuthology.nuke:shortname: smithi057 2023-12-13T23:39:53.403 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T23:39:53.424 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490642', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 23:20:41.817334', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHH0MThfwz03hg8vT6rOHtdWvk1n2M6FNZfVgPnYgwcdG1IsZLPFscxkg63nRv/DrUSSKx3WC8fFXdNhoVTCoc='} 2023-12-13T23:39:53.429 DEBUG:teuthology.nuke:shortname: smithi162 2023-12-13T23:39:53.429 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T23:39:53.450 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490642', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 23:20:41.816047', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxGmRbm3iiCaC77Islq7NCJ93x9kjx5XrVD96HVWvXwIOc7Lcp0A7p9n0n1lHI9d0GhwhpwA5bMa91mbfAdEP0='} 2023-12-13T23:39:53.460 INFO:teuthology.orchestra.console.smithi047:Power off 2023-12-13T23:39:53.460 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:39:53.484 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2023-12-13T23:39:53.484 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:39:53.500 INFO:teuthology.orchestra.console.smithi057:Power off 2023-12-13T23:39:53.501 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:39:53.511 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2023-12-13T23:39:53.523 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-12-13T23:39:53.524 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:39:53.539 INFO:teuthology.orchestra.console.smithi162:Power off 2023-12-13T23:39:53.539 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:39:53.547 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-12-13T23:39:53.560 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2023-12-13T23:39:53.560 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:39:53.584 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-12-13T23:39:53.612 INFO:teuthology.orchestra.console.smithi047:Power off completed 2023-12-13T23:39:53.648 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-12-13T23:39:53.685 INFO:teuthology.orchestra.console.smithi162:Power off completed 2023-12-13T23:39:53.767 INFO:teuthology.lock.ops:unlocked: smithi047.front.sepia.ceph.com 2023-12-13T23:39:53.792 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com 2023-12-13T23:39:53.834 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com