2024-01-23T15:39:43.228 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-23T15:39:43.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T15:39:43.381 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8bad87ac10>, signals=[15]) 2024-01-23T15:39:43.382 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2024-01-23T15:39:43.382 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T15:39:43.382 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-01-23T15:39:43.413 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging 2024-01-23T15:39:43.414 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T15:39:43.414 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-01-23T15:39:43.538 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_8.stream (ID 3) 2024-01-23T15:39:43.574 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_8.stream (ID 3) 2024-01-23T15:39:43.599 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 8.stream 2024-01-23T15:39:43.623 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 8.stream 2024-01-23T15:39:43.876 INFO:teuthology.orchestra.console.smithi150:Power off 2024-01-23T15:39:43.877 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T15:39:43.890 INFO:teuthology.orchestra.console.smithi088:Power off 2024-01-23T15:39:43.891 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T15:39:43.902 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2024-01-23T15:39:43.902 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T15:39:43.911 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-01-23T15:39:43.912 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T15:39:43.923 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-01-23T15:39:43.932 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-01-23T15:39:47.924 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T15:39:47.933 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T15:39:48.034 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-01-23T15:39:48.042 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-01-23T15:39:52.036 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T15:39:52.044 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T15:39:52.147 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-01-23T15:39:52.153 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-01-23T15:39:52.248 INFO:teuthology.orchestra.console.smithi150:Power off completed 2024-01-23T15:39:52.253 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-01-23T15:39:52.349 INFO:teuthology.orchestra.console.smithi150:Power on 2024-01-23T15:39:52.349 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T15:39:52.357 INFO:teuthology.orchestra.console.smithi088:Power on 2024-01-23T15:39:52.357 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T15:39:52.371 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On 2024-01-23T15:39:52.371 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T15:39:52.379 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2024-01-23T15:39:52.379 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T15:39:52.392 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-01-23T15:39:52.399 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-01-23T15:39:56.397 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T15:39:56.403 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T15:39:56.506 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-01-23T15:39:56.512 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-01-23T15:40:00.509 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T15:40:00.516 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T15:40:00.618 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-01-23T15:40:00.719 INFO:teuthology.orchestra.console.smithi150:Power on completed 2024-01-23T15:40:00.725 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-01-23T15:40:00.820 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2024-01-23T15:40:00.826 INFO:teuthology.orchestra.console.smithi088:Power on completed 2024-01-23T15:40:00.927 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2024-01-23T15:42:46.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:42:46.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:42:50.044 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-23T15:42:50.045 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-01-23T15:42:56.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:42:56.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:42:59.100 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-23T15:42:59.100 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-01-23T15:43:05.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:43:05.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:43:08.188 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-23T15:43:08.188 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-01-23T15:43:14.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:43:14.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:43:17.244 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-23T15:43:17.276 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-01-23T15:43:23.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:43:23.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:43:26.336 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-01-23T15:43:26.336 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-23T15:43:32.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:43:32.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:43:35.424 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-01-23T15:43:35.424 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-23T15:43:41.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:43:41.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:43:44.508 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-23T15:43:50.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:43:53.564 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-01-23T15:43:59.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:44:41.455 WARNING:teuthology.provision.fog.smithi150:timed out 2024-01-23T15:44:47.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:44:47.661 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T15:44:47.661 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T15:44:47.913 INFO:teuthology.provision.fog.smithi150:Node is ready 2024-01-23T15:44:47.913 DEBUG:teuthology.orchestra.run.smithi150:> hostname 2024-01-23T15:44:47.933 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com 2024-01-23T15:44:47.933 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts 2024-01-23T15:44:47.993 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2024-01-23T15:44:47.994 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2024-01-23T15:44:48.083 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts 2024-01-23T15:44:48.114 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts 2024-01-23T15:44:48.183 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname 2024-01-23T15:44:48.251 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2024-01-23T15:44:48.319 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8" 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8" 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-23T15:44:48.377 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T15:44:48.378 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2024-01-23T15:44:48.379 DEBUG:teuthology.parallel:result is None 2024-01-23T15:44:59.580 WARNING:teuthology.provision.fog.smithi088:timed out 2024-01-23T15:45:05.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:45:05.847 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T15:45:05.847 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T15:45:06.095 INFO:teuthology.provision.fog.smithi088:Node is ready 2024-01-23T15:45:06.095 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2024-01-23T15:45:06.154 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2024-01-23T15:45:06.155 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2024-01-23T15:45:06.213 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2024-01-23T15:45:06.213 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-01-23T15:45:06.317 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2024-01-23T15:45:06.346 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2024-01-23T15:45:06.414 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2024-01-23T15:45:06.481 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-01-23T15:45:06.548 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-01-23T15:45:06.607 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-01-23T15:45:06.607 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2024-01-23T15:45:06.607 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-01-23T15:45:06.607 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-01-23T15:45:06.607 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2024-01-23T15:45:06.607 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2024-01-23T15:45:06.607 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-23T15:45:06.607 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-01-23T15:45:06.607 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-23T15:45:06.607 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-01-23T15:45:06.607 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T15:45:06.608 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-23T15:45:06.608 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T15:45:06.608 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2024-01-23T15:45:06.609 DEBUG:teuthology.parallel:result is None 2024-01-23T15:45:06.801 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2024-01-23T15:45:06.802 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T15:45:06.820 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2024-01-23T15:45:06.820 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T15:45:06.846 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2024-01-23T15:45:06.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-01-23T15:45:06.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:45:06.960 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-01-23T15:45:06.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-01-23T15:45:06.983 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-01-23T15:45:07.040 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-01-23T15:45:07.041 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-23T15:45:07.099 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T15:45:07.100 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-01-23T15:45:07.120 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2024-01-23T15:45:07.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-01-23T15:45:07.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T15:45:07.191 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-01-23T15:45:07.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-01-23T15:45:07.326 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-01-23T15:45:07.385 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-01-23T15:45:07.385 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-01-23T15:45:07.443 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-01-23T15:45:07.443 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8" 2024-01-23T15:45:07.443 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-01-23T15:45:07.443 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-01-23T15:45:07.444 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8" 2024-01-23T15:45:07.444 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2024-01-23T15:45:07.444 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-23T15:45:07.444 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-01-23T15:45:07.444 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-23T15:45:07.444 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-01-23T15:45:07.444 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T15:45:07.444 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-23T15:45:07.444 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T15:45:07.445 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-01-23T15:45:07.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T15:45:07.564 INFO:teuthology.dispatcher.supervisor:Running job 7528131 2024-01-23T15:45:07.565 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528131 --name vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528131/orig.config.yaml 2024-01-23T15:45:07.568 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528131 2024-01-23T15:45:07.568 INFO:teuthology.dispatcher.supervisor:Job PID: 167517 2024-01-23T15:45:07.568 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-23T15:47:07.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T15:49:07.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T15:51:07.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T15:53:08.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T15:55:08.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T15:57:08.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T15:59:08.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:01:08.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:03:09.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:05:09.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:07:09.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:09:09.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:11:09.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:13:09.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:15:09.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:17:10.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:19:10.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:21:10.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:23:10.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:25:10.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:27:11.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:29:11.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:31:11.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:33:11.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:35:11.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:37:11.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:39:12.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:41:12.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:43:12.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:45:12.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:47:12.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:49:12.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:51:13.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:53:13.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:55:13.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:57:13.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T16:59:13.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:01:13.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:03:14.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:05:14.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:07:14.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:09:14.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:11:14.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:13:14.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:15:15.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:17:15.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:19:15.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:21:15.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:23:15.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:25:16.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:27:16.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:29:16.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:31:16.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:33:16.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:35:16.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:37:17.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:39:17.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:41:17.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:43:17.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:45:17.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:47:22.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:49:22.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:51:22.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:53:22.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:55:22.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:57:22.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T17:59:23.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:01:23.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:03:23.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:05:23.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:07:23.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:09:23.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:11:23.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:13:24.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:15:24.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:17:24.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:19:24.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:21:24.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:23:24.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:25:25.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:27:25.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:29:25.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:31:25.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:33:25.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:35:25.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:37:26.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:39:26.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:41:26.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:43:26.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:45:26.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:47:26.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:49:27.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:51:27.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:53:27.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:55:27.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:57:27.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T18:59:28.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:01:28.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:03:28.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:05:28.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:07:28.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:09:28.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:11:29.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:13:29.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:15:29.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:17:29.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:19:29.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:21:29.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:23:30.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:25:30.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:27:30.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:29:30.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:31:30.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:33:30.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:35:31.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:37:31.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:39:31.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:41:31.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:43:31.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:45:31.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:47:32.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:49:32.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:51:32.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:53:32.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:55:32.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:57:33.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T19:59:33.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:01:33.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:03:33.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:05:33.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:07:33.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:09:34.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:11:34.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:13:34.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:15:34.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:17:34.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:19:35.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:21:35.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:23:35.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:25:35.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:27:35.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:29:35.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:31:36.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:33:36.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:35:36.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:37:36.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:39:36.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:41:36.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:43:37.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:45:37.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:47:37.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:49:37.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:51:37.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T20:51:37.714 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-23T20:51:37.898 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-23T20:51:37.898 INFO:teuthology.nuke:Checking targets against current locks 2024-01-23T20:51:37.954 DEBUG:teuthology.nuke:shortname: smithi088 2024-01-23T20:51:37.955 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T20:51:37.974 DEBUG:teuthology.nuke:shortname: smithi150 2024-01-23T20:51:37.974 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T20:51:37.977 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528131', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 15:39:42.157407', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL7/yuALLiiZCeGDyIJlkLFKWKeV4ortQSMGfept8xHkHiHOsY/600W6lqbDB6Cpgu+C406vmd3+zxtwVzKrdsc='} 2024-01-23T20:51:37.994 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528131', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 15:39:42.159173', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI3DjIOCuUEfDysCiTtNYRYG3xk9AXDA1CcF/bZeeAueW/Oggrg7mFMPg8ZurMN6rk+mKopM988p/K8ZUCusoo8='} 2024-01-23T20:51:38.024 INFO:teuthology.orchestra.console.smithi088:Power off 2024-01-23T20:51:38.024 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T20:51:38.045 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-01-23T20:51:38.046 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T20:51:38.059 INFO:teuthology.orchestra.console.smithi150:Power off 2024-01-23T20:51:38.059 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T20:51:38.067 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-01-23T20:51:38.083 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2024-01-23T20:51:38.083 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T20:51:38.102 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-01-23T20:51:38.168 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-01-23T20:51:38.204 INFO:teuthology.orchestra.console.smithi150:Power off completed 2024-01-23T20:51:38.321 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com 2024-01-23T20:51:38.353 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com