2024-01-13T18:45:27.627 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-13T18:45:27.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T18:45:27.768 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2cde5a6c10>, signals=[15]) 2024-01-13T18:45:27.769 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2024-01-13T18:45:27.769 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T18:45:27.770 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-01-13T18:45:27.785 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2024-01-13T18:45:27.786 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T18:45:27.786 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-01-13T18:45:27.902 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_8.stream (ID 3) 2024-01-13T18:45:27.921 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_8.stream (ID 3) 2024-01-13T18:45:27.950 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.stream 2024-01-13T18:45:27.962 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.stream 2024-01-13T18:45:28.194 INFO:teuthology.orchestra.console.smithi142:Power off 2024-01-13T18:45:28.194 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T18:45:28.207 INFO:teuthology.orchestra.console.smithi154:Power off 2024-01-13T18:45:28.207 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T18:45:28.216 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-01-13T18:45:28.216 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:28.227 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2024-01-13T18:45:28.227 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:28.237 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-01-13T18:45:28.248 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-01-13T18:45:32.242 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:32.249 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:32.351 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-01-13T18:45:32.356 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-01-13T18:45:36.356 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:36.363 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:36.465 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-01-13T18:45:36.471 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-01-13T18:45:36.572 INFO:teuthology.orchestra.console.smithi154:Power off completed 2024-01-13T18:45:36.672 INFO:teuthology.orchestra.console.smithi154:Power on 2024-01-13T18:45:36.673 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T18:45:36.693 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On 2024-01-13T18:45:36.694 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:36.714 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-01-13T18:45:40.470 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:40.578 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-01-13T18:45:40.679 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-01-13T18:45:40.715 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:40.781 INFO:teuthology.orchestra.console.smithi142:Power on 2024-01-13T18:45:40.781 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T18:45:40.803 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2024-01-13T18:45:40.803 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:40.823 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-01-13T18:45:40.824 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-01-13T18:45:44.827 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:44.834 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:44.936 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-01-13T18:45:44.941 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-01-13T18:45:45.038 INFO:teuthology.orchestra.console.smithi154:Power on completed 2024-01-13T18:45:45.138 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2024-01-13T18:45:48.945 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T18:45:49.055 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-01-13T18:45:49.155 INFO:teuthology.orchestra.console.smithi142:Power on completed 2024-01-13T18:45:49.256 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2024-01-13T18:48:31.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:48:34.108 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-01-13T18:48:40.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:48:43.164 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-01-13T18:48:49.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:48:50.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:48:52.220 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-01-13T18:48:53.180 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-01-13T18:48:58.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:48:59.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:49:01.276 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-01-13T18:49:02.236 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-01-13T18:49:07.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:49:08.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:49:10.336 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-01-13T18:49:11.292 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-01-13T18:49:16.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:49:17.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:49:19.420 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-01-13T18:49:20.352 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-01-13T18:49:25.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:49:26.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:49:28.476 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-01-13T18:49:29.468 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-01-13T18:49:34.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:49:35.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:49:37.532 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-01-13T18:49:38.528 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-01-13T18:49:43.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:49:44.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:50:02.940 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-01-13T18:50:08.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:50:12.028 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-01-13T18:50:18.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:50:20.896 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T18:50:20.896 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T18:50:43.537 WARNING:teuthology.provision.fog.smithi154:timed out 2024-01-13T18:50:46.123 INFO:teuthology.provision.fog.smithi142:Node is ready 2024-01-13T18:50:46.123 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2024-01-13T18:50:46.147 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2024-01-13T18:50:46.148 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2024-01-13T18:50:46.209 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2024-01-13T18:50:46.210 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-01-13T18:50:46.327 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2024-01-13T18:50:46.357 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2024-01-13T18:50:46.429 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2024-01-13T18:50:46.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-01-13T18:50:46.566 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-01-13T18:50:46.624 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-01-13T18:50:46.625 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2024-01-13T18:50:46.625 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-01-13T18:50:46.625 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-01-13T18:50:46.625 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2024-01-13T18:50:46.625 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2024-01-13T18:50:46.625 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T18:50:46.625 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-01-13T18:50:46.625 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T18:50:46.625 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-01-13T18:50:46.625 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T18:50:46.625 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T18:50:46.626 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T18:50:46.626 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2024-01-13T18:50:46.627 DEBUG:teuthology.parallel:result is None 2024-01-13T18:50:49.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:50:49.787 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T18:50:49.787 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T18:50:50.080 INFO:teuthology.provision.fog.smithi154:Node is ready 2024-01-13T18:50:50.081 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2024-01-13T18:50:50.099 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154 2024-01-13T18:50:50.100 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154 /etc/hosts 2024-01-13T18:50:50.160 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2024-01-13T18:50:50.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2024-01-13T18:50:50.269 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154/smithi154/g' /etc/hosts 2024-01-13T18:50:50.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2024-01-13T18:50:50.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154/smithi154/g' /etc/hostname 2024-01-13T18:50:50.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2024-01-13T18:50:50.501 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-01-13T18:50:50.559 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-01-13T18:50:50.560 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8" 2024-01-13T18:50:50.560 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-01-13T18:50:50.560 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-01-13T18:50:50.560 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2024-01-13T18:50:50.560 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2024-01-13T18:50:50.560 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T18:50:50.560 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-01-13T18:50:50.560 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T18:50:50.560 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-01-13T18:50:50.560 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T18:50:50.560 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T18:50:50.560 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T18:50:50.561 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2024-01-13T18:50:50.561 DEBUG:teuthology.parallel:result is None 2024-01-13T18:50:50.710 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2024-01-13T18:50:50.711 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T18:50:50.730 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2024-01-13T18:50:50.731 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T18:50:50.756 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2024-01-13T18:50:50.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-01-13T18:50:50.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:50:50.831 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-01-13T18:50:50.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-01-13T18:50:50.911 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-01-13T18:50:50.971 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-01-13T18:50:50.972 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-01-13T18:50:51.032 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-01-13T18:50:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2024-01-13T18:50:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-01-13T18:50:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-01-13T18:50:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2024-01-13T18:50:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2024-01-13T18:50:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T18:50:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-01-13T18:50:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T18:50:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-01-13T18:50:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T18:50:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T18:50:51.033 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T18:50:51.034 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-01-13T18:50:51.055 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2024-01-13T18:50:51.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-01-13T18:50:51.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T18:50:51.128 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-01-13T18:50:51.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-01-13T18:50:51.198 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-01-13T18:50:51.255 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-01-13T18:50:51.256 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-01-13T18:50:51.314 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-01-13T18:50:51.314 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8" 2024-01-13T18:50:51.314 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-01-13T18:50:51.314 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-01-13T18:50:51.314 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2024-01-13T18:50:51.314 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2024-01-13T18:50:51.314 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-13T18:50:51.314 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-01-13T18:50:51.314 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-13T18:50:51.315 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-01-13T18:50:51.315 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T18:50:51.315 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T18:50:51.315 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-13T18:50:51.315 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-01-13T18:50:51.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T18:50:51.434 INFO:teuthology.dispatcher.supervisor:Running job 7516281 2024-01-13T18:50:51.434 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516281 --name yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi --description rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516281/orig.config.yaml 2024-01-13T18:50:51.439 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516281 2024-01-13T18:50:51.439 INFO:teuthology.dispatcher.supervisor:Job PID: 1844789 2024-01-13T18:50:51.439 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-13T18:52:51.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T18:54:51.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T18:56:51.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T18:58:52.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:00:52.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:02:52.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:04:52.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:06:52.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:08:52.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:10:53.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:12:53.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:14:53.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:16:53.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:18:53.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:20:53.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:22:54.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:24:54.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:26:54.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:28:54.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:30:54.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:32:54.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:34:55.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:36:55.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:38:55.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:40:55.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:42:55.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:44:55.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:46:56.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:48:56.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:50:56.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:52:56.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:54:56.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:56:56.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T19:58:56.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:00:57.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:02:57.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:04:57.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:06:57.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:08:57.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:10:57.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:12:58.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:14:58.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:16:58.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:18:58.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:20:58.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:22:59.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T20:22:59.085 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-13T20:22:59.269 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-13T20:22:59.269 INFO:teuthology.nuke:Checking targets against current locks 2024-01-13T20:22:59.324 DEBUG:teuthology.nuke:shortname: smithi142 2024-01-13T20:22:59.324 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T20:22:59.347 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516281', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 18:45:26.604230', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCFrb37pYJlDi7L7iyHs9u6Wt2YcfriQrZJMyGWtqO7ul5H+5YZ47tcYp4B/wk7yVisO1NEnaMHDeyKR/8pgqR0='} 2024-01-13T20:22:59.351 DEBUG:teuthology.nuke:shortname: smithi154 2024-01-13T20:22:59.351 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T20:22:59.375 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516281', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 18:45:26.602790', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHu6oRN7TCFylukXa+x2MKtcjHuQ91L3lTBSW2T1J8LCafLqzp1Re6XOBUxOZeNJU9xv8nmIzn8vT5J3G7xi0Ws='} 2024-01-13T20:22:59.400 INFO:teuthology.orchestra.console.smithi142:Power off 2024-01-13T20:22:59.400 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T20:22:59.423 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-01-13T20:22:59.424 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T20:22:59.444 INFO:teuthology.orchestra.console.smithi154:Power off 2024-01-13T20:22:59.444 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T20:22:59.455 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-01-13T20:22:59.467 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2024-01-13T20:22:59.467 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T20:22:59.496 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-01-13T20:22:59.557 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-01-13T20:22:59.599 INFO:teuthology.orchestra.console.smithi154:Power off completed 2024-01-13T20:22:59.714 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com 2024-01-13T20:22:59.746 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com