2023-09-20T14:12:35.125 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-20T14:12:35.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:12:35.322 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fefbcb8a670>, signals=[15]) 2023-09-20T14:12:35.326 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-09-20T14:12:35.327 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-09-20T14:12:35.327 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-09-20T14:12:35.351 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-09-20T14:12:35.351 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-09-20T14:12:35.352 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-09-20T14:12:35.354 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-09-20T14:12:35.376 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"} 2023-09-20T14:12:35.444 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-20T14:12:35.448 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-20T14:12:35.495 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_8.stream (ID 3) 2023-09-20T14:12:35.495 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 3} 2023-09-20T14:12:35.499 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_8.stream (ID 3) 2023-09-20T14:12:35.499 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 3} 2023-09-20T14:12:35.541 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.stream 2023-09-20T14:12:35.541 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:12:35.542 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 8.stream 2023-09-20T14:12:35.543 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:12:35.597 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"} 2023-09-20T14:12:35.600 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-09-20T14:12:35.637 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-09-20T14:12:35.641 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1} 2023-09-20T14:12:35.691 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:12:35.709 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:12:35.783 INFO:teuthology.orchestra.console.smithi159:Power off 2023-09-20T14:12:35.784 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-20T14:12:35.798 INFO:teuthology.orchestra.console.smithi149:Power off 2023-09-20T14:12:35.798 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-20T14:12:35.807 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-09-20T14:12:35.808 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:12:35.821 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2023-09-20T14:12:35.821 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:12:35.830 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-09-20T14:12:35.843 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-09-20T14:12:39.835 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:12:39.844 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:12:39.946 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-09-20T14:12:39.955 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-09-20T14:12:43.950 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:12:43.957 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:12:44.060 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-09-20T14:12:44.068 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-09-20T14:12:44.161 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-09-20T14:12:44.169 INFO:teuthology.orchestra.console.smithi149:Power off completed 2023-09-20T14:12:44.263 INFO:teuthology.orchestra.console.smithi159:Power on 2023-09-20T14:12:44.263 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-20T14:12:44.270 INFO:teuthology.orchestra.console.smithi149:Power on 2023-09-20T14:12:44.270 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-20T14:12:44.284 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On 2023-09-20T14:12:44.285 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:12:44.293 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On 2023-09-20T14:12:44.293 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:12:44.305 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-09-20T14:12:44.313 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-09-20T14:12:48.310 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:12:48.317 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:12:48.419 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-09-20T14:12:48.425 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-09-20T14:12:48.521 INFO:teuthology.orchestra.console.smithi159:Power on completed 2023-09-20T14:12:48.621 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-09-20T14:12:48.622 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:12:52.430 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:12:52.539 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-09-20T14:12:52.640 INFO:teuthology.orchestra.console.smithi149:Power on completed 2023-09-20T14:12:52.740 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-09-20T14:12:52.741 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:13:03.700 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:13:07.810 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:13:18.766 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:13:22.878 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:13:33.843 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:13:37.941 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:13:48.914 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:13:53.009 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:14:04.053 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:14:08.077 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:14:19.127 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:14:23.140 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:14:34.198 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:14:38.210 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:14:49.263 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:14:53.270 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:15:04.334 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:15:08.330 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:15:19.394 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:15:23.386 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:15:34.455 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-09-20T14:15:34.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:15:38.449 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-09-20T14:15:38.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:15:52.986 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-09-20T14:15:56.826 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-09-20T14:15:58.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:16:02.042 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-09-20T14:16:02.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:16:05.882 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-09-20T14:16:08.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:16:11.098 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-09-20T14:16:11.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:16:14.938 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-09-20T14:16:17.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:16:20.155 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-09-20T14:16:20.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:16:23.994 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-09-20T14:16:26.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:16:29.210 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-09-20T14:16:29.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:16:33.050 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-09-20T14:16:35.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:16:38.266 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-09-20T14:16:39.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:16:42.106 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-09-20T14:16:44.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:16:48.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:16:51.162 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-09-20T14:16:57.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:17:00.250 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-09-20T14:17:06.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:17:09.306 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-09-20T14:17:15.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:17:18.362 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-09-20T14:17:24.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:17:44.290 WARNING:teuthology.provision.fog.smithi159:timed out 2023-09-20T14:17:50.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:17:50.529 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-20T14:17:50.530 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-20T14:17:50.786 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-09-20T14:17:50.786 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-09-20T14:17:50.805 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2023-09-20T14:17:50.806 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2023-09-20T14:17:50.866 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-09-20T14:17:50.867 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-09-20T14:17:50.956 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2023-09-20T14:17:50.986 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-09-20T14:17:51.055 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2023-09-20T14:17:51.124 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-09-20T14:17:51.192 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-09-20T14:17:51.251 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-09-20T14:17:51.251 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-09-20T14:17:51.251 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-09-20T14:17:51.251 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-09-20T14:17:51.252 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-09-20T14:17:51.252 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-09-20T14:17:51.253 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-20T14:17:51.253 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-09-20T14:17:51.253 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-20T14:17:51.254 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-09-20T14:17:51.254 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-20T14:17:51.254 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-20T14:17:51.255 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-20T14:17:51.255 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-09-20T14:17:51.257 DEBUG:teuthology.parallel:result is None 2023-09-20T14:18:24.405 WARNING:teuthology.provision.fog.smithi149:timed out 2023-09-20T14:18:30.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:18:30.613 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-20T14:18:30.614 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-20T14:18:30.873 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-09-20T14:18:30.873 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-09-20T14:18:30.893 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-09-20T14:18:30.893 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-09-20T14:18:30.953 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-09-20T14:18:30.953 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-09-20T14:18:31.066 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-09-20T14:18:31.097 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-09-20T14:18:31.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-09-20T14:18:31.235 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-09-20T14:18:31.302 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-09-20T14:18:31.360 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2023-09-20T14:18:31.360 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8" 2023-09-20T14:18:31.360 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2023-09-20T14:18:31.361 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2023-09-20T14:18:31.361 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8" 2023-09-20T14:18:31.361 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-09-20T14:18:31.361 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-20T14:18:31.361 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-09-20T14:18:31.362 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-20T14:18:31.362 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2023-09-20T14:18:31.362 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-20T14:18:31.362 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-20T14:18:31.362 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-20T14:18:31.363 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-09-20T14:18:31.363 DEBUG:teuthology.parallel:result is None 2023-09-20T14:18:31.547 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-09-20T14:18:31.547 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-20T14:18:31.578 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2023-09-20T14:18:31.578 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-20T14:18:31.604 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-09-20T14:18:31.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-09-20T14:18:31.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:18:31.670 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-09-20T14:18:31.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-09-20T14:18:31.694 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-09-20T14:18:31.751 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-09-20T14:18:31.752 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-09-20T14:18:31.809 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2023-09-20T14:18:31.809 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8" 2023-09-20T14:18:31.809 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2023-09-20T14:18:31.810 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2023-09-20T14:18:31.810 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8" 2023-09-20T14:18:31.810 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-09-20T14:18:31.810 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-20T14:18:31.810 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-09-20T14:18:31.811 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-20T14:18:31.811 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2023-09-20T14:18:31.811 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-20T14:18:31.811 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-20T14:18:31.811 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-20T14:18:31.812 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-09-20T14:18:31.836 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2023-09-20T14:18:31.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-09-20T14:18:31.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-20T14:18:31.903 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-09-20T14:18:32.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-09-20T14:18:32.041 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-09-20T14:18:32.102 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-09-20T14:18:32.102 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-09-20T14:18:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-09-20T14:18:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-09-20T14:18:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-09-20T14:18:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-09-20T14:18:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-09-20T14:18:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-09-20T14:18:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-20T14:18:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-09-20T14:18:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-20T14:18:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-09-20T14:18:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-20T14:18:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-20T14:18:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-20T14:18:32.164 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-09-20T14:18:32.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:18:32.278 INFO:teuthology.dispatcher.supervisor:Running job 7399470 2023-09-20T14:18:32.279 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-09-20_11:41:36-orch:cephadm-wip-guits-testing-2-2023-09-20-0746-quincy-distro-default-smithi/7399470 --name gabrioux-2023-09-20_11:41:36-orch:cephadm-wip-guits-testing-2-2023-09-20-0746-quincy-distro-default-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/gabrioux-2023-09-20_11:41:36-orch:cephadm-wip-guits-testing-2-2023-09-20-0746-quincy-distro-default-smithi/7399470/orig.config.yaml 2023-09-20T14:18:32.282 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-09-20_11:41:36-orch:cephadm-wip-guits-testing-2-2023-09-20-0746-quincy-distro-default-smithi/7399470 2023-09-20T14:18:32.283 INFO:teuthology.dispatcher.supervisor:Job PID: 2547337 2023-09-20T14:18:32.283 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-20T14:20:32.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:22:32.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:24:32.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:26:32.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:28:33.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:30:33.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:32:33.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:34:33.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:36:33.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:38:33.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:40:34.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-20T14:40:34.138 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-20T14:40:34.245 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-20T14:40:34.245 INFO:teuthology.nuke:Checking targets against current locks 2023-09-20T14:40:34.289 DEBUG:teuthology.nuke:shortname: smithi149 2023-09-20T14:40:34.290 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-20T14:40:34.312 DEBUG:teuthology.nuke:shortname: smithi159 2023-09-20T14:40:34.313 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-20T14:40:34.316 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-09-20_11:41:36-orch:cephadm-wip-guits-testing-2-2023-09-20-0746-quincy-distro-default-smithi/7399470', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-20 14:12:34.345164', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMlS/0pVbk3+GLJnvTFMbLKPLPpGxog91KLXSXoS/2Dd47bu+eshXKwmK5FCwa1zmATjWZfSwMsDJMOCtt4uNhA='} 2023-09-20T14:40:34.330 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-09-20_11:41:36-orch:cephadm-wip-guits-testing-2-2023-09-20-0746-quincy-distro-default-smithi/7399470', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-20 14:12:34.347261', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNjsIBckmj7m4Z811CEASPw1RBJfmOiDRZAYHui/3pzPC0uLd6lQnVM8GCua6PPJrp+980YzAH7v8P01xSxs8YY='} 2023-09-20T14:40:34.361 INFO:teuthology.orchestra.console.smithi149:Power off 2023-09-20T14:40:34.361 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-20T14:40:34.375 INFO:teuthology.orchestra.console.smithi159:Power off 2023-09-20T14:40:34.376 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-20T14:40:34.384 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2023-09-20T14:40:34.384 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:40:34.397 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-09-20T14:40:34.397 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-20T14:40:34.406 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-09-20T14:40:34.419 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-09-20T14:40:34.508 INFO:teuthology.orchestra.console.smithi149:Power off completed 2023-09-20T14:40:34.520 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-09-20T14:40:34.655 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com 2023-09-20T14:40:34.670 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com