2023-11-05T04:19:09.226 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-05T04:19:09.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T04:19:09.376 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fadec755ee0>, signals=[15]) 2023-11-05T04:19:09.378 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-11-05T04:19:09.378 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-11-05T04:19:09.378 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-05T04:19:09.402 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-11-05T04:19:09.402 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-11-05T04:19:09.402 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-11-05T04:19:09.404 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"} 2023-11-05T04:19:09.426 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-11-05T04:19:09.472 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-05T04:19:09.495 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-05T04:19:09.513 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_centos_8.stream (ID 3) 2023-11-05T04:19:09.513 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 3} 2023-11-05T04:19:09.541 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_8.stream (ID 3) 2023-11-05T04:19:09.541 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 3} 2023-11-05T04:19:09.561 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 8.stream 2023-11-05T04:19:09.561 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:19:09.580 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 8.stream 2023-11-05T04:19:09.581 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:19:09.621 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"} 2023-11-05T04:19:09.639 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-11-05T04:19:09.655 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1} 2023-11-05T04:19:09.678 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-11-05T04:19:09.704 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:19:09.730 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:19:09.801 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-05T04:19:09.802 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T04:19:09.817 INFO:teuthology.orchestra.console.smithi195:Power off 2023-11-05T04:19:09.817 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T04:19:09.826 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-05T04:19:09.826 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:19:09.838 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-11-05T04:19:09.838 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:19:09.848 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-05T04:19:09.861 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-11-05T04:19:09.962 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-11-05T04:19:10.063 INFO:teuthology.orchestra.console.smithi195:Power on 2023-11-05T04:19:10.063 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-05T04:19:10.087 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-11-05T04:19:10.088 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:19:10.112 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-11-05T04:19:13.850 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:19:13.959 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-05T04:19:14.113 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:19:14.223 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-11-05T04:19:17.962 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:19:18.076 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-05T04:19:18.224 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:19:18.337 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-11-05T04:19:18.439 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-11-05T04:19:18.540 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-11-05T04:19:18.540 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:19:22.078 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:19:22.188 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-05T04:19:22.289 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-05T04:19:22.391 INFO:teuthology.orchestra.console.smithi186:Power on 2023-11-05T04:19:22.391 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-05T04:19:22.415 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-11-05T04:19:22.416 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:19:22.440 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-05T04:19:26.442 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:19:26.551 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-05T04:19:30.554 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:19:30.663 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-05T04:19:30.765 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-11-05T04:19:30.865 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-11-05T04:19:30.866 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:19:33.618 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:19:45.954 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:19:48.696 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:20:01.046 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:20:03.766 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:20:16.138 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:20:18.848 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:20:31.230 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:20:33.917 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:20:46.314 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:20:48.993 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:21:01.410 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:21:04.074 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:21:16.493 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:21:19.156 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:21:31.574 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:21:34.227 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:21:46.654 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:21:49.306 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:22:01.736 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:22:04.364 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-11-05T04:22:04.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:22:07.482 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-05T04:22:13.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:22:16.574 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-05T04:22:16.801 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-11-05T04:22:16.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:22:19.930 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-05T04:22:22.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:22:25.658 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-05T04:22:25.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:22:28.986 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-05T04:22:31.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:22:34.718 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-05T04:22:34.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:22:38.042 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-05T04:22:40.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:22:43.806 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-11-05T04:22:44.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:22:47.098 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-05T04:22:49.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:22:53.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:22:56.154 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-05T04:23:02.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:23:05.214 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-05T04:23:11.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:23:14.298 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-05T04:23:20.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:23:23.358 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-05T04:23:29.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:23:47.838 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-05T04:23:49.814 WARNING:teuthology.provision.fog.smithi195:timed out 2023-11-05T04:23:53.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:23:55.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:23:56.121 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-05T04:23:56.122 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-05T04:23:56.357 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-11-05T04:23:56.358 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-11-05T04:23:56.377 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2023-11-05T04:23:56.378 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2023-11-05T04:23:56.437 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-11-05T04:23:56.437 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-11-05T04:23:56.542 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2023-11-05T04:23:56.571 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-11-05T04:23:56.640 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2023-11-05T04:23:56.709 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-11-05T04:23:56.777 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-11-05T04:23:56.835 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-11-05T04:23:56.835 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8" 2023-11-05T04:23:56.835 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-11-05T04:23:56.835 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-11-05T04:23:56.836 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8" 2023-11-05T04:23:56.836 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-11-05T04:23:56.836 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-05T04:23:56.836 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-11-05T04:23:56.836 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-05T04:23:56.837 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-11-05T04:23:56.837 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T04:23:56.837 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-05T04:23:56.837 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T04:23:56.838 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-11-05T04:23:56.840 DEBUG:teuthology.parallel:result is None 2023-11-05T04:23:56.922 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-05T04:24:02.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:24:04.805 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-05T04:24:04.806 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-05T04:24:30.506 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-11-05T04:24:30.507 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-11-05T04:24:30.532 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2023-11-05T04:24:30.532 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts 2023-11-05T04:24:30.593 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-11-05T04:24:30.593 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-11-05T04:24:30.718 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts 2023-11-05T04:24:30.749 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2023-11-05T04:24:30.819 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname 2023-11-05T04:24:30.888 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-11-05T04:24:30.957 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-05T04:24:31.016 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-11-05T04:24:31.016 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-11-05T04:24:31.017 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-11-05T04:24:31.017 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-11-05T04:24:31.017 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-11-05T04:24:31.017 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-11-05T04:24:31.017 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-05T04:24:31.018 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-11-05T04:24:31.018 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-05T04:24:31.018 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-11-05T04:24:31.018 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T04:24:31.018 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-05T04:24:31.019 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T04:24:31.019 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-11-05T04:24:31.020 DEBUG:teuthology.parallel:result is None 2023-11-05T04:24:31.172 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-11-05T04:24:31.173 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-05T04:24:31.196 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-11-05T04:24:31.197 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-05T04:24:31.214 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-11-05T04:24:31.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-05T04:24:31.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:24:31.283 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-11-05T04:24:31.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-05T04:24:31.353 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-11-05T04:24:31.411 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-11-05T04:24:31.411 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-05T04:24:31.469 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-11-05T04:24:31.469 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-11-05T04:24:31.470 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-11-05T04:24:31.470 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-11-05T04:24:31.470 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-11-05T04:24:31.470 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-11-05T04:24:31.471 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-05T04:24:31.471 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-11-05T04:24:31.471 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-05T04:24:31.471 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-11-05T04:24:31.471 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T04:24:31.472 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-05T04:24:31.472 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T04:24:31.473 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-05T04:24:31.497 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-11-05T04:24:31.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-11-05T04:24:31.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-05T04:24:31.566 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-11-05T04:24:31.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-11-05T04:24:31.702 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-11-05T04:24:31.761 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-11-05T04:24:31.761 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-11-05T04:24:31.819 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-11-05T04:24:31.820 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8" 2023-11-05T04:24:31.820 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-11-05T04:24:31.820 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-11-05T04:24:31.820 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8" 2023-11-05T04:24:31.821 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-11-05T04:24:31.821 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-05T04:24:31.821 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-11-05T04:24:31.821 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-05T04:24:31.821 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-11-05T04:24:31.822 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-05T04:24:31.822 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-05T04:24:31.822 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-05T04:24:31.823 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-11-05T04:24:31.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T04:24:31.940 INFO:teuthology.dispatcher.supervisor:Running job 7447978 2023-11-05T04:24:31.941 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-11-04_23:24:43-orch:cephadm-wip-adk3-testing-2023-11-03-2000-distro-default-smithi/7447978 --name adking-2023-11-04_23:24:43-orch:cephadm-wip-adk3-testing-2023-11-03-2000-distro-default-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/adking-2023-11-04_23:24:43-orch:cephadm-wip-adk3-testing-2023-11-03-2000-distro-default-smithi/7447978/orig.config.yaml 2023-11-05T04:24:31.944 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-11-04_23:24:43-orch:cephadm-wip-adk3-testing-2023-11-03-2000-distro-default-smithi/7447978 2023-11-05T04:24:31.945 INFO:teuthology.dispatcher.supervisor:Job PID: 960829 2023-11-05T04:24:31.946 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-05T04:26:32.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T04:28:32.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T04:30:32.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T04:32:32.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T04:34:32.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T04:36:32.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T04:38:33.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T04:40:33.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T04:42:33.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T04:44:33.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T04:44:33.616 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-05T04:44:33.728 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-05T04:44:33.728 INFO:teuthology.nuke:Checking targets against current locks 2023-11-05T04:44:33.771 DEBUG:teuthology.nuke:shortname: smithi186 2023-11-05T04:44:33.771 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T04:44:33.789 DEBUG:teuthology.nuke:shortname: smithi195 2023-11-05T04:44:33.789 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T04:44:33.792 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-04_23:24:43-orch:cephadm-wip-adk3-testing-2023-11-03-2000-distro-default-smithi/7447978', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 04:19:08.415992', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBARRSpSoH/Md3tT0hS9XqIe7qrUbC0LEBQI1EaCHbwJpatS5qx5nZPtDLj35vaxAPeog8kJUoLxaIFLafE7RACA='} 2023-11-05T04:44:33.809 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-04_23:24:43-orch:cephadm-wip-adk3-testing-2023-11-03-2000-distro-default-smithi/7447978', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-05 04:19:08.417433', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOWwFZORGM2LmOUClZXfnV6MDl8uGMt3UGc1iWCjc74vmqph6OphST6dAjaDTQy4iyRWkGqmED/2jCmVJglHPkY='} 2023-11-05T04:44:33.837 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-05T04:44:33.837 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T04:44:33.858 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-05T04:44:33.858 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:44:33.872 INFO:teuthology.orchestra.console.smithi195:Power off 2023-11-05T04:44:33.873 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T04:44:33.882 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-05T04:44:33.893 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-11-05T04:44:33.893 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T04:44:33.914 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-11-05T04:44:33.984 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-05T04:44:34.015 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-11-05T04:44:34.132 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com 2023-11-05T04:44:34.157 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com