2023-11-15T02:25:17.886 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-15T02:25:17.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:25:18.030 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0f51ac7670>, signals=[15]) 2023-11-15T02:25:18.032 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging 2023-11-15T02:25:18.032 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T02:25:18.032 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-11-15T02:25:18.057 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2023-11-15T02:25:18.058 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T02:25:18.058 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-11-15T02:25:18.059 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /host {"name": "smithi089"} 2023-11-15T02:25:18.082 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /host {"name": "smithi177"} 2023-11-15T02:25:18.133 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-15T02:25:18.149 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-15T02:25:18.174 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_centos_8.stream (ID 3) 2023-11-15T02:25:18.175 DEBUG:teuthology.provision.fog.smithi089:FOG request: PUT /host/194 {"imageID": 3} 2023-11-15T02:25:18.182 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_8.stream (ID 3) 2023-11-15T02:25:18.182 DEBUG:teuthology.provision.fog.smithi177:FOG request: PUT /host/282 {"imageID": 3} 2023-11-15T02:25:18.233 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 8.stream 2023-11-15T02:25:18.234 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:25:18.237 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 8.stream 2023-11-15T02:25:18.237 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:25:18.282 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T02:25:18.285 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T02:25:18.322 DEBUG:teuthology.provision.fog.smithi177:FOG request: POST /host/282/task {"taskTypeID": 1} 2023-11-15T02:25:18.329 DEBUG:teuthology.provision.fog.smithi089:FOG request: POST /host/194/task {"taskTypeID": 1} 2023-11-15T02:25:18.483 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:25:18.492 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:25:18.563 INFO:teuthology.orchestra.console.smithi089:Power off 2023-11-15T02:25:18.564 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T02:25:18.577 INFO:teuthology.orchestra.console.smithi177:Power off 2023-11-15T02:25:18.578 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T02:25:18.587 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-11-15T02:25:18.588 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:25:18.601 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2023-11-15T02:25:18.601 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:25:18.611 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-11-15T02:25:18.624 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-11-15T02:25:22.616 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:25:22.626 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:25:22.725 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-11-15T02:25:22.735 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-11-15T02:25:26.730 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:25:26.739 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:25:26.842 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-11-15T02:25:26.849 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-11-15T02:25:30.846 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:25:30.853 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:25:30.956 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-11-15T02:25:30.963 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-11-15T02:25:31.058 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-11-15T02:25:31.064 INFO:teuthology.orchestra.console.smithi177:Power off completed 2023-11-15T02:25:31.159 INFO:teuthology.orchestra.console.smithi089:Power on 2023-11-15T02:25:31.160 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T02:25:31.170 INFO:teuthology.orchestra.console.smithi177:Power on 2023-11-15T02:25:31.171 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T02:25:31.183 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On 2023-11-15T02:25:31.184 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:25:31.194 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On 2023-11-15T02:25:31.195 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:25:31.203 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-11-15T02:25:31.216 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-11-15T02:25:35.206 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:25:35.217 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:25:35.315 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-11-15T02:25:35.326 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-11-15T02:25:35.416 INFO:teuthology.orchestra.console.smithi089:Power on completed 2023-11-15T02:25:35.427 INFO:teuthology.orchestra.console.smithi177:Power on completed 2023-11-15T02:25:35.518 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2023-11-15T02:25:35.518 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:25:35.528 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2023-11-15T02:25:35.529 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:25:50.586 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:25:50.589 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:26:05.679 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:26:05.681 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:26:20.754 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:26:20.756 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:26:35.846 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:26:35.848 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:26:50.938 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:26:50.940 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:27:06.050 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:27:06.052 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:27:21.146 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:27:21.148 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:27:36.246 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:27:36.248 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:27:51.350 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:27:51.352 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:28:06.453 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:28:06.455 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:28:21.550 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-11-15T02:28:21.552 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-11-15T02:28:21.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:28:21.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:28:24.698 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-11-15T02:28:24.730 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-15T02:28:30.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:28:30.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:28:33.786 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-11-15T02:28:33.787 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-15T02:28:39.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:28:39.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:28:42.874 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-11-15T02:28:42.875 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-15T02:28:48.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:28:48.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:28:51.934 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-11-15T02:28:51.962 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-15T02:28:57.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:28:57.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:29:01.018 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-11-15T02:29:01.019 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-15T02:29:07.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:29:07.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:29:10.075 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-11-15T02:29:10.075 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-11-15T02:29:16.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:29:16.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:29:19.130 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-11-15T02:29:25.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:30:16.131 WARNING:teuthology.provision.fog.smithi177:timed out 2023-11-15T02:30:22.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:30:22.366 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T02:30:22.367 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T02:30:22.602 INFO:teuthology.provision.fog.smithi177:Node is ready 2023-11-15T02:30:22.603 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2023-11-15T02:30:22.666 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com 2023-11-15T02:30:22.667 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts 2023-11-15T02:30:22.727 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177 2023-11-15T02:30:22.728 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-11-15T02:30:22.839 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts 2023-11-15T02:30:22.871 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2023-11-15T02:30:22.941 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname 2023-11-15T02:30:23.011 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-11-15T02:30:23.079 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-11-15T02:30:23.137 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2023-11-15T02:30:23.138 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8" 2023-11-15T02:30:23.138 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2023-11-15T02:30:23.138 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2023-11-15T02:30:23.139 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8" 2023-11-15T02:30:23.139 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-11-15T02:30:23.139 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-15T02:30:23.139 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-11-15T02:30:23.139 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-15T02:30:23.140 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2023-11-15T02:30:23.140 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T02:30:23.140 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T02:30:23.140 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-15T02:30:23.141 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2023-11-15T02:30:23.142 DEBUG:teuthology.parallel:result is None 2023-11-15T02:30:25.141 WARNING:teuthology.provision.fog.smithi089:timed out 2023-11-15T02:30:31.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:30:31.411 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T02:30:31.412 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T02:30:31.644 INFO:teuthology.provision.fog.smithi089:Node is ready 2023-11-15T02:30:31.645 DEBUG:teuthology.orchestra.run.smithi089:> hostname 2023-11-15T02:30:31.704 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2023-11-15T02:30:31.704 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts 2023-11-15T02:30:31.763 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2023-11-15T02:30:31.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-11-15T02:30:31.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts 2023-11-15T02:30:31.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts 2023-11-15T02:30:31.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname 2023-11-15T02:30:32.032 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-11-15T02:30:32.099 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-11-15T02:30:32.156 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-11-15T02:30:32.157 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8" 2023-11-15T02:30:32.157 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-11-15T02:30:32.157 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-11-15T02:30:32.157 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8" 2023-11-15T02:30:32.158 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-11-15T02:30:32.158 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-15T02:30:32.158 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-11-15T02:30:32.158 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-15T02:30:32.158 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-11-15T02:30:32.159 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T02:30:32.159 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T02:30:32.159 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-15T02:30:32.159 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2023-11-15T02:30:32.160 DEBUG:teuthology.parallel:result is None 2023-11-15T02:30:32.308 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2023-11-15T02:30:32.308 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-15T02:30:32.330 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2023-11-15T02:30:32.330 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-15T02:30:32.356 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2023-11-15T02:30:32.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-11-15T02:30:32.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:30:32.425 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-11-15T02:30:32.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-11-15T02:30:32.450 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-11-15T02:30:32.507 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-11-15T02:30:32.507 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-11-15T02:30:32.565 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-11-15T02:30:32.565 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8" 2023-11-15T02:30:32.565 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-11-15T02:30:32.565 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-11-15T02:30:32.566 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8" 2023-11-15T02:30:32.566 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-11-15T02:30:32.566 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-15T02:30:32.566 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-11-15T02:30:32.566 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-15T02:30:32.567 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-11-15T02:30:32.567 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T02:30:32.567 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T02:30:32.567 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-15T02:30:32.568 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-11-15T02:30:32.589 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2023-11-15T02:30:32.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-15T02:30:32.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T02:30:32.658 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-11-15T02:30:32.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-11-15T02:30:32.732 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2023-11-15T02:30:32.793 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2023-11-15T02:30:32.793 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-11-15T02:30:32.853 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2023-11-15T02:30:32.853 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8" 2023-11-15T02:30:32.853 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2023-11-15T02:30:32.853 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2023-11-15T02:30:32.854 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8" 2023-11-15T02:30:32.854 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-11-15T02:30:32.854 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-15T02:30:32.854 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-11-15T02:30:32.854 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-15T02:30:32.855 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2023-11-15T02:30:32.855 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T02:30:32.855 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T02:30:32.855 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-15T02:30:32.856 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-11-15T02:30:32.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:30:32.960 INFO:teuthology.dispatcher.supervisor:Running job 7458141 2023-11-15T02:30:32.961 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458141 --name yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi --description fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} -- /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458141/orig.config.yaml 2023-11-15T02:30:32.964 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458141 2023-11-15T02:30:32.964 INFO:teuthology.dispatcher.supervisor:Job PID: 812511 2023-11-15T02:30:32.964 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-15T02:32:33.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:34:33.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:36:33.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:38:33.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:40:33.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:42:34.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:44:34.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:46:34.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:48:34.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:50:34.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:52:34.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T02:52:34.983 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-15T02:52:35.130 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-15T02:52:35.131 INFO:teuthology.nuke:Checking targets against current locks 2023-11-15T02:52:35.175 DEBUG:teuthology.nuke:shortname: smithi089 2023-11-15T02:52:35.176 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T02:52:35.198 DEBUG:teuthology.nuke:shortname: smithi177 2023-11-15T02:52:35.198 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T02:52:35.202 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458141', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 02:25:17.065384', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPlFsVXfKTX5a5Eg3vxnRtTiU26GNDy57XBNgWG87SVKh/ctiYvDrQho2uL15PCtugXbNlisVzSM4tEG+X07+ec='} 2023-11-15T02:52:35.227 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458141', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 02:25:17.066781', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMByKr2e+BewtQjBAIQo0PfSOp8NyrTJFTeN7DPw4SkFAuDjzu8K42MWTB82C6mlq+OGi0uVVym/SHfsrURN5cI='} 2023-11-15T02:52:35.255 INFO:teuthology.orchestra.console.smithi089:Power off 2023-11-15T02:52:35.256 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T02:52:35.286 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-11-15T02:52:35.287 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:52:35.299 INFO:teuthology.orchestra.console.smithi177:Power off 2023-11-15T02:52:35.300 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T02:52:35.312 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-11-15T02:52:35.326 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2023-11-15T02:52:35.327 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T02:52:35.349 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-11-15T02:52:35.413 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-11-15T02:52:35.451 INFO:teuthology.orchestra.console.smithi177:Power off completed 2023-11-15T02:52:35.566 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com 2023-11-15T02:52:35.598 INFO:teuthology.lock.ops:unlocked: smithi177.front.sepia.ceph.com