2023-09-28T06:05:31.099 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-28T06:05:31.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T06:05:31.235 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1831bf8670>, signals=[15]) 2023-09-28T06:05:31.236 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-09-28T06:05:31.236 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-09-28T06:05:31.238 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-09-28T06:05:31.263 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2023-09-28T06:05:31.263 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2023-09-28T06:05:31.263 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-09-28T06:05:31.264 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /host {"name": "smithi069"} 2023-09-28T06:05:31.288 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /host {"name": "smithi178"} 2023-09-28T06:05:31.340 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-28T06:05:31.364 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-28T06:05:31.384 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-28T06:05:31.384 DEBUG:teuthology.provision.fog.smithi069:FOG request: PUT /host/174 {"imageID": 7} 2023-09-28T06:05:31.402 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-28T06:05:31.403 DEBUG:teuthology.provision.fog.smithi178:FOG request: PUT /host/283 {"imageID": 7} 2023-09-28T06:05:31.431 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of rhel 8.4 2023-09-28T06:05:31.431 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:05:31.455 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of rhel 8.4 2023-09-28T06:05:31.455 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:05:31.486 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /tasktype {"name": "deploy"} 2023-09-28T06:05:31.497 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /tasktype {"name": "deploy"} 2023-09-28T06:05:31.524 DEBUG:teuthology.provision.fog.smithi069:FOG request: POST /host/174/task {"taskTypeID": 1} 2023-09-28T06:05:31.533 DEBUG:teuthology.provision.fog.smithi178:FOG request: POST /host/283/task {"taskTypeID": 1} 2023-09-28T06:05:31.581 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:05:31.662 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:05:31.718 INFO:teuthology.orchestra.console.smithi069:Power off 2023-09-28T06:05:31.718 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T06:05:31.739 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-09-28T06:05:31.739 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:05:31.751 INFO:teuthology.orchestra.console.smithi178:Power off 2023-09-28T06:05:31.751 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T06:05:31.760 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-09-28T06:05:31.771 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-09-28T06:05:31.771 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:05:31.791 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-09-28T06:05:35.765 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:05:35.792 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:05:35.873 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-09-28T06:05:35.901 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-09-28T06:05:39.875 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:05:39.901 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:05:39.984 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-09-28T06:05:40.009 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-09-28T06:05:40.110 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-09-28T06:05:40.211 INFO:teuthology.orchestra.console.smithi178:Power on 2023-09-28T06:05:40.211 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-28T06:05:40.233 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On 2023-09-28T06:05:40.233 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:05:40.253 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-09-28T06:05:43.986 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:05:44.094 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-09-28T06:05:44.195 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-09-28T06:05:44.253 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:05:44.296 INFO:teuthology.orchestra.console.smithi069:Power on 2023-09-28T06:05:44.296 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-28T06:05:44.315 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2023-09-28T06:05:44.316 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:05:44.335 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-09-28T06:05:44.362 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-09-28T06:05:48.340 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:05:48.363 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:05:48.449 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-09-28T06:05:48.470 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-09-28T06:05:48.550 INFO:teuthology.orchestra.console.smithi069:Power on completed 2023-09-28T06:05:48.571 INFO:teuthology.orchestra.console.smithi178:Power on completed 2023-09-28T06:05:48.652 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-09-28T06:05:48.652 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:05:48.672 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2023-09-28T06:05:48.672 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:06:03.714 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:06:03.727 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:06:18.778 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:06:18.781 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:06:33.858 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:06:33.859 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:06:48.922 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:06:48.924 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:07:03.990 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:07:03.991 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:07:19.039 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:07:19.052 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:07:34.114 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:07:34.116 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:07:49.197 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:07:49.199 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:08:04.270 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:08:04.272 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:08:19.346 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:08:19.348 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:08:34.422 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:08:34.424 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-28T06:08:34.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:08:49.502 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-09-28T06:08:49.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:08:52.862 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-28T06:08:58.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:09:01.946 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-28T06:09:07.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:09:07.962 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-09-28T06:09:11.006 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-28T06:09:13.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:09:17.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:09:17.018 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-09-28T06:09:20.090 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-28T06:09:23.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:09:26.074 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-09-28T06:09:26.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:09:29.146 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-28T06:09:32.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:09:35.131 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-09-28T06:09:35.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:09:41.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:09:44.218 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-09-28T06:09:50.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:09:53.306 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-09-28T06:09:59.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:10:35.177 WARNING:teuthology.provision.fog.smithi069:timed out 2023-09-28T06:10:41.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:10:41.461 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-28T06:10:41.461 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-28T06:10:41.750 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-09-28T06:10:41.751 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-09-28T06:10:41.766 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069 2023-09-28T06:10:41.767 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069 /etc/hosts 2023-09-28T06:10:41.823 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-09-28T06:10:41.823 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-09-28T06:10:41.945 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069/smithi069/g' /etc/hosts 2023-09-28T06:10:41.972 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-09-28T06:10:42.038 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069/smithi069/g' /etc/hostname 2023-09-28T06:10:42.103 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-09-28T06:10:42.168 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-09-28T06:10:42.222 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T06:10:42.222 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T06:10:42.222 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel" 2023-09-28T06:10:42.222 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora" 2023-09-28T06:10:42.222 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.4" 2023-09-28T06:10:42.222 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-09-28T06:10:42.223 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T06:10:42.223 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-09-28T06:10:42.223 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T06:10:42.223 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T06:10:42.223 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T06:10:42.223 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T06:10:42.223 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T06:10:42.223 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T06:10:42.223 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T06:10:42.223 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T06:10:42.223 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T06:10:42.224 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-09-28T06:10:42.225 DEBUG:teuthology.parallel:result is None 2023-09-28T06:10:59.330 WARNING:teuthology.provision.fog.smithi178:timed out 2023-09-28T06:11:05.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:11:05.641 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-28T06:11:05.642 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-28T06:11:05.916 INFO:teuthology.provision.fog.smithi178:Node is ready 2023-09-28T06:11:05.916 DEBUG:teuthology.orchestra.run.smithi178:> hostname 2023-09-28T06:11:05.931 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com 2023-09-28T06:11:05.931 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts 2023-09-28T06:11:05.986 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2023-09-28T06:11:05.986 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-09-28T06:11:06.105 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts 2023-09-28T06:11:06.129 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts 2023-09-28T06:11:06.194 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname 2023-09-28T06:11:06.257 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-09-28T06:11:06.320 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-09-28T06:11:06.375 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T06:11:06.375 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T06:11:06.375 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2023-09-28T06:11:06.375 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2023-09-28T06:11:06.375 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.4" 2023-09-28T06:11:06.375 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-09-28T06:11:06.375 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T06:11:06.375 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-09-28T06:11:06.375 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T06:11:06.375 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T06:11:06.376 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T06:11:06.376 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T06:11:06.376 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-09-28T06:11:06.376 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T06:11:06.376 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T06:11:06.376 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T06:11:06.376 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T06:11:06.376 INFO:teuthology.provision.fog.smithi178:Deploy complete! 2023-09-28T06:11:06.377 DEBUG:teuthology.parallel:result is None 2023-09-28T06:11:06.524 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-09-28T06:11:06.524 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-28T06:11:06.543 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com 2023-09-28T06:11:06.543 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-28T06:11:06.560 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-09-28T06:11:06.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-09-28T06:11:06.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:11:06.628 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-09-28T06:11:06.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-09-28T06:11:06.749 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-09-28T06:11:06.803 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-09-28T06:11:06.803 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-09-28T06:11:06.857 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T06:11:06.857 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T06:11:06.857 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel" 2023-09-28T06:11:06.857 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora" 2023-09-28T06:11:06.857 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.4" 2023-09-28T06:11:06.857 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-09-28T06:11:06.857 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T06:11:06.857 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-09-28T06:11:06.857 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T06:11:06.857 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T06:11:06.857 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T06:11:06.858 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T06:11:06.858 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-09-28T06:11:06.858 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T06:11:06.858 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T06:11:06.858 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T06:11:06.858 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T06:11:06.858 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-09-28T06:11:06.884 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server 2023-09-28T06:11:06.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-09-28T06:11:06.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T06:11:06.947 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-09-28T06:11:07.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-09-28T06:11:07.012 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-09-28T06:11:07.065 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-09-28T06:11:07.066 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-09-28T06:11:07.119 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T06:11:07.119 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T06:11:07.119 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2023-09-28T06:11:07.120 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2023-09-28T06:11:07.120 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.4" 2023-09-28T06:11:07.120 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-09-28T06:11:07.120 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T06:11:07.120 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-09-28T06:11:07.120 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T06:11:07.120 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T06:11:07.120 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T06:11:07.120 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T06:11:07.120 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-09-28T06:11:07.120 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T06:11:07.121 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T06:11:07.121 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T06:11:07.121 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T06:11:07.121 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-09-28T06:11:07.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T06:11:07.249 INFO:teuthology.dispatcher.supervisor:Running job 7403678 2023-09-28T06:11:07.250 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-27_19:25:46-fs-wip-yuri2-testing-2023-09-27-0908-quincy-distro-default-smithi/7403678 --name yuriw-2023-09-27_19:25:46-fs-wip-yuri2-testing-2023-09-27-0908-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} -- /home/teuthworker/archive/yuriw-2023-09-27_19:25:46-fs-wip-yuri2-testing-2023-09-27-0908-quincy-distro-default-smithi/7403678/orig.config.yaml 2023-09-28T06:11:07.254 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-27_19:25:46-fs-wip-yuri2-testing-2023-09-27-0908-quincy-distro-default-smithi/7403678 2023-09-28T06:11:07.254 INFO:teuthology.dispatcher.supervisor:Job PID: 2094221 2023-09-28T06:11:07.254 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-28T06:13:07.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T06:15:07.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T06:17:07.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T06:19:07.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T06:21:08.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T06:23:08.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T06:25:08.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T06:27:08.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T06:27:08.498 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-28T06:27:08.604 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-28T06:27:08.605 INFO:teuthology.nuke:Checking targets against current locks 2023-09-28T06:27:08.650 DEBUG:teuthology.nuke:shortname: smithi069 2023-09-28T06:27:08.650 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T06:27:08.673 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:25:46-fs-wip-yuri2-testing-2023-09-27-0908-quincy-distro-default-smithi/7403678', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 06:05:30.307046', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUEBzt97jEwwcYk6Mu3wd2oosAFzrKttdorai7YYL9CodBgWVnmqm9PR9bR9EhsXACECm9HBOYcbUEwr18WF/s='} 2023-09-28T06:27:08.676 DEBUG:teuthology.nuke:shortname: smithi178 2023-09-28T06:27:08.676 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T06:27:08.700 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:25:46-fs-wip-yuri2-testing-2023-09-27-0908-quincy-distro-default-smithi/7403678', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 06:05:30.309004', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIjqXMGq9AFCf3l7nao0Qjt3PgMyA3MzHBkmxNs/rXLQVsAAz28rexGi8XR7uqXPdcE0DYkPBp3WDfEZyXBKts4='} 2023-09-28T06:27:08.728 INFO:teuthology.orchestra.console.smithi069:Power off 2023-09-28T06:27:08.729 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T06:27:08.750 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-09-28T06:27:08.751 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:27:08.763 INFO:teuthology.orchestra.console.smithi178:Power off 2023-09-28T06:27:08.763 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T06:27:08.771 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-09-28T06:27:08.783 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-09-28T06:27:08.783 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T06:27:08.803 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-09-28T06:27:08.872 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-09-28T06:27:08.904 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-09-28T06:27:09.023 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com 2023-09-28T06:27:09.047 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com