2023-09-21T11:47:41.915 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-21T11:47:41.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:47:42.049 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f31f3db7c10>, signals=[15]) 2023-09-21T11:47:42.050 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2023-09-21T11:47:42.050 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T11:47:42.051 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-09-21T11:47:42.076 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-09-21T11:47:42.076 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T11:47:42.076 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-09-21T11:47:42.078 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /host {"name": "smithi144"} 2023-09-21T11:47:42.109 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-09-21T11:47:42.163 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-21T11:47:42.187 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-21T11:47:42.206 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-21T11:47:42.206 DEBUG:teuthology.provision.fog.smithi144:FOG request: PUT /host/249 {"imageID": 5} 2023-09-21T11:47:42.231 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-21T11:47:42.231 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 5} 2023-09-21T11:47:42.253 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of rhel 8.6 2023-09-21T11:47:42.253 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:47:42.282 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.6 2023-09-21T11:47:42.282 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:47:42.334 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T11:47:42.355 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T11:47:42.371 DEBUG:teuthology.provision.fog.smithi144:FOG request: POST /host/249/task {"taskTypeID": 1} 2023-09-21T11:47:42.389 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-09-21T11:47:42.449 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:47:42.466 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:47:42.588 INFO:teuthology.orchestra.console.smithi144:Power off 2023-09-21T11:47:42.589 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T11:47:42.601 INFO:teuthology.orchestra.console.smithi169:Power off 2023-09-21T11:47:42.601 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T11:47:42.613 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-09-21T11:47:42.613 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:47:42.622 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-09-21T11:47:42.622 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:47:42.633 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-09-21T11:47:42.642 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-09-21T11:47:46.638 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:47:46.645 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:47:46.747 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-09-21T11:47:46.754 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-09-21T11:47:50.751 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:47:50.758 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:47:50.860 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-21T11:47:50.866 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-09-21T11:47:50.962 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-09-21T11:47:51.062 INFO:teuthology.orchestra.console.smithi144:Power on 2023-09-21T11:47:51.063 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T11:47:51.084 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On 2023-09-21T11:47:51.085 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:47:51.104 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-21T11:47:54.870 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:47:54.979 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-09-21T11:47:55.080 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-09-21T11:47:55.105 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:47:55.181 INFO:teuthology.orchestra.console.smithi169:Power on 2023-09-21T11:47:55.181 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T11:47:55.202 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-09-21T11:47:55.203 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:47:55.214 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-21T11:47:55.226 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-09-21T11:47:59.218 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:47:59.227 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:47:59.327 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-09-21T11:47:59.336 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-09-21T11:47:59.429 INFO:teuthology.orchestra.console.smithi144:Power on completed 2023-09-21T11:47:59.530 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2023-09-21T11:47:59.531 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:48:03.338 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T11:48:03.447 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-09-21T11:48:03.548 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-09-21T11:48:03.649 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-09-21T11:48:03.650 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:48:14.636 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:48:18.762 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:48:29.754 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:48:33.870 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:48:44.846 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:48:48.962 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:48:59.954 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:49:04.058 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:49:15.042 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:49:19.146 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:49:30.122 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:49:34.230 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:49:45.202 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:49:49.318 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:50:00.294 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:50:04.401 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:50:15.370 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:50:19.482 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:50:30.454 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-21T11:50:30.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:50:34.562 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:50:48.986 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-21T11:50:49.649 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-09-21T11:50:49.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:50:54.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:50:58.042 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-21T11:51:04.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:51:07.130 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-21T11:51:08.186 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-21T11:51:13.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:51:14.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:51:16.186 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-21T11:51:17.242 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-21T11:51:22.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:51:23.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:51:25.278 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-21T11:51:26.298 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-21T11:51:31.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:51:32.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:51:35.354 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-21T11:51:41.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:51:44.410 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-21T11:51:50.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:51:53.466 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-21T11:51:59.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:52:17.822 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-21T11:52:23.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:52:26.910 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-21T11:52:31.286 WARNING:teuthology.provision.fog.smithi144:timed out 2023-09-21T11:52:32.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:52:35.994 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-09-21T11:52:37.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:52:37.612 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-21T11:52:37.613 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-21T11:52:37.913 INFO:teuthology.provision.fog.smithi144:Node is ready 2023-09-21T11:52:37.914 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2023-09-21T11:52:37.931 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144 2023-09-21T11:52:37.932 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144 /etc/hosts 2023-09-21T11:52:37.987 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2023-09-21T11:52:37.987 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-09-21T11:52:38.113 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144/smithi144/g' /etc/hosts 2023-09-21T11:52:38.143 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2023-09-21T11:52:38.209 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144/smithi144/g' /etc/hostname 2023-09-21T11:52:38.274 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-09-21T11:52:38.339 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-09-21T11:52:38.393 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T11:52:38.393 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T11:52:38.394 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-09-21T11:52:38.394 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-09-21T11:52:38.394 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6" 2023-09-21T11:52:38.394 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-09-21T11:52:38.394 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T11:52:38.395 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-09-21T11:52:38.395 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T11:52:38.395 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T11:52:38.395 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T11:52:38.395 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T11:52:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-21T11:52:38.396 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T11:52:38.396 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T11:52:38.396 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T11:52:38.397 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T11:52:38.398 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2023-09-21T11:52:38.400 DEBUG:teuthology.parallel:result is None 2023-09-21T11:52:41.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:52:42.312 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-21T11:52:42.313 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-21T11:52:42.590 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-09-21T11:52:42.590 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-09-21T11:52:42.605 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-09-21T11:52:42.606 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-09-21T11:52:42.661 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-09-21T11:52:42.662 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-09-21T11:52:42.777 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-09-21T11:52:42.803 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-09-21T11:52:42.869 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-09-21T11:52:42.936 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-09-21T11:52:43.001 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-09-21T11:52:43.056 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T11:52:43.057 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T11:52:43.057 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-09-21T11:52:43.057 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-09-21T11:52:43.057 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-09-21T11:52:43.058 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-09-21T11:52:43.058 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T11:52:43.058 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-09-21T11:52:43.058 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T11:52:43.058 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T11:52:43.059 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T11:52:43.059 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T11:52:43.059 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-09-21T11:52:43.059 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T11:52:43.059 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T11:52:43.060 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T11:52:43.060 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T11:52:43.060 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-09-21T11:52:43.061 DEBUG:teuthology.parallel:result is None 2023-09-21T11:52:43.211 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2023-09-21T11:52:43.212 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-21T11:52:43.240 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-09-21T11:52:43.240 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-21T11:52:43.266 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2023-09-21T11:52:43.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-21T11:52:43.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:52:43.334 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-09-21T11:52:43.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-21T11:52:43.405 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-09-21T11:52:43.463 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-09-21T11:52:43.463 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-09-21T11:52:43.520 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T11:52:43.521 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T11:52:43.521 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-09-21T11:52:43.521 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-09-21T11:52:43.521 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6" 2023-09-21T11:52:43.522 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-09-21T11:52:43.522 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T11:52:43.522 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-09-21T11:52:43.522 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T11:52:43.522 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T11:52:43.523 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T11:52:43.523 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T11:52:43.523 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-09-21T11:52:43.523 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T11:52:43.523 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T11:52:43.523 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T11:52:43.524 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T11:52:43.524 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-09-21T11:52:43.548 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-09-21T11:52:43.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-09-21T11:52:43.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T11:52:43.614 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-09-21T11:52:43.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-09-21T11:52:43.679 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-09-21T11:52:43.735 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-09-21T11:52:43.736 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-09-21T11:52:43.792 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T11:52:43.793 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T11:52:43.793 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-09-21T11:52:43.793 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-09-21T11:52:43.794 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-09-21T11:52:43.794 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-09-21T11:52:43.794 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T11:52:43.795 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-09-21T11:52:43.795 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T11:52:43.796 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T11:52:43.796 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T11:52:43.796 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T11:52:43.796 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-09-21T11:52:43.797 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T11:52:43.797 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T11:52:43.797 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T11:52:43.797 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T11:52:43.798 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-09-21T11:52:43.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:52:43.904 INFO:teuthology.dispatcher.supervisor:Running job 7399818 2023-09-21T11:52:43.905 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399818 --name leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399818/orig.config.yaml 2023-09-21T11:52:43.907 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399818 2023-09-21T11:52:43.908 INFO:teuthology.dispatcher.supervisor:Job PID: 3793129 2023-09-21T11:52:43.908 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-21T11:54:44.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:56:44.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:58:44.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T12:00:44.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T12:02:44.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T12:02:44.761 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-21T12:02:44.914 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-21T12:02:44.914 INFO:teuthology.nuke:Checking targets against current locks 2023-09-21T12:02:44.959 DEBUG:teuthology.nuke:shortname: smithi144 2023-09-21T12:02:44.959 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T12:02:44.981 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399818', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 11:47:41.084730', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-21T12:02:44.984 DEBUG:teuthology.nuke:shortname: smithi169 2023-09-21T12:02:44.984 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T12:02:45.009 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399818', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 11:47:41.082813', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-21T12:02:45.237 INFO:teuthology.orchestra.console.smithi144:Power off 2023-09-21T12:02:45.238 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T12:02:45.252 INFO:teuthology.orchestra.console.smithi169:Power off 2023-09-21T12:02:45.252 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T12:02:45.259 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-09-21T12:02:45.260 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:02:45.271 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-09-21T12:02:45.272 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:02:45.283 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-21T12:02:45.297 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-09-21T12:02:45.384 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-09-21T12:02:45.398 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-09-21T12:02:45.535 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com 2023-09-21T12:02:45.543 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com