2023-10-14T11:38:19.520 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T11:38:19.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T11:38:19.691 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8ec9593ca0>, signals=[15]) 2023-10-14T11:38:19.693 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2023-10-14T11:38:19.693 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2023-10-14T11:38:19.693 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-14T11:38:19.715 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2023-10-14T11:38:19.715 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2023-10-14T11:38:19.715 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-10-14T11:38:19.717 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /host {"name": "smithi059"} 2023-10-14T11:38:19.740 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2023-10-14T11:38:19.740 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2023-10-14T11:38:19.740 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-10-14T11:38:19.742 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /host {"name": "smithi086"} 2023-10-14T11:38:19.765 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /host {"name": "smithi144"} 2023-10-14T11:38:19.793 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-14T11:38:19.813 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-14T11:38:19.830 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-14T11:38:19.834 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-14T11:38:19.834 DEBUG:teuthology.provision.fog.smithi059:FOG request: PUT /host/164 {"imageID": 5} 2023-10-14T11:38:19.854 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-14T11:38:19.855 DEBUG:teuthology.provision.fog.smithi086:FOG request: PUT /host/191 {"imageID": 5} 2023-10-14T11:38:19.863 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-14T11:38:19.863 DEBUG:teuthology.provision.fog.smithi144:FOG request: PUT /host/249 {"imageID": 5} 2023-10-14T11:38:19.877 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of rhel 8.6 2023-10-14T11:38:19.878 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:38:19.897 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of rhel 8.6 2023-10-14T11:38:19.897 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:38:19.904 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of rhel 8.6 2023-10-14T11:38:19.904 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:38:19.916 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /tasktype {"name": "deploy"} 2023-10-14T11:38:19.937 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /tasktype {"name": "deploy"} 2023-10-14T11:38:19.946 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /tasktype {"name": "deploy"} 2023-10-14T11:38:19.951 DEBUG:teuthology.provision.fog.smithi059:FOG request: POST /host/164/task {"taskTypeID": 1} 2023-10-14T11:38:19.973 DEBUG:teuthology.provision.fog.smithi086:FOG request: POST /host/191/task {"taskTypeID": 1} 2023-10-14T11:38:19.981 DEBUG:teuthology.provision.fog.smithi144:FOG request: POST /host/249/task {"taskTypeID": 1} 2023-10-14T11:38:20.011 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:38:20.029 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:38:20.032 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:38:20.087 INFO:teuthology.orchestra.console.smithi059:Power off 2023-10-14T11:38:20.088 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T11:38:20.104 INFO:teuthology.orchestra.console.smithi144:Power off 2023-10-14T11:38:20.105 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T11:38:20.117 INFO:teuthology.orchestra.console.smithi086:Power off 2023-10-14T11:38:20.117 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T11:38:20.124 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-10-14T11:38:20.124 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:38:20.132 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-10-14T11:38:20.133 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:38:20.139 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-10-14T11:38:20.140 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:38:20.147 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-14T11:38:20.151 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-10-14T11:38:20.159 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-10-14T11:38:20.249 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-10-14T11:38:20.252 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-10-14T11:38:20.260 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-10-14T11:38:20.350 INFO:teuthology.orchestra.console.smithi059:Power on 2023-10-14T11:38:20.350 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-14T11:38:20.357 INFO:teuthology.orchestra.console.smithi144:Power on 2023-10-14T11:38:20.358 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-14T11:38:20.364 INFO:teuthology.orchestra.console.smithi086:Power on 2023-10-14T11:38:20.365 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-14T11:38:20.371 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2023-10-14T11:38:20.371 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:38:20.379 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On 2023-10-14T11:38:20.380 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:38:20.390 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2023-10-14T11:38:20.391 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:38:20.398 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-14T11:38:20.402 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-10-14T11:38:20.411 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-10-14T11:38:24.403 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:38:24.410 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:38:24.417 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:38:24.513 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-14T11:38:24.519 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-14T11:38:24.526 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-10-14T11:38:24.620 INFO:teuthology.orchestra.console.smithi144:Power on completed 2023-10-14T11:38:24.721 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2023-10-14T11:38:24.721 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:38:28.518 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:38:28.526 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:38:28.627 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-14T11:38:28.635 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-10-14T11:38:28.729 INFO:teuthology.orchestra.console.smithi059:Power on completed 2023-10-14T11:38:28.736 INFO:teuthology.orchestra.console.smithi086:Power on completed 2023-10-14T11:38:28.831 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2023-10-14T11:38:28.831 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:38:28.837 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2023-10-14T11:38:28.837 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:38:39.786 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:38:43.893 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:38:43.895 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:38:54.854 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:38:58.957 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:38:58.959 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:39:09.931 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:39:14.022 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:39:14.023 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:39:24.998 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:39:29.096 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:39:29.097 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:39:40.406 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:39:44.159 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:39:44.160 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:39:55.484 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:39:59.230 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:39:59.232 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:40:10.562 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:40:14.290 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:40:14.291 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:40:25.642 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:40:29.358 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:40:29.359 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:40:40.718 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:40:44.443 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:40:44.445 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:40:55.794 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:40:59.519 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-14T11:40:59.520 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:40:59.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:41:10.869 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-14T11:41:10.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:41:14.580 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-14T11:41:14.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:41:18.078 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-14T11:41:24.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:41:27.162 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-14T11:41:29.338 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-14T11:41:33.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:41:33.178 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-14T11:41:35.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:41:36.218 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-14T11:41:38.394 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-14T11:41:39.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:41:42.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:41:42.234 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-14T11:41:44.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:41:45.278 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-14T11:41:47.450 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-14T11:41:48.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:41:51.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:41:51.290 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-14T11:41:53.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:41:56.506 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-14T11:41:57.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:42:00.350 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-14T11:42:02.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:42:05.566 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-14T11:42:06.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:42:09.434 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-14T11:42:11.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:42:15.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:42:51.318 WARNING:teuthology.provision.fog.smithi059:timed out 2023-10-14T11:42:57.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:42:57.567 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-14T11:42:57.568 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-14T11:42:57.856 INFO:teuthology.provision.fog.smithi059:Node is ready 2023-10-14T11:42:57.857 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2023-10-14T11:42:57.877 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2023-10-14T11:42:57.877 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2023-10-14T11:42:57.936 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2023-10-14T11:42:57.937 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-10-14T11:42:58.059 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2023-10-14T11:42:58.089 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2023-10-14T11:42:58.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2023-10-14T11:42:58.228 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-10-14T11:42:58.296 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-14T11:42:58.355 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T11:42:58.355 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T11:42:58.355 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2023-10-14T11:42:58.356 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2023-10-14T11:42:58.356 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.6" 2023-10-14T11:42:58.356 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-10-14T11:42:58.357 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T11:42:58.357 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-10-14T11:42:58.357 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T11:42:58.357 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T11:42:58.358 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T11:42:58.358 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T11:42:58.358 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-14T11:42:58.359 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T11:42:58.359 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T11:42:58.359 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T11:42:58.359 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T11:42:58.360 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2023-10-14T11:42:58.361 DEBUG:teuthology.parallel:result is None 2023-10-14T11:43:11.583 WARNING:teuthology.provision.fog.smithi144:timed out 2023-10-14T11:43:15.443 WARNING:teuthology.provision.fog.smithi086:timed out 2023-10-14T11:43:17.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:43:17.920 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-14T11:43:17.921 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-14T11:43:18.255 INFO:teuthology.provision.fog.smithi144:Node is ready 2023-10-14T11:43:18.255 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2023-10-14T11:43:18.273 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com 2023-10-14T11:43:18.274 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts 2023-10-14T11:43:18.336 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2023-10-14T11:43:18.337 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-10-14T11:43:18.466 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts 2023-10-14T11:43:18.495 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2023-10-14T11:43:18.567 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname 2023-10-14T11:43:18.639 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-10-14T11:43:18.709 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-10-14T11:43:18.770 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T11:43:18.770 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T11:43:18.771 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-10-14T11:43:18.771 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-10-14T11:43:18.771 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6" 2023-10-14T11:43:18.772 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-10-14T11:43:18.772 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T11:43:18.772 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-10-14T11:43:18.773 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T11:43:18.773 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T11:43:18.774 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T11:43:18.774 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T11:43:18.774 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T11:43:18.775 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T11:43:18.775 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T11:43:18.775 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T11:43:18.776 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T11:43:18.776 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2023-10-14T11:43:18.777 DEBUG:teuthology.parallel:result is None 2023-10-14T11:43:21.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:43:21.805 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-14T11:43:22.050 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-14T11:43:22.137 INFO:teuthology.provision.fog.smithi086:Node is ready 2023-10-14T11:43:22.137 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2023-10-14T11:43:22.156 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2023-10-14T11:43:22.156 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts 2023-10-14T11:43:22.214 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2023-10-14T11:43:22.214 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-10-14T11:43:22.332 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts 2023-10-14T11:43:22.360 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2023-10-14T11:43:22.426 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname 2023-10-14T11:43:22.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-10-14T11:43:22.560 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-10-14T11:43:22.616 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T11:43:22.616 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T11:43:22.616 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-10-14T11:43:22.617 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-10-14T11:43:22.617 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2023-10-14T11:43:22.617 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-10-14T11:43:22.617 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T11:43:22.618 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-10-14T11:43:22.618 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T11:43:22.618 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T11:43:22.618 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T11:43:22.618 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T11:43:22.619 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-14T11:43:22.619 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T11:43:22.619 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T11:43:22.619 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T11:43:22.619 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T11:43:22.620 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2023-10-14T11:43:22.620 DEBUG:teuthology.parallel:result is None 2023-10-14T11:43:22.810 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2023-10-14T11:43:22.810 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2023-10-14T11:43:22.811 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2023-10-14T11:43:22.811 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-14T11:43:22.841 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2023-10-14T11:43:22.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-14T11:43:22.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:43:22.910 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-14T11:43:23.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-14T11:43:23.051 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-10-14T11:43:23.110 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-10-14T11:43:23.111 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-14T11:43:23.171 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T11:43:23.171 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T11:43:23.171 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2023-10-14T11:43:23.171 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2023-10-14T11:43:23.172 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.6" 2023-10-14T11:43:23.172 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-10-14T11:43:23.172 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T11:43:23.172 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-10-14T11:43:23.172 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T11:43:23.173 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T11:43:23.173 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T11:43:23.173 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T11:43:23.173 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-14T11:43:23.173 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T11:43:23.174 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T11:43:23.174 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T11:43:23.174 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T11:43:23.175 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-14T11:43:23.198 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2023-10-14T11:43:23.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-14T11:43:23.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:43:23.264 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-10-14T11:43:23.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-14T11:43:23.332 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-10-14T11:43:23.387 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-10-14T11:43:23.388 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-10-14T11:43:23.444 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T11:43:23.445 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T11:43:23.445 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-10-14T11:43:23.445 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-10-14T11:43:23.445 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2023-10-14T11:43:23.446 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-10-14T11:43:23.446 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T11:43:23.446 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-10-14T11:43:23.446 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T11:43:23.447 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T11:43:23.447 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T11:43:23.447 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T11:43:23.447 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-14T11:43:23.448 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T11:43:23.448 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T11:43:23.448 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T11:43:23.448 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T11:43:23.449 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-10-14T11:43:23.473 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2023-10-14T11:43:23.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-14T11:43:23.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:43:23.540 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-10-14T11:43:23.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-14T11:43:23.613 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-10-14T11:43:23.671 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-10-14T11:43:23.672 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-10-14T11:43:23.731 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T11:43:23.732 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T11:43:23.732 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-10-14T11:43:23.732 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-10-14T11:43:23.732 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6" 2023-10-14T11:43:23.733 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-10-14T11:43:23.733 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T11:43:23.733 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-10-14T11:43:23.733 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T11:43:23.733 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T11:43:23.733 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T11:43:23.734 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T11:43:23.734 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T11:43:23.734 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T11:43:23.734 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T11:43:23.734 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T11:43:23.735 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T11:43:23.735 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-10-14T11:43:23.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T11:43:23.865 INFO:teuthology.dispatcher.supervisor:Running job 7425290 2023-10-14T11:43:23.865 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425290 --name rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425290/orig.config.yaml 2023-10-14T11:43:23.868 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425290 2023-10-14T11:43:23.869 INFO:teuthology.dispatcher.supervisor:Job PID: 3514354 2023-10-14T11:43:23.869 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-14T11:45:23.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T11:47:24.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T11:49:24.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T11:51:24.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T11:53:24.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T11:55:24.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T11:57:24.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T11:59:24.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:01:25.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:03:25.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:05:25.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:07:25.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:09:25.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:11:25.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:13:26.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:15:26.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:17:26.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:19:26.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:21:26.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:23:27.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:25:27.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:27:27.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:29:27.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:31:27.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:33:27.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:35:28.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:37:28.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:39:28.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:41:28.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:43:28.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:45:28.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:47:29.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:49:29.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:51:29.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:53:29.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:55:29.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:57:29.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:59:30.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:01:30.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:03:30.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:05:30.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:07:30.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:09:30.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:11:31.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:13:31.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:15:31.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:17:31.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:19:31.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:21:32.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:23:32.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:25:32.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:27:32.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:29:32.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:31:32.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:33:33.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:35:33.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:37:33.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:39:33.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:41:33.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:43:33.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:45:34.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:47:34.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:49:34.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:51:34.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:53:34.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T13:53:34.820 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-14T13:53:35.044 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-14T13:53:35.044 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T13:53:35.094 DEBUG:teuthology.nuke:shortname: smithi059 2023-10-14T13:53:35.094 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T13:53:35.126 DEBUG:teuthology.nuke:shortname: smithi086 2023-10-14T13:53:35.127 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T13:53:35.128 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425290', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 11:38:18.618663', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T13:53:35.153 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425290', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 11:38:18.620160', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T13:53:35.154 DEBUG:teuthology.nuke:shortname: smithi144 2023-10-14T13:53:35.155 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T13:53:35.179 INFO:teuthology.orchestra.console.smithi059:Power off 2023-10-14T13:53:35.180 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T13:53:35.193 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425290', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 11:38:18.621276', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T13:53:35.207 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-10-14T13:53:35.207 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T13:53:35.225 INFO:teuthology.orchestra.console.smithi086:Power off 2023-10-14T13:53:35.226 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T13:53:35.237 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-14T13:53:35.247 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-10-14T13:53:35.247 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T13:53:35.264 INFO:teuthology.orchestra.console.smithi144:Power off 2023-10-14T13:53:35.265 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T13:53:35.273 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-10-14T13:53:35.286 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-10-14T13:53:35.287 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T13:53:35.309 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-10-14T13:53:35.339 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-10-14T13:53:35.374 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-10-14T13:53:35.410 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-10-14T13:53:35.494 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com 2023-10-14T13:53:35.521 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com 2023-10-14T13:53:35.560 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com