2023-09-02T01:40:47.748 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-02T01:40:47.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:40:47.926 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f927e694670>, signals=[15]) 2023-09-02T01:40:47.927 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2023-09-02T01:40:47.927 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T01:40:47.928 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-09-02T01:40:47.951 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-09-02T01:40:47.951 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T01:40:47.951 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-09-02T01:40:47.953 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /host {"name": "smithi038"} 2023-09-02T01:40:47.976 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2023-09-02T01:40:47.977 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T01:40:47.977 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-09-02T01:40:47.978 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"} 2023-09-02T01:40:48.001 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /host {"name": "smithi144"} 2023-09-02T01:40:48.023 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-02T01:40:48.051 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-02T01:40:48.060 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_centos_8.stream (ID 3) 2023-09-02T01:40:48.060 DEBUG:teuthology.provision.fog.smithi038:FOG request: PUT /host/143 {"imageID": 3} 2023-09-02T01:40:48.072 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-02T01:40:48.097 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_8.stream (ID 3) 2023-09-02T01:40:48.098 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 3} 2023-09-02T01:40:48.101 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 8.stream 2023-09-02T01:40:48.101 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:40:48.109 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_centos_8.stream (ID 3) 2023-09-02T01:40:48.110 DEBUG:teuthology.provision.fog.smithi144:FOG request: PUT /host/249 {"imageID": 3} 2023-09-02T01:40:48.150 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of centos 8.stream 2023-09-02T01:40:48.150 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:40:48.156 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 8.stream 2023-09-02T01:40:48.156 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:40:48.164 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T01:40:48.203 DEBUG:teuthology.provision.fog.smithi038:FOG request: POST /host/143/task {"taskTypeID": 1} 2023-09-02T01:40:48.207 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T01:40:48.210 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T01:40:48.245 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1} 2023-09-02T01:40:48.246 DEBUG:teuthology.provision.fog.smithi144:FOG request: POST /host/249/task {"taskTypeID": 1} 2023-09-02T01:40:48.279 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:40:48.297 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:40:48.301 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:40:48.371 INFO:teuthology.orchestra.console.smithi038:Power off 2023-09-02T01:40:48.372 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:40:48.386 INFO:teuthology.orchestra.console.smithi079:Power off 2023-09-02T01:40:48.387 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:40:48.402 INFO:teuthology.orchestra.console.smithi144:Power off 2023-09-02T01:40:48.403 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:40:48.410 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-09-02T01:40:48.411 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:40:48.418 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2023-09-02T01:40:48.419 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:40:48.427 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-09-02T01:40:48.428 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:40:48.437 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-09-02T01:40:48.439 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-09-02T01:40:48.451 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-02T01:40:48.539 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-09-02T01:40:48.541 INFO:teuthology.orchestra.console.smithi038:Power off completed 2023-09-02T01:40:48.552 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-09-02T01:40:48.641 INFO:teuthology.orchestra.console.smithi079:Power on 2023-09-02T01:40:48.641 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T01:40:48.649 INFO:teuthology.orchestra.console.smithi038:Power on 2023-09-02T01:40:48.649 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T01:40:48.655 INFO:teuthology.orchestra.console.smithi144:Power on 2023-09-02T01:40:48.656 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T01:40:48.664 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2023-09-02T01:40:48.665 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:40:48.672 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On 2023-09-02T01:40:48.673 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:40:48.681 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On 2023-09-02T01:40:48.681 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:40:48.689 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-09-02T01:40:48.694 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-09-02T01:40:48.701 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-02T01:40:52.694 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:40:52.702 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:40:52.711 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:40:52.804 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-09-02T01:40:52.813 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-09-02T01:40:52.819 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-02T01:40:56.810 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:40:56.817 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:40:56.824 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:40:56.919 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-09-02T01:40:56.926 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-09-02T01:40:56.933 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-09-02T01:40:57.020 INFO:teuthology.orchestra.console.smithi079:Power on completed 2023-09-02T01:40:57.028 INFO:teuthology.orchestra.console.smithi038:Power on completed 2023-09-02T01:40:57.034 INFO:teuthology.orchestra.console.smithi144:Power on completed 2023-09-02T01:40:57.121 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-09-02T01:40:57.122 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:40:57.128 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2023-09-02T01:40:57.129 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:40:57.135 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2023-09-02T01:40:57.136 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:41:12.202 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:41:12.204 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:41:12.205 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:41:27.293 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:41:27.295 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:41:27.296 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:41:42.370 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:41:42.371 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:41:42.373 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:41:57.453 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:41:57.455 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:41:57.456 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:42:12.533 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:42:12.535 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:42:12.540 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:42:27.614 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:42:27.616 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:42:27.617 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:42:42.690 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:42:42.691 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:42:42.692 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:42:57.774 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:42:57.775 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:42:57.776 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:43:12.850 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:43:12.852 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:43:12.853 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:43:27.926 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:43:27.928 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:43:27.932 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-09-02T01:43:27.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:43:28.070 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: Authentication failed. 2023-09-02T01:43:28.072 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T01:43:28.073 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T01:43:28.074 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-02T01:43:29.081 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-02T01:43:30.087 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-02T01:43:42.983 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-09-02T01:43:42.990 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-02T01:43:43.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:43:43.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:43:46.110 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-09-02T01:43:46.111 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-02T01:43:52.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:43:52.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:43:55.166 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-09-02T01:43:55.194 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-02T01:44:01.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:44:01.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:44:04.218 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-09-02T01:44:04.250 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-02T01:44:10.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:44:10.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:44:13.274 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-09-02T01:44:13.306 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-02T01:44:19.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:44:19.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:44:22.334 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-09-02T01:44:22.362 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-02T01:44:28.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:44:28.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:44:31.390 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-09-02T01:44:37.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:45:18.490 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-09-02T01:45:18.492 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi038 2023-09-02T01:45:27.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-09-02T01:45:27.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:45:27.715 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-09-02T01:45:27.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-09-02T01:45:27.994 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T01:45:27.994 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T01:45:28.015 INFO:teuthology.provision.fog.smithi038:Node is ready 2023-09-02T01:45:28.015 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2023-09-02T01:45:28.075 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2023-09-02T01:45:28.076 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2023-09-02T01:45:28.135 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2023-09-02T01:45:28.136 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-09-02T01:45:28.231 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2023-09-02T01:45:28.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2023-09-02T01:45:28.335 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2023-09-02T01:45:28.366 WARNING:teuthology.provision.fog.smithi144:timed out 2023-09-02T01:45:28.406 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-09-02T01:45:28.476 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-09-02T01:45:28.535 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-09-02T01:45:28.535 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2023-09-02T01:45:28.536 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-09-02T01:45:28.536 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:45:28.536 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2023-09-02T01:45:28.536 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-09-02T01:45:28.536 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-02T01:45:28.537 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-09-02T01:45:28.537 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-02T01:45:28.537 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:45:28.537 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:45:28.538 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T01:45:28.538 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:45:28.539 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2023-09-02T01:45:28.540 DEBUG:teuthology.parallel:result is None 2023-09-02T01:45:34.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:45:34.622 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T01:45:34.622 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T01:45:34.911 INFO:teuthology.provision.fog.smithi144:Node is ready 2023-09-02T01:45:34.912 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2023-09-02T01:45:34.931 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com 2023-09-02T01:45:34.932 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts 2023-09-02T01:45:34.993 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2023-09-02T01:45:34.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-09-02T01:45:35.105 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts 2023-09-02T01:45:35.134 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2023-09-02T01:45:35.202 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname 2023-09-02T01:45:35.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-09-02T01:45:35.336 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-09-02T01:45:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-09-02T01:45:35.394 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8" 2023-09-02T01:45:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-09-02T01:45:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:45:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8" 2023-09-02T01:45:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-09-02T01:45:35.395 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-02T01:45:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-09-02T01:45:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-02T01:45:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:45:35.396 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:45:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T01:45:35.397 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:45:35.397 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2023-09-02T01:45:35.398 DEBUG:teuthology.parallel:result is None 2023-09-02T01:45:37.396 WARNING:teuthology.provision.fog.smithi079:timed out 2023-09-02T01:45:43.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:45:43.646 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T01:45:43.646 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T01:45:43.866 INFO:teuthology.provision.fog.smithi079:Node is ready 2023-09-02T01:45:43.867 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2023-09-02T01:45:43.926 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2023-09-02T01:45:43.926 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2023-09-02T01:45:43.985 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2023-09-02T01:45:43.985 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-09-02T01:45:44.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2023-09-02T01:45:44.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2023-09-02T01:45:44.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2023-09-02T01:45:44.273 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-09-02T01:45:44.341 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-09-02T01:45:44.399 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-09-02T01:45:44.399 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8" 2023-09-02T01:45:44.399 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-09-02T01:45:44.399 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:45:44.400 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8" 2023-09-02T01:45:44.400 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-09-02T01:45:44.400 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-02T01:45:44.400 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-09-02T01:45:44.400 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-02T01:45:44.401 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:45:44.401 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:45:44.401 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T01:45:44.401 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:45:44.401 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2023-09-02T01:45:44.402 DEBUG:teuthology.parallel:result is None 2023-09-02T01:45:44.587 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2023-09-02T01:45:44.588 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-02T01:45:44.614 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2023-09-02T01:45:44.614 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-02T01:45:44.637 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2023-09-02T01:45:44.638 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-02T01:45:44.655 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2023-09-02T01:45:44.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-09-02T01:45:44.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:45:44.724 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-09-02T01:45:44.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-09-02T01:45:44.865 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-09-02T01:45:44.924 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-09-02T01:45:44.925 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-09-02T01:45:44.984 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-09-02T01:45:44.984 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2023-09-02T01:45:44.984 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-09-02T01:45:44.984 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:45:44.985 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2023-09-02T01:45:44.985 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-09-02T01:45:44.985 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-02T01:45:44.985 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-09-02T01:45:44.985 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-02T01:45:44.986 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:45:44.986 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:45:44.986 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T01:45:44.986 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:45:44.987 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-09-02T01:45:45.013 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2023-09-02T01:45:45.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-09-02T01:45:45.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:45:45.082 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-09-02T01:45:45.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-09-02T01:45:45.149 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-09-02T01:45:45.208 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-09-02T01:45:45.208 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-09-02T01:45:45.266 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-09-02T01:45:45.267 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8" 2023-09-02T01:45:45.267 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-09-02T01:45:45.267 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:45:45.267 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8" 2023-09-02T01:45:45.267 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-09-02T01:45:45.268 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-02T01:45:45.268 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-09-02T01:45:45.268 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-02T01:45:45.268 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:45:45.268 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:45:45.269 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T01:45:45.269 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:45:45.269 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-09-02T01:45:45.288 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2023-09-02T01:45:45.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-02T01:45:45.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:45:45.357 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-09-02T01:45:45.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-02T01:45:45.432 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-09-02T01:45:45.493 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-09-02T01:45:45.493 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-09-02T01:45:45.552 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-09-02T01:45:45.553 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8" 2023-09-02T01:45:45.553 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-09-02T01:45:45.553 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:45:45.553 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8" 2023-09-02T01:45:45.554 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-09-02T01:45:45.554 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-02T01:45:45.554 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-09-02T01:45:45.554 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-02T01:45:45.554 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:45:45.555 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:45:45.555 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-02T01:45:45.555 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:45:45.556 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-09-02T01:45:45.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:45:45.671 INFO:teuthology.dispatcher.supervisor:Running job 7386791 2023-09-02T01:45:45.671 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386791 --name pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} -- /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386791/orig.config.yaml 2023-09-02T01:45:45.675 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386791 2023-09-02T01:45:45.675 INFO:teuthology.dispatcher.supervisor:Job PID: 1051141 2023-09-02T01:45:45.676 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-02T01:47:45.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:49:45.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:51:46.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:53:46.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:55:46.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:57:46.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:59:46.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:01:46.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:01:46.887 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-02T02:01:47.023 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-02T02:01:47.023 INFO:teuthology.nuke:Checking targets against current locks 2023-09-02T02:01:47.070 DEBUG:teuthology.nuke:shortname: smithi038 2023-09-02T02:01:47.071 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T02:01:47.099 DEBUG:teuthology.nuke:shortname: smithi079 2023-09-02T02:01:47.099 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T02:01:47.102 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386791', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:40:46.869084', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7QWLTA10uHdnIZXiMaxgRjLT+G5u1lVKpsVkwIEHPiOM4s8J5/j6jBciAle+jeiTmJqcVIcTS+iZfqe/296laLUQqXWjPIZodlBFV+AAu7IIrUb0kFxlW1KC8WqrO04aPiDXzZaQuMJoqgZWRgE+AeTRiZp5eerd1w4cnmHThoitSTIkBa7uYpqRXxJUYMIefKb1SP4sr0TU5NDSp9jSPEgq7AIaNLhhOCtM6DvdvpCWvGxFWWPHob/gvmiZbbpMb74onDSZMEeOXr686d83qCoZZ/zhOsCY2Rexp5SICptlOzUwhKcFR6tAQk43Bu7kOXMSpUbLw5Ffq+Gl1dsAFcGglAaQgjGeWHGWXA2HoZPW1HA+xMWQR8Or1uELm0dGucLIo3ksJ11k2GJE+rk7ZTmPXkvbJUuvf20i7FUWvQKYwaZgDHF/89gtWBnm9/6RDKBpx7ebkJadyiPofLX1ZRmoc/OHT8bpr+cUX14vX9eUUuOFqIiarYNTo6sjVyN0='} 2023-09-02T02:01:47.129 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386791', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:40:46.870436', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC81oWoWDhLHUFJzOMAtnOmRQXeyFioeIiHagNXJ/I518nlKUTgAZZ095NqTZHBUjM21YNGv+ud725UBtOqw3QyQrRdvI4KLS6ooMR4YJDjfrJ4uU0AGbRYyBsO7uNVAhXz5P5ptjqDrVHvwNp7ggSjRWSzS/M051fGx33kYZ25TUSGkB2YFn2bel1xTSJWTCr6P8XcAt/TrS44nX8oJKCk3gJdCK8nEWI5eOau7hsUFNeKxhbR8Si+ylTtvN8HTSehKeCfHiuKh7s3KRPX3CFY2PYh+kbPEwm7FFNXhhkglc1tPanJw/kpwopPOz0HX4doPlA1x3WCkbf8wRMBPSXjs9pwCyW6KNEvgaaPzhzUlwOykqSrvCEB0Yt3iA9cK2zgoNPY1Fbn184o/mLqXUcAy4mBY3HK8x3JcsnhUM1BmXaj4dlt74K/ssXrlzBUpyWNypahQtZoznVz+FtNr7NqWWgnRklD0zvoxrmls4B4UX+97H9GunTLrVf3jCXiBVE='} 2023-09-02T02:01:47.130 DEBUG:teuthology.nuke:shortname: smithi144 2023-09-02T02:01:47.130 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T02:01:47.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386791', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:40:46.871596', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuh9dKv7lhrqj9Q+wT7HrTm2kLf/r3BLfrAn0oE535WSoApH1ydsAfVRTkMTo0RRVlMHV0wI2UMcvXlZ6HDl2QN97oZIax8rFvmC5AeJ+Kg34aE+HN6yEty8WogR0Ruc1cUuWlSDmCXUnRkmMmjYcDhmJ5iMxu7SWyE+JkUjKR0J+JHk+cCi7mAdEFBqmqORrDQT9f4JZJu0n+tj202Zzr64L3bavdNuncbQC6HSqqIa8cgS4OGirQiJO/+/VfxMHigHf32wttudtYKgU9OY0cQunaRM1p9ph1bQtW/j9iNh6WUjGVP6S12onr3BmM6oa0KF4UXYjaNQlmc4Ix2/pKb2L274cc1rHQdaZNTVY0gIlxBCerKYprE4P9eYPYugXbJXLXJBinJqIxdnHZiaA+gPpIshRgJ+Vyc/L/vWr+1ZALx1/0Yu5V1Hi6wGqIs7+TbTj0TxmU961VMye6oAOxyiM+68lAGeVZxTinJh2j6W96JMxmMp+5aoZwbu3WYkk='} 2023-09-02T02:01:47.165 INFO:teuthology.orchestra.console.smithi038:Power off 2023-09-02T02:01:47.166 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T02:01:47.179 INFO:teuthology.orchestra.console.smithi079:Power off 2023-09-02T02:01:47.180 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T02:01:47.187 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2023-09-02T02:01:47.188 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T02:01:47.199 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-09-02T02:01:47.200 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T02:01:47.209 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-09-02T02:01:47.219 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-09-02T02:01:47.231 INFO:teuthology.orchestra.console.smithi144:Power off 2023-09-02T02:01:47.232 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T02:01:47.250 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-09-02T02:01:47.251 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T02:01:47.269 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-02T02:01:47.309 INFO:teuthology.orchestra.console.smithi038:Power off completed 2023-09-02T02:01:47.321 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-09-02T02:01:47.370 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-09-02T02:01:47.462 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com 2023-09-02T02:01:47.469 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2023-09-02T02:01:47.523 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com