2023-10-06T11:45:39.471 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T11:45:39.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:45:39.640 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5dab243670>, signals=[15]) 2023-10-06T11:45:39.641 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-10-06T11:45:39.641 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-10-06T11:45:39.641 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-10-06T11:45:39.664 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-10-06T11:45:39.664 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-10-06T11:45:39.664 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-10-06T11:45:39.665 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-10-06T11:45:39.688 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-10-06T11:45:39.688 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-10-06T11:45:39.689 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-10-06T11:45:39.690 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"} 2023-10-06T11:45:39.713 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /host {"name": "smithi174"} 2023-10-06T11:45:39.741 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-06T11:45:39.764 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-06T11:45:39.781 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_centos_9.stream (ID 10) 2023-10-06T11:45:39.781 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 10} 2023-10-06T11:45:39.787 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-06T11:45:39.804 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_9.stream (ID 10) 2023-10-06T11:45:39.804 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 10} 2023-10-06T11:45:39.827 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 9.stream 2023-10-06T11:45:39.827 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:45:39.841 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_centos_9.stream (ID 10) 2023-10-06T11:45:39.841 DEBUG:teuthology.provision.fog.smithi174:FOG request: PUT /host/279 {"imageID": 10} 2023-10-06T11:45:39.856 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 9.stream 2023-10-06T11:45:39.856 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:45:39.903 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 9.stream 2023-10-06T11:45:39.903 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:45:39.908 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-10-06T11:45:39.918 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"} 2023-10-06T11:45:39.950 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-10-06T11:45:39.958 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /tasktype {"name": "deploy"} 2023-10-06T11:45:39.961 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1} 2023-10-06T11:45:39.996 DEBUG:teuthology.provision.fog.smithi174:FOG request: POST /host/279/task {"taskTypeID": 1} 2023-10-06T11:45:40.000 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:45:40.014 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:45:40.042 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:45:40.094 INFO:teuthology.orchestra.console.smithi033:Power off 2023-10-06T11:45:40.094 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:45:40.114 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-10-06T11:45:40.115 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:45:40.131 INFO:teuthology.orchestra.console.smithi079:Power off 2023-10-06T11:45:40.132 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:45:40.140 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-06T11:45:40.152 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-10-06T11:45:40.153 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:45:40.167 INFO:teuthology.orchestra.console.smithi174:Power off 2023-10-06T11:45:40.167 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:45:40.177 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-06T11:45:40.187 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-10-06T11:45:40.188 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:45:40.210 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-10-06T11:45:40.241 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-10-06T11:45:40.312 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-10-06T11:45:40.342 INFO:teuthology.orchestra.console.smithi033:Power on 2023-10-06T11:45:40.342 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-06T11:45:40.366 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-10-06T11:45:40.366 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:45:40.391 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-06T11:45:40.413 INFO:teuthology.orchestra.console.smithi174:Power on 2023-10-06T11:45:40.413 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-06T11:45:40.434 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-10-06T11:45:40.434 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:45:40.455 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-10-06T11:45:44.182 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:45:44.294 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-06T11:45:44.392 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:45:44.456 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:45:44.503 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-06T11:45:44.565 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-10-06T11:45:44.605 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-10-06T11:45:44.666 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-10-06T11:45:44.706 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-10-06T11:45:44.706 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:45:44.767 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-10-06T11:45:44.768 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:45:48.298 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:45:48.412 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-06T11:45:48.513 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-10-06T11:45:48.614 INFO:teuthology.orchestra.console.smithi079:Power on 2023-10-06T11:45:48.614 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-06T11:45:48.636 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2023-10-06T11:45:48.637 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:45:48.658 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-06T11:45:52.662 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:45:52.771 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-06T11:45:56.774 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:45:56.883 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-06T11:45:56.983 INFO:teuthology.orchestra.console.smithi079:Power on completed 2023-10-06T11:45:57.084 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-10-06T11:45:57.084 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:45:59.789 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:45:59.832 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:46:12.182 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:46:14.890 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:46:14.909 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:46:27.278 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:46:30.064 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:46:30.065 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:46:42.350 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:46:45.136 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:46:45.137 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:46:57.446 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:47:00.218 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:47:00.219 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:47:12.534 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:47:15.290 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:47:15.294 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:47:27.615 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:47:30.366 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:47:30.367 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:47:42.695 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:47:45.438 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:47:45.439 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:47:57.778 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:48:00.515 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:48:00.517 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:48:00.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:48:00.893 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: Authentication failed. 2023-10-06T11:48:00.893 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T11:48:00.894 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T11:48:00.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-10-06T11:48:01.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-10-06T11:48:02.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-10-06T11:48:12.862 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:48:15.592 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:48:27.931 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-10-06T11:48:27.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:48:30.671 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:48:30.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:48:46.330 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-06T11:48:49.146 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T11:48:52.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:48:55.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:48:55.386 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-06T11:48:58.202 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T11:49:01.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:49:04.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:49:04.442 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-06T11:49:07.258 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T11:49:10.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:49:13.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:49:13.502 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-06T11:49:16.317 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T11:49:19.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:49:22.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:49:22.554 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-06T11:49:28.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:49:40.858 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T11:49:46.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:49:47.002 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-06T11:49:49.914 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T11:49:53.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:49:55.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:49:56.065 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-06T11:49:58.522 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-06T11:49:58.523 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi033 2023-10-06T11:49:58.974 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T11:50:02.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:50:04.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:50:05.150 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-06T11:50:05.214 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T11:50:05.215 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T11:50:07.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-06T11:50:07.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:50:07.786 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-10-06T11:50:08.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-06T11:50:08.168 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T11:50:08.168 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T11:50:08.183 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-10-06T11:50:08.183 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-10-06T11:50:08.239 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-10-06T11:50:08.240 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-10-06T11:50:08.296 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-10-06T11:50:08.297 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-10-06T11:50:08.404 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-10-06T11:50:08.437 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-10-06T11:50:08.509 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-10-06T11:50:08.581 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-10-06T11:50:08.652 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-10-06T11:50:08.708 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-10-06T11:50:08.708 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2023-10-06T11:50:08.709 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-10-06T11:50:08.709 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-10-06T11:50:08.709 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2023-10-06T11:50:08.709 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2023-10-06T11:50:08.709 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-06T11:50:08.709 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-10-06T11:50:08.710 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2023-10-06T11:50:08.710 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-06T11:50:08.710 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-10-06T11:50:08.710 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:50:08.710 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-06T11:50:08.710 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-06T11:50:08.711 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-10-06T11:50:08.712 DEBUG:teuthology.parallel:result is None 2023-10-06T11:50:11.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:50:11.533 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T11:50:11.533 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T11:50:20.726 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-10-06T11:50:20.726 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-10-06T11:50:20.745 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-10-06T11:50:20.745 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2023-10-06T11:50:20.803 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-10-06T11:50:20.803 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-10-06T11:50:20.935 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2023-10-06T11:50:20.963 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-10-06T11:50:21.032 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2023-10-06T11:50:21.099 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-10-06T11:50:21.165 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-10-06T11:50:21.219 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2023-10-06T11:50:21.220 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2023-10-06T11:50:21.220 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2023-10-06T11:50:21.220 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2023-10-06T11:50:21.220 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2023-10-06T11:50:21.220 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2023-10-06T11:50:21.220 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-06T11:50:21.220 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-10-06T11:50:21.220 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2023-10-06T11:50:21.220 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-06T11:50:21.220 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2023-10-06T11:50:21.220 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:50:21.221 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-06T11:50:21.221 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-06T11:50:21.221 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-10-06T11:50:21.221 DEBUG:teuthology.parallel:result is None 2023-10-06T11:50:26.980 INFO:teuthology.provision.fog.smithi079:Node is ready 2023-10-06T11:50:26.980 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2023-10-06T11:50:27.039 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2023-10-06T11:50:27.040 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2023-10-06T11:50:27.097 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2023-10-06T11:50:27.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-10-06T11:50:27.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2023-10-06T11:50:27.264 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2023-10-06T11:50:27.335 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2023-10-06T11:50:27.404 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-10-06T11:50:27.473 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-10-06T11:50:27.528 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-10-06T11:50:27.528 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2023-10-06T11:50:27.528 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-10-06T11:50:27.529 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-10-06T11:50:27.529 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2023-10-06T11:50:27.529 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2023-10-06T11:50:27.529 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-06T11:50:27.529 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-10-06T11:50:27.529 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2023-10-06T11:50:27.529 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-06T11:50:27.529 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-10-06T11:50:27.529 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:50:27.529 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-06T11:50:27.529 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-06T11:50:27.530 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2023-10-06T11:50:27.530 DEBUG:teuthology.parallel:result is None 2023-10-06T11:50:27.745 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-10-06T11:50:27.745 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-06T11:50:27.765 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2023-10-06T11:50:27.765 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-06T11:50:27.780 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-10-06T11:50:27.781 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-06T11:50:27.799 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-10-06T11:50:27.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-06T11:50:27.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:50:27.899 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-10-06T11:50:28.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-06T11:50:28.085 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-10-06T11:50:28.139 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-10-06T11:50:28.140 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-10-06T11:50:28.195 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-10-06T11:50:28.195 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2023-10-06T11:50:28.195 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-10-06T11:50:28.195 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-10-06T11:50:28.195 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2023-10-06T11:50:28.196 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2023-10-06T11:50:28.196 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-06T11:50:28.196 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-10-06T11:50:28.196 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2023-10-06T11:50:28.196 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-06T11:50:28.196 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-10-06T11:50:28.196 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:50:28.196 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-06T11:50:28.196 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-06T11:50:28.197 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-10-06T11:50:28.223 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2023-10-06T11:50:28.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-06T11:50:28.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:50:28.307 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-10-06T11:50:28.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-06T11:50:28.374 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-10-06T11:50:28.430 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-10-06T11:50:28.430 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-10-06T11:50:28.486 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-10-06T11:50:28.486 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2023-10-06T11:50:28.486 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-10-06T11:50:28.486 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-10-06T11:50:28.486 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2023-10-06T11:50:28.486 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2023-10-06T11:50:28.486 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-06T11:50:28.486 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-10-06T11:50:28.486 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2023-10-06T11:50:28.487 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-06T11:50:28.487 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-10-06T11:50:28.487 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:50:28.487 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-06T11:50:28.487 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-06T11:50:28.487 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-10-06T11:50:28.506 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-10-06T11:50:28.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-10-06T11:50:28.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:50:28.589 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-10-06T11:50:28.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-10-06T11:50:28.663 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-10-06T11:50:28.720 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-10-06T11:50:28.721 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-10-06T11:50:28.777 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2023-10-06T11:50:28.777 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2023-10-06T11:50:28.777 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2023-10-06T11:50:28.778 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2023-10-06T11:50:28.778 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2023-10-06T11:50:28.778 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2023-10-06T11:50:28.778 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-06T11:50:28.778 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-10-06T11:50:28.778 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2023-10-06T11:50:28.778 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-06T11:50:28.779 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2023-10-06T11:50:28.779 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:50:28.779 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-06T11:50:28.779 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-06T11:50:28.780 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-10-06T11:50:28.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:50:28.893 INFO:teuthology.dispatcher.supervisor:Running job 7412444 2023-10-06T11:50:28.893 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:58:21-rados-wip-yuri7-testing-2023-10-04-1350-reef-distro-default-smithi/7412444 --name yuriw-2023-10-05_23:58:21-rados-wip-yuri7-testing-2023-10-04-1350-reef-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/yuriw-2023-10-05_23:58:21-rados-wip-yuri7-testing-2023-10-04-1350-reef-distro-default-smithi/7412444/orig.config.yaml 2023-10-06T11:50:28.896 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-05_23:58:21-rados-wip-yuri7-testing-2023-10-04-1350-reef-distro-default-smithi/7412444 2023-10-06T11:50:28.896 INFO:teuthology.dispatcher.supervisor:Job PID: 1848749 2023-10-06T11:50:28.896 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-06T11:52:28.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:54:29.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:56:29.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:58:29.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T12:00:29.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T12:02:29.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T12:02:29.897 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-06T12:02:30.020 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-06T12:02:30.020 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T12:02:30.079 DEBUG:teuthology.nuke:shortname: smithi033 2023-10-06T12:02:30.080 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T12:02:30.104 DEBUG:teuthology.nuke:shortname: smithi079 2023-10-06T12:02:30.105 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T12:02:30.106 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:58:21-rados-wip-yuri7-testing-2023-10-04-1350-reef-distro-default-smithi/7412444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 11:45:38.639102', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP91iHOuX79bbHu4XIYdT+rxpE6vML/z4fA39Ttoc6Mpfbc69msCoiQTzcX4lYce9tglb7oZphJ6c/hUNnJAe0M='} 2023-10-06T12:02:30.133 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:58:21-rados-wip-yuri7-testing-2023-10-04-1350-reef-distro-default-smithi/7412444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 11:45:38.642803', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIys/QjjwW2geRJ/+ysREF+zp8g39xYt+q5c2PVhURFH0Mv9dKPQ1FwOeu2zWEc/lpbD9iuwiyFeAH33Hk+YAFY='} 2023-10-06T12:02:30.134 DEBUG:teuthology.nuke:shortname: smithi174 2023-10-06T12:02:30.134 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T12:02:30.159 INFO:teuthology.orchestra.console.smithi033:Power off 2023-10-06T12:02:30.160 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T12:02:30.168 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:58:21-rados-wip-yuri7-testing-2023-10-04-1350-reef-distro-default-smithi/7412444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 11:45:38.640873', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMVWKYw3icwAZ8t443e+kbLOVyrnxZVP5Cn4wcCm5rfSe/k7aFJiESX8tcZKqULZhhbkE2Czw1WhVf5D02F6mwM='} 2023-10-06T12:02:30.180 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-10-06T12:02:30.181 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T12:02:30.202 INFO:teuthology.orchestra.console.smithi079:Power off 2023-10-06T12:02:30.203 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T12:02:30.217 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-06T12:02:30.225 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-10-06T12:02:30.225 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T12:02:30.245 INFO:teuthology.orchestra.console.smithi174:Power off 2023-10-06T12:02:30.245 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T12:02:30.254 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-06T12:02:30.266 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-10-06T12:02:30.267 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T12:02:30.291 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-10-06T12:02:30.319 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-10-06T12:02:30.354 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-10-06T12:02:30.392 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-10-06T12:02:30.469 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-10-06T12:02:30.503 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2023-10-06T12:02:30.536 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com