2023-09-29T23:49:15.095 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-29T23:49:15.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T23:49:15.268 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9b6e663be0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9b6f164670>, signals=[15])
2023-09-29T23:49:15.268 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2023-09-29T23:49:15.268 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2023-09-29T23:49:15.268 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-09-29T23:49:15.294 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2023-09-29T23:49:15.295 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2023-09-29T23:49:15.295 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-09-29T23:49:15.296 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"}
2023-09-29T23:49:15.319 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging
2023-09-29T23:49:15.319 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server
2023-09-29T23:49:15.320 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server
2023-09-29T23:49:15.321 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"}
2023-09-29T23:49:15.344 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"}
2023-09-29T23:49:15.371 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-29T23:49:15.395 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-29T23:49:15.412 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_8.stream (ID 3)
2023-09-29T23:49:15.413 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 3}
2023-09-29T23:49:15.417 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-29T23:49:15.433 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_centos_8.stream (ID 3)
2023-09-29T23:49:15.433 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 3}
2023-09-29T23:49:15.458 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_centos_8.stream (ID 3)
2023-09-29T23:49:15.458 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 3}
2023-09-29T23:49:15.461 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream
2023-09-29T23:49:15.461 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:49:15.479 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 8.stream
2023-09-29T23:49:15.479 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:49:15.502 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of centos 8.stream
2023-09-29T23:49:15.502 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:49:15.505 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"}
2023-09-29T23:49:15.523 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"}
2023-09-29T23:49:15.537 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1}
2023-09-29T23:49:15.549 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"}
2023-09-29T23:49:15.558 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1}
2023-09-29T23:49:15.588 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1}
2023-09-29T23:49:15.603 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:49:15.637 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:49:15.656 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:49:15.683 INFO:teuthology.orchestra.console.smithi062:Power off
2023-09-29T23:49:15.683 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-29T23:49:15.703 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off
2023-09-29T23:49:15.704 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:15.721 INFO:teuthology.orchestra.console.smithi093:Power off
2023-09-29T23:49:15.721 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-29T23:49:15.730 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-09-29T23:49:15.742 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2023-09-29T23:49:15.743 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:15.757 INFO:teuthology.orchestra.console.smithi139:Power off
2023-09-29T23:49:15.757 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-29T23:49:15.765 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-09-29T23:49:15.780 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off
2023-09-29T23:49:15.780 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:15.802 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2023-09-29T23:49:19.734 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:19.766 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:19.802 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:19.845 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-09-29T23:49:19.874 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-09-29T23:49:19.910 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2023-09-29T23:49:23.849 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:23.876 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:23.912 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:23.958 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-09-29T23:49:23.985 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-09-29T23:49:24.020 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off
2023-09-29T23:49:24.059 INFO:teuthology.orchestra.console.smithi062:Power off completed
2023-09-29T23:49:24.085 INFO:teuthology.orchestra.console.smithi093:Power off completed
2023-09-29T23:49:24.120 INFO:teuthology.orchestra.console.smithi139:Power off completed
2023-09-29T23:49:24.160 INFO:teuthology.orchestra.console.smithi062:Power on
2023-09-29T23:49:24.161 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-29T23:49:24.181 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On
2023-09-29T23:49:24.182 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:24.191 INFO:teuthology.orchestra.console.smithi093:Power on
2023-09-29T23:49:24.191 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-29T23:49:24.206 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-09-29T23:49:24.211 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On
2023-09-29T23:49:24.211 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:24.221 INFO:teuthology.orchestra.console.smithi139:Power on
2023-09-29T23:49:24.221 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-29T23:49:24.233 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-09-29T23:49:24.240 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On
2023-09-29T23:49:24.241 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:24.263 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off
2023-09-29T23:49:28.210 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:28.235 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:28.264 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:28.319 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-09-29T23:49:28.344 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-09-29T23:49:28.372 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off
2023-09-29T23:49:32.323 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:32.345 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:32.373 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T23:49:32.431 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-09-29T23:49:32.454 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2023-09-29T23:49:32.482 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2023-09-29T23:49:32.532 INFO:teuthology.orchestra.console.smithi062:Power on completed
2023-09-29T23:49:32.556 INFO:teuthology.orchestra.console.smithi093:Power on completed
2023-09-29T23:49:32.585 INFO:teuthology.orchestra.console.smithi139:Power on completed
2023-09-29T23:49:32.634 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2023-09-29T23:49:32.634 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:49:32.657 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2023-09-29T23:49:32.657 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:49:32.686 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish
2023-09-29T23:49:32.687 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:49:47.726 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:49:47.727 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:49:47.740 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:50:02.806 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:50:02.807 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:50:02.808 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:50:17.890 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:50:17.891 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:50:17.892 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:50:32.970 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:50:32.971 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:50:32.972 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:50:48.048 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:50:48.049 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:50:48.050 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:51:03.126 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:51:03.128 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:51:03.129 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:51:18.218 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:51:18.219 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:51:18.220 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:51:33.299 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:51:33.301 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:51:33.302 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:51:48.368 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:51:48.369 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:51:48.370 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:52:03.442 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:52:03.443 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:52:03.444 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-09-29T23:52:03.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:52:03.796 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: Authentication failed.
2023-09-29T23:52:03.796 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-29T23:52:03.796 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-29T23:52:03.797 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-09-29T23:52:18.511 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-09-29T23:52:18.523 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-09-29T23:52:18.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:52:18.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:52:36.986 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-09-29T23:52:36.987 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-09-29T23:52:42.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:52:42.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:52:46.046 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-09-29T23:52:46.047 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-09-29T23:52:52.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:52:52.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:52:55.098 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-09-29T23:52:55.130 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-09-29T23:53:01.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:53:01.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:53:04.154 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-09-29T23:53:04.186 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-09-29T23:53:10.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:53:10.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:53:28.698 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-09-29T23:53:28.699 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-09-29T23:53:34.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:53:34.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:53:37.754 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-09-29T23:53:37.755 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-09-29T23:53:43.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:53:43.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:53:44.907 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-29T23:53:44.907 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-29T23:53:46.995 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-29T23:53:46.996 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-29T23:54:03.771 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-09-29T23:54:03.771 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi139
2023-09-29T23:54:10.004 INFO:teuthology.provision.fog.smithi062:Node is ready
2023-09-29T23:54:10.004 DEBUG:teuthology.orchestra.run.smithi062:> hostname
2023-09-29T23:54:10.029 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2023-09-29T23:54:10.030 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts
2023-09-29T23:54:10.091 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2023-09-29T23:54:10.091 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-09-29T23:54:10.217 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts
2023-09-29T23:54:10.250 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts
2023-09-29T23:54:10.322 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname
2023-09-29T23:54:10.393 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-09-29T23:54:10.463 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-09-29T23:54:10.522 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2023-09-29T23:54:10.522 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8"
2023-09-29T23:54:10.522 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2023-09-29T23:54:10.522 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2023-09-29T23:54:10.522 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8"
2023-09-29T23:54:10.523 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-09-29T23:54:10.523 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-29T23:54:10.523 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-09-29T23:54:10.523 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-29T23:54:10.523 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2023-09-29T23:54:10.523 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T23:54:10.523 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T23:54:10.523 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-29T23:54:10.524 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2023-09-29T23:54:10.525 DEBUG:teuthology.parallel:result is None
2023-09-29T23:54:12.767 INFO:teuthology.provision.fog.smithi093:Node is ready
2023-09-29T23:54:12.767 DEBUG:teuthology.orchestra.run.smithi093:> hostname
2023-09-29T23:54:12.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com'
2023-09-29T23:54:12.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:54:12.791 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com
2023-09-29T23:54:12.791 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts
2023-09-29T23:54:12.853 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093
2023-09-29T23:54:12.854 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-09-29T23:54:12.977 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts
2023-09-29T23:54:13.012 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts
2023-09-29T23:54:13.056 DEBUG:teuthology.orchestra.run.smithi139:> true
2023-09-29T23:54:13.085 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname
2023-09-29T23:54:13.158 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-09-29T23:54:13.228 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-09-29T23:54:13.288 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream"
2023-09-29T23:54:13.288 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8"
2023-09-29T23:54:13.288 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos"
2023-09-29T23:54:13.288 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora"
2023-09-29T23:54:13.288 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8"
2023-09-29T23:54:13.288 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2023-09-29T23:54:13.289 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-29T23:54:13.289 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-09-29T23:54:13.289 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-29T23:54:13.289 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/"
2023-09-29T23:54:13.289 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T23:54:13.289 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T23:54:13.289 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-29T23:54:13.289 INFO:teuthology.provision.fog.smithi093:Deploy complete!
2023-09-29T23:54:13.290 DEBUG:teuthology.parallel:result is None
2023-09-29T23:54:13.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com'
2023-09-29T23:54:13.308 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-29T23:54:13.309 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-29T23:54:13.327 INFO:teuthology.provision.fog.smithi139:Node is ready
2023-09-29T23:54:13.327 DEBUG:teuthology.orchestra.run.smithi139:> hostname
2023-09-29T23:54:13.386 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com
2023-09-29T23:54:13.386 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts
2023-09-29T23:54:13.445 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139
2023-09-29T23:54:13.445 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139
2023-09-29T23:54:13.540 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts
2023-09-29T23:54:13.570 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts
2023-09-29T23:54:13.638 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname
2023-09-29T23:54:13.706 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139
2023-09-29T23:54:13.773 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release
2023-09-29T23:54:13.831 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream"
2023-09-29T23:54:13.831 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8"
2023-09-29T23:54:13.831 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos"
2023-09-29T23:54:13.831 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora"
2023-09-29T23:54:13.831 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8"
2023-09-29T23:54:13.832 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8"
2023-09-29T23:54:13.832 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-29T23:54:13.832 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31"
2023-09-29T23:54:13.832 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-29T23:54:13.832 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/"
2023-09-29T23:54:13.832 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T23:54:13.832 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T23:54:13.832 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-29T23:54:13.832 INFO:teuthology.provision.fog.smithi139:Deploy complete!
2023-09-29T23:54:13.833 DEBUG:teuthology.parallel:result is None
2023-09-29T23:54:14.050 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2023-09-29T23:54:14.050 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-29T23:54:14.078 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com
2023-09-29T23:54:14.078 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-29T23:54:14.102 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com
2023-09-29T23:54:14.102 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-29T23:54:14.120 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2023-09-29T23:54:14.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-09-29T23:54:14.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:54:14.189 DEBUG:teuthology.orchestra.run.smithi062:> true
2023-09-29T23:54:14.265 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-09-29T23:54:14.265 DEBUG:teuthology.orchestra.run.smithi062:> uname -m
2023-09-29T23:54:14.327 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2023-09-29T23:54:14.327 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-09-29T23:54:14.388 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2023-09-29T23:54:14.388 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8"
2023-09-29T23:54:14.388 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2023-09-29T23:54:14.388 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2023-09-29T23:54:14.388 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8"
2023-09-29T23:54:14.389 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-09-29T23:54:14.389 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-29T23:54:14.389 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-09-29T23:54:14.389 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-29T23:54:14.389 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2023-09-29T23:54:14.389 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T23:54:14.389 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T23:54:14.389 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-29T23:54:14.390 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-09-29T23:54:14.411 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server
2023-09-29T23:54:14.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-09-29T23:54:14.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:54:14.480 DEBUG:teuthology.orchestra.run.smithi093:> true
2023-09-29T23:54:14.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-09-29T23:54:14.552 DEBUG:teuthology.orchestra.run.smithi093:> uname -m
2023-09-29T23:54:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64
2023-09-29T23:54:14.613 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-09-29T23:54:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream"
2023-09-29T23:54:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8"
2023-09-29T23:54:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos"
2023-09-29T23:54:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora"
2023-09-29T23:54:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8"
2023-09-29T23:54:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2023-09-29T23:54:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-29T23:54:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-09-29T23:54:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-29T23:54:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/"
2023-09-29T23:54:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T23:54:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T23:54:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-29T23:54:14.675 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-09-29T23:54:14.703 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server
2023-09-29T23:54:14.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com'
2023-09-29T23:54:14.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T23:54:14.769 DEBUG:teuthology.orchestra.run.smithi139:> true
2023-09-29T23:54:14.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com'
2023-09-29T23:54:14.837 DEBUG:teuthology.orchestra.run.smithi139:> uname -m
2023-09-29T23:54:14.895 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64
2023-09-29T23:54:14.896 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release
2023-09-29T23:54:14.953 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream"
2023-09-29T23:54:14.954 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8"
2023-09-29T23:54:14.954 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos"
2023-09-29T23:54:14.954 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora"
2023-09-29T23:54:14.954 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8"
2023-09-29T23:54:14.954 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8"
2023-09-29T23:54:14.954 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-29T23:54:14.954 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31"
2023-09-29T23:54:14.954 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-29T23:54:14.954 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/"
2023-09-29T23:54:14.954 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T23:54:14.954 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T23:54:14.955 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-29T23:54:14.955 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server
2023-09-29T23:54:14.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T23:54:15.067 INFO:teuthology.dispatcher.supervisor:Running job 7406660
2023-09-29T23:54:15.067 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406660 --name yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} -- /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406660/orig.config.yaml
2023-09-29T23:54:15.070 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406660
2023-09-29T23:54:15.070 INFO:teuthology.dispatcher.supervisor:Job PID: 2566711
2023-09-29T23:54:15.071 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-29T23:56:15.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T23:58:15.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:00:15.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:02:15.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:04:15.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:06:15.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:08:15.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:10:15.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:12:15.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:14:16.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:16:16.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:18:16.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:20:16.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:22:16.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:24:16.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:26:17.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:28:17.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:30:17.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:32:17.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:34:17.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:36:17.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:38:18.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:40:18.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:42:18.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:44:18.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:46:19.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:48:19.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-30T00:48:19.272 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-09-30T00:48:19.390 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-30T00:48:19.391 INFO:teuthology.nuke:Checking targets against current locks
2023-09-30T00:48:19.442 DEBUG:teuthology.nuke:shortname: smithi062
2023-09-30T00:48:19.442 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-30T00:48:19.467 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 23:49:14.278293', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE5Nhf1LrM0eHwfeByq4VmvSGAvTmWYtgXacVAxeiuSHmE+KS4OH20+d4sZWW7HFUkJvZJ8BO2/UFwZSrS1EUQE='}
2023-09-30T00:48:19.469 DEBUG:teuthology.nuke:shortname: smithi093
2023-09-30T00:48:19.469 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-30T00:48:19.490 DEBUG:teuthology.nuke:shortname: smithi139
2023-09-30T00:48:19.490 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-30T00:48:19.494 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 23:49:14.275607', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP3SQXqzl6rGtdr+KlK7UY6LBpJ7Od1TWI9iK1JFBb6lcAjEUKtKXP0fk5X7tONC5mKZMxI8RBhdyqShiPiGxko='}
2023-09-30T00:48:19.518 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 23:49:14.277044', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHyOiXf7F6r/fSHMEc1RmGeijdESED5hv4BKM04oDmCXQISiRHmJuYg6SGiCw+Sh3zhn7vn84OYBzgtSlyNFIds='}
2023-09-30T00:48:19.525 INFO:teuthology.orchestra.console.smithi062:Power off
2023-09-30T00:48:19.526 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-30T00:48:19.541 INFO:teuthology.orchestra.console.smithi093:Power off
2023-09-30T00:48:19.541 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-30T00:48:19.552 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off
2023-09-30T00:48:19.552 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T00:48:19.563 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2023-09-30T00:48:19.563 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T00:48:19.576 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-09-30T00:48:19.584 INFO:teuthology.orchestra.console.smithi139:Power off
2023-09-30T00:48:19.585 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-30T00:48:19.593 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2023-09-30T00:48:19.606 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off
2023-09-30T00:48:19.606 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-30T00:48:19.626 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off
2023-09-30T00:48:19.678 INFO:teuthology.orchestra.console.smithi062:Power off completed
2023-09-30T00:48:19.694 INFO:teuthology.orchestra.console.smithi093:Power off completed
2023-09-30T00:48:19.727 INFO:teuthology.orchestra.console.smithi139:Power off completed
2023-09-30T00:48:19.831 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com
2023-09-30T00:48:19.845 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com
2023-09-30T00:48:19.871 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com