2023-07-08T06:31:52.119 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-08T06:31:52.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-08T06:31:52.121 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-08T06:31:52.258 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1fdd056640>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1fdc9d2ee0>, signals=[15])
2023-07-08T06:31:52.259 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging
2023-07-08T06:31:52.259 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server
2023-07-08T06:31:52.260 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2023-07-08T06:31:52.283 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging
2023-07-08T06:31:52.284 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server
2023-07-08T06:31:52.284 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server
2023-07-08T06:31:52.285 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /host {"name": "smithi038"}
2023-07-08T06:31:52.308 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /host {"name": "smithi070"}
2023-07-08T06:31:52.342 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-08T06:31:52.382 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-08T06:31:52.391 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_centos_8.stream (ID 3)
2023-07-08T06:31:52.392 DEBUG:teuthology.provision.fog.smithi038:FOG request: PUT /host/143 {"imageID": 3}
2023-07-08T06:31:52.432 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_centos_8.stream (ID 3)
2023-07-08T06:31:52.432 DEBUG:teuthology.provision.fog.smithi070:FOG request: PUT /host/175 {"imageID": 3}
2023-07-08T06:31:52.446 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 8.stream
2023-07-08T06:31:52.446 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:31:52.487 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of centos 8.stream
2023-07-08T06:31:52.487 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:31:52.591 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /tasktype {"name": "deploy"}
2023-07-08T06:31:52.610 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /tasktype {"name": "deploy"}
2023-07-08T06:31:52.629 DEBUG:teuthology.provision.fog.smithi038:FOG request: POST /host/143/task {"taskTypeID": 1}
2023-07-08T06:31:52.645 DEBUG:teuthology.provision.fog.smithi070:FOG request: POST /host/175/task {"taskTypeID": 1}
2023-07-08T06:31:52.682 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:31:52.691 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:31:52.852 INFO:teuthology.orchestra.console:Power off smithi070
2023-07-08T06:31:52.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-08T06:31:52.867 INFO:teuthology.orchestra.console:Power off smithi038
2023-07-08T06:31:52.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-08T06:31:52.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-08T06:31:52.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-08T06:31:53.000 INFO:teuthology.orchestra.console:Power off for smithi070 completed
2023-07-08T06:31:53.010 INFO:teuthology.orchestra.console:Power off for smithi038 completed
2023-07-08T06:31:53.101 INFO:teuthology.orchestra.console:Power on smithi070
2023-07-08T06:31:53.102 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-08T06:31:53.111 INFO:teuthology.orchestra.console:Power on smithi038
2023-07-08T06:31:53.111 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-08T06:31:53.125 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-08T06:31:53.134 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-08T06:31:57.150 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-08T06:31:57.158 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-08T06:32:01.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-08T06:32:01.274 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-08T06:32:01.477 INFO:teuthology.orchestra.console:Power on for smithi070 completed
2023-07-08T06:32:01.483 INFO:teuthology.orchestra.console:Power on for smithi038 completed
2023-07-08T06:32:01.579 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish
2023-07-08T06:32:01.580 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:32:01.584 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish
2023-07-08T06:32:01.584 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:32:16.872 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:32:16.873 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:32:32.120 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:32:32.121 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:32:47.379 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:32:47.380 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:33:02.612 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:33:02.616 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:33:17.876 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:33:17.877 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:33:33.185 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:33:33.193 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:33:48.607 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:33:48.610 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:34:04.048 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:34:04.073 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:34:20.740 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:34:20.747 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:34:38.876 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:34:38.954 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:34:56.376 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:34:56.410 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:35:13.392 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:35:13.503 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:35:30.303 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:35:30.361 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:35:47.725 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:35:47.739 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:36:03.372 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:36:03.373 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:36:19.289 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:36:19.450 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:36:37.372 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:36:37.542 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:36:54.332 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:36:54.479 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:37:10.894 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:37:11.147 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:37:27.244 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:37:27.576 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:37:42.564 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:37:44.243 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:37:57.889 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:37:59.671 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:38:13.250 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:38:15.044 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:38:28.569 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:38:30.504 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:38:44.033 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:38:45.873 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:38:59.548 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:39:01.360 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:39:14.919 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:39:16.733 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:39:30.286 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:39:32.218 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:39:45.669 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:39:47.556 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:40:00.991 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:40:02.937 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:40:16.239 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:40:18.332 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:40:31.596 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:40:33.706 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:40:46.888 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:40:49.066 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:41:02.112 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:41:04.397 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:41:17.360 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:41:19.787 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:41:32.573 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:41:35.071 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:41:47.800 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:41:50.304 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:42:03.068 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:42:05.520 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:42:18.210 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:42:20.730 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:42:33.553 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:42:35.928 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:42:48.776 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:42:51.099 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:43:03.998 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:43:06.316 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:43:19.196 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:43:21.516 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:43:34.396 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:43:36.708 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:43:49.580 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:43:51.876 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:44:04.764 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:44:07.044 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-08T06:44:07.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-08T06:44:10.256 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-07-08T06:44:16.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-08T06:44:19.314 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-07-08T06:44:19.920 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:44:25.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-08T06:44:28.405 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-07-08T06:44:34.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-08T06:44:35.078 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:44:37.488 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-07-08T06:44:43.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-08T06:44:46.544 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-07-08T06:44:50.234 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None
2023-07-08T06:44:50.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-08T06:44:50.493 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: Authentication failed.
2023-07-08T06:44:50.495 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-08T06:44:50.496 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-08T06:44:50.497 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-08T06:44:51.505 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-08T06:44:52.513 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-08T06:44:52.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-08T06:44:53.519 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-08T06:44:55.600 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-07-08T06:45:01.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-08T06:46:01.603 WARNING:teuthology.provision.fog.smithi070:timed out
2023-07-08T06:46:07.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-08T06:46:07.854 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-08T06:46:07.855 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-08T06:46:08.111 INFO:teuthology.provision.fog.smithi070:Node is ready
2023-07-08T06:46:08.112 DEBUG:teuthology.orchestra.run.smithi070:> hostname
2023-07-08T06:46:08.131 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com
2023-07-08T06:46:08.131 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts
2023-07-08T06:46:08.190 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070
2023-07-08T06:46:08.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070
2023-07-08T06:46:08.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts
2023-07-08T06:46:08.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts
2023-07-08T06:46:08.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname
2023-07-08T06:46:08.458 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070
2023-07-08T06:46:08.524 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release
2023-07-08T06:46:08.582 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream"
2023-07-08T06:46:08.583 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8"
2023-07-08T06:46:08.583 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos"
2023-07-08T06:46:08.583 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora"
2023-07-08T06:46:08.583 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8"
2023-07-08T06:46:08.583 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8"
2023-07-08T06:46:08.584 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-08T06:46:08.584 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31"
2023-07-08T06:46:08.584 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-08T06:46:08.584 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/"
2023-07-08T06:46:08.584 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-08T06:46:08.584 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-08T06:46:08.585 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-08T06:46:08.585 INFO:teuthology.provision.fog.smithi070:Deploy complete!
2023-07-08T06:46:08.586 DEBUG:teuthology.parallel:result is None
2023-07-08T06:46:44.080 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-08T06:46:44.081 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi038
2023-07-08T06:46:53.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com'
2023-07-08T06:46:53.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-08T06:46:53.345 DEBUG:teuthology.orchestra.run.smithi038:> true
2023-07-08T06:46:53.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com'
2023-07-08T06:46:53.563 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-08T06:46:53.564 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-08T06:46:53.623 INFO:teuthology.provision.fog.smithi038:Node is ready
2023-07-08T06:46:53.624 DEBUG:teuthology.orchestra.run.smithi038:> hostname
2023-07-08T06:46:53.685 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com
2023-07-08T06:46:53.686 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts
2023-07-08T06:46:53.746 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038
2023-07-08T06:46:53.747 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038
2023-07-08T06:46:53.861 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts
2023-07-08T06:46:53.895 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts
2023-07-08T06:46:53.965 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname
2023-07-08T06:46:54.039 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038
2023-07-08T06:46:54.114 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release
2023-07-08T06:46:54.177 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream"
2023-07-08T06:46:54.177 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8"
2023-07-08T06:46:54.178 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos"
2023-07-08T06:46:54.178 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora"
2023-07-08T06:46:54.178 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8"
2023-07-08T06:46:54.179 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8"
2023-07-08T06:46:54.179 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-08T06:46:54.179 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31"
2023-07-08T06:46:54.180 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-08T06:46:54.180 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/"
2023-07-08T06:46:54.184 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-08T06:46:54.184 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-08T06:46:54.185 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-08T06:46:54.185 INFO:teuthology.provision.fog.smithi038:Deploy complete!
2023-07-08T06:46:54.186 DEBUG:teuthology.parallel:result is None
2023-07-08T06:46:54.370 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com
2023-07-08T06:46:54.371 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-08T06:46:54.393 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com
2023-07-08T06:46:54.395 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-08T06:46:54.419 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server
2023-07-08T06:46:54.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com'
2023-07-08T06:46:54.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-08T06:46:54.493 DEBUG:teuthology.orchestra.run.smithi038:> true
2023-07-08T06:46:54.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com'
2023-07-08T06:46:54.568 DEBUG:teuthology.orchestra.run.smithi038:> uname -m
2023-07-08T06:46:54.628 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64
2023-07-08T06:46:54.629 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release
2023-07-08T06:46:54.689 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream"
2023-07-08T06:46:54.690 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8"
2023-07-08T06:46:54.690 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos"
2023-07-08T06:46:54.691 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora"
2023-07-08T06:46:54.691 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8"
2023-07-08T06:46:54.691 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8"
2023-07-08T06:46:54.691 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-08T06:46:54.692 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31"
2023-07-08T06:46:54.697 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-08T06:46:54.697 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/"
2023-07-08T06:46:54.697 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-08T06:46:54.698 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-08T06:46:54.698 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-08T06:46:54.699 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2023-07-08T06:46:54.726 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server
2023-07-08T06:46:54.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com'
2023-07-08T06:46:54.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-08T06:46:54.796 DEBUG:teuthology.orchestra.run.smithi070:> true
2023-07-08T06:46:54.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com'
2023-07-08T06:46:54.931 DEBUG:teuthology.orchestra.run.smithi070:> uname -m
2023-07-08T06:46:54.991 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64
2023-07-08T06:46:54.991 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release
2023-07-08T06:46:55.055 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream"
2023-07-08T06:46:55.056 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8"
2023-07-08T06:46:55.056 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos"
2023-07-08T06:46:55.056 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora"
2023-07-08T06:46:55.056 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8"
2023-07-08T06:46:55.056 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8"
2023-07-08T06:46:55.056 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-08T06:46:55.057 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31"
2023-07-08T06:46:55.057 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-08T06:46:55.057 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/"
2023-07-08T06:46:55.057 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-08T06:46:55.057 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-08T06:46:55.057 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-08T06:46:55.058 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server
2023-07-08T06:46:55.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-08T06:46:55.085 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-08T06:46:55.209 INFO:teuthology.dispatcher.supervisor:Running job 7328956
2023-07-08T06:46:55.209 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328956 --name adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi --description orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} -- /home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328956/orig.config.yaml
2023-07-08T06:46:55.214 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328956
2023-07-08T06:46:55.215 INFO:teuthology.dispatcher.supervisor:Job PID: 12566
2023-07-08T06:46:55.215 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-08T06:48:55.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-08T06:48:55.317 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-08T06:50:55.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-08T06:50:55.499 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-08T06:52:55.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-08T06:52:55.674 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-08T06:54:55.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-08T06:54:55.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-08T06:56:56.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-08T06:56:56.165 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-08T06:58:56.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-08T06:58:56.361 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-08T07:00:56.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-08T07:00:56.541 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-08T07:02:56.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-08T07:02:56.721 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-08T07:04:56.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-08T07:04:56.893 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-08T07:06:57.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-08T07:06:57.065 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-08T07:06:57.140 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-08T07:06:57.235 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-08T07:06:57.236 INFO:teuthology.nuke:Checking targets against current locks
2023-07-08T07:06:57.286 DEBUG:teuthology.nuke:shortname: smithi038
2023-07-08T07:06:57.287 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-08T07:06:57.308 DEBUG:teuthology.nuke:shortname: smithi070
2023-07-08T07:06:57.309 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-08T07:06:57.312 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328956', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 06:31:51.298125', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCa2TYEbsqQl56wqktGd4fZyJJz/81/Kup7/ZJxPzai9qeD9wtuzh9QzGt1RYO5AaFgbTThWR010rCaktA382KPdaWwzRNVVaIDDUUdpJYqV8cU2eTNXlMoIAeMvILHsNOm1/O0RIKVi4KmnJxZFAQP2G1xPqn9UMS8uEA1dWXGbljQYQHMNWUqArO+wRtExByzOAJhwkpDfBJp1RD3Wv7k+QI6W12odxaCKL7P6kiGeogr4KOusZQI4KqZtyK2Eci1RNTApUlLZyoFFkhFl0uDSvEbFiaQU7ZLh0KpmHjn3F8fg4xuNnfKF2US69HhIVnW3+ptfqy+s7bc28TuZBDkU1fdZv0KaMi7RqFxlAABxz+Y/avyqMov6TbwsPL4WwveZt+uGxF338UrCXXYdoz95U3AWb4CvS+RnORs5mNvevHoRM2SDwXlTu+FgXwrQ9kkY7cxgpeEF2l9HNzD4jvp4Bqt14Bn7BChP3tSF9Z57xpyaKy3JQRChf/ZwkXGa4U='}
2023-07-08T07:06:57.333 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328956', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 06:31:51.300155', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDO9VC6FrxvluSXSriwu8Db0M0uQmXTDBPUMQWOrFTws1uo37r3ga+UXi+99GAGW+kreiA9EfKkzkhvJrKnM0BzwgfX7WV3VI3xDBynHE9ceX5bxDApyrsmB32U7B7C2G65AR2JanKaZXh542FNBi/tvkeuZIx+x1Z2dl1ld3+gHcrK32j61fv0RIOUMyrCuu3dM5UMD0YXYhv1KYyQvToaonH/EfZcxGBa1QBPLEe+LGUjTM1ZJQNKccohJAQNGwxhLExyATHOcNXQmLXpAyp1QNj8ElUFQtuE/dZwi3F4hQ6vjKr895NwL9hjifbpRMHSrm32D8r+LGBZE3RhaJeRQR/AJ9FBQXYlxt16x2KMJzqMEiBHJ8NDKVFWM9Dz7ciuHMwrEYJhOCTNYLaqj3fQiS7kYwkB/YYG9e512K8F3uNfQ/b6ZZlZCk68zkRiPMYmYeU6dJxe8g2VN3BHhiGXxWnUyspNMedHR+xr2B9lqZI4io941H/wdggxp8HNL1c='}
2023-07-08T07:06:57.366 INFO:teuthology.orchestra.console:Power off smithi038
2023-07-08T07:06:57.366 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-08T07:06:57.388 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-08T07:06:57.407 INFO:teuthology.orchestra.console:Power off smithi070
2023-07-08T07:06:57.409 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-08T07:06:57.431 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-08T07:06:57.521 INFO:teuthology.orchestra.console:Power off for smithi038 completed
2023-07-08T07:06:57.555 INFO:teuthology.orchestra.console:Power off for smithi070 completed
2023-07-08T07:06:57.683 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com
2023-07-08T07:06:57.704 INFO:teuthology.lock.ops:unlocked: smithi070.front.sepia.ceph.com