2023-07-21T14:47:45.660 INFO:root:teuthology version: 0.0.1.dev153+g79491cb
2023-07-21T14:47:45.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T14:47:45.662 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T14:48:05.360 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5cb5b49610>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5cb54e0820>, signals=[15])
2023-07-21T14:48:05.361 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging
2023-07-21T14:48:05.362 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T14:48:05.362 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-07-21T14:48:05.386 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging
2023-07-21T14:48:05.386 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T14:48:05.386 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2023-07-21T14:48:05.388 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"}
2023-07-21T14:48:10.410 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /host {"name": "smithi141"}
2023-07-21T14:48:20.450 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-07-21T14:48:30.488 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-07-21T14:48:35.495 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-07-21T14:48:35.495 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 6}
2023-07-21T14:48:40.542 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-07-21T14:48:40.542 DEBUG:teuthology.provision.fog.smithi141:FOG request: PUT /host/246 {"imageID": 6}
2023-07-21T14:48:40.550 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of ubuntu 22.04
2023-07-21T14:48:40.550 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:48:40.586 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of ubuntu 22.04
2023-07-21T14:48:40.587 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-07-21T14:48:40.597 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T14:48:40.638 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1}
2023-07-21T14:48:40.641 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T14:48:40.679 DEBUG:teuthology.provision.fog.smithi141:FOG request: POST /host/246/task {"taskTypeID": 1}
2023-07-21T14:48:40.696 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:48:40.763 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-07-21T14:48:46.444 INFO:teuthology.orchestra.console:Power off smithi124
2023-07-21T14:48:46.445 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T14:48:46.461 INFO:teuthology.orchestra.console:Power off smithi141
2023-07-21T14:48:46.462 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T14:48:46.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:48:46.485 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:48:50.500 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:48:50.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:48:55.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:48:55.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:48:55.831 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2023-07-21T14:48:55.932 INFO:teuthology.orchestra.console:Power on smithi141
2023-07-21T14:48:55.933 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T14:48:55.953 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:48:59.977 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:49:00.187 INFO:teuthology.orchestra.console:Power on for smithi141 completed
2023-07-21T14:49:00.288 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish
2023-07-21T14:49:00.289 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None
2023-07-21T14:49:05.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:49:05.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:49:08.432 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-07-21T14:49:10.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:49:14.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:49:19.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:49:22.512 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-07-21T14:49:24.552 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:49:28.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:49:29.662 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:49:31.568 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-07-21T14:49:34.772 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:49:35.867 INFO:teuthology.orchestra.console:Power off for smithi124 completed
2023-07-21T14:49:35.968 INFO:teuthology.orchestra.console:Power on smithi124
2023-07-21T14:49:35.968 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T14:49:35.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:49:37.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:49:42.577 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:49:45.648 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-07-21T14:49:47.690 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:49:51.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:49:56.657 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T14:49:56.868 INFO:teuthology.orchestra.console:Power on for smithi124 completed
2023-07-21T14:49:56.969 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2023-07-21T14:49:56.970 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:50:01.977 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-07-21T14:50:07.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:50:17.043 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:50:26.544 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-07-21T14:50:32.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:50:35.022 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-07-21T14:50:37.104 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:50:41.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:50:46.144 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed.
2023-07-21T14:50:46.146 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T14:50:46.146 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T14:50:46.147 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:50:47.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:50:48.155 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:50:49.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:50:50.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:50:51.166 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:50:52.163 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:50:57.169 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:50:58.173 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:50:59.177 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:00.180 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:01.184 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:02.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:03.192 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:04.196 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:05.201 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:06.206 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:07.211 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:08.216 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:09.220 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:10.224 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:11.229 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:12.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:12.237 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:51:13.239 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:14.244 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:15.249 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:16.253 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:17.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:18.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:19.268 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:20.273 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:21.279 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:22.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:23.290 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:24.296 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:25.301 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:26.307 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:27.312 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:27.324 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:51:30.748 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:31.753 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:32.758 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:33.764 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:34.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:35.774 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:36.780 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:37.785 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:38.791 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:39.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:40.801 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:41.806 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:42.811 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:43.816 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:44.822 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:45.806 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:51:50.465 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:51.469 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:52.474 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:53.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:54.484 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:55.490 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:56.495 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:57.500 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:58.505 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:51:59.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:52:00.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:52:01.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:52:02.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:52:03.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:52:04.537 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:52:05.523 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:52:05.543 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:52:06.549 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T14:52:20.600 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:52:35.663 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:52:50.720 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-07-21T14:52:50.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:52:53.872 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-07-21T14:52:59.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:53:02.928 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-07-21T14:53:08.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:53:17.008 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-07-21T14:53:23.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:53:31.088 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-07-21T14:53:37.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:53:45.168 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-07-21T14:53:51.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:53:56.173 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-21T14:53:56.174 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi141
2023-07-21T14:54:05.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2023-07-21T14:54:05.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:54:05.185 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.141
2023-07-21T14:54:14.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2023-07-21T14:54:14.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:54:19.419 DEBUG:teuthology.orchestra.run.smithi141:> true
2023-07-21T14:54:19.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com'
2023-07-21T14:54:19.902 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T14:54:19.902 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T14:54:19.946 INFO:teuthology.provision.fog.smithi141:Node is ready
2023-07-21T14:54:19.947 DEBUG:teuthology.orchestra.run.smithi141:> hostname
2023-07-21T14:54:19.994 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com
2023-07-21T14:54:19.995 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts
2023-07-21T14:54:20.044 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141
2023-07-21T14:54:20.045 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141
2023-07-21T14:54:20.168 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts
2023-07-21T14:54:20.185 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts
2023-07-21T14:54:20.238 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname
2023-07-21T14:54:20.294 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141
2023-07-21T14:54:20.350 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release
2023-07-21T14:54:20.399 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-07-21T14:54:20.399 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Ubuntu"
2023-07-21T14:54:20.399 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="22.04"
2023-07-21T14:54:20.399 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-07-21T14:54:20.399 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_CODENAME=jammy
2023-07-21T14:54:20.400 INFO:teuthology.orchestra.run.smithi141.stdout:ID=ubuntu
2023-07-21T14:54:20.400 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE=debian
2023-07-21T14:54:20.400 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-21T14:54:20.400 INFO:teuthology.orchestra.run.smithi141.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-21T14:54:20.401 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-21T14:54:20.401 INFO:teuthology.orchestra.run.smithi141.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-21T14:54:20.401 INFO:teuthology.orchestra.run.smithi141.stdout:UBUNTU_CODENAME=jammy
2023-07-21T14:54:20.402 INFO:teuthology.provision.fog.smithi141:Deploy complete!
2023-07-21T14:54:20.404 DEBUG:teuthology.parallel:result is None
2023-07-21T14:54:27.700 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-07-21T14:54:33.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:54:33.707 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-07-21T14:54:39.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:54:44.717 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-07-21T14:54:50.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:54:55.967 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T14:54:55.967 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T14:54:56.485 INFO:teuthology.provision.fog.smithi124:Node is ready
2023-07-21T14:54:56.486 DEBUG:teuthology.orchestra.run.smithi124:> hostname
2023-07-21T14:54:56.530 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2023-07-21T14:54:56.530 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts
2023-07-21T14:54:56.578 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2023-07-21T14:54:56.579 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-07-21T14:54:56.724 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts
2023-07-21T14:54:56.737 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts
2023-07-21T14:54:56.794 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname
2023-07-21T14:54:56.853 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-07-21T14:54:56.909 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-07-21T14:54:56.955 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-07-21T14:54:56.955 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Ubuntu"
2023-07-21T14:54:56.955 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="22.04"
2023-07-21T14:54:56.955 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-07-21T14:54:56.956 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_CODENAME=jammy
2023-07-21T14:54:56.956 INFO:teuthology.orchestra.run.smithi124.stdout:ID=ubuntu
2023-07-21T14:54:56.956 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE=debian
2023-07-21T14:54:56.956 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-21T14:54:56.956 INFO:teuthology.orchestra.run.smithi124.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-21T14:54:56.956 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-21T14:54:56.957 INFO:teuthology.orchestra.run.smithi124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-21T14:54:56.957 INFO:teuthology.orchestra.run.smithi124.stdout:UBUNTU_CODENAME=jammy
2023-07-21T14:54:56.957 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2023-07-21T14:54:56.957 DEBUG:teuthology.parallel:result is None
2023-07-21T14:55:02.132 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2023-07-21T14:55:02.133 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-21T14:55:07.178 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com
2023-07-21T14:55:07.179 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-21T14:55:10.280 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2023-07-21T14:55:10.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-07-21T14:55:10.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:55:10.363 DEBUG:teuthology.orchestra.run.smithi124:> true
2023-07-21T14:55:10.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-07-21T14:55:10.461 DEBUG:teuthology.orchestra.run.smithi124:> uname -m
2023-07-21T14:55:10.510 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2023-07-21T14:55:10.511 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-07-21T14:55:10.558 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-07-21T14:55:10.559 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Ubuntu"
2023-07-21T14:55:10.559 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="22.04"
2023-07-21T14:55:10.559 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-07-21T14:55:10.559 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_CODENAME=jammy
2023-07-21T14:55:10.559 INFO:teuthology.orchestra.run.smithi124.stdout:ID=ubuntu
2023-07-21T14:55:10.560 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE=debian
2023-07-21T14:55:10.560 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-21T14:55:10.560 INFO:teuthology.orchestra.run.smithi124.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-21T14:55:10.560 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-21T14:55:10.561 INFO:teuthology.orchestra.run.smithi124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-21T14:55:10.561 INFO:teuthology.orchestra.run.smithi124.stdout:UBUNTU_CODENAME=jammy
2023-07-21T14:55:10.562 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-07-21T14:55:10.586 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server
2023-07-21T14:55:10.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2023-07-21T14:55:10.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T14:55:10.665 DEBUG:teuthology.orchestra.run.smithi141:> true
2023-07-21T14:55:10.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com'
2023-07-21T14:55:10.877 DEBUG:teuthology.orchestra.run.smithi141:> uname -m
2023-07-21T14:55:10.922 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64
2023-07-21T14:55:10.922 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release
2023-07-21T14:55:10.972 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-07-21T14:55:10.989 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Ubuntu"
2023-07-21T14:55:10.991 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="22.04"
2023-07-21T14:55:10.991 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-07-21T14:55:10.992 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_CODENAME=jammy
2023-07-21T14:55:10.992 INFO:teuthology.orchestra.run.smithi141.stdout:ID=ubuntu
2023-07-21T14:55:10.993 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE=debian
2023-07-21T14:55:10.993 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-21T14:55:10.993 INFO:teuthology.orchestra.run.smithi141.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-21T14:55:10.994 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-21T14:55:10.994 INFO:teuthology.orchestra.run.smithi141.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-21T14:55:10.994 INFO:teuthology.orchestra.run.smithi141.stdout:UBUNTU_CODENAME=jammy
2023-07-21T14:55:10.995 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2023-07-21T14:55:11.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T14:55:11.035 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T14:55:11.159 INFO:teuthology.dispatcher.supervisor:Running job 7346635
2023-07-21T14:55:11.160 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-07-21_14:03:02-rgw-main-distro-default-smithi/7346635 --name cbodley-2023-07-21_14:03:02-rgw-main-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2023-07-21_14:03:02-rgw-main-distro-default-smithi/7346635/orig.config.yaml
2023-07-21T14:55:11.164 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-07-21_14:03:02-rgw-main-distro-default-smithi/7346635
2023-07-21T14:55:11.165 INFO:teuthology.dispatcher.supervisor:Job PID: 20606
2023-07-21T14:55:11.165 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-21T14:57:11.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T14:57:11.266 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T14:59:16.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T14:59:16.433 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:01:16.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:01:16.611 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:03:21.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:03:21.785 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:05:26.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:05:26.965 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:07:32.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:07:32.148 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:09:37.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:09:37.326 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:11:42.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:11:42.508 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:13:43.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:13:43.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:15:46.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:15:46.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:17:52.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:17:52.301 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:19:57.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:19:57.473 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:22:00.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:22:00.377 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:24:05.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:24:05.553 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:26:10.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:26:10.726 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:28:15.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:28:15.907 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:30:16.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:30:16.089 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:32:19.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:32:19.503 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:34:24.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:34:24.644 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:36:29.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:36:29.735 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:38:34.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:38:34.941 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:40:40.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:40:40.198 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:42:45.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:42:45.377 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:44:50.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:44:50.559 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:46:55.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:46:55.732 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:49:00.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:49:00.899 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:51:06.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:51:06.106 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:53:11.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:53:11.300 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:55:16.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:55:16.473 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:57:19.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:57:19.474 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T15:59:24.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T15:59:24.644 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:01:26.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:01:26.685 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:03:28.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:03:28.917 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:05:34.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:05:34.114 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:07:39.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:07:39.292 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:09:44.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:09:44.469 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:11:45.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:11:45.664 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:13:50.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:13:50.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:15:52.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:15:52.453 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:17:53.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:17:53.338 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:19:58.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:19:58.517 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:22:03.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:22:03.697 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:24:03.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:24:03.862 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:26:09.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:26:09.033 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:28:11.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:28:11.177 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:30:16.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:30:16.358 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:32:17.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:32:17.514 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:34:18.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:34:18.005 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:36:18.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:36:18.182 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:38:23.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:38:23.354 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:40:28.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:40:28.518 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:42:28.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:42:28.695 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:44:30.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:44:30.954 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:46:31.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:46:31.129 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:48:36.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:48:36.334 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:50:41.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:50:41.510 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:52:46.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:52:46.685 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:54:51.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:54:51.853 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:56:57.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:56:57.046 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T16:59:02.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T16:59:02.217 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T17:01:07.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T17:01:07.389 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T17:03:12.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T17:03:12.590 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T17:05:17.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T17:05:17.780 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T17:07:22.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T17:07:22.953 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T17:09:24.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T17:09:24.277 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T17:11:29.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T17:11:29.453 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T17:13:34.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T17:13:34.650 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T17:13:34.730 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-21T17:13:44.926 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-21T17:13:44.926 INFO:teuthology.nuke:Checking targets against current locks
2023-07-21T17:14:00.003 DEBUG:teuthology.nuke:shortname: smithi124
2023-07-21T17:14:00.004 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-21T17:14:10.045 DEBUG:teuthology.nuke:shortname: smithi141
2023-07-21T17:14:10.046 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-21T17:14:15.054 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-07-21_14:03:02-rgw-main-distro-default-smithi/7346635', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 14:47:44.827845', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKHIoXyu/87wpsFmJ2rSdxyUW+ahe7NQwAZbq1Lp3Pg+Ph480i1kJhRAyNKAe7G3C8W2ERCgCgfMRiw41xtwlCA='}
2023-07-21T17:14:22.716 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-07-21_14:03:02-rgw-main-distro-default-smithi/7346635', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 14:47:44.829442', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK3C7GdIrAQu/o5sumVTyA3j1EB6FHK5cO/7KBnVWHae8LYGJwd7my/kBuZv23c7JniVBUy2HE+m8IuTg4zs+Sk='}
2023-07-21T17:14:22.751 INFO:teuthology.orchestra.console:Power off smithi124
2023-07-21T17:14:22.751 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T17:14:27.777 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T17:14:27.805 INFO:teuthology.orchestra.console:Power off smithi141
2023-07-21T17:14:27.806 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T17:14:32.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T17:14:32.830 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T17:14:37.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T17:14:37.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T17:14:38.057 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2023-07-21T17:14:47.964 INFO:teuthology.orchestra.console:Power off for smithi124 completed
2023-07-21T17:14:47.996 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com
2023-07-21T17:14:48.127 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com