2023-07-18T00:38:11.789 INFO:root:teuthology version: 0.0.1.dev147+gff9991b
2023-07-18T00:38:11.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T00:38:11.791 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T00:38:26.233 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3b4628a520>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3b462c0ee0>, signals=[15])
2023-07-18T00:38:26.236 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging
2023-07-18T00:38:26.237 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server
2023-07-18T00:38:26.237 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-07-18T00:38:26.265 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging
2023-07-18T00:38:26.265 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server
2023-07-18T00:38:26.265 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2023-07-18T00:38:26.267 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"}
2023-07-18T00:38:32.014 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"}
2023-07-18T00:38:47.070 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-18T00:38:51.190 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-18T00:38:51.235 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_9.stream (ID 10)
2023-07-18T00:38:51.235 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 10}
2023-07-18T00:38:51.239 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_9.stream (ID 10)
2023-07-18T00:38:51.239 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 10}
2023-07-18T00:38:51.296 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 9.stream
2023-07-18T00:38:51.296 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-18T00:38:51.299 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 9.stream
2023-07-18T00:38:51.300 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-07-18T00:38:51.363 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"}
2023-07-18T00:38:51.365 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"}
2023-07-18T00:38:56.417 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1}
2023-07-18T00:38:56.420 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1}
2023-07-18T00:38:56.511 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-07-18T00:38:56.550 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-18T00:39:06.282 INFO:teuthology.orchestra.console:Power off smithi110
2023-07-18T00:39:06.284 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-18T00:39:06.301 INFO:teuthology.orchestra.console:Power off smithi188
2023-07-18T00:39:06.302 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-18T00:39:06.311 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:06.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:10.338 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:10.348 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:15.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:15.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:15.663 INFO:teuthology.orchestra.console:Power off for smithi110 completed
2023-07-18T00:39:15.764 INFO:teuthology.orchestra.console:Power on smithi110
2023-07-18T00:39:15.764 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-18T00:39:20.573 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:20.787 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:25.731 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:25.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:25.942 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2023-07-18T00:39:26.043 INFO:teuthology.orchestra.console:Power on smithi188
2023-07-18T00:39:26.044 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-18T00:39:26.068 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:30.092 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:30.909 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:35.202 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:36.021 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:36.231 INFO:teuthology.orchestra.console:Power on for smithi110 completed
2023-07-18T00:39:36.333 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish
2023-07-18T00:39:36.334 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-07-18T00:39:41.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:46.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:51.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T00:39:51.777 INFO:teuthology.orchestra.console:Power on for smithi188 completed
2023-07-18T00:39:51.878 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish
2023-07-18T00:39:51.878 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-18T00:39:51.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:39:55.028 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-18T00:39:56.427 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-07-18T00:40:01.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:40:09.488 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-18T00:40:15.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:40:21.503 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-07-18T00:40:26.510 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-18T00:40:32.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:40:40.592 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-18T00:40:41.598 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-07-18T00:40:46.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:40:54.672 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-18T00:41:00.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:41:06.692 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-07-18T00:41:11.697 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-18T00:41:17.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:41:22.788 ERROR:teuthology.orchestra.connection:Error authenticating with smithi188.front.sepia.ceph.com: Authentication failed.
2023-07-18T00:41:22.790 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-18T00:41:22.790 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-18T00:41:22.791 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:23.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:24.800 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:25.809 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:26.781 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-07-18T00:41:26.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:27.825 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:28.830 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:29.836 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:30.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:31.846 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:32.852 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:33.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:34.864 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:35.871 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:36.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:37.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:38.888 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:39.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:40.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:41.866 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-07-18T00:41:43.126 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:44.131 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:45.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:46.143 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:47.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:48.155 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:49.161 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:50.166 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:51.171 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:52.177 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:53.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:54.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:55.192 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:56.199 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:57.204 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:58.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:41:58.229 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-07-18T00:42:03.237 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T00:42:03.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:42:11.376 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-07-18T00:42:17.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:42:21.904 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-07-18T00:42:27.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:42:30.960 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-07-18T00:42:36.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:42:40.016 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-07-18T00:42:46.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:42:54.096 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-07-18T00:43:00.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:43:55.888 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-18T00:43:55.890 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi188
2023-07-18T00:44:04.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com'
2023-07-18T00:44:04.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:44:09.901 WARNING:teuthology.provision.fog.smithi110:timed out
2023-07-18T00:44:10.134 DEBUG:teuthology.orchestra.run.smithi188:> true
2023-07-18T00:44:10.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com'
2023-07-18T00:44:10.457 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-18T00:44:10.458 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-18T00:44:10.472 INFO:teuthology.provision.fog.smithi188:Node is ready
2023-07-18T00:44:10.472 DEBUG:teuthology.orchestra.run.smithi188:> hostname
2023-07-18T00:44:10.527 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com
2023-07-18T00:44:10.528 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts
2023-07-18T00:44:10.582 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188
2023-07-18T00:44:10.582 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188
2023-07-18T00:44:10.700 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts
2023-07-18T00:44:10.728 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts
2023-07-18T00:44:10.795 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname
2023-07-18T00:44:10.862 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188
2023-07-18T00:44:10.928 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release
2023-07-18T00:44:10.982 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2023-07-18T00:44:10.983 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9"
2023-07-18T00:44:10.983 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2023-07-18T00:44:10.983 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2023-07-18T00:44:10.983 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9"
2023-07-18T00:44:10.983 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9"
2023-07-18T00:44:10.984 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-18T00:44:10.984 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2023-07-18T00:44:10.984 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon"
2023-07-18T00:44:10.984 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-18T00:44:10.984 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2023-07-18T00:44:10.984 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-18T00:44:10.984 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-18T00:44:10.985 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-18T00:44:10.985 INFO:teuthology.provision.fog.smithi188:Deploy complete!
2023-07-18T00:44:10.987 DEBUG:teuthology.parallel:result is None
2023-07-18T00:44:15.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:44:16.116 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-18T00:44:16.116 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-18T00:44:16.440 INFO:teuthology.provision.fog.smithi110:Node is ready
2023-07-18T00:44:16.441 DEBUG:teuthology.orchestra.run.smithi110:> hostname
2023-07-18T00:44:16.455 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com
2023-07-18T00:44:16.455 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts
2023-07-18T00:44:16.510 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110
2023-07-18T00:44:16.511 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2023-07-18T00:44:16.616 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts
2023-07-18T00:44:16.644 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts
2023-07-18T00:44:16.711 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname
2023-07-18T00:44:16.779 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2023-07-18T00:44:16.845 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2023-07-18T00:44:16.899 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream"
2023-07-18T00:44:16.899 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9"
2023-07-18T00:44:16.899 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos"
2023-07-18T00:44:16.899 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora"
2023-07-18T00:44:16.899 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9"
2023-07-18T00:44:16.900 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9"
2023-07-18T00:44:16.900 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-18T00:44:16.900 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2023-07-18T00:44:16.900 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon"
2023-07-18T00:44:16.900 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-18T00:44:16.900 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/"
2023-07-18T00:44:16.901 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-18T00:44:16.901 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-18T00:44:16.901 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-18T00:44:16.902 INFO:teuthology.provision.fog.smithi110:Deploy complete!
2023-07-18T00:44:16.902 DEBUG:teuthology.parallel:result is None
2023-07-18T00:44:57.109 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com
2023-07-18T00:44:57.110 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-18T00:45:02.145 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com
2023-07-18T00:45:02.146 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-18T00:45:07.169 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server
2023-07-18T00:45:07.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2023-07-18T00:45:07.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:45:07.254 DEBUG:teuthology.orchestra.run.smithi110:> true
2023-07-18T00:45:07.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com'
2023-07-18T00:45:07.426 DEBUG:teuthology.orchestra.run.smithi110:> uname -m
2023-07-18T00:45:07.481 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64
2023-07-18T00:45:07.481 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2023-07-18T00:45:07.534 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream"
2023-07-18T00:45:07.535 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9"
2023-07-18T00:45:07.535 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos"
2023-07-18T00:45:07.535 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora"
2023-07-18T00:45:07.535 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9"
2023-07-18T00:45:07.535 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9"
2023-07-18T00:45:07.536 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-18T00:45:07.536 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2023-07-18T00:45:07.536 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon"
2023-07-18T00:45:07.536 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-18T00:45:07.536 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/"
2023-07-18T00:45:07.537 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-18T00:45:07.537 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-18T00:45:07.537 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-18T00:45:07.538 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-07-18T00:45:12.276 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server
2023-07-18T00:45:12.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com'
2023-07-18T00:45:12.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T00:45:12.362 DEBUG:teuthology.orchestra.run.smithi188:> true
2023-07-18T00:45:12.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com'
2023-07-18T00:45:12.531 DEBUG:teuthology.orchestra.run.smithi188:> uname -m
2023-07-18T00:45:12.585 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64
2023-07-18T00:45:12.585 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release
2023-07-18T00:45:12.639 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2023-07-18T00:45:12.639 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9"
2023-07-18T00:45:12.639 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2023-07-18T00:45:12.639 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2023-07-18T00:45:12.639 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9"
2023-07-18T00:45:12.640 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9"
2023-07-18T00:45:12.640 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-18T00:45:12.640 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2023-07-18T00:45:12.640 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon"
2023-07-18T00:45:12.640 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-18T00:45:12.640 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2023-07-18T00:45:12.640 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-18T00:45:12.641 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-18T00:45:12.641 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-18T00:45:12.641 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2023-07-18T00:45:12.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T00:45:12.875 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T00:45:12.976 INFO:teuthology.dispatcher.supervisor:Running job 7342445
2023-07-18T00:45:12.976 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342445 --name yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} -- /home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342445/orig.config.yaml
2023-07-18T00:45:12.981 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342445
2023-07-18T00:45:12.982 INFO:teuthology.dispatcher.supervisor:Job PID: 17285
2023-07-18T00:45:12.982 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-18T00:47:13.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T00:47:13.081 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T00:49:18.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T00:49:18.264 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T00:51:23.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T00:51:23.447 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T00:53:28.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T00:53:28.634 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T00:55:33.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T00:55:33.818 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T00:57:37.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T00:57:37.250 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T00:59:42.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T00:59:42.173 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:01:47.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:01:47.354 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:03:52.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:03:52.541 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:05:57.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:05:57.722 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:08:02.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:08:02.920 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:10:03.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:10:03.097 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:12:03.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:12:03.297 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:14:08.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:14:08.482 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:16:13.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:16:13.688 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:18:18.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:18:18.865 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:20:23.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:20:23.986 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:22:29.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:22:29.166 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:22:29.860 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-18T01:22:30.207 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-18T01:22:30.208 INFO:teuthology.nuke:Checking targets against current locks
2023-07-18T01:22:30.256 DEBUG:teuthology.nuke:shortname: smithi110
2023-07-18T01:22:30.259 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-18T01:22:30.284 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342445', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 00:37:55.917726', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfbfN/GxDQlVg7q0kIxcoiX8/1cFoLR30xn6NC5LMtRRCfVnIYxnIfmdsesbEaHF+8do5bhdsaelWBnqAAIW2c='}
2023-07-18T01:22:30.287 DEBUG:teuthology.nuke:shortname: smithi188
2023-07-18T01:22:30.288 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-18T01:22:30.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342445', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 00:37:55.916009', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAUUFQByaJW9iLiP8hGdAvv0p+ioiJLVs7vE/pqwOv8LGt653kk6ASQ4kykqvGs77kjnTfCvvCXHHrJUveFOdQw='}
2023-07-18T01:22:30.341 INFO:teuthology.orchestra.console:Power off smithi110
2023-07-18T01:22:30.342 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-18T01:22:30.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T01:22:30.389 INFO:teuthology.orchestra.console:Power off smithi188
2023-07-18T01:22:30.390 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-18T01:22:30.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T01:22:30.503 INFO:teuthology.orchestra.console:Power off for smithi110 completed
2023-07-18T01:22:30.544 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2023-07-18T01:22:30.669 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com
2023-07-18T01:22:30.692 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com