2023-07-18T01:44:47.843 INFO:root:teuthology version: 0.0.1.dev147+gff9991b
2023-07-18T01:44:47.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:44:47.845 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:45:13.026 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f02d7c98550>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f02d8eb48b0>, signals=[15])
2023-07-18T01:45:13.028 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging
2023-07-18T01:45:13.028 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server
2023-07-18T01:45:13.028 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2023-07-18T01:45:18.063 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging
2023-07-18T01:45:18.064 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server
2023-07-18T01:45:18.064 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2023-07-18T01:45:18.066 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"}
2023-07-18T01:45:23.112 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"}
2023-07-18T01:45:33.186 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-18T01:45:38.193 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-18T01:45:43.242 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_9.stream (ID 10)
2023-07-18T01:45:43.242 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 10}
2023-07-18T01:45:48.245 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_centos_9.stream (ID 10)
2023-07-18T01:45:48.245 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 10}
2023-07-18T01:45:53.303 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 9.stream
2023-07-18T01:45:53.303 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None
2023-07-18T01:45:58.312 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 9.stream
2023-07-18T01:45:58.312 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-18T01:46:03.383 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"}
2023-07-18T01:46:08.390 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"}
2023-07-18T01:46:13.433 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1}
2023-07-18T01:46:18.442 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1}
2023-07-18T01:46:18.519 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None
2023-07-18T01:46:18.531 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-18T01:46:27.282 INFO:teuthology.orchestra.console:Power off smithi153
2023-07-18T01:46:27.283 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-18T01:46:27.302 INFO:teuthology.orchestra.console:Power off smithi090
2023-07-18T01:46:27.303 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-18T01:46:27.314 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T01:46:27.327 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T01:46:27.439 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2023-07-18T01:46:27.452 INFO:teuthology.orchestra.console:Power off for smithi090 completed
2023-07-18T01:46:27.541 INFO:teuthology.orchestra.console:Power on smithi153
2023-07-18T01:46:27.541 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-18T01:46:27.553 INFO:teuthology.orchestra.console:Power on smithi090
2023-07-18T01:46:27.554 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-18T01:46:27.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T01:46:27.579 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T01:46:31.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T01:46:31.605 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T01:46:31.807 INFO:teuthology.orchestra.console:Power on for smithi153 completed
2023-07-18T01:46:31.908 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2023-07-18T01:46:31.909 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-18T01:46:36.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T01:46:36.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:46:42.095 INFO:teuthology.orchestra.console:Power on for smithi090 completed
2023-07-18T01:46:42.196 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish
2023-07-18T01:46:42.196 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None
2023-07-18T01:46:47.201 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-07-18T01:46:53.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:47:01.264 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-07-18T01:47:02.290 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None
2023-07-18T01:47:07.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:47:10.320 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-07-18T01:47:16.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:47:21.333 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None
2023-07-18T01:47:26.340 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-07-18T01:47:32.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:47:35.412 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-07-18T01:47:41.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:47:46.421 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None
2023-07-18T01:47:51.424 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-07-18T01:47:57.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:48:03.536 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-07-18T01:48:06.512 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None
2023-07-18T01:48:09.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:48:17.616 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-07-18T01:48:21.596 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None
2023-07-18T01:48:26.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:48:31.689 ERROR:teuthology.orchestra.connection:Error authenticating with smithi153.front.sepia.ceph.com: Authentication failed.
2023-07-18T01:48:31.690 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-18T01:48:31.691 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-18T01:48:31.692 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:32.696 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:33.700 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:34.704 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:35.708 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:36.714 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:37.723 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:38.729 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:39.735 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:40.740 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:41.745 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:42.752 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:43.758 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:44.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:45.770 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:46.682 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None
2023-07-18T01:48:48.247 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:49.253 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:50.259 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:51.264 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:52.270 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:53.276 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:54.281 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:55.286 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:56.292 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:57.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:58.304 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:48:59.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:49:00.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:49:01.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:49:02.325 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:49:03.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:49:03.341 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None
2023-07-18T01:49:08.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:49:09.351 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:49:10.356 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-18T01:49:23.424 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None
2023-07-18T01:49:43.512 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None
2023-07-18T01:49:48.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:49:51.668 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-07-18T01:49:57.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:50:00.720 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-07-18T01:50:06.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:50:09.780 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-07-18T01:50:15.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:50:23.856 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-07-18T01:50:29.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:50:34.576 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-07-18T01:50:40.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:50:48.656 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-07-18T01:50:54.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:50:59.664 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-18T01:50:59.666 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi153
2023-07-18T01:51:08.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2023-07-18T01:51:08.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:51:08.923 DEBUG:teuthology.orchestra.run.smithi153:> true
2023-07-18T01:51:09.235 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com'
2023-07-18T01:51:09.235 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-18T01:51:09.236 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-18T01:51:18.128 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-07-18T01:51:24.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:51:24.253 INFO:teuthology.provision.fog.smithi153:Node is ready
2023-07-18T01:51:24.253 DEBUG:teuthology.orchestra.run.smithi153:> hostname
2023-07-18T01:51:24.272 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2023-07-18T01:51:24.273 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts
2023-07-18T01:51:24.329 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2023-07-18T01:51:24.330 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2023-07-18T01:51:24.458 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts
2023-07-18T01:51:24.489 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts
2023-07-18T01:51:24.560 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname
2023-07-18T01:51:24.630 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2023-07-18T01:51:24.698 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2023-07-18T01:51:24.753 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2023-07-18T01:51:24.753 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9"
2023-07-18T01:51:24.754 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2023-07-18T01:51:24.754 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2023-07-18T01:51:24.754 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9"
2023-07-18T01:51:24.754 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9"
2023-07-18T01:51:24.754 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-18T01:51:24.754 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2023-07-18T01:51:24.755 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon"
2023-07-18T01:51:24.755 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-18T01:51:24.755 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2023-07-18T01:51:24.755 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-18T01:51:24.755 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-18T01:51:24.755 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-18T01:51:24.756 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2023-07-18T01:51:24.757 DEBUG:teuthology.parallel:result is None
2023-07-18T01:51:27.188 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2023-07-18T01:51:33.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:51:38.450 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-18T01:51:38.451 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-18T01:51:58.879 INFO:teuthology.provision.fog.smithi090:Node is ready
2023-07-18T01:51:58.880 DEBUG:teuthology.orchestra.run.smithi090:> hostname
2023-07-18T01:51:58.938 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com
2023-07-18T01:51:58.938 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts
2023-07-18T01:51:58.996 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090
2023-07-18T01:51:58.996 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090
2023-07-18T01:51:59.125 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts
2023-07-18T01:51:59.156 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts
2023-07-18T01:51:59.225 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname
2023-07-18T01:51:59.295 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090
2023-07-18T01:51:59.363 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release
2023-07-18T01:51:59.418 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2023-07-18T01:51:59.418 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9"
2023-07-18T01:51:59.419 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2023-07-18T01:51:59.419 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2023-07-18T01:51:59.419 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9"
2023-07-18T01:51:59.419 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9"
2023-07-18T01:51:59.419 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-18T01:51:59.419 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2023-07-18T01:51:59.420 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon"
2023-07-18T01:51:59.420 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-18T01:51:59.420 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2023-07-18T01:51:59.420 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-18T01:51:59.420 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-18T01:51:59.420 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-18T01:51:59.421 INFO:teuthology.provision.fog.smithi090:Deploy complete!
2023-07-18T01:51:59.421 DEBUG:teuthology.parallel:result is None
2023-07-18T01:52:54.616 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com
2023-07-18T01:52:54.618 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-18T01:52:59.645 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2023-07-18T01:52:59.645 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-18T01:53:04.679 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server
2023-07-18T01:53:04.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2023-07-18T01:53:04.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:53:09.773 DEBUG:teuthology.orchestra.run.smithi090:> true
2023-07-18T01:53:09.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com'
2023-07-18T01:53:09.947 DEBUG:teuthology.orchestra.run.smithi090:> uname -m
2023-07-18T01:53:10.002 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64
2023-07-18T01:53:10.003 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release
2023-07-18T01:53:10.056 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2023-07-18T01:53:10.057 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9"
2023-07-18T01:53:10.057 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2023-07-18T01:53:10.057 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2023-07-18T01:53:10.057 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9"
2023-07-18T01:53:10.057 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9"
2023-07-18T01:53:10.057 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-18T01:53:10.058 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2023-07-18T01:53:10.058 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon"
2023-07-18T01:53:10.058 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-18T01:53:10.058 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2023-07-18T01:53:10.058 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-18T01:53:10.058 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-18T01:53:10.058 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-18T01:53:10.059 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2023-07-18T01:53:15.118 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2023-07-18T01:53:15.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2023-07-18T01:53:15.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-18T01:53:15.204 DEBUG:teuthology.orchestra.run.smithi153:> true
2023-07-18T01:53:15.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com'
2023-07-18T01:53:15.383 DEBUG:teuthology.orchestra.run.smithi153:> uname -m
2023-07-18T01:53:15.438 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2023-07-18T01:53:15.438 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2023-07-18T01:53:15.493 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream"
2023-07-18T01:53:15.493 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9"
2023-07-18T01:53:15.493 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos"
2023-07-18T01:53:15.494 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora"
2023-07-18T01:53:15.494 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9"
2023-07-18T01:53:15.494 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9"
2023-07-18T01:53:15.494 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-18T01:53:15.494 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2023-07-18T01:53:15.494 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon"
2023-07-18T01:53:15.494 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-18T01:53:15.495 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/"
2023-07-18T01:53:15.495 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-18T01:53:15.495 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-18T01:53:15.495 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-18T01:53:15.495 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2023-07-18T01:53:20.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:53:20.526 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:53:25.647 INFO:teuthology.dispatcher.supervisor:Running job 7342533
2023-07-18T01:53:25.648 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342533 --name yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} -- /home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342533/orig.config.yaml
2023-07-18T01:53:25.651 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342533
2023-07-18T01:53:25.652 INFO:teuthology.dispatcher.supervisor:Job PID: 5753
2023-07-18T01:53:25.652 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-18T01:55:25.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:55:25.753 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:57:30.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:57:30.929 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T01:59:36.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T01:59:36.131 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T02:01:41.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T02:01:41.310 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T02:03:46.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T02:03:46.494 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T02:05:46.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T02:05:46.670 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T02:07:51.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-18T02:07:51.846 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-18T02:07:56.925 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-18T02:08:07.052 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-18T02:08:07.053 INFO:teuthology.nuke:Checking targets against current locks
2023-07-18T02:08:17.860 DEBUG:teuthology.nuke:shortname: smithi090
2023-07-18T02:08:17.861 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-18T02:08:17.883 DEBUG:teuthology.nuke:shortname: smithi153
2023-07-18T02:08:17.883 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-18T02:08:17.905 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342533', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 01:44:42.030441', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBALrZnE5lVPrE8SMpt+fMXcIpaHC7u7egxKxNh14lUszIzZa4BvHFzHhOmWhwik2fdxTYi97IGzvskEYVq+Y9xc='}
2023-07-18T02:08:17.907 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342533', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 01:44:42.031913', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN/B+QucTDU1HYtfM6/unQyXAMuZOJkbZ6Mn797DEc7MBLsHcr8RVFLeQQ1bIwazGjBzA9AOCbfUyov+Eb6OFk8='}
2023-07-18T02:08:17.957 INFO:teuthology.orchestra.console:Power off smithi153
2023-07-18T02:08:17.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-18T02:08:17.975 INFO:teuthology.orchestra.console:Power off smithi090
2023-07-18T02:08:17.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-18T02:08:17.986 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T02:08:17.998 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-18T02:08:18.110 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2023-07-18T02:08:18.121 INFO:teuthology.orchestra.console:Power off for smithi090 completed
2023-07-18T02:08:33.287 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com
2023-07-18T02:08:33.293 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com