2023-07-21T21:26:06.084 INFO:root:teuthology version: 0.0.1.dev153+g79491cb
2023-07-21T21:26:06.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T21:26:06.086 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T21:26:36.310 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7efd4ff37640>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7efd4f8e68b0>, signals=[15])
2023-07-21T21:26:36.312 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2023-07-21T21:26:36.312 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T21:26:36.312 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-07-21T21:26:41.352 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging
2023-07-21T21:26:41.353 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T21:26:41.353 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2023-07-21T21:26:41.354 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /host {"name": "smithi043"}
2023-07-21T21:26:46.381 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging
2023-07-21T21:26:46.382 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T21:26:46.382 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-07-21T21:26:46.383 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"}
2023-07-21T21:27:01.403 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"}
2023-07-21T21:27:11.413 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-21T21:27:21.426 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-21T21:27:26.434 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_9.stream (ID 10)
2023-07-21T21:27:26.434 DEBUG:teuthology.provision.fog.smithi043:FOG request: PUT /host/148 {"imageID": 10}
2023-07-21T21:27:31.442 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-21T21:27:36.450 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_centos_9.stream (ID 10)
2023-07-21T21:27:36.450 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 10}
2023-07-21T21:27:36.507 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_9.stream (ID 10)
2023-07-21T21:27:36.507 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 10}
2023-07-21T21:27:41.515 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 9.stream
2023-07-21T21:27:41.515 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-07-21T21:27:41.517 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 9.stream
2023-07-21T21:27:41.517 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-21T21:27:51.567 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 9.stream
2023-07-21T21:27:51.568 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-07-21T21:27:56.575 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T21:27:56.577 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T21:27:56.618 DEBUG:teuthology.provision.fog.smithi043:FOG request: POST /host/148/task {"taskTypeID": 1}
2023-07-21T21:27:56.626 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1}
2023-07-21T21:27:56.637 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T21:27:56.676 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-07-21T21:27:56.679 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-21T21:27:56.682 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1}
2023-07-21T21:27:56.730 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-07-21T21:27:57.531 INFO:teuthology.orchestra.console:Power off smithi164
2023-07-21T21:27:57.533 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T21:27:57.547 INFO:teuthology.orchestra.console:Power off smithi043
2023-07-21T21:27:57.548 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T21:27:57.563 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:27:57.576 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:27:57.602 INFO:teuthology.orchestra.console:Power off smithi203
2023-07-21T21:27:57.603 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T21:27:57.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:27:57.690 INFO:teuthology.orchestra.console:Power off for smithi164 completed
2023-07-21T21:27:57.748 INFO:teuthology.orchestra.console:Power off for smithi203 completed
2023-07-21T21:27:57.792 INFO:teuthology.orchestra.console:Power on smithi164
2023-07-21T21:27:57.792 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T21:27:57.814 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:27:57.850 INFO:teuthology.orchestra.console:Power on smithi203
2023-07-21T21:27:57.850 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T21:27:57.872 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:01.616 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:01.839 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:01.895 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:05.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:05.938 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2023-07-21T21:28:06.039 INFO:teuthology.orchestra.console:Power on smithi043
2023-07-21T21:28:06.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T21:28:06.950 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:07.007 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:11.063 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:12.063 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:12.117 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:16.074 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:17.177 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:17.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:17.387 INFO:teuthology.orchestra.console:Power on for smithi164 completed
2023-07-21T21:28:17.488 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish
2023-07-21T21:28:17.489 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-21T21:28:22.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T21:28:22.602 INFO:teuthology.orchestra.console:Power on for smithi203 completed
2023-07-21T21:28:22.703 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2023-07-21T21:28:22.704 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-07-21T21:28:27.810 INFO:teuthology.orchestra.console:Power on for smithi043 completed
2023-07-21T21:28:27.910 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2023-07-21T21:28:27.911 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-07-21T21:28:37.579 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-21T21:28:42.788 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-07-21T21:28:47.994 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-07-21T21:28:53.338 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-21T21:29:02.872 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-07-21T21:29:08.068 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-07-21T21:29:13.411 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-21T21:29:22.956 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-07-21T21:29:28.148 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-07-21T21:29:33.493 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-21T21:29:43.028 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-07-21T21:29:48.219 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-07-21T21:29:53.251 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-21T21:30:03.104 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-07-21T21:30:13.236 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-07-21T21:30:18.243 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-21T21:30:23.248 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-07-21T21:30:43.268 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None
2023-07-21T21:30:43.414 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-21T21:30:43.416 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-07-21T21:30:43.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:30:43.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:30:43.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:30:46.576 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-07-21T21:30:46.577 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-07-21T21:30:46.578 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-07-21T21:30:52.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:30:52.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:30:52.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:30:55.664 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-07-21T21:30:55.665 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-07-21T21:30:55.665 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-07-21T21:31:01.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:31:06.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:31:11.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:31:16.680 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-07-21T21:31:16.681 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-07-21T21:31:19.760 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-07-21T21:31:22.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:31:27.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:31:32.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:31:37.697 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-07-21T21:31:37.698 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-07-21T21:31:40.757 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-07-21T21:31:43.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:31:43.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:31:46.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:31:51.765 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-07-21T21:31:57.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:32:16.116 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-07-21T21:32:22.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:32:27.305 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T21:32:27.306 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T21:32:27.430 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T21:32:27.431 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T21:32:32.613 INFO:teuthology.provision.fog.smithi043:Node is ready
2023-07-21T21:32:32.613 DEBUG:teuthology.orchestra.run.smithi043:> hostname
2023-07-21T21:32:32.671 INFO:teuthology.orchestra.run.smithi043.stdout:smithi197
2023-07-21T21:32:32.671 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi197 /etc/hosts
2023-07-21T21:32:32.729 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197
2023-07-21T21:32:32.730 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-07-21T21:32:32.857 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi197/smithi043/g' /etc/hosts
2023-07-21T21:32:32.891 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.197/172.21.15.43/g' /etc/hosts
2023-07-21T21:32:32.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi197/smithi043/g' /etc/hostname
2023-07-21T21:32:33.037 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-07-21T21:32:33.109 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-07-21T21:32:33.164 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream"
2023-07-21T21:32:33.165 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9"
2023-07-21T21:32:33.165 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos"
2023-07-21T21:32:33.165 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora"
2023-07-21T21:32:33.165 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9"
2023-07-21T21:32:33.165 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9"
2023-07-21T21:32:33.165 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-21T21:32:33.166 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-07-21T21:32:33.166 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon"
2023-07-21T21:32:33.166 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-21T21:32:33.166 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/"
2023-07-21T21:32:33.166 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T21:32:33.166 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-21T21:32:33.166 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-21T21:32:33.167 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2023-07-21T21:32:33.170 DEBUG:teuthology.parallel:result is None
2023-07-21T21:32:43.705 WARNING:teuthology.provision.fog.smithi164:timed out
2023-07-21T21:32:49.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:32:54.714 INFO:teuthology.provision.fog.smithi203:Node is ready
2023-07-21T21:32:54.715 DEBUG:teuthology.orchestra.run.smithi203:> hostname
2023-07-21T21:32:54.736 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com
2023-07-21T21:32:54.737 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts
2023-07-21T21:32:54.794 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2023-07-21T21:32:54.794 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-07-21T21:32:54.925 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts
2023-07-21T21:32:54.957 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts
2023-07-21T21:32:55.028 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname
2023-07-21T21:32:55.059 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T21:32:55.059 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T21:32:55.098 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-07-21T21:32:55.166 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-07-21T21:32:55.221 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-07-21T21:32:55.221 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9"
2023-07-21T21:32:55.222 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-07-21T21:32:55.222 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-07-21T21:32:55.222 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9"
2023-07-21T21:32:55.223 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9"
2023-07-21T21:32:55.223 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-21T21:32:55.223 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-07-21T21:32:55.223 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon"
2023-07-21T21:32:55.223 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-21T21:32:55.223 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-07-21T21:32:55.224 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T21:32:55.224 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-21T21:32:55.224 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-21T21:32:55.224 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2023-07-21T21:32:55.225 DEBUG:teuthology.parallel:result is None
2023-07-21T21:32:55.364 INFO:teuthology.provision.fog.smithi164:Node is ready
2023-07-21T21:32:55.365 DEBUG:teuthology.orchestra.run.smithi164:> hostname
2023-07-21T21:32:55.383 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com
2023-07-21T21:32:55.384 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts
2023-07-21T21:32:55.439 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164
2023-07-21T21:32:55.439 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2023-07-21T21:32:55.562 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts
2023-07-21T21:32:55.590 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts
2023-07-21T21:32:55.657 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname
2023-07-21T21:32:55.725 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2023-07-21T21:32:55.791 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2023-07-21T21:32:55.845 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream"
2023-07-21T21:32:55.846 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9"
2023-07-21T21:32:55.846 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos"
2023-07-21T21:32:55.846 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora"
2023-07-21T21:32:55.846 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9"
2023-07-21T21:32:55.846 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9"
2023-07-21T21:32:55.846 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-21T21:32:55.846 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2023-07-21T21:32:55.847 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon"
2023-07-21T21:32:55.847 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-21T21:32:55.847 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/"
2023-07-21T21:32:55.847 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T21:32:55.847 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-21T21:32:55.847 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-21T21:32:55.847 INFO:teuthology.provision.fog.smithi164:Deploy complete!
2023-07-21T21:32:55.848 DEBUG:teuthology.parallel:result is None
2023-07-21T21:33:26.062 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2023-07-21T21:33:26.063 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-21T21:33:31.089 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com
2023-07-21T21:33:31.090 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-21T21:33:36.121 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com
2023-07-21T21:33:36.122 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-21T21:33:41.173 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2023-07-21T21:33:41.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-07-21T21:33:41.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:33:46.274 DEBUG:teuthology.orchestra.run.smithi043:> true
2023-07-21T21:33:46.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-07-21T21:33:46.420 DEBUG:teuthology.orchestra.run.smithi043:> uname -m
2023-07-21T21:33:46.475 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2023-07-21T21:33:46.475 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-07-21T21:33:46.530 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream"
2023-07-21T21:33:46.530 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9"
2023-07-21T21:33:46.530 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos"
2023-07-21T21:33:46.530 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora"
2023-07-21T21:33:46.531 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9"
2023-07-21T21:33:46.531 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9"
2023-07-21T21:33:46.531 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-21T21:33:46.531 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-07-21T21:33:46.531 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon"
2023-07-21T21:33:46.531 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-21T21:33:46.531 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/"
2023-07-21T21:33:46.532 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T21:33:46.532 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-21T21:33:46.532 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-21T21:33:46.532 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-07-21T21:33:51.561 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server
2023-07-21T21:33:51.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2023-07-21T21:33:51.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:33:56.649 DEBUG:teuthology.orchestra.run.smithi164:> true
2023-07-21T21:33:56.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com'
2023-07-21T21:33:56.823 DEBUG:teuthology.orchestra.run.smithi164:> uname -m
2023-07-21T21:33:56.878 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64
2023-07-21T21:33:56.878 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2023-07-21T21:33:56.934 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream"
2023-07-21T21:33:56.934 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9"
2023-07-21T21:33:56.934 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos"
2023-07-21T21:33:56.935 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora"
2023-07-21T21:33:56.935 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9"
2023-07-21T21:33:56.935 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9"
2023-07-21T21:33:56.935 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-21T21:33:56.936 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2023-07-21T21:33:56.936 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon"
2023-07-21T21:33:56.936 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-21T21:33:56.936 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/"
2023-07-21T21:33:56.937 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T21:33:56.937 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-21T21:33:56.937 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-21T21:33:56.938 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2023-07-21T21:34:01.967 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server
2023-07-21T21:34:01.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-07-21T21:34:01.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T21:34:07.058 DEBUG:teuthology.orchestra.run.smithi203:> true
2023-07-21T21:34:07.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-07-21T21:34:07.231 DEBUG:teuthology.orchestra.run.smithi203:> uname -m
2023-07-21T21:34:07.286 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64
2023-07-21T21:34:07.287 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-07-21T21:34:07.341 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-07-21T21:34:07.342 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9"
2023-07-21T21:34:07.342 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-07-21T21:34:07.342 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-07-21T21:34:07.343 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9"
2023-07-21T21:34:07.343 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9"
2023-07-21T21:34:07.343 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-21T21:34:07.343 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-07-21T21:34:07.344 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon"
2023-07-21T21:34:07.344 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-21T21:34:07.344 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-07-21T21:34:07.344 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T21:34:07.345 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-21T21:34:07.345 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-21T21:34:07.345 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-07-21T21:34:12.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T21:34:12.374 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T21:34:17.483 INFO:teuthology.dispatcher.supervisor:Running job 7346824
2023-07-21T21:34:17.483 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346824 --name yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346824/orig.config.yaml
2023-07-21T21:34:17.487 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-21_15:23:26-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346824
2023-07-21T21:34:17.488 INFO:teuthology.dispatcher.supervisor:Job PID: 8702
2023-07-21T21:34:17.488 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-21T21:36:17.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T21:36:17.590 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T21:38:22.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T21:38:22.766 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T21:40:23.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T21:40:23.833 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T21:42:29.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T21:42:29.021 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T21:44:34.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T21:44:34.190 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T21:46:34.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T21:46:34.446 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T21:48:39.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T21:48:39.620 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T21:50:44.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T21:50:44.787 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T21:50:44.860 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120