2024-04-01T23:44:27.023 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-04-01T23:44:27.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T23:44:27.247 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f992e04ef70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f992f0afc10>, signals=[15])
2024-04-01T23:44:27.248 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging
2024-04-01T23:44:27.248 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T23:44:27.248 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2024-04-01T23:44:27.280 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2024-04-01T23:44:27.280 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T23:44:27.280 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-04-01T23:44:27.320 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2024-04-01T23:44:27.321 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2024-04-01T23:44:27.321 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2024-04-01T23:44:27.444 DEBUG:teuthology.provision.fog.smithi106:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T23:44:27.505 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T23:44:27.515 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_9.stream (ID 10)
2024-04-01T23:44:27.524 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of centos 9.stream
2024-04-01T23:44:27.578 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream
2024-04-01T23:44:27.589 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 9.stream
2024-04-01T23:44:27.906 INFO:teuthology.orchestra.console.smithi106:Power off
2024-04-01T23:44:27.907 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T23:44:27.992 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off
2024-04-01T23:44:27.993 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:28.020 INFO:teuthology.orchestra.console.smithi161:Power off
2024-04-01T23:44:28.020 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T23:44:28.040 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-04-01T23:44:28.054 INFO:teuthology.orchestra.console.smithi196:Power off
2024-04-01T23:44:28.054 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-01T23:44:28.094 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2024-04-01T23:44:28.094 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:28.104 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2024-04-01T23:44:28.104 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:28.127 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-04-01T23:44:28.177 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-04-01T23:44:32.045 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:32.128 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:32.154 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-04-01T23:44:32.178 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:32.236 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-04-01T23:44:32.286 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-04-01T23:44:36.158 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:36.237 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:36.268 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-04-01T23:44:36.287 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:36.347 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-04-01T23:44:36.395 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-04-01T23:44:36.448 INFO:teuthology.orchestra.console.smithi161:Power off completed
2024-04-01T23:44:36.549 INFO:teuthology.orchestra.console.smithi161:Power on
2024-04-01T23:44:36.549 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T23:44:36.596 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2024-04-01T23:44:36.596 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:36.627 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-04-01T23:44:40.270 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:40.379 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-04-01T23:44:40.396 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:40.480 INFO:teuthology.orchestra.console.smithi106:Power off completed
2024-04-01T23:44:40.505 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-04-01T23:44:40.581 INFO:teuthology.orchestra.console.smithi106:Power on
2024-04-01T23:44:40.581 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T23:44:40.607 INFO:teuthology.orchestra.console.smithi196:Power off completed
2024-04-01T23:44:40.612 DEBUG:teuthology.orchestra.console.smithi106:power on output: Chassis Power Control: Up/On
2024-04-01T23:44:40.612 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:40.628 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:40.641 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-04-01T23:44:40.708 INFO:teuthology.orchestra.console.smithi196:Power on
2024-04-01T23:44:40.708 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-01T23:44:40.736 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-04-01T23:44:40.754 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On
2024-04-01T23:44:40.754 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:40.787 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2024-04-01T23:44:44.645 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:44.737 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:44.754 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-04-01T23:44:44.788 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:44.846 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-04-01T23:44:44.896 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2024-04-01T23:44:44.948 INFO:teuthology.orchestra.console.smithi161:Power on completed
2024-04-01T23:44:44.997 INFO:teuthology.orchestra.console.smithi196:Power on completed
2024-04-01T23:44:45.049 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2024-04-01T23:44:45.098 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2024-04-01T23:44:48.759 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-01T23:44:48.923 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-04-01T23:44:49.023 INFO:teuthology.orchestra.console.smithi106:Power on completed
2024-04-01T23:44:49.124 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish
2024-04-01T23:47:16.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:19.134 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-04-01T23:47:20.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:23.106 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-01T23:47:25.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:28.226 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-04-01T23:47:29.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:31.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:32.190 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-01T23:47:34.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:34.302 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-04-01T23:47:37.314 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-04-01T23:47:38.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:40.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:41.282 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-01T23:47:43.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:43.394 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-04-01T23:47:46.398 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-04-01T23:47:47.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:49.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:50.370 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-01T23:47:52.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:52.478 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-04-01T23:47:55.486 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-04-01T23:47:56.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:58.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:47:59.486 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-01T23:48:01.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:48:01.566 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-04-01T23:48:04.578 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-04-01T23:48:05.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:48:07.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:48:08.574 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-01T23:48:10.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:48:10.654 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-04-01T23:48:13.662 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2024-04-01T23:48:14.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:48:16.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:48:17.662 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-01T23:48:19.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:48:19.742 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-04-01T23:48:23.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:48:25.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:49:19.730 WARNING:teuthology.provision.fog.smithi196:timed out
2024-04-01T23:49:23.686 WARNING:teuthology.provision.fog.smithi106:timed out
2024-04-01T23:49:25.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:49:25.756 WARNING:teuthology.provision.fog.smithi161:timed out
2024-04-01T23:49:25.985 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T23:49:25.985 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T23:49:26.349 INFO:teuthology.provision.fog.smithi196:Node is ready
2024-04-01T23:49:26.349 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2024-04-01T23:49:26.364 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2024-04-01T23:49:26.364 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts
2024-04-01T23:49:26.420 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2024-04-01T23:49:26.421 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2024-04-01T23:49:26.531 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts
2024-04-01T23:49:26.561 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2024-04-01T23:49:26.631 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname
2024-04-01T23:49:26.701 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2024-04-01T23:49:26.769 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2024-04-01T23:49:26.824 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T23:49:26.825 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T23:49:26.826 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2024-04-01T23:49:26.828 DEBUG:teuthology.parallel:result is None
2024-04-01T23:49:29.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:49:30.091 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T23:49:30.092 DEBUG:teuthology.orchestra.run.smithi106:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T23:49:30.414 INFO:teuthology.provision.fog.smithi106:Node is ready
2024-04-01T23:49:30.414 DEBUG:teuthology.orchestra.run.smithi106:> hostname
2024-04-01T23:49:30.430 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com
2024-04-01T23:49:30.430 DEBUG:teuthology.orchestra.run.smithi106:> grep smithi106.front.sepia.ceph.com /etc/hosts
2024-04-01T23:49:30.485 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106
2024-04-01T23:49:30.486 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106
2024-04-01T23:49:30.600 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hosts
2024-04-01T23:49:30.628 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/172.21.15.106/172.21.15.106/g' /etc/hosts
2024-04-01T23:49:30.695 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hostname
2024-04-01T23:49:30.762 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106
2024-04-01T23:49:30.828 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release
2024-04-01T23:49:30.882 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream"
2024-04-01T23:49:30.882 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9"
2024-04-01T23:49:30.882 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos"
2024-04-01T23:49:30.883 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora"
2024-04-01T23:49:30.883 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9"
2024-04-01T23:49:30.883 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9"
2024-04-01T23:49:30.883 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T23:49:30.883 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31"
2024-04-01T23:49:30.883 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon"
2024-04-01T23:49:30.883 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T23:49:30.883 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/"
2024-04-01T23:49:30.883 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T23:49:30.883 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T23:49:30.883 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T23:49:30.883 INFO:teuthology.provision.fog.smithi106:Deploy complete!
2024-04-01T23:49:30.884 DEBUG:teuthology.parallel:result is None
2024-04-01T23:49:31.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:49:32.022 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-01T23:49:32.022 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-01T23:49:32.319 INFO:teuthology.provision.fog.smithi161:Node is ready
2024-04-01T23:49:32.319 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2024-04-01T23:49:32.334 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2024-04-01T23:49:32.334 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2024-04-01T23:49:32.388 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2024-04-01T23:49:32.389 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-04-01T23:49:32.483 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2024-04-01T23:49:32.511 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2024-04-01T23:49:32.578 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2024-04-01T23:49:32.645 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-04-01T23:49:32.711 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-04-01T23:49:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-04-01T23:49:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2024-04-01T23:49:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-04-01T23:49:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-04-01T23:49:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2024-04-01T23:49:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2024-04-01T23:49:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T23:49:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-04-01T23:49:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2024-04-01T23:49:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T23:49:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-04-01T23:49:32.766 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T23:49:32.767 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T23:49:32.767 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T23:49:32.767 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2024-04-01T23:49:32.767 DEBUG:teuthology.parallel:result is None
2024-04-01T23:49:33.132 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com
2024-04-01T23:49:33.133 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T23:49:33.169 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2024-04-01T23:49:33.169 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T23:49:33.202 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2024-04-01T23:49:33.202 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-01T23:49:33.228 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server
2024-04-01T23:49:33.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com'
2024-04-01T23:49:33.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:49:33.330 DEBUG:teuthology.orchestra.run.smithi106:> true
2024-04-01T23:49:33.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com'
2024-04-01T23:49:33.402 DEBUG:teuthology.orchestra.run.smithi106:> uname -m
2024-04-01T23:49:33.458 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64
2024-04-01T23:49:33.458 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release
2024-04-01T23:49:33.514 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream"
2024-04-01T23:49:33.514 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9"
2024-04-01T23:49:33.514 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos"
2024-04-01T23:49:33.514 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora"
2024-04-01T23:49:33.514 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9"
2024-04-01T23:49:33.514 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9"
2024-04-01T23:49:33.514 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T23:49:33.514 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31"
2024-04-01T23:49:33.514 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon"
2024-04-01T23:49:33.515 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T23:49:33.515 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/"
2024-04-01T23:49:33.515 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T23:49:33.515 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T23:49:33.515 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T23:49:33.515 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2024-04-01T23:49:33.544 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2024-04-01T23:49:33.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-04-01T23:49:33.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:49:33.642 DEBUG:teuthology.orchestra.run.smithi161:> true
2024-04-01T23:49:33.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-04-01T23:49:33.709 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2024-04-01T23:49:33.763 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2024-04-01T23:49:33.763 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-04-01T23:49:33.820 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-04-01T23:49:33.820 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2024-04-01T23:49:33.820 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-04-01T23:49:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-04-01T23:49:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2024-04-01T23:49:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2024-04-01T23:49:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T23:49:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-04-01T23:49:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2024-04-01T23:49:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T23:49:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-04-01T23:49:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T23:49:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T23:49:33.821 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T23:49:33.822 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-04-01T23:49:33.852 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2024-04-01T23:49:33.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2024-04-01T23:49:33.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-01T23:49:33.951 DEBUG:teuthology.orchestra.run.smithi196:> true
2024-04-01T23:49:34.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com'
2024-04-01T23:49:34.022 DEBUG:teuthology.orchestra.run.smithi196:> uname -m
2024-04-01T23:49:34.078 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2024-04-01T23:49:34.078 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2024-04-01T23:49:34.134 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2024-04-01T23:49:34.134 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9"
2024-04-01T23:49:34.134 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2024-04-01T23:49:34.134 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2024-04-01T23:49:34.134 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9"
2024-04-01T23:49:34.134 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9"
2024-04-01T23:49:34.134 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-01T23:49:34.134 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2024-04-01T23:49:34.134 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon"
2024-04-01T23:49:34.134 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-01T23:49:34.134 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2024-04-01T23:49:34.135 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-01T23:49:34.135 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-01T23:49:34.135 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-01T23:49:34.135 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2024-04-01T23:49:34.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T23:49:34.258 INFO:teuthology.dispatcher.supervisor:Running job 7634483
2024-04-01T23:49:34.258 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-rados-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634483 --name yuriw-2024-04-01_20:57:46-rados-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi --description rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} -- /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-rados-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634483/orig.config.yaml
2024-04-01T23:49:34.261 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-rados-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634483
2024-04-01T23:49:34.261 INFO:teuthology.dispatcher.supervisor:Job PID: 789642
2024-04-01T23:49:34.261 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-01T23:51:34.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T23:53:34.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T23:55:34.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T23:57:34.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T23:59:35.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-01T23:59:35.114 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1