2024-02-21T07:39:36.253 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-21T07:39:36.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:39:36.430 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fcd503daf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fcd5143bc10>, signals=[15])
2024-02-21T07:39:36.430 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging
2024-02-21T07:39:36.430 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server
2024-02-21T07:39:36.430 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server
2024-02-21T07:39:36.448 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging
2024-02-21T07:39:36.448 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server
2024-02-21T07:39:36.449 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server
2024-02-21T07:39:36.472 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging
2024-02-21T07:39:36.473 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server
2024-02-21T07:39:36.473 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2024-02-21T07:39:36.554 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_centos_9.stream (ID 10)
2024-02-21T07:39:36.579 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_centos_9.stream (ID 10)
2024-02-21T07:39:36.597 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 9.stream
2024-02-21T07:39:36.600 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_centos_9.stream (ID 10)
2024-02-21T07:39:36.627 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 9.stream
2024-02-21T07:39:36.639 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of centos 9.stream
2024-02-21T07:39:36.890 INFO:teuthology.orchestra.console.smithi089:Power off
2024-02-21T07:39:36.890 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-21T07:39:36.914 INFO:teuthology.orchestra.console.smithi183:Power off
2024-02-21T07:39:36.914 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-21T07:39:36.924 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off
2024-02-21T07:39:36.924 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:39:36.936 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off
2024-02-21T07:39:36.936 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:39:36.952 INFO:teuthology.orchestra.console.smithi172:Power off
2024-02-21T07:39:36.952 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-21T07:39:36.959 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2024-02-21T07:39:36.960 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2024-02-21T07:39:36.973 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off
2024-02-21T07:39:36.974 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:39:36.996 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2024-02-21T07:39:37.060 INFO:teuthology.orchestra.console.smithi089:Power off completed
2024-02-21T07:39:37.061 INFO:teuthology.orchestra.console.smithi183:Power off completed
2024-02-21T07:39:37.098 INFO:teuthology.orchestra.console.smithi172:Power off completed
2024-02-21T07:39:37.161 INFO:teuthology.orchestra.console.smithi089:Power on
2024-02-21T07:39:37.162 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-21T07:39:37.172 INFO:teuthology.orchestra.console.smithi183:Power on
2024-02-21T07:39:37.172 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-21T07:39:37.187 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On
2024-02-21T07:39:37.187 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:39:37.196 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On
2024-02-21T07:39:37.197 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:39:37.204 INFO:teuthology.orchestra.console.smithi172:Power on
2024-02-21T07:39:37.204 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-21T07:39:37.214 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2024-02-21T07:39:37.222 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2024-02-21T07:39:37.228 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On
2024-02-21T07:39:37.228 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:39:37.258 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2024-02-21T07:39:41.216 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:39:41.225 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:39:41.259 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:39:41.328 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2024-02-21T07:39:41.335 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2024-02-21T07:39:41.368 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2024-02-21T07:39:41.436 INFO:teuthology.orchestra.console.smithi183:Power on completed
2024-02-21T07:39:41.537 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2024-02-21T07:39:45.332 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:39:45.369 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-21T07:39:45.441 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on
2024-02-21T07:39:45.479 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on
2024-02-21T07:39:45.543 INFO:teuthology.orchestra.console.smithi089:Power on completed
2024-02-21T07:39:45.580 INFO:teuthology.orchestra.console.smithi172:Power on completed
2024-02-21T07:39:45.644 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish
2024-02-21T07:39:45.681 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish
2024-02-21T07:42:28.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:42:31.200 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T07:42:37.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:42:40.284 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T07:42:46.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:42:49.372 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T07:42:55.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:42:58.432 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T07:43:02.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:43:02.365 ERROR:teuthology.orchestra.connection:Error authenticating with smithi089.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-02-21T07:43:04.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:43:07.484 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T07:43:13.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:43:16.540 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T07:43:17.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:43:20.380 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-02-21T07:43:22.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:43:26.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:43:28.640 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T07:43:29.436 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-02-21T07:43:34.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:43:35.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:43:37.695 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T07:43:38.492 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-02-21T07:43:43.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:43:44.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:43:46.752 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T07:43:47.548 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-02-21T07:43:52.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:43:53.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:43:55.804 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2024-02-21T07:43:56.604 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-02-21T07:44:01.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:44:02.059 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-21T07:44:02.060 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-21T07:44:02.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:44:05.660 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-02-21T07:44:06.368 WARNING:teuthology.provision.fog.smithi089:timed out
2024-02-21T07:44:11.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:44:12.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:44:22.422 INFO:teuthology.provision.fog.smithi183:Node is ready
2024-02-21T07:44:22.422 DEBUG:teuthology.orchestra.run.smithi183:> hostname
2024-02-21T07:44:22.440 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2024-02-21T07:44:22.441 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts
2024-02-21T07:44:22.498 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2024-02-21T07:44:22.498 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2024-02-21T07:44:22.798 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts
2024-02-21T07:44:22.829 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts
2024-02-21T07:44:22.902 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname
2024-02-21T07:44:22.971 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2024-02-21T07:44:23.040 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2024-02-21T07:44:23.095 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2024-02-21T07:44:23.095 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9"
2024-02-21T07:44:23.095 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2024-02-21T07:44:23.095 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2024-02-21T07:44:23.096 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9"
2024-02-21T07:44:23.096 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9"
2024-02-21T07:44:23.096 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T07:44:23.096 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2024-02-21T07:44:23.096 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon"
2024-02-21T07:44:23.096 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T07:44:23.096 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2024-02-21T07:44:23.096 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T07:44:23.096 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T07:44:23.096 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T07:44:23.097 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2024-02-21T07:44:23.098 DEBUG:teuthology.parallel:result is None
2024-02-21T07:45:11.664 WARNING:teuthology.provision.fog.smithi172:timed out
2024-02-21T07:45:12.372 WARNING:teuthology.provision.fog.smithi089:timed out
2024-02-21T07:45:17.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:45:17.902 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-21T07:45:17.902 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-21T07:45:18.215 INFO:teuthology.provision.fog.smithi172:Node is ready
2024-02-21T07:45:18.216 DEBUG:teuthology.orchestra.run.smithi172:> hostname
2024-02-21T07:45:18.230 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com
2024-02-21T07:45:18.230 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts
2024-02-21T07:45:18.286 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172
2024-02-21T07:45:18.286 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172
2024-02-21T07:45:18.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:45:18.413 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts
2024-02-21T07:45:18.441 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts
2024-02-21T07:45:18.567 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname
2024-02-21T07:45:18.636 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172
2024-02-21T07:45:18.702 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release
2024-02-21T07:45:18.757 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T07:45:18.758 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T07:45:18.759 INFO:teuthology.provision.fog.smithi172:Deploy complete!
2024-02-21T07:45:18.759 DEBUG:teuthology.parallel:result is None
2024-02-21T07:45:18.767 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-21T07:45:18.768 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-21T07:45:19.102 INFO:teuthology.provision.fog.smithi089:Node is ready
2024-02-21T07:45:19.103 DEBUG:teuthology.orchestra.run.smithi089:> hostname
2024-02-21T07:45:19.118 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com
2024-02-21T07:45:19.118 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts
2024-02-21T07:45:19.173 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089
2024-02-21T07:45:19.173 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089
2024-02-21T07:45:19.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts
2024-02-21T07:45:19.310 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts
2024-02-21T07:45:19.377 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname
2024-02-21T07:45:19.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089
2024-02-21T07:45:19.511 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release
2024-02-21T07:45:19.565 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream"
2024-02-21T07:45:19.565 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9"
2024-02-21T07:45:19.565 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos"
2024-02-21T07:45:19.565 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora"
2024-02-21T07:45:19.565 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9"
2024-02-21T07:45:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9"
2024-02-21T07:45:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T07:45:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31"
2024-02-21T07:45:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon"
2024-02-21T07:45:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T07:45:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/"
2024-02-21T07:45:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T07:45:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T07:45:19.566 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T07:45:19.566 INFO:teuthology.provision.fog.smithi089:Deploy complete!
2024-02-21T07:45:19.567 DEBUG:teuthology.parallel:result is None
2024-02-21T07:45:19.778 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com
2024-02-21T07:45:19.778 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-21T07:45:19.809 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com
2024-02-21T07:45:19.809 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-21T07:45:19.824 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2024-02-21T07:45:19.825 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-21T07:45:19.842 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server
2024-02-21T07:45:19.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com'
2024-02-21T07:45:19.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:45:19.929 DEBUG:teuthology.orchestra.run.smithi089:> true
2024-02-21T07:45:19.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com'
2024-02-21T07:45:19.994 DEBUG:teuthology.orchestra.run.smithi089:> uname -m
2024-02-21T07:45:20.048 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64
2024-02-21T07:45:20.048 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release
2024-02-21T07:45:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream"
2024-02-21T07:45:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9"
2024-02-21T07:45:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos"
2024-02-21T07:45:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora"
2024-02-21T07:45:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9"
2024-02-21T07:45:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9"
2024-02-21T07:45:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T07:45:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31"
2024-02-21T07:45:20.102 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon"
2024-02-21T07:45:20.103 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T07:45:20.103 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/"
2024-02-21T07:45:20.103 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T07:45:20.103 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T07:45:20.103 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T07:45:20.103 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server
2024-02-21T07:45:20.125 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server
2024-02-21T07:45:20.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com'
2024-02-21T07:45:20.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:45:20.212 DEBUG:teuthology.orchestra.run.smithi172:> true
2024-02-21T07:45:20.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com'
2024-02-21T07:45:20.284 DEBUG:teuthology.orchestra.run.smithi172:> uname -m
2024-02-21T07:45:20.339 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64
2024-02-21T07:45:20.340 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release
2024-02-21T07:45:20.395 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream"
2024-02-21T07:45:20.395 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9"
2024-02-21T07:45:20.395 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos"
2024-02-21T07:45:20.396 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora"
2024-02-21T07:45:20.396 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9"
2024-02-21T07:45:20.396 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9"
2024-02-21T07:45:20.396 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T07:45:20.396 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31"
2024-02-21T07:45:20.396 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon"
2024-02-21T07:45:20.396 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T07:45:20.396 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/"
2024-02-21T07:45:20.396 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T07:45:20.396 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T07:45:20.396 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T07:45:20.397 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server
2024-02-21T07:45:20.417 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2024-02-21T07:45:20.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2024-02-21T07:45:20.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-21T07:45:20.511 DEBUG:teuthology.orchestra.run.smithi183:> true
2024-02-21T07:45:20.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com'
2024-02-21T07:45:20.682 DEBUG:teuthology.orchestra.run.smithi183:> uname -m
2024-02-21T07:45:20.737 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2024-02-21T07:45:20.737 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2024-02-21T07:45:20.791 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream"
2024-02-21T07:45:20.791 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9"
2024-02-21T07:45:20.791 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos"
2024-02-21T07:45:20.791 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora"
2024-02-21T07:45:20.791 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9"
2024-02-21T07:45:20.791 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9"
2024-02-21T07:45:20.791 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-21T07:45:20.791 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2024-02-21T07:45:20.791 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon"
2024-02-21T07:45:20.792 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-21T07:45:20.792 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/"
2024-02-21T07:45:20.792 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-21T07:45:20.792 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-21T07:45:20.792 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-21T07:45:20.792 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2024-02-21T07:45:20.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:45:20.915 INFO:teuthology.dispatcher.supervisor:Running job 7569325
2024-02-21T07:45:20.916 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569325 --name vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi --description fs:workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/test_o_trunc}} -- /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569325/orig.config.yaml
2024-02-21T07:45:20.919 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569325
2024-02-21T07:45:20.919 INFO:teuthology.dispatcher.supervisor:Job PID: 300508
2024-02-21T07:45:20.919 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-21T07:47:20.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:49:20.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:51:21.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:53:21.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:55:21.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:57:21.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T07:59:21.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T08:01:21.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T08:03:21.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T08:05:21.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T08:07:21.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T08:09:21.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T08:11:22.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T08:13:22.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T08:15:22.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T08:17:22.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-21T08:17:22.329 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1