2024-02-28T09:33:57.651 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-28T09:33:57.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:33:57.814 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0de0053f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0de0fb5c10>, signals=[15])
2024-02-28T09:33:57.814 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging
2024-02-28T09:33:57.815 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server
2024-02-28T09:33:57.815 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2024-02-28T09:33:57.833 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2024-02-28T09:33:57.833 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2024-02-28T09:33:57.833 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-02-28T09:33:57.857 INFO:teuthology.lock.ops:Start node 'smithi122.front.sepia.ceph.com' reimaging
2024-02-28T09:33:57.857 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: reset os type and version on server
2024-02-28T09:33:57.857 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server
2024-02-28T09:33:57.949 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-28T09:33:57.953 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-28T09:33:57.987 DEBUG:teuthology.provision.fog.smithi122:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-28T09:33:58.000 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of rhel 8.6
2024-02-28T09:33:58.007 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.6
2024-02-28T09:33:58.029 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of rhel 8.6
2024-02-28T09:33:58.228 INFO:teuthology.orchestra.console.smithi028:Power off
2024-02-28T09:33:58.229 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-28T09:33:58.241 INFO:teuthology.orchestra.console.smithi119:Power off
2024-02-28T09:33:58.241 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-28T09:33:58.253 INFO:teuthology.orchestra.console.smithi122:Power off
2024-02-28T09:33:58.255 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-28T09:33:58.263 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2024-02-28T09:33:58.263 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:33:58.269 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off
2024-02-28T09:33:58.269 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:33:58.277 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off
2024-02-28T09:33:58.278 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:33:58.285 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-02-28T09:33:58.291 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-02-28T09:33:58.300 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off
2024-02-28T09:33:58.386 INFO:teuthology.orchestra.console.smithi119:Power off completed
2024-02-28T09:33:58.392 INFO:teuthology.orchestra.console.smithi028:Power off completed
2024-02-28T09:33:58.401 INFO:teuthology.orchestra.console.smithi122:Power off completed
2024-02-28T09:33:58.487 INFO:teuthology.orchestra.console.smithi119:Power on
2024-02-28T09:33:58.487 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-28T09:33:58.502 INFO:teuthology.orchestra.console.smithi028:Power on
2024-02-28T09:33:58.502 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-28T09:33:58.509 INFO:teuthology.orchestra.console.smithi122:Power on
2024-02-28T09:33:58.509 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-28T09:33:58.516 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On
2024-02-28T09:33:58.516 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:33:58.524 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On
2024-02-28T09:33:58.524 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:33:58.532 DEBUG:teuthology.orchestra.console.smithi122:power on output: Chassis Power Control: Up/On
2024-02-28T09:33:58.532 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:33:58.541 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-02-28T09:33:58.546 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-02-28T09:33:58.553 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off
2024-02-28T09:34:02.544 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:02.554 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:02.561 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:02.656 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-02-28T09:34:02.663 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2024-02-28T09:34:02.669 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off
2024-02-28T09:34:02.757 INFO:teuthology.orchestra.console.smithi119:Power on completed
2024-02-28T09:34:02.763 INFO:teuthology.orchestra.console.smithi028:Power on completed
2024-02-28T09:34:02.858 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2024-02-28T09:34:02.864 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish
2024-02-28T09:34:06.674 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-28T09:34:06.782 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on
2024-02-28T09:34:06.883 INFO:teuthology.orchestra.console.smithi122:Power on completed
2024-02-28T09:34:06.984 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish
2024-02-28T09:37:06.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:06.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:09.244 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-02-28T09:37:09.248 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-02-28T09:37:09.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:12.636 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2024-02-28T09:37:15.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:15.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:18.304 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-02-28T09:37:18.332 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-02-28T09:37:18.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:21.692 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2024-02-28T09:37:24.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:24.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:27.388 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-02-28T09:37:27.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:30.748 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2024-02-28T09:37:33.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:36.444 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-02-28T09:37:36.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:39.804 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2024-02-28T09:37:42.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:45.500 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-02-28T09:37:45.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:37:51.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:38:24.368 WARNING:teuthology.provision.fog.smithi028:timed out
2024-02-28T09:38:30.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:38:30.576 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-28T09:38:30.576 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-28T09:38:30.840 INFO:teuthology.provision.fog.smithi028:Node is ready
2024-02-28T09:38:30.840 DEBUG:teuthology.orchestra.run.smithi028:> hostname
2024-02-28T09:38:30.861 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com
2024-02-28T09:38:30.861 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts
2024-02-28T09:38:30.922 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028
2024-02-28T09:38:30.923 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2024-02-28T09:38:31.047 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts
2024-02-28T09:38:31.082 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts
2024-02-28T09:38:31.157 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname
2024-02-28T09:38:31.232 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2024-02-28T09:38:31.305 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2024-02-28T09:38:31.366 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T09:38:31.366 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T09:38:31.366 INFO:teuthology.orchestra.run.smithi028.stdout:ID="rhel"
2024-02-28T09:38:31.366 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="fedora"
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="8.6"
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el8"
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T09:38:31.367 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T09:38:31.368 INFO:teuthology.provision.fog.smithi028:Deploy complete!
2024-02-28T09:38:31.369 DEBUG:teuthology.parallel:result is None
2024-02-28T09:38:45.822 WARNING:teuthology.provision.fog.smithi122:timed out
2024-02-28T09:38:51.515 WARNING:teuthology.provision.fog.smithi119:timed out
2024-02-28T09:38:51.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:38:52.084 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-28T09:38:52.084 DEBUG:teuthology.orchestra.run.smithi122:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-28T09:38:52.337 INFO:teuthology.provision.fog.smithi122:Node is ready
2024-02-28T09:38:52.337 DEBUG:teuthology.orchestra.run.smithi122:> hostname
2024-02-28T09:38:52.396 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com
2024-02-28T09:38:52.396 DEBUG:teuthology.orchestra.run.smithi122:> grep smithi122.front.sepia.ceph.com /etc/hosts
2024-02-28T09:38:52.454 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122
2024-02-28T09:38:52.454 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122
2024-02-28T09:38:52.607 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hosts
2024-02-28T09:38:52.636 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/172.21.15.122/172.21.15.122/g' /etc/hosts
2024-02-28T09:38:52.705 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hostname
2024-02-28T09:38:52.772 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122
2024-02-28T09:38:52.840 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release
2024-02-28T09:38:52.897 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T09:38:52.897 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:ID="rhel"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="fedora"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8.6"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T09:38:52.898 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T09:38:52.899 INFO:teuthology.provision.fog.smithi122:Deploy complete!
2024-02-28T09:38:52.899 DEBUG:teuthology.parallel:result is None
2024-02-28T09:38:57.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:38:57.790 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-28T09:38:57.790 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-28T09:38:58.025 INFO:teuthology.provision.fog.smithi119:Node is ready
2024-02-28T09:38:58.025 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2024-02-28T09:38:58.083 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119
2024-02-28T09:38:58.083 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119 /etc/hosts
2024-02-28T09:38:58.141 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2024-02-28T09:38:58.142 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-02-28T09:38:58.262 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119/smithi119/g' /etc/hosts
2024-02-28T09:38:58.291 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2024-02-28T09:38:58.361 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119/smithi119/g' /etc/hostname
2024-02-28T09:38:58.429 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-02-28T09:38:58.497 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-02-28T09:38:58.554 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T09:38:58.554 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T09:38:58.554 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2024-02-28T09:38:58.554 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2024-02-28T09:38:58.554 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6"
2024-02-28T09:38:58.555 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2024-02-28T09:38:58.555 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T09:38:58.555 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-02-28T09:38:58.555 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T09:38:58.555 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T09:38:58.555 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T09:38:58.555 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T09:38:58.555 INFO:teuthology.orchestra.run.smithi119.stdout:
2024-02-28T09:38:58.556 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T09:38:58.556 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T09:38:58.556 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T09:38:58.556 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T09:38:58.556 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2024-02-28T09:38:58.557 DEBUG:teuthology.parallel:result is None
2024-02-28T09:38:58.790 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com
2024-02-28T09:38:58.790 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-28T09:38:58.816 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2024-02-28T09:38:58.816 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-28T09:38:58.841 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com
2024-02-28T09:38:58.841 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-28T09:38:58.859 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server
2024-02-28T09:38:58.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com'
2024-02-28T09:38:58.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:38:58.936 DEBUG:teuthology.orchestra.run.smithi028:> true
2024-02-28T09:38:59.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com'
2024-02-28T09:38:59.082 DEBUG:teuthology.orchestra.run.smithi028:> uname -m
2024-02-28T09:38:59.143 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64
2024-02-28T09:38:59.143 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2024-02-28T09:38:59.204 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T09:38:59.204 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T09:38:59.204 INFO:teuthology.orchestra.run.smithi028.stdout:ID="rhel"
2024-02-28T09:38:59.205 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="fedora"
2024-02-28T09:38:59.205 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="8.6"
2024-02-28T09:38:59.205 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el8"
2024-02-28T09:38:59.205 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T09:38:59.205 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2024-02-28T09:38:59.205 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T09:38:59.205 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T09:38:59.205 INFO:teuthology.orchestra.run.smithi028.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T09:38:59.205 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T09:38:59.205 INFO:teuthology.orchestra.run.smithi028.stdout:
2024-02-28T09:38:59.205 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T09:38:59.205 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T09:38:59.206 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T09:38:59.206 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T09:38:59.206 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2024-02-28T09:38:59.233 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2024-02-28T09:38:59.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-02-28T09:38:59.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:38:59.302 DEBUG:teuthology.orchestra.run.smithi119:> true
2024-02-28T09:38:59.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-02-28T09:38:59.370 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2024-02-28T09:38:59.428 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2024-02-28T09:38:59.429 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-02-28T09:38:59.486 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T09:38:59.486 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6"
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T09:38:59.487 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T09:38:59.488 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T09:38:59.488 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T09:38:59.488 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-02-28T09:38:59.507 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server
2024-02-28T09:38:59.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com'
2024-02-28T09:38:59.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-28T09:38:59.579 DEBUG:teuthology.orchestra.run.smithi122:> true
2024-02-28T09:38:59.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com'
2024-02-28T09:38:59.653 DEBUG:teuthology.orchestra.run.smithi122:> uname -m
2024-02-28T09:38:59.713 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64
2024-02-28T09:38:59.713 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release
2024-02-28T09:38:59.773 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Red Hat Enterprise Linux"
2024-02-28T09:38:59.773 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8.6 (Ootpa)"
2024-02-28T09:38:59.773 INFO:teuthology.orchestra.run.smithi122.stdout:ID="rhel"
2024-02-28T09:38:59.773 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="fedora"
2024-02-28T09:38:59.773 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8.6"
2024-02-28T09:38:59.773 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8"
2024-02-28T09:38:59.773 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-28T09:38:59.773 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31"
2024-02-28T09:38:59.773 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-28T09:38:59.774 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.redhat.com/"
2024-02-28T09:38:59.774 INFO:teuthology.orchestra.run.smithi122.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-28T09:38:59.774 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-28T09:38:59.774 INFO:teuthology.orchestra.run.smithi122.stdout:
2024-02-28T09:38:59.774 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-28T09:38:59.774 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-28T09:38:59.774 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-28T09:38:59.774 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-28T09:38:59.774 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server
2024-02-28T09:38:59.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:38:59.892 INFO:teuthology.dispatcher.supervisor:Running job 7575175
2024-02-28T09:38:59.892 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-28_09:32:44-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi/7575175 --name vshankar-2024-02-28_09:32:44-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/vshankar-2024-02-28_09:32:44-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi/7575175/orig.config.yaml
2024-02-28T09:38:59.895 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-28_09:32:44-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi/7575175
2024-02-28T09:38:59.895 INFO:teuthology.dispatcher.supervisor:Job PID: 885022
2024-02-28T09:38:59.895 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-28T09:40:59.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:43:00.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:45:00.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:47:00.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:49:00.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:51:00.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:53:01.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:55:01.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:57:01.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T09:59:01.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:01:01.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:03:01.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:05:02.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:07:02.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:09:02.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:11:02.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:13:02.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-28T10:13:02.878 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1