2024-02-29T14:45:00.928 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-29T14:45:00.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T14:45:01.122 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3009b11f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f300ab72c10>, signals=[15])
2024-02-29T14:45:01.123 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging
2024-02-29T14:45:01.123 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server
2024-02-29T14:45:01.123 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server
2024-02-29T14:45:01.145 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging
2024-02-29T14:45:01.145 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server
2024-02-29T14:45:01.145 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2024-02-29T14:45:01.169 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging
2024-02-29T14:45:01.169 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server
2024-02-29T14:45:01.169 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2024-02-29T14:45:01.272 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-29T14:45:01.276 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-29T14:45:01.296 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-29T14:45:01.327 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of rhel 8.6
2024-02-29T14:45:01.330 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of rhel 8.6
2024-02-29T14:45:01.340 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of rhel 8.6
2024-02-29T14:45:01.597 INFO:teuthology.orchestra.console.smithi016:Power off
2024-02-29T14:45:01.597 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-29T14:45:01.613 INFO:teuthology.orchestra.console.smithi044:Power off
2024-02-29T14:45:01.613 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-29T14:45:01.630 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off
2024-02-29T14:45:01.630 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-29T14:45:01.642 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off
2024-02-29T14:45:01.642 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-29T14:45:01.661 INFO:teuthology.orchestra.console.smithi037:Power off
2024-02-29T14:45:01.662 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-29T14:45:01.671 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off
2024-02-29T14:45:01.673 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2024-02-29T14:45:01.684 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off
2024-02-29T14:45:01.684 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-29T14:45:01.706 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2024-02-29T14:45:01.772 INFO:teuthology.orchestra.console.smithi016:Power off completed
2024-02-29T14:45:01.774 INFO:teuthology.orchestra.console.smithi044:Power off completed
2024-02-29T14:45:01.807 INFO:teuthology.orchestra.console.smithi037:Power off completed
2024-02-29T14:45:01.873 INFO:teuthology.orchestra.console.smithi016:Power on
2024-02-29T14:45:01.874 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-29T14:45:01.884 INFO:teuthology.orchestra.console.smithi044:Power on
2024-02-29T14:45:01.884 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-29T14:45:01.900 DEBUG:teuthology.orchestra.console.smithi016:power on output: Chassis Power Control: Up/On
2024-02-29T14:45:01.900 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-29T14:45:01.909 INFO:teuthology.orchestra.console.smithi037:Power on
2024-02-29T14:45:01.909 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-29T14:45:01.917 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On
2024-02-29T14:45:01.918 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-29T14:45:01.930 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off
2024-02-29T14:45:01.932 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On
2024-02-29T14:45:01.932 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-29T14:45:01.948 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2024-02-29T14:45:01.964 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2024-02-29T14:45:05.932 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-29T14:45:05.950 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-29T14:45:05.965 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-29T14:45:06.045 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off
2024-02-29T14:45:06.061 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2024-02-29T14:45:06.075 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2024-02-29T14:45:10.050 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-29T14:45:10.062 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-29T14:45:10.076 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-29T14:45:10.160 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on
2024-02-29T14:45:10.171 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2024-02-29T14:45:10.187 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2024-02-29T14:45:10.261 INFO:teuthology.orchestra.console.smithi016:Power on completed
2024-02-29T14:45:10.272 INFO:teuthology.orchestra.console.smithi044:Power on completed
2024-02-29T14:45:10.288 INFO:teuthology.orchestra.console.smithi037:Power on completed
2024-02-29T14:45:10.362 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish
2024-02-29T14:45:10.373 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish
2024-02-29T14:45:10.389 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2024-02-29T14:47:41.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:47:41.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:47:41.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:47:44.252 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-02-29T14:47:44.252 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2024-02-29T14:47:44.253 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2024-02-29T14:47:50.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:47:50.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:47:50.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:47:53.312 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-02-29T14:47:53.340 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2024-02-29T14:47:53.340 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2024-02-29T14:47:59.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:47:59.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:47:59.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:48:02.396 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2024-02-29T14:48:02.396 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2024-02-29T14:48:02.396 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-02-29T14:48:08.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:48:08.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:48:08.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:48:11.452 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2024-02-29T14:48:11.484 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2024-02-29T14:48:11.488 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-02-29T14:48:17.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:48:17.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:48:17.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:48:20.540 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-02-29T14:48:20.540 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2024-02-29T14:48:20.544 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2024-02-29T14:48:26.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:48:26.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:48:26.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:48:29.600 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44
2024-02-29T14:48:29.628 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2024-02-29T14:48:35.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:48:35.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:49:26.601 WARNING:teuthology.provision.fog.smithi037:timed out
2024-02-29T14:49:32.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:49:32.882 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-29T14:49:32.882 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-29T14:49:33.184 INFO:teuthology.provision.fog.smithi037:Node is ready
2024-02-29T14:49:33.185 DEBUG:teuthology.orchestra.run.smithi037:> hostname
2024-02-29T14:49:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2024-02-29T14:49:33.206 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts
2024-02-29T14:49:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2024-02-29T14:49:33.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2024-02-29T14:49:33.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts
2024-02-29T14:49:33.434 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts
2024-02-29T14:49:33.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname
2024-02-29T14:49:33.585 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2024-02-29T14:49:33.660 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2024-02-29T14:49:33.722 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux"
2024-02-29T14:49:33.722 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.6 (Ootpa)"
2024-02-29T14:49:33.722 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel"
2024-02-29T14:49:33.722 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora"
2024-02-29T14:49:33.722 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.6"
2024-02-29T14:49:33.722 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8"
2024-02-29T14:49:33.722 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-29T14:49:33.722 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2024-02-29T14:49:33.722 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-29T14:49:33.722 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/"
2024-02-29T14:49:33.722 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-29T14:49:33.723 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-29T14:49:33.723 INFO:teuthology.orchestra.run.smithi037.stdout:
2024-02-29T14:49:33.723 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-29T14:49:33.723 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-29T14:49:33.723 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-29T14:49:33.723 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-29T14:49:33.724 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2024-02-29T14:49:33.725 DEBUG:teuthology.parallel:result is None
2024-02-29T14:49:35.608 WARNING:teuthology.provision.fog.smithi044:timed out
2024-02-29T14:49:35.631 WARNING:teuthology.provision.fog.smithi016:timed out
2024-02-29T14:49:41.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:49:41.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:49:41.869 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-29T14:49:41.869 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-29T14:49:41.936 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-29T14:49:41.937 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-29T14:49:42.138 INFO:teuthology.provision.fog.smithi044:Node is ready
2024-02-29T14:49:42.139 DEBUG:teuthology.orchestra.run.smithi044:> hostname
2024-02-29T14:49:42.160 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com
2024-02-29T14:49:42.160 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts
2024-02-29T14:49:42.179 INFO:teuthology.provision.fog.smithi016:Node is ready
2024-02-29T14:49:42.179 DEBUG:teuthology.orchestra.run.smithi016:> hostname
2024-02-29T14:49:42.222 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044
2024-02-29T14:49:42.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2024-02-29T14:49:42.240 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com
2024-02-29T14:49:42.241 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts
2024-02-29T14:49:42.302 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016
2024-02-29T14:49:42.303 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016
2024-02-29T14:49:42.353 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts
2024-02-29T14:49:42.388 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts
2024-02-29T14:49:42.433 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts
2024-02-29T14:49:42.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname
2024-02-29T14:49:42.467 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts
2024-02-29T14:49:42.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2024-02-29T14:49:42.542 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname
2024-02-29T14:49:42.613 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2024-02-29T14:49:42.616 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016
2024-02-29T14:49:42.674 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Red Hat Enterprise Linux"
2024-02-29T14:49:42.675 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="8.6 (Ootpa)"
2024-02-29T14:49:42.675 INFO:teuthology.orchestra.run.smithi044.stdout:ID="rhel"
2024-02-29T14:49:42.675 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="fedora"
2024-02-29T14:49:42.675 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="8.6"
2024-02-29T14:49:42.675 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el8"
2024-02-29T14:49:42.675 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-29T14:49:42.675 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31"
2024-02-29T14:49:42.675 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-29T14:49:42.675 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.redhat.com/"
2024-02-29T14:49:42.675 INFO:teuthology.orchestra.run.smithi044.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-29T14:49:42.675 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-29T14:49:42.676 INFO:teuthology.orchestra.run.smithi044.stdout:
2024-02-29T14:49:42.676 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-29T14:49:42.676 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-29T14:49:42.676 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-29T14:49:42.676 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-29T14:49:42.676 INFO:teuthology.provision.fog.smithi044:Deploy complete!
2024-02-29T14:49:42.677 DEBUG:teuthology.parallel:result is None
2024-02-29T14:49:42.692 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release
2024-02-29T14:49:42.753 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux"
2024-02-29T14:49:42.753 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.6 (Ootpa)"
2024-02-29T14:49:42.753 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel"
2024-02-29T14:49:42.753 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora"
2024-02-29T14:49:42.753 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.6"
2024-02-29T14:49:42.753 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8"
2024-02-29T14:49:42.753 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-29T14:49:42.754 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31"
2024-02-29T14:49:42.754 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-29T14:49:42.754 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/"
2024-02-29T14:49:42.754 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-29T14:49:42.754 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-29T14:49:42.754 INFO:teuthology.orchestra.run.smithi016.stdout:
2024-02-29T14:49:42.754 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-29T14:49:42.754 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-29T14:49:42.754 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-29T14:49:42.754 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-29T14:49:42.754 INFO:teuthology.provision.fog.smithi016:Deploy complete!
2024-02-29T14:49:42.755 DEBUG:teuthology.parallel:result is None
2024-02-29T14:49:42.964 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com
2024-02-29T14:49:42.964 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-29T14:49:42.984 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2024-02-29T14:49:42.984 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-29T14:49:43.009 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com
2024-02-29T14:49:43.010 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-29T14:49:43.036 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server
2024-02-29T14:49:43.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com'
2024-02-29T14:49:43.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:49:43.113 DEBUG:teuthology.orchestra.run.smithi016:> true
2024-02-29T14:49:43.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com'
2024-02-29T14:49:43.185 DEBUG:teuthology.orchestra.run.smithi016:> uname -m
2024-02-29T14:49:43.246 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64
2024-02-29T14:49:43.247 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release
2024-02-29T14:49:43.307 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux"
2024-02-29T14:49:43.307 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.6 (Ootpa)"
2024-02-29T14:49:43.307 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel"
2024-02-29T14:49:43.307 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora"
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.6"
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8"
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31"
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/"
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-29T14:49:43.308 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-29T14:49:43.309 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server
2024-02-29T14:49:43.335 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2024-02-29T14:49:43.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2024-02-29T14:49:43.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:49:43.411 DEBUG:teuthology.orchestra.run.smithi037:> true
2024-02-29T14:49:43.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com'
2024-02-29T14:49:43.486 DEBUG:teuthology.orchestra.run.smithi037:> uname -m
2024-02-29T14:49:43.548 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2024-02-29T14:49:43.548 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2024-02-29T14:49:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux"
2024-02-29T14:49:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.6 (Ootpa)"
2024-02-29T14:49:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel"
2024-02-29T14:49:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora"
2024-02-29T14:49:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.6"
2024-02-29T14:49:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8"
2024-02-29T14:49:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-29T14:49:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2024-02-29T14:49:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-29T14:49:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/"
2024-02-29T14:49:43.609 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-29T14:49:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-29T14:49:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:
2024-02-29T14:49:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-29T14:49:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-29T14:49:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-29T14:49:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-29T14:49:43.610 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2024-02-29T14:49:43.635 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server
2024-02-29T14:49:43.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com'
2024-02-29T14:49:43.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-29T14:49:43.725 DEBUG:teuthology.orchestra.run.smithi044:> true
2024-02-29T14:49:43.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com'
2024-02-29T14:49:43.798 DEBUG:teuthology.orchestra.run.smithi044:> uname -m
2024-02-29T14:49:43.859 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64
2024-02-29T14:49:43.860 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2024-02-29T14:49:43.921 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Red Hat Enterprise Linux"
2024-02-29T14:49:43.921 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="8.6 (Ootpa)"
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:ID="rhel"
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="fedora"
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="8.6"
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el8"
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31"
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.redhat.com/"
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-29T14:49:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-29T14:49:43.923 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-29T14:49:43.923 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2024-02-29T14:49:43.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T14:49:44.047 INFO:teuthology.dispatcher.supervisor:Running job 7576627
2024-02-29T14:49:44.048 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-29_10:46:50-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi/7576627 --name vshankar-2024-02-29_10:46:50-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/vshankar-2024-02-29_10:46:50-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi/7576627/orig.config.yaml
2024-02-29T14:49:44.052 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-29_10:46:50-fs-wip-vshankar-testing1-reef-2024-02-28-1133-testing-default-smithi/7576627
2024-02-29T14:49:44.053 INFO:teuthology.dispatcher.supervisor:Job PID: 2156693
2024-02-29T14:49:44.053 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-29T14:51:44.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T14:53:44.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T14:55:44.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T14:57:44.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T14:59:44.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:01:45.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:03:45.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:05:45.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:07:45.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:09:45.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:11:45.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:13:46.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:15:46.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:17:46.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:19:46.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:21:46.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:23:46.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:25:47.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:27:47.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:29:47.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:31:47.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:33:47.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-29T15:33:47.991 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1