2024-04-18T03:33:31.798 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d
2024-04-18T03:33:31.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:33:31.968 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fec9da53f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fec9eab4c10>, signals=[15])
2024-04-18T03:33:31.968 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging
2024-04-18T03:33:31.969 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T03:33:31.969 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2024-04-18T03:33:31.986 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging
2024-04-18T03:33:31.986 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T03:33:31.987 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2024-04-18T03:33:32.002 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging
2024-04-18T03:33:32.003 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T03:33:32.003 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2024-04-18T03:33:32.094 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T03:33:32.116 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T03:33:32.128 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T03:33:32.136 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of rhel 8.6
2024-04-18T03:33:32.176 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.6
2024-04-18T03:33:32.179 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of rhel 8.6
2024-04-18T03:33:32.462 INFO:teuthology.orchestra.console.smithi008:Power off
2024-04-18T03:33:32.462 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T03:33:32.476 INFO:teuthology.orchestra.console.smithi186:Power off
2024-04-18T03:33:32.476 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T03:33:32.486 INFO:teuthology.orchestra.console.smithi072:Power off
2024-04-18T03:33:32.487 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T03:33:32.496 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off
2024-04-18T03:33:32.497 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:32.505 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off
2024-04-18T03:33:32.505 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:32.514 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off
2024-04-18T03:33:32.515 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:32.523 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off
2024-04-18T03:33:32.527 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2024-04-18T03:33:32.538 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-04-18T03:33:32.624 INFO:teuthology.orchestra.console.smithi008:Power off completed
2024-04-18T03:33:32.628 INFO:teuthology.orchestra.console.smithi186:Power off completed
2024-04-18T03:33:32.638 INFO:teuthology.orchestra.console.smithi072:Power off completed
2024-04-18T03:33:32.725 INFO:teuthology.orchestra.console.smithi008:Power on
2024-04-18T03:33:32.726 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T03:33:32.734 INFO:teuthology.orchestra.console.smithi186:Power on
2024-04-18T03:33:32.734 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T03:33:32.740 INFO:teuthology.orchestra.console.smithi072:Power on
2024-04-18T03:33:32.741 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T03:33:32.750 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On
2024-04-18T03:33:32.751 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:32.759 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On
2024-04-18T03:33:32.759 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:32.768 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On
2024-04-18T03:33:32.768 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:32.776 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off
2024-04-18T03:33:32.781 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2024-04-18T03:33:32.791 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-04-18T03:33:36.779 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:36.787 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:36.794 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:36.889 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on
2024-04-18T03:33:36.896 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2024-04-18T03:33:36.903 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-04-18T03:33:36.991 INFO:teuthology.orchestra.console.smithi008:Power on completed
2024-04-18T03:33:37.092 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish
2024-04-18T03:33:40.900 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:40.907 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:41.009 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on
2024-04-18T03:33:41.015 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-04-18T03:33:41.111 INFO:teuthology.orchestra.console.smithi186:Power on completed
2024-04-18T03:33:41.116 INFO:teuthology.orchestra.console.smithi072:Power on completed
2024-04-18T03:33:41.212 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish
2024-04-18T03:33:41.217 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish
2024-04-18T03:36:23.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:36:42.014 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2024-04-18T03:36:48.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:36:51.106 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2024-04-18T03:36:57.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:36:57.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:00.190 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2024-04-18T03:37:06.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:09.278 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8
2024-04-18T03:37:12.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:15.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:16.062 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-04-18T03:37:22.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:25.150 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-04-18T03:37:31.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:31.166 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2024-04-18T03:37:34.206 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-04-18T03:37:37.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:40.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:40.226 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2024-04-18T03:37:43.262 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-04-18T03:37:46.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:49.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:49.310 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2024-04-18T03:37:55.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:58.366 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2024-04-18T03:38:04.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:38:07.454 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2024-04-18T03:38:13.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:38:15.285 WARNING:teuthology.provision.fog.smithi008:timed out
2024-04-18T03:38:16.510 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2024-04-18T03:38:21.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:38:21.551 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T03:38:21.551 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T03:38:21.830 INFO:teuthology.provision.fog.smithi008:Node is ready
2024-04-18T03:38:21.831 DEBUG:teuthology.orchestra.run.smithi008:> hostname
2024-04-18T03:38:21.851 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com
2024-04-18T03:38:21.851 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts
2024-04-18T03:38:21.913 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008
2024-04-18T03:38:21.913 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008
2024-04-18T03:38:22.045 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts
2024-04-18T03:38:22.078 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts
2024-04-18T03:38:22.154 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname
2024-04-18T03:38:22.230 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008
2024-04-18T03:38:22.304 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release
2024-04-18T03:38:22.365 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:38:22.365 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel"
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora"
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6"
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31"
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:38:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:38:22.367 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:38:22.367 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:38:22.367 INFO:teuthology.provision.fog.smithi008:Deploy complete!
2024-04-18T03:38:22.369 DEBUG:teuthology.parallel:result is None
2024-04-18T03:38:22.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:38:41.054 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2024-04-18T03:38:47.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:38:49.269 WARNING:teuthology.provision.fog.smithi072:timed out
2024-04-18T03:38:50.142 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2024-04-18T03:38:55.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:38:55.568 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T03:38:55.568 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T03:38:55.829 INFO:teuthology.provision.fog.smithi072:Node is ready
2024-04-18T03:38:55.829 DEBUG:teuthology.orchestra.run.smithi072:> hostname
2024-04-18T03:38:55.846 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com
2024-04-18T03:38:55.847 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts
2024-04-18T03:38:55.905 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072
2024-04-18T03:38:55.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2024-04-18T03:38:56.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts
2024-04-18T03:38:56.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts
2024-04-18T03:38:56.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:38:56.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname
2024-04-18T03:38:56.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2024-04-18T03:38:56.298 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release
2024-04-18T03:38:56.357 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:38:56.357 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:38:56.357 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel"
2024-04-18T03:38:56.357 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora"
2024-04-18T03:38:56.357 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6"
2024-04-18T03:38:56.357 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:38:56.357 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:38:56.357 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31"
2024-04-18T03:38:56.358 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:38:56.358 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:38:56.358 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:38:56.358 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:38:56.358 INFO:teuthology.orchestra.run.smithi072.stdout:
2024-04-18T03:38:56.358 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:38:56.358 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:38:56.358 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:38:56.358 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:38:56.358 INFO:teuthology.provision.fog.smithi072:Deploy complete!
2024-04-18T03:38:56.359 DEBUG:teuthology.parallel:result is None
2024-04-18T03:38:59.202 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2024-04-18T03:39:05.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:39:05.763 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T03:39:05.764 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T03:39:21.878 INFO:teuthology.provision.fog.smithi186:Node is ready
2024-04-18T03:39:21.879 DEBUG:teuthology.orchestra.run.smithi186:> hostname
2024-04-18T03:39:21.897 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com
2024-04-18T03:39:21.898 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts
2024-04-18T03:39:21.955 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186
2024-04-18T03:39:21.956 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186
2024-04-18T03:39:22.075 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts
2024-04-18T03:39:22.103 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts
2024-04-18T03:39:22.170 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname
2024-04-18T03:39:22.237 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186
2024-04-18T03:39:22.304 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release
2024-04-18T03:39:22.360 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:39:22.360 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:39:22.360 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel"
2024-04-18T03:39:22.360 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora"
2024-04-18T03:39:22.360 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6"
2024-04-18T03:39:22.360 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:39:22.360 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:39:22.361 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31"
2024-04-18T03:39:22.361 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:39:22.361 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:39:22.361 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:39:22.361 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:39:22.361 INFO:teuthology.orchestra.run.smithi186.stdout:
2024-04-18T03:39:22.361 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:39:22.361 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:39:22.361 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:39:22.361 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:39:22.361 INFO:teuthology.provision.fog.smithi186:Deploy complete!
2024-04-18T03:39:22.362 DEBUG:teuthology.parallel:result is None
2024-04-18T03:39:22.550 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com
2024-04-18T03:39:22.550 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T03:39:22.570 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com
2024-04-18T03:39:22.570 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T03:39:22.595 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com
2024-04-18T03:39:22.595 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T03:39:22.613 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server
2024-04-18T03:39:22.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2024-04-18T03:39:22.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:39:22.686 DEBUG:teuthology.orchestra.run.smithi008:> true
2024-04-18T03:39:22.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com'
2024-04-18T03:39:22.834 DEBUG:teuthology.orchestra.run.smithi008:> uname -m
2024-04-18T03:39:22.895 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64
2024-04-18T03:39:22.896 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release
2024-04-18T03:39:22.956 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:39:22.956 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:39:22.956 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel"
2024-04-18T03:39:22.956 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora"
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6"
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31"
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:39:22.957 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:39:22.958 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2024-04-18T03:39:22.987 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server
2024-04-18T03:39:22.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com'
2024-04-18T03:39:22.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:39:23.060 DEBUG:teuthology.orchestra.run.smithi072:> true
2024-04-18T03:39:23.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com'
2024-04-18T03:39:23.196 DEBUG:teuthology.orchestra.run.smithi072:> uname -m
2024-04-18T03:39:23.252 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64
2024-04-18T03:39:23.253 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release
2024-04-18T03:39:23.309 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:39:23.309 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:39:23.309 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel"
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora"
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6"
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31"
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:39:23.310 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:39:23.311 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2024-04-18T03:39:23.328 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server
2024-04-18T03:39:23.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com'
2024-04-18T03:39:23.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:39:23.399 DEBUG:teuthology.orchestra.run.smithi186:> true
2024-04-18T03:39:23.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com'
2024-04-18T03:39:23.469 DEBUG:teuthology.orchestra.run.smithi186:> uname -m
2024-04-18T03:39:23.526 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64
2024-04-18T03:39:23.527 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release
2024-04-18T03:39:23.584 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:39:23.584 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:39:23.584 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel"
2024-04-18T03:39:23.584 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora"
2024-04-18T03:39:23.584 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6"
2024-04-18T03:39:23.585 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:39:23.585 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:39:23.585 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31"
2024-04-18T03:39:23.585 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:39:23.585 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:39:23.585 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:39:23.585 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:39:23.585 INFO:teuthology.orchestra.run.smithi186.stdout:
2024-04-18T03:39:23.585 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:39:23.585 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:39:23.585 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:39:23.585 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:39:23.586 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2024-04-18T03:39:23.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:39:23.696 INFO:teuthology.dispatcher.supervisor:Running job 7661456
2024-04-18T03:39:23.696 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661456 --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661456/orig.config.yaml
2024-04-18T03:39:23.699 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661456
2024-04-18T03:39:23.699 INFO:teuthology.dispatcher.supervisor:Job PID: 967124
2024-04-18T03:39:23.699 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-18T03:41:23.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:43:23.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:45:24.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:47:24.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:49:24.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:51:24.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:53:24.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:53:24.891 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1