2023-12-07T11:43:59.695 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-07T11:43:59.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:43:59.848 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc966a85400>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc9679a8550>, signals=[15])
2023-12-07T11:43:59.848 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging
2023-12-07T11:43:59.849 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server
2023-12-07T11:43:59.849 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2023-12-07T11:43:59.876 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging
2023-12-07T11:43:59.876 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server
2023-12-07T11:43:59.877 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2023-12-07T11:43:59.993 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-07T11:44:00.009 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-07T11:44:00.042 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.6
2023-12-07T11:44:00.057 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of rhel 8.6
2023-12-07T11:44:00.335 INFO:teuthology.orchestra.console.smithi142:Power off
2023-12-07T11:44:00.335 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T11:44:00.350 INFO:teuthology.orchestra.console.smithi186:Power off
2023-12-07T11:44:00.350 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T11:44:00.361 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off
2023-12-07T11:44:00.362 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:00.376 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off
2023-12-07T11:44:00.376 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:00.386 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2023-12-07T11:44:00.401 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on
2023-12-07T11:44:04.390 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:04.401 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:04.504 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2023-12-07T11:44:04.510 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on
2023-12-07T11:44:08.508 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:08.515 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:08.617 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2023-12-07T11:44:08.623 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on
2023-12-07T11:44:12.622 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:12.631 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:12.733 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2023-12-07T11:44:12.741 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2023-12-07T11:44:12.835 INFO:teuthology.orchestra.console.smithi142:Power off completed
2023-12-07T11:44:12.842 INFO:teuthology.orchestra.console.smithi186:Power off completed
2023-12-07T11:44:12.937 INFO:teuthology.orchestra.console.smithi142:Power on
2023-12-07T11:44:12.937 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-07T11:44:12.946 INFO:teuthology.orchestra.console.smithi186:Power on
2023-12-07T11:44:12.946 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-07T11:44:12.960 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On
2023-12-07T11:44:12.960 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:12.970 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On
2023-12-07T11:44:12.971 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:12.984 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2023-12-07T11:44:12.992 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2023-12-07T11:44:16.987 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:16.994 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:17.096 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2023-12-07T11:44:17.103 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2023-12-07T11:44:21.100 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:21.110 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T11:44:21.212 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2023-12-07T11:44:21.221 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on
2023-12-07T11:44:21.313 INFO:teuthology.orchestra.console.smithi142:Power on completed
2023-12-07T11:44:21.322 INFO:teuthology.orchestra.console.smithi186:Power on completed
2023-12-07T11:44:21.414 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2023-12-07T11:44:21.424 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish
2023-12-07T11:47:07.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:47:10.434 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-07T11:47:16.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:47:19.494 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-07T11:47:22.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:47:25.479 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-12-07T11:47:25.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:47:28.582 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-07T11:47:31.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:47:34.562 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-12-07T11:47:34.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:47:37.638 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-07T11:47:40.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:47:43.622 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-12-07T11:47:43.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:47:46.690 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-07T11:47:49.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:47:52.674 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-12-07T11:47:52.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:47:58.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:48:01.730 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-12-07T11:48:07.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:48:10.786 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-12-07T11:48:16.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:48:19.846 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-12-07T11:48:25.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:48:52.719 WARNING:teuthology.provision.fog.smithi142:timed out
2023-12-07T11:48:58.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:48:59.062 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-07T11:48:59.063 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-07T11:48:59.365 INFO:teuthology.provision.fog.smithi142:Node is ready
2023-12-07T11:48:59.365 DEBUG:teuthology.orchestra.run.smithi142:> hostname
2023-12-07T11:48:59.382 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142
2023-12-07T11:48:59.383 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142 /etc/hosts
2023-12-07T11:48:59.441 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2023-12-07T11:48:59.442 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2023-12-07T11:48:59.575 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142/smithi142/g' /etc/hosts
2023-12-07T11:48:59.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts
2023-12-07T11:48:59.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142/smithi142/g' /etc/hostname
2023-12-07T11:48:59.837 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2023-12-07T11:48:59.861 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2023-12-07T11:48:59.918 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux"
2023-12-07T11:48:59.918 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)"
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel"
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora"
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6"
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8"
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/"
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T11:48:59.919 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-07T11:48:59.920 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-07T11:48:59.920 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-07T11:48:59.920 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2023-12-07T11:48:59.921 DEBUG:teuthology.parallel:result is None
2023-12-07T11:49:25.881 WARNING:teuthology.provision.fog.smithi186:timed out
2023-12-07T11:49:31.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:49:32.227 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-07T11:49:32.228 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-07T11:49:32.557 INFO:teuthology.provision.fog.smithi186:Node is ready
2023-12-07T11:49:32.558 DEBUG:teuthology.orchestra.run.smithi186:> hostname
2023-12-07T11:49:32.576 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com
2023-12-07T11:49:32.577 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts
2023-12-07T11:49:32.632 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186
2023-12-07T11:49:32.633 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186
2023-12-07T11:49:32.752 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts
2023-12-07T11:49:32.782 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts
2023-12-07T11:49:32.850 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname
2023-12-07T11:49:32.916 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186
2023-12-07T11:49:32.981 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release
2023-12-07T11:49:33.036 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux"
2023-12-07T11:49:33.036 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)"
2023-12-07T11:49:33.036 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel"
2023-12-07T11:49:33.037 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora"
2023-12-07T11:49:33.037 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6"
2023-12-07T11:49:33.037 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8"
2023-12-07T11:49:33.038 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-07T11:49:33.038 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31"
2023-12-07T11:49:33.038 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-07T11:49:33.038 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/"
2023-12-07T11:49:33.039 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-07T11:49:33.039 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T11:49:33.040 INFO:teuthology.orchestra.run.smithi186.stdout:
2023-12-07T11:49:33.040 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T11:49:33.040 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-07T11:49:33.040 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-07T11:49:33.041 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-07T11:49:33.041 INFO:teuthology.provision.fog.smithi186:Deploy complete!
2023-12-07T11:49:33.043 DEBUG:teuthology.parallel:result is None
2023-12-07T11:49:33.191 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com
2023-12-07T11:49:33.191 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-07T11:49:33.213 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com
2023-12-07T11:49:33.214 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-07T11:49:33.239 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server
2023-12-07T11:49:33.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2023-12-07T11:49:33.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:49:33.307 DEBUG:teuthology.orchestra.run.smithi142:> true
2023-12-07T11:49:33.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com'
2023-12-07T11:49:33.396 DEBUG:teuthology.orchestra.run.smithi142:> uname -m
2023-12-07T11:49:33.454 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64
2023-12-07T11:49:33.454 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2023-12-07T11:49:33.511 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux"
2023-12-07T11:49:33.512 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)"
2023-12-07T11:49:33.512 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel"
2023-12-07T11:49:33.513 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora"
2023-12-07T11:49:33.513 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6"
2023-12-07T11:49:33.513 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8"
2023-12-07T11:49:33.513 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-07T11:49:33.514 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2023-12-07T11:49:33.514 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-07T11:49:33.514 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/"
2023-12-07T11:49:33.514 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-07T11:49:33.515 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T11:49:33.515 INFO:teuthology.orchestra.run.smithi142.stdout:
2023-12-07T11:49:33.515 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T11:49:33.515 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-07T11:49:33.516 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-07T11:49:33.516 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-07T11:49:33.517 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2023-12-07T11:49:33.538 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server
2023-12-07T11:49:33.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com'
2023-12-07T11:49:33.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T11:49:33.602 DEBUG:teuthology.orchestra.run.smithi186:> true
2023-12-07T11:49:33.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com'
2023-12-07T11:49:33.672 DEBUG:teuthology.orchestra.run.smithi186:> uname -m
2023-12-07T11:49:33.728 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64
2023-12-07T11:49:33.728 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release
2023-12-07T11:49:33.785 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux"
2023-12-07T11:49:33.785 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)"
2023-12-07T11:49:33.785 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel"
2023-12-07T11:49:33.785 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora"
2023-12-07T11:49:33.785 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6"
2023-12-07T11:49:33.785 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8"
2023-12-07T11:49:33.785 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-07T11:49:33.786 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31"
2023-12-07T11:49:33.786 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-07T11:49:33.786 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/"
2023-12-07T11:49:33.786 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-07T11:49:33.786 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T11:49:33.786 INFO:teuthology.orchestra.run.smithi186.stdout:
2023-12-07T11:49:33.786 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T11:49:33.786 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-07T11:49:33.786 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-07T11:49:33.786 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-07T11:49:33.787 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2023-12-07T11:49:33.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:49:33.897 INFO:teuthology.dispatcher.supervisor:Running job 7481937
2023-12-07T11:49:33.897 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481937 --name vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-flush} -- /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481937/orig.config.yaml
2023-12-07T11:49:33.900 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481937
2023-12-07T11:49:33.900 INFO:teuthology.dispatcher.supervisor:Job PID: 1582517
2023-12-07T11:49:33.900 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-07T11:51:33.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:53:34.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:55:34.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:57:34.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T11:59:34.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:01:34.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:03:35.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:05:35.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:07:35.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T12:07:35.509 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-07T12:07:35.691 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-07T12:07:35.691 INFO:teuthology.nuke:Checking targets against current locks
2023-12-07T12:07:35.744 DEBUG:teuthology.nuke:shortname: smithi142
2023-12-07T12:07:35.744 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-07T12:07:35.763 DEBUG:teuthology.nuke:shortname: smithi186
2023-12-07T12:07:35.764 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-07T12:07:35.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 11:43:58.773877', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-12-07T12:07:35.781 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 11:43:58.772613', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-12-07T12:07:35.821 INFO:teuthology.orchestra.console.smithi142:Power off
2023-12-07T12:07:35.821 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T12:07:35.833 INFO:teuthology.orchestra.console.smithi186:Power off
2023-12-07T12:07:35.833 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T12:07:35.845 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off
2023-12-07T12:07:35.846 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T12:07:35.855 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off
2023-12-07T12:07:35.855 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T12:07:35.869 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2023-12-07T12:07:35.879 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2023-12-07T12:07:35.971 INFO:teuthology.orchestra.console.smithi142:Power off completed
2023-12-07T12:07:35.980 INFO:teuthology.orchestra.console.smithi186:Power off completed
2023-12-07T12:07:36.131 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com
2023-12-07T12:07:36.139 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com