2023-12-19T13:26:54.496 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-19T13:26:54.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T13:26:54.634 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f424b8332b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f424c78e940>, signals=[15])
2023-12-19T13:26:54.634 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging
2023-12-19T13:26:54.635 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T13:26:54.635 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-12-19T13:26:54.659 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging
2023-12-19T13:26:54.659 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T13:26:54.659 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-12-19T13:26:54.787 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-19T13:26:54.800 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-19T13:26:54.831 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.6
2023-12-19T13:26:54.849 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of rhel 8.6
2023-12-19T13:26:55.106 INFO:teuthology.orchestra.console.smithi081:Power off
2023-12-19T13:26:55.107 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T13:26:55.121 INFO:teuthology.orchestra.console.smithi159:Power off
2023-12-19T13:26:55.122 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T13:26:55.129 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-12-19T13:26:55.130 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T13:26:55.145 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2023-12-19T13:26:55.146 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T13:26:55.154 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-12-19T13:26:55.168 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-12-19T13:26:55.255 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-12-19T13:26:55.269 INFO:teuthology.orchestra.console.smithi159:Power off completed
2023-12-19T13:26:55.356 INFO:teuthology.orchestra.console.smithi081:Power on
2023-12-19T13:26:55.356 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T13:26:55.370 INFO:teuthology.orchestra.console.smithi159:Power on
2023-12-19T13:26:55.370 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T13:26:55.378 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On
2023-12-19T13:26:55.379 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T13:26:55.391 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On
2023-12-19T13:26:55.391 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T13:26:55.401 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-12-19T13:26:55.418 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-12-19T13:26:59.402 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T13:26:59.419 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T13:26:59.511 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-12-19T13:26:59.528 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-12-19T13:27:03.515 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T13:27:03.529 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T13:27:03.625 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-12-19T13:27:03.639 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-12-19T13:27:03.726 INFO:teuthology.orchestra.console.smithi081:Power on completed
2023-12-19T13:27:03.740 INFO:teuthology.orchestra.console.smithi159:Power on completed
2023-12-19T13:27:03.827 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2023-12-19T13:27:03.840 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2023-12-19T13:29:49.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:29:49.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:29:52.978 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-19T13:29:52.981 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-19T13:29:58.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:29:58.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:30:02.070 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-19T13:30:02.070 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-19T13:30:08.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:30:08.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:30:11.157 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-19T13:30:11.158 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-19T13:30:17.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:30:17.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:30:20.241 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-19T13:30:20.242 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-19T13:30:26.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:30:26.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:30:29.297 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-19T13:30:29.329 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-19T13:30:35.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:30:35.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:30:38.353 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-19T13:30:38.389 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-19T13:30:44.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:30:44.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:30:47.409 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-19T13:30:53.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:31:02.806 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-19T13:31:08.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:31:11.762 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-19T13:31:11.889 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-19T13:31:17.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:31:17.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:31:20.818 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-19T13:31:20.945 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-12-19T13:31:26.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:31:26.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:31:27.199 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T13:31:27.199 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T13:31:29.909 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-19T13:31:35.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:31:36.657 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T13:31:36.657 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T13:31:47.436 INFO:teuthology.provision.fog.smithi081:Node is ready
2023-12-19T13:31:47.437 DEBUG:teuthology.orchestra.run.smithi081:> hostname
2023-12-19T13:31:47.459 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com
2023-12-19T13:31:47.460 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts
2023-12-19T13:31:47.519 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2023-12-19T13:31:47.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-12-19T13:31:47.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts
2023-12-19T13:31:47.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts
2023-12-19T13:31:47.741 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname
2023-12-19T13:31:47.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-12-19T13:31:47.876 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-12-19T13:31:47.933 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T13:31:47.933 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T13:31:47.933 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-12-19T13:31:47.933 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6"
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T13:31:47.934 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T13:31:47.935 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2023-12-19T13:31:47.937 DEBUG:teuthology.parallel:result is None
2023-12-19T13:31:52.694 INFO:teuthology.provision.fog.smithi159:Node is ready
2023-12-19T13:31:52.694 DEBUG:teuthology.orchestra.run.smithi159:> hostname
2023-12-19T13:31:52.717 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2023-12-19T13:31:52.717 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts
2023-12-19T13:31:52.776 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2023-12-19T13:31:52.776 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-12-19T13:31:52.911 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts
2023-12-19T13:31:52.942 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts
2023-12-19T13:31:53.012 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname
2023-12-19T13:31:53.080 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-12-19T13:31:53.147 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-12-19T13:31:53.206 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.6"
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:
2023-12-19T13:31:53.207 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T13:31:53.208 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T13:31:53.208 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T13:31:53.208 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T13:31:53.208 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2023-12-19T13:31:53.208 DEBUG:teuthology.parallel:result is None
2023-12-19T13:31:53.355 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2023-12-19T13:31:53.356 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T13:31:53.385 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2023-12-19T13:31:53.385 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T13:31:53.411 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2023-12-19T13:31:53.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-12-19T13:31:53.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:31:53.482 DEBUG:teuthology.orchestra.run.smithi081:> true
2023-12-19T13:31:53.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-12-19T13:31:53.554 DEBUG:teuthology.orchestra.run.smithi081:> uname -m
2023-12-19T13:31:53.614 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2023-12-19T13:31:53.614 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-12-19T13:31:53.673 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T13:31:53.673 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T13:31:53.673 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-12-19T13:31:53.673 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-12-19T13:31:53.673 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6"
2023-12-19T13:31:53.673 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-12-19T13:31:53.673 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T13:31:53.673 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-12-19T13:31:53.674 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T13:31:53.674 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T13:31:53.674 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T13:31:53.674 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T13:31:53.674 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-12-19T13:31:53.674 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T13:31:53.674 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T13:31:53.674 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T13:31:53.674 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T13:31:53.674 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-12-19T13:31:53.693 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2023-12-19T13:31:53.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-12-19T13:31:53.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T13:31:53.761 DEBUG:teuthology.orchestra.run.smithi159:> true
2023-12-19T13:31:53.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-12-19T13:31:53.826 DEBUG:teuthology.orchestra.run.smithi159:> uname -m
2023-12-19T13:31:53.882 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2023-12-19T13:31:53.883 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-12-19T13:31:53.939 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T13:31:53.939 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.6 (Ootpa)"
2023-12-19T13:31:53.939 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2023-12-19T13:31:53.939 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2023-12-19T13:31:53.939 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.6"
2023-12-19T13:31:53.939 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2023-12-19T13:31:53.939 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-19T13:31:53.940 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-12-19T13:31:53.940 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-19T13:31:53.940 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T13:31:53.940 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T13:31:53.940 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T13:31:53.940 INFO:teuthology.orchestra.run.smithi159.stdout:
2023-12-19T13:31:53.940 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T13:31:53.940 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-19T13:31:53.940 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T13:31:53.940 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-19T13:31:53.941 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-12-19T13:31:53.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T13:31:54.045 INFO:teuthology.dispatcher.supervisor:Running job 7496770
2023-12-19T13:31:54.045 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496770 --name rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} -- /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496770/orig.config.yaml
2023-12-19T13:31:54.048 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496770
2023-12-19T13:31:54.049 INFO:teuthology.dispatcher.supervisor:Job PID: 1176520
2023-12-19T13:31:54.049 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-19T13:33:54.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T13:35:54.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T13:37:54.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T13:39:54.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T13:39:54.736 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-19T13:39:54.861 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-19T13:39:54.861 INFO:teuthology.nuke:Checking targets against current locks
2023-12-19T13:39:54.912 DEBUG:teuthology.nuke:shortname: smithi081
2023-12-19T13:39:54.912 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T13:39:54.926 DEBUG:teuthology.nuke:shortname: smithi159
2023-12-19T13:39:54.926 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T13:39:54.934 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:26:53.666231', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAhZUYrY0qjymY71SYhvfqkY7hYvR3iUkHcc8DLQk7HsVz16UMts50tScayHbKudVDsGrKHTQGZzgZ3gS/nWssc='}
2023-12-19T13:39:54.945 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_11:42:11-fs-rishabh-mdscap-reef-testing-default-smithi/7496770', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 13:26:53.668157', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMoKErB/5u2FbGJbXksuwQvmgsA+bDD8KTvBIqBnjAMQrxJOFWZYuC0SFoDcTeZQprVCFniITdhfl54/pNJe474='}
2023-12-19T13:39:54.978 INFO:teuthology.orchestra.console.smithi081:Power off
2023-12-19T13:39:54.978 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T13:39:54.992 INFO:teuthology.orchestra.console.smithi159:Power off
2023-12-19T13:39:54.993 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T13:39:55.001 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-12-19T13:39:55.001 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T13:39:55.015 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2023-12-19T13:39:55.016 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T13:39:55.025 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-12-19T13:39:55.037 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-12-19T13:39:55.127 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-12-19T13:39:55.138 INFO:teuthology.orchestra.console.smithi159:Power off completed
2023-12-19T13:39:55.280 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2023-12-19T13:39:55.291 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com