2023-12-26T17:23:32.179 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a
2023-12-26T17:23:32.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-26T17:23:32.340 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f13d2313310>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f13d326e940>, signals=[15])
2023-12-26T17:23:32.341 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging
2023-12-26T17:23:32.341 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server
2023-12-26T17:23:32.342 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2023-12-26T17:23:32.365 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging
2023-12-26T17:23:32.365 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server
2023-12-26T17:23:32.366 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2023-12-26T17:23:32.494 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-26T17:23:32.498 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-26T17:23:32.546 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of rhel 8.4
2023-12-26T17:23:32.547 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of rhel 8.4
2023-12-26T17:23:32.845 INFO:teuthology.orchestra.console.smithi086:Power off
2023-12-26T17:23:32.845 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-26T17:23:32.875 INFO:teuthology.orchestra.console.smithi156:Power off
2023-12-26T17:23:32.875 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-26T17:23:32.893 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off
2023-12-26T17:23:32.894 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-26T17:23:32.905 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2023-12-26T17:23:32.906 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-26T17:23:32.917 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off
2023-12-26T17:23:32.932 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2023-12-26T17:23:33.018 INFO:teuthology.orchestra.console.smithi086:Power off completed
2023-12-26T17:23:33.033 INFO:teuthology.orchestra.console.smithi156:Power off completed
2023-12-26T17:23:33.119 INFO:teuthology.orchestra.console.smithi086:Power on
2023-12-26T17:23:33.120 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-26T17:23:33.134 INFO:teuthology.orchestra.console.smithi156:Power on
2023-12-26T17:23:33.134 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-26T17:23:33.146 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On
2023-12-26T17:23:33.147 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-26T17:23:33.158 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On
2023-12-26T17:23:33.158 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-26T17:23:33.170 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off
2023-12-26T17:23:33.183 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2023-12-26T17:23:37.173 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-26T17:23:37.184 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-26T17:23:37.283 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on
2023-12-26T17:23:37.292 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2023-12-26T17:23:37.385 INFO:teuthology.orchestra.console.smithi086:Power on completed
2023-12-26T17:23:37.394 INFO:teuthology.orchestra.console.smithi156:Power on completed
2023-12-26T17:23:37.486 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish
2023-12-26T17:23:37.495 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2023-12-26T17:26:23.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:26:26.769 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-12-26T17:26:32.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:26:35.826 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-12-26T17:26:38.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:26:41.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:26:41.841 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-26T17:26:44.885 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-12-26T17:26:47.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:26:50.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:26:50.898 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-26T17:26:53.969 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-12-26T17:26:56.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:26:59.957 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-26T17:26:59.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:27:03.025 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-12-26T17:27:05.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:27:09.009 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-26T17:27:09.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:27:12.085 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-12-26T17:27:15.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:27:18.065 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-26T17:27:18.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:27:24.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:27:27.158 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-26T17:27:33.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:27:51.570 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-26T17:27:57.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:28:00.625 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-26T17:28:06.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:28:09.685 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2023-12-26T17:28:15.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:28:15.988 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-26T17:28:15.988 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-26T17:28:18.088 WARNING:teuthology.provision.fog.smithi086:timed out
2023-12-26T17:28:24.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:28:24.360 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-26T17:28:24.360 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-26T17:28:24.652 INFO:teuthology.provision.fog.smithi086:Node is ready
2023-12-26T17:28:24.652 DEBUG:teuthology.orchestra.run.smithi086:> hostname
2023-12-26T17:28:24.667 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com
2023-12-26T17:28:24.667 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts
2023-12-26T17:28:24.723 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086
2023-12-26T17:28:24.724 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086
2023-12-26T17:28:24.846 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts
2023-12-26T17:28:24.873 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts
2023-12-26T17:28:24.938 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname
2023-12-26T17:28:25.002 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086
2023-12-26T17:28:25.066 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release
2023-12-26T17:28:25.120 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux"
2023-12-26T17:28:25.120 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.4 (Ootpa)"
2023-12-26T17:28:25.120 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel"
2023-12-26T17:28:25.120 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora"
2023-12-26T17:28:25.120 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.4"
2023-12-26T17:28:25.120 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8"
2023-12-26T17:28:25.120 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-26T17:28:25.120 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31"
2023-12-26T17:28:25.120 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-26T17:28:25.120 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/"
2023-12-26T17:28:25.121 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-26T17:28:25.121 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-26T17:28:25.121 INFO:teuthology.orchestra.run.smithi086.stdout:
2023-12-26T17:28:25.121 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-26T17:28:25.121 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-26T17:28:25.121 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-26T17:28:25.121 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-26T17:28:25.122 INFO:teuthology.provision.fog.smithi086:Deploy complete!
2023-12-26T17:28:25.123 DEBUG:teuthology.parallel:result is None
2023-12-26T17:28:36.225 INFO:teuthology.provision.fog.smithi156:Node is ready
2023-12-26T17:28:36.225 DEBUG:teuthology.orchestra.run.smithi156:> hostname
2023-12-26T17:28:36.241 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2023-12-26T17:28:36.241 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts
2023-12-26T17:28:36.295 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2023-12-26T17:28:36.295 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2023-12-26T17:28:36.410 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts
2023-12-26T17:28:36.435 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts
2023-12-26T17:28:36.499 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname
2023-12-26T17:28:36.563 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2023-12-26T17:28:36.627 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2023-12-26T17:28:36.681 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux"
2023-12-26T17:28:36.681 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.4 (Ootpa)"
2023-12-26T17:28:36.681 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel"
2023-12-26T17:28:36.681 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora"
2023-12-26T17:28:36.681 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.4"
2023-12-26T17:28:36.681 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8"
2023-12-26T17:28:36.681 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-26T17:28:36.681 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2023-12-26T17:28:36.681 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-26T17:28:36.681 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/"
2023-12-26T17:28:36.681 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-26T17:28:36.682 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-26T17:28:36.682 INFO:teuthology.orchestra.run.smithi156.stdout:
2023-12-26T17:28:36.682 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-26T17:28:36.682 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-26T17:28:36.682 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-26T17:28:36.682 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-26T17:28:36.682 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2023-12-26T17:28:36.683 DEBUG:teuthology.parallel:result is None
2023-12-26T17:28:36.831 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com
2023-12-26T17:28:36.832 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-26T17:28:36.862 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2023-12-26T17:28:36.862 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-26T17:28:36.880 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server
2023-12-26T17:28:36.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-12-26T17:28:36.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:28:36.950 DEBUG:teuthology.orchestra.run.smithi086:> true
2023-12-26T17:28:37.068 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-12-26T17:28:37.068 DEBUG:teuthology.orchestra.run.smithi086:> uname -m
2023-12-26T17:28:37.122 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64
2023-12-26T17:28:37.123 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release
2023-12-26T17:28:37.177 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux"
2023-12-26T17:28:37.177 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.4 (Ootpa)"
2023-12-26T17:28:37.177 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel"
2023-12-26T17:28:37.177 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora"
2023-12-26T17:28:37.177 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.4"
2023-12-26T17:28:37.177 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8"
2023-12-26T17:28:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-26T17:28:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31"
2023-12-26T17:28:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-26T17:28:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/"
2023-12-26T17:28:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-26T17:28:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-26T17:28:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:
2023-12-26T17:28:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-26T17:28:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-26T17:28:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-26T17:28:37.178 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-26T17:28:37.179 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2023-12-26T17:28:37.204 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2023-12-26T17:28:37.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2023-12-26T17:28:37.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-26T17:28:37.272 DEBUG:teuthology.orchestra.run.smithi156:> true
2023-12-26T17:28:37.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com'
2023-12-26T17:28:37.339 DEBUG:teuthology.orchestra.run.smithi156:> uname -m
2023-12-26T17:28:37.393 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2023-12-26T17:28:37.393 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2023-12-26T17:28:37.447 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux"
2023-12-26T17:28:37.447 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.4 (Ootpa)"
2023-12-26T17:28:37.447 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel"
2023-12-26T17:28:37.447 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora"
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.4"
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8"
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/"
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-26T17:28:37.448 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-26T17:28:37.449 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2023-12-26T17:28:37.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-26T17:28:37.567 INFO:teuthology.dispatcher.supervisor:Running job 7501523
2023-12-26T17:28:37.567 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501523 --name yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi --description rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests} -- /home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501523/orig.config.yaml
2023-12-26T17:28:37.570 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501523
2023-12-26T17:28:37.570 INFO:teuthology.dispatcher.supervisor:Job PID: 611612
2023-12-26T17:28:37.571 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-26T17:30:37.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-26T17:32:37.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-26T17:34:38.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-26T17:36:38.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-26T17:36:38.351 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-26T17:36:38.454 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-26T17:36:38.454 INFO:teuthology.nuke:Checking targets against current locks
2023-12-26T17:36:38.508 DEBUG:teuthology.nuke:shortname: smithi086
2023-12-26T17:36:38.508 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-26T17:36:38.530 DEBUG:teuthology.nuke:shortname: smithi156
2023-12-26T17:36:38.530 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-26T17:36:38.535 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501523', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-26 17:23:31.312283', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEIqut9FTzcQxlr6eOYQ1BW8pOdpnxXSSe+7goda5RsX5cUIfcX2PoMl1a++9S9DZsJa5n5p6otuajjm1UiNFI0='}
2023-12-26T17:36:38.551 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501523', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-26 17:23:31.313838', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJAXSzFE9t3G4RAEdizyGJCeucdMOpsoJpt0W2hFNIlkB7VPhRtqSrPlYTlspybs4iX1ShX6UZzq0+IRLBAthk='}
2023-12-26T17:36:38.586 INFO:teuthology.orchestra.console.smithi086:Power off
2023-12-26T17:36:38.586 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-26T17:36:38.607 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off
2023-12-26T17:36:38.608 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-26T17:36:38.624 INFO:teuthology.orchestra.console.smithi156:Power off
2023-12-26T17:36:38.625 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-26T17:36:38.632 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off
2023-12-26T17:36:38.648 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2023-12-26T17:36:38.648 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-26T17:36:38.674 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2023-12-26T17:36:38.733 INFO:teuthology.orchestra.console.smithi086:Power off completed
2023-12-26T17:36:38.775 INFO:teuthology.orchestra.console.smithi156:Power off completed
2023-12-26T17:36:38.890 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com
2023-12-26T17:36:38.932 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com