2023-12-26T17:09:05.623 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-26T17:09:05.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:09:05.770 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f326b9b6940>, signals=[15]) 2023-12-26T17:09:05.771 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2023-12-26T17:09:05.771 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2023-12-26T17:09:05.771 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-12-26T17:09:05.794 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-12-26T17:09:05.794 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-12-26T17:09:05.794 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-12-26T17:09:05.909 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-26T17:09:05.931 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-26T17:09:05.955 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.4 2023-12-26T17:09:05.974 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of rhel 8.4 2023-12-26T17:09:06.245 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-26T17:09:06.246 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T17:09:06.263 INFO:teuthology.orchestra.console.smithi110:Power off 2023-12-26T17:09:06.263 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T17:09:06.273 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-26T17:09:06.273 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:09:06.287 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-12-26T17:09:06.287 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:09:06.298 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-26T17:09:06.312 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-12-26T17:09:06.399 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-26T17:09:06.413 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-12-26T17:09:06.500 INFO:teuthology.orchestra.console.smithi195:Power on 2023-12-26T17:09:06.500 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-26T17:09:06.514 INFO:teuthology.orchestra.console.smithi110:Power on 2023-12-26T17:09:06.514 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-26T17:09:06.526 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-12-26T17:09:06.527 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:09:06.541 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On 2023-12-26T17:09:06.541 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:09:06.555 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-26T17:09:06.565 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-12-26T17:09:10.557 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:09:10.568 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:09:10.670 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-26T17:09:10.683 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-12-26T17:09:10.783 INFO:teuthology.orchestra.console.smithi110:Power on completed 2023-12-26T17:09:10.884 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2023-12-26T17:09:14.674 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:09:14.783 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-26T17:09:14.884 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-12-26T17:09:14.984 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-12-26T17:11:56.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:11:59.954 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-26T17:12:00.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:12:03.921 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-26T17:12:05.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:12:09.013 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-26T17:12:09.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:12:12.981 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-26T17:12:15.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:12:18.097 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-26T17:12:18.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:12:22.069 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-26T17:12:24.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:12:27.153 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-26T17:12:28.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:12:31.121 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-26T17:12:33.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:12:36.213 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-26T17:12:37.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:12:40.181 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-26T17:12:42.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:12:45.265 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-12-26T17:12:46.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:12:49.269 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-26T17:12:51.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:12:55.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:13:05.554 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-26T17:13:11.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:13:14.609 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-26T17:13:20.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:13:23.669 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-26T17:13:29.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:13:31.822 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-26T17:13:31.823 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-26T17:13:51.271 WARNING:teuthology.provision.fog.smithi110:timed out 2023-12-26T17:13:52.399 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-12-26T17:13:52.399 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-12-26T17:13:52.416 INFO:teuthology.orchestra.run.smithi195.stdout:smithi036 2023-12-26T17:13:52.416 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi036 /etc/hosts 2023-12-26T17:13:52.470 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2023-12-26T17:13:52.471 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-12-26T17:13:52.587 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi036/smithi195/g' /etc/hosts 2023-12-26T17:13:52.612 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.36/172.21.15.195/g' /etc/hosts 2023-12-26T17:13:52.676 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi036/smithi195/g' /etc/hostname 2023-12-26T17:13:52.741 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-12-26T17:13:52.804 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-12-26T17:13:52.858 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-12-26T17:13:52.858 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.4 (Ootpa)" 2023-12-26T17:13:52.858 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-12-26T17:13:52.858 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.4" 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-26T17:13:52.859 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-26T17:13:52.860 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-12-26T17:13:52.861 DEBUG:teuthology.parallel:result is None 2023-12-26T17:13:57.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:13:57.588 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-26T17:13:57.589 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-26T17:13:57.835 INFO:teuthology.provision.fog.smithi110:Node is ready 2023-12-26T17:13:57.835 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2023-12-26T17:13:57.850 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2023-12-26T17:13:57.850 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2023-12-26T17:13:57.906 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2023-12-26T17:13:57.906 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-12-26T17:13:58.026 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2023-12-26T17:13:58.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2023-12-26T17:13:58.119 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2023-12-26T17:13:58.184 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-12-26T17:13:58.248 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-12-26T17:13:58.303 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2023-12-26T17:13:58.303 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.4 (Ootpa)" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.4" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-26T17:13:58.304 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-26T17:13:58.305 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2023-12-26T17:13:58.305 DEBUG:teuthology.parallel:result is None 2023-12-26T17:13:58.453 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2023-12-26T17:13:58.454 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-26T17:13:58.473 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-12-26T17:13:58.473 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-26T17:13:58.500 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2023-12-26T17:13:58.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-12-26T17:13:58.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:13:58.565 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-12-26T17:13:58.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-12-26T17:13:58.628 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-12-26T17:13:58.683 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-12-26T17:13:58.683 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-12-26T17:13:58.738 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.4 (Ootpa)" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.4" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-26T17:13:58.739 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-26T17:13:58.740 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-26T17:13:58.740 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-12-26T17:13:58.765 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-12-26T17:13:58.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-26T17:13:58.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:13:58.834 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-12-26T17:13:58.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-26T17:13:58.908 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-12-26T17:13:58.963 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-12-26T17:13:58.963 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-12-26T17:13:59.019 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-12-26T17:13:59.019 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.4 (Ootpa)" 2023-12-26T17:13:59.019 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-12-26T17:13:59.019 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-12-26T17:13:59.019 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.4" 2023-12-26T17:13:59.019 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-12-26T17:13:59.019 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-26T17:13:59.020 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-12-26T17:13:59.020 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-26T17:13:59.020 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-12-26T17:13:59.020 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-26T17:13:59.020 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-26T17:13:59.020 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-26T17:13:59.020 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-26T17:13:59.020 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-26T17:13:59.020 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-26T17:13:59.020 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-26T17:13:59.021 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-12-26T17:13:59.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:13:59.128 INFO:teuthology.dispatcher.supervisor:Running job 7501485 2023-12-26T17:13:59.128 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501485 --name yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} -- /home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501485/orig.config.yaml 2023-12-26T17:13:59.131 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501485 2023-12-26T17:13:59.132 INFO:teuthology.dispatcher.supervisor:Job PID: 289063 2023-12-26T17:13:59.132 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-26T17:15:59.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:17:59.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:19:59.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:21:59.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:21:59.803 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-26T17:21:59.907 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-26T17:21:59.907 INFO:teuthology.nuke:Checking targets against current locks 2023-12-26T17:21:59.956 DEBUG:teuthology.nuke:shortname: smithi110 2023-12-26T17:21:59.956 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-26T17:21:59.981 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501485', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-26 17:09:04.788072', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9AolHHOnLSZQ/HV8DSnJlzddGvZzwQu/8Bpqj7jBW1LiC4hHeERN/BlXZIJZshG+RsMQ0YEQPwy862UPaN44g='} 2023-12-26T17:21:59.985 DEBUG:teuthology.nuke:shortname: smithi195 2023-12-26T17:21:59.985 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-26T17:22:00.011 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501485', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-26 17:09:04.789870', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFjkb82t9jL+rGhiv4ZOEbKv7/nl4CmbfMf57XY906wFUcb8wIYQSxgvSHkbwDPhLrPU8kTC+LJDSZAkLIsi73U='} 2023-12-26T17:22:00.037 INFO:teuthology.orchestra.console.smithi110:Power off 2023-12-26T17:22:00.038 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T17:22:00.061 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-12-26T17:22:00.062 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:22:00.076 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-26T17:22:00.077 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T17:22:00.088 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-12-26T17:22:00.097 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-26T17:22:00.098 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:22:00.121 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-26T17:22:00.189 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-12-26T17:22:00.222 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-26T17:22:00.344 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2023-12-26T17:22:00.368 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com