2023-12-26T16:50:35.655 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-26T16:50:35.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T16:50:35.787 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9883597940>, signals=[15]) 2023-12-26T16:50:35.788 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging 2023-12-26T16:50:35.788 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server 2023-12-26T16:50:35.788 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-12-26T16:50:35.813 INFO:teuthology.lock.ops:Start node 'smithi076.front.sepia.ceph.com' reimaging 2023-12-26T16:50:35.813 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: reset os type and version on server 2023-12-26T16:50:35.813 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2023-12-26T16:50:35.925 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-26T16:50:35.951 DEBUG:teuthology.provision.fog.smithi076:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-26T16:50:35.970 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of rhel 8.4 2023-12-26T16:50:35.990 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of rhel 8.4 2023-12-26T16:50:36.289 INFO:teuthology.orchestra.console.smithi016:Power off 2023-12-26T16:50:36.289 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T16:50:36.313 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2023-12-26T16:50:36.313 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T16:50:36.331 INFO:teuthology.orchestra.console.smithi076:Power off 2023-12-26T16:50:36.332 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T16:50:36.339 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-12-26T16:50:36.351 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2023-12-26T16:50:36.352 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T16:50:36.372 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2023-12-26T16:50:36.440 INFO:teuthology.orchestra.console.smithi016:Power off completed 2023-12-26T16:50:36.474 INFO:teuthology.orchestra.console.smithi076:Power off completed 2023-12-26T16:50:36.541 INFO:teuthology.orchestra.console.smithi016:Power on 2023-12-26T16:50:36.541 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-26T16:50:36.563 DEBUG:teuthology.orchestra.console.smithi016:power on output: Chassis Power Control: Up/On 2023-12-26T16:50:36.564 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T16:50:36.575 INFO:teuthology.orchestra.console.smithi076:Power on 2023-12-26T16:50:36.575 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-26T16:50:36.585 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-12-26T16:50:36.598 DEBUG:teuthology.orchestra.console.smithi076:power on output: Chassis Power Control: Up/On 2023-12-26T16:50:36.598 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T16:50:36.620 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2023-12-26T16:50:40.589 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T16:50:40.621 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T16:50:40.698 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-12-26T16:50:40.729 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2023-12-26T16:50:40.799 INFO:teuthology.orchestra.console.smithi016:Power on completed 2023-12-26T16:50:40.900 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2023-12-26T16:50:44.733 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T16:50:44.843 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2023-12-26T16:50:44.943 INFO:teuthology.orchestra.console.smithi076:Power on completed 2023-12-26T16:50:45.044 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish 2023-12-26T16:53:27.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:53:30.102 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-26T16:53:36.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:53:39.185 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-26T16:53:45.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:53:46.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:53:48.245 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-26T16:53:49.169 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-26T16:53:54.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:53:55.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:53:57.329 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-26T16:53:58.225 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-26T16:54:03.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:54:04.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:54:06.389 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-12-26T16:54:07.281 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-26T16:54:12.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:54:13.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:54:16.338 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-26T16:54:22.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:54:25.394 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-26T16:54:31.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:54:34.449 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-26T16:54:40.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:54:43.509 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2023-12-26T16:54:49.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:55:12.418 WARNING:teuthology.provision.fog.smithi016:timed out 2023-12-26T16:55:18.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:55:18.785 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-26T16:55:18.786 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-26T16:55:19.047 INFO:teuthology.provision.fog.smithi016:Node is ready 2023-12-26T16:55:19.047 DEBUG:teuthology.orchestra.run.smithi016:> hostname 2023-12-26T16:55:19.063 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2023-12-26T16:55:19.063 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts 2023-12-26T16:55:19.120 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2023-12-26T16:55:19.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2023-12-26T16:55:19.218 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts 2023-12-26T16:55:19.245 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts 2023-12-26T16:55:19.311 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname 2023-12-26T16:55:19.377 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2023-12-26T16:55:19.442 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-12-26T16:55:19.497 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2023-12-26T16:55:19.497 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.4 (Ootpa)" 2023-12-26T16:55:19.497 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2023-12-26T16:55:19.497 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2023-12-26T16:55:19.497 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.4" 2023-12-26T16:55:19.497 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-12-26T16:55:19.498 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-26T16:55:19.498 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-12-26T16:55:19.498 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-26T16:55:19.498 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2023-12-26T16:55:19.498 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-26T16:55:19.498 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-26T16:55:19.498 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-12-26T16:55:19.498 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-26T16:55:19.498 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-26T16:55:19.498 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-26T16:55:19.498 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-26T16:55:19.499 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2023-12-26T16:55:19.500 DEBUG:teuthology.parallel:result is None 2023-12-26T16:55:49.546 WARNING:teuthology.provision.fog.smithi076:timed out 2023-12-26T16:55:55.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:55:55.813 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-26T16:55:55.814 DEBUG:teuthology.orchestra.run.smithi076:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-26T16:55:56.129 INFO:teuthology.provision.fog.smithi076:Node is ready 2023-12-26T16:55:56.129 DEBUG:teuthology.orchestra.run.smithi076:> hostname 2023-12-26T16:55:56.144 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076.front.sepia.ceph.com 2023-12-26T16:55:56.145 DEBUG:teuthology.orchestra.run.smithi076:> grep smithi076.front.sepia.ceph.com /etc/hosts 2023-12-26T16:55:56.201 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2023-12-26T16:55:56.201 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2023-12-26T16:55:56.306 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hosts 2023-12-26T16:55:56.332 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/172.21.15.76/172.21.15.76/g' /etc/hosts 2023-12-26T16:55:56.397 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hostname 2023-12-26T16:55:56.462 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2023-12-26T16:55:56.525 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2023-12-26T16:55:56.580 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Red Hat Enterprise Linux" 2023-12-26T16:55:56.581 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8.4 (Ootpa)" 2023-12-26T16:55:56.581 INFO:teuthology.orchestra.run.smithi076.stdout:ID="rhel" 2023-12-26T16:55:56.581 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="fedora" 2023-12-26T16:55:56.581 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8.4" 2023-12-26T16:55:56.581 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8" 2023-12-26T16:55:56.581 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-26T16:55:56.581 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2023-12-26T16:55:56.581 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-26T16:55:56.581 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.redhat.com/" 2023-12-26T16:55:56.581 INFO:teuthology.orchestra.run.smithi076.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-26T16:55:56.581 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-26T16:55:56.581 INFO:teuthology.orchestra.run.smithi076.stdout: 2023-12-26T16:55:56.582 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-26T16:55:56.582 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-26T16:55:56.582 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-26T16:55:56.582 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-26T16:55:56.582 INFO:teuthology.provision.fog.smithi076:Deploy complete! 2023-12-26T16:55:56.583 DEBUG:teuthology.parallel:result is None 2023-12-26T16:55:56.733 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2023-12-26T16:55:56.734 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-26T16:55:56.753 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com 2023-12-26T16:55:56.753 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-26T16:55:56.770 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2023-12-26T16:55:56.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-12-26T16:55:56.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:55:56.838 DEBUG:teuthology.orchestra.run.smithi016:> true 2023-12-26T16:55:56.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-12-26T16:55:56.961 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2023-12-26T16:55:57.016 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2023-12-26T16:55:57.016 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-12-26T16:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2023-12-26T16:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.4 (Ootpa)" 2023-12-26T16:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2023-12-26T16:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2023-12-26T16:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.4" 2023-12-26T16:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-12-26T16:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-26T16:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-12-26T16:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-26T16:55:57.071 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2023-12-26T16:55:57.072 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-26T16:55:57.072 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-26T16:55:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-12-26T16:55:57.072 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-26T16:55:57.072 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-26T16:55:57.072 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-26T16:55:57.072 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-26T16:55:57.072 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-12-26T16:55:57.094 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server 2023-12-26T16:55:57.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2023-12-26T16:55:57.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T16:55:57.162 DEBUG:teuthology.orchestra.run.smithi076:> true 2023-12-26T16:55:57.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2023-12-26T16:55:57.223 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2023-12-26T16:55:57.277 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2023-12-26T16:55:57.277 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2023-12-26T16:55:57.331 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Red Hat Enterprise Linux" 2023-12-26T16:55:57.331 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8.4 (Ootpa)" 2023-12-26T16:55:57.331 INFO:teuthology.orchestra.run.smithi076.stdout:ID="rhel" 2023-12-26T16:55:57.331 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="fedora" 2023-12-26T16:55:57.331 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8.4" 2023-12-26T16:55:57.331 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8" 2023-12-26T16:55:57.332 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-26T16:55:57.332 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2023-12-26T16:55:57.332 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-26T16:55:57.332 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.redhat.com/" 2023-12-26T16:55:57.332 INFO:teuthology.orchestra.run.smithi076.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-26T16:55:57.332 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-26T16:55:57.332 INFO:teuthology.orchestra.run.smithi076.stdout: 2023-12-26T16:55:57.332 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-26T16:55:57.332 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-26T16:55:57.332 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-26T16:55:57.332 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-26T16:55:57.333 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2023-12-26T16:55:57.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T16:55:57.441 INFO:teuthology.dispatcher.supervisor:Running job 7501438 2023-12-26T16:55:57.441 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501438 --name yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi --description rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} -- /home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501438/orig.config.yaml 2023-12-26T16:55:57.445 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501438 2023-12-26T16:55:57.445 INFO:teuthology.dispatcher.supervisor:Job PID: 4112764 2023-12-26T16:55:57.445 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-26T16:57:57.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T16:59:57.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:01:57.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:03:58.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:05:58.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:05:58.287 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-26T17:05:58.394 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-26T17:05:58.394 INFO:teuthology.nuke:Checking targets against current locks 2023-12-26T17:05:58.447 DEBUG:teuthology.nuke:shortname: smithi016 2023-12-26T17:05:58.448 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-26T17:05:58.467 DEBUG:teuthology.nuke:shortname: smithi076 2023-12-26T17:05:58.467 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-26T17:05:58.470 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501438', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-26 16:50:34.800981', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOJTqPsRizb7pWQQXhK613aTELdDGEO5QAdEEwAvk5vimITNCfWrEFO9+BElOd6AlC66hXUYrW/dGC4sAQ9pDM4='} 2023-12-26T17:05:58.491 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501438', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-26 16:50:34.799219', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCt0tm6lAmZ/nlDt0PDRmUHaImVZM1PZayZTQtMvUSNGOOurGljRoMi9UEED8uy3RpTsMBLAt8JvJyQlDlallro='} 2023-12-26T17:05:58.522 INFO:teuthology.orchestra.console.smithi016:Power off 2023-12-26T17:05:58.523 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T17:05:58.544 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2023-12-26T17:05:58.545 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:05:58.564 INFO:teuthology.orchestra.console.smithi076:Power off 2023-12-26T17:05:58.564 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T17:05:58.572 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-12-26T17:05:58.585 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2023-12-26T17:05:58.585 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:05:58.608 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2023-12-26T17:05:58.675 INFO:teuthology.orchestra.console.smithi016:Power off completed 2023-12-26T17:05:58.709 INFO:teuthology.orchestra.console.smithi076:Power off completed 2023-12-26T17:05:58.836 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com 2023-12-26T17:05:58.851 INFO:teuthology.lock.ops:unlocked: smithi076.front.sepia.ceph.com