2023-11-30T22:22:09.298 INFO:root:teuthology version: 0.0.1.dev212+g595fad1 2023-11-30T22:22:09.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:22:09.448 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1dab7d2550>, signals=[15]) 2023-11-30T22:22:09.448 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2023-11-30T22:22:09.449 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2023-11-30T22:22:09.449 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-11-30T22:22:09.467 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-11-30T22:22:09.467 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-11-30T22:22:09.467 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-11-30T22:22:09.601 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_rhel_8.4 (ID 7) 2023-11-30T22:22:09.609 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_rhel_8.4 (ID 7) 2023-11-30T22:22:09.641 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of rhel 8.4 2023-11-30T22:22:09.652 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.4 2023-11-30T22:22:09.910 INFO:teuthology.orchestra.console.smithi115:Power off 2023-11-30T22:22:09.910 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T22:22:09.925 INFO:teuthology.orchestra.console.smithi132:Power off 2023-11-30T22:22:09.925 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T22:22:09.934 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-11-30T22:22:09.935 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:22:09.948 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-11-30T22:22:09.949 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:22:09.957 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-11-30T22:22:09.968 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-30T22:22:10.059 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-11-30T22:22:10.069 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-11-30T22:22:10.160 INFO:teuthology.orchestra.console.smithi115:Power on 2023-11-30T22:22:10.160 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-30T22:22:10.170 INFO:teuthology.orchestra.console.smithi132:Power on 2023-11-30T22:22:10.170 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-30T22:22:10.185 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2023-11-30T22:22:10.185 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:22:10.194 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2023-11-30T22:22:10.195 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:22:10.210 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-11-30T22:22:10.221 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-30T22:22:14.214 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:22:14.222 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:22:14.323 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2023-11-30T22:22:14.335 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-30T22:22:14.424 INFO:teuthology.orchestra.console.smithi115:Power on completed 2023-11-30T22:22:14.525 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2023-11-30T22:22:18.338 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:22:18.448 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-11-30T22:22:18.549 INFO:teuthology.orchestra.console.smithi132:Power on completed 2023-11-30T22:22:18.649 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-11-30T22:24:49.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:24:52.386 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-30T22:24:58.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:00.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:01.442 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-30T22:25:03.426 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-30T22:25:07.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:09.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:10.498 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-30T22:25:12.482 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-30T22:25:16.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:18.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:19.555 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-30T22:25:21.538 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-30T22:25:25.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:27.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:28.610 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-30T22:25:30.594 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-30T22:25:34.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:36.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:37.670 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-11-30T22:25:39.650 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-30T22:25:43.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:45.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:48.709 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-30T22:25:54.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:25:57.795 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-11-30T22:26:03.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:26:43.714 WARNING:teuthology.provision.fog.smithi132:timed out 2023-11-30T22:26:49.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:26:50.029 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-30T22:26:50.030 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-30T22:26:50.262 INFO:teuthology.provision.fog.smithi132:Node is ready 2023-11-30T22:26:50.262 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2023-11-30T22:26:50.317 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2023-11-30T22:26:50.318 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2023-11-30T22:26:50.372 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2023-11-30T22:26:50.373 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-11-30T22:26:50.476 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2023-11-30T22:26:50.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2023-11-30T22:26:50.565 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2023-11-30T22:26:50.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-11-30T22:26:50.692 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-11-30T22:26:50.746 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2023-11-30T22:26:50.746 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.4 (Ootpa)" 2023-11-30T22:26:50.749 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2023-11-30T22:26:50.749 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2023-11-30T22:26:50.749 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.4" 2023-11-30T22:26:50.749 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-11-30T22:26:50.749 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-30T22:26:50.749 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-11-30T22:26:50.749 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-30T22:26:50.749 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2023-11-30T22:26:50.750 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-30T22:26:50.750 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T22:26:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-30T22:26:50.750 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T22:26:50.750 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-30T22:26:50.750 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-30T22:26:50.750 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-30T22:26:50.751 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2023-11-30T22:26:50.752 DEBUG:teuthology.parallel:result is None 2023-11-30T22:27:03.814 WARNING:teuthology.provision.fog.smithi115:timed out 2023-11-30T22:27:09.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:27:10.208 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-30T22:27:10.208 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-30T22:27:10.473 INFO:teuthology.provision.fog.smithi115:Node is ready 2023-11-30T22:27:10.473 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2023-11-30T22:27:10.488 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115 2023-11-30T22:27:10.489 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115 /etc/hosts 2023-11-30T22:27:10.544 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2023-11-30T22:27:10.544 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-11-30T22:27:10.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115/smithi115/g' /etc/hosts 2023-11-30T22:27:10.690 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2023-11-30T22:27:10.756 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115/smithi115/g' /etc/hostname 2023-11-30T22:27:10.820 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-11-30T22:27:10.884 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-11-30T22:27:10.938 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux" 2023-11-30T22:27:10.939 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.4 (Ootpa)" 2023-11-30T22:27:10.939 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel" 2023-11-30T22:27:10.939 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora" 2023-11-30T22:27:10.939 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.4" 2023-11-30T22:27:10.939 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-11-30T22:27:10.939 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-30T22:27:10.939 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-11-30T22:27:10.939 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-30T22:27:10.939 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/" 2023-11-30T22:27:10.939 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-30T22:27:10.940 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T22:27:10.940 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T22:27:10.940 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T22:27:10.940 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-30T22:27:10.940 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-30T22:27:10.940 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-30T22:27:10.940 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2023-11-30T22:27:10.941 DEBUG:teuthology.parallel:result is None 2023-11-30T22:27:11.092 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2023-11-30T22:27:11.092 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-30T22:27:11.117 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2023-11-30T22:27:11.117 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-30T22:27:11.135 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2023-11-30T22:27:11.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-11-30T22:27:11.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:27:11.201 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-11-30T22:27:11.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-11-30T22:27:11.268 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2023-11-30T22:27:11.321 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-11-30T22:27:11.322 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-11-30T22:27:11.376 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux" 2023-11-30T22:27:11.376 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.4 (Ootpa)" 2023-11-30T22:27:11.376 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel" 2023-11-30T22:27:11.376 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora" 2023-11-30T22:27:11.376 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.4" 2023-11-30T22:27:11.376 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-11-30T22:27:11.376 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-30T22:27:11.376 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-11-30T22:27:11.376 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-30T22:27:11.376 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/" 2023-11-30T22:27:11.377 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-30T22:27:11.377 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T22:27:11.377 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-11-30T22:27:11.377 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T22:27:11.377 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-30T22:27:11.377 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-30T22:27:11.377 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-30T22:27:11.377 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-11-30T22:27:11.401 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2023-11-30T22:27:11.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-30T22:27:11.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-30T22:27:11.466 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-11-30T22:27:11.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-11-30T22:27:11.581 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-11-30T22:27:11.636 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-11-30T22:27:11.636 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-11-30T22:27:11.691 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2023-11-30T22:27:11.691 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.4 (Ootpa)" 2023-11-30T22:27:11.691 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2023-11-30T22:27:11.691 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2023-11-30T22:27:11.691 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.4" 2023-11-30T22:27:11.691 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-11-30T22:27:11.691 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-30T22:27:11.692 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-11-30T22:27:11.692 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-30T22:27:11.692 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2023-11-30T22:27:11.692 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-30T22:27:11.692 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-30T22:27:11.692 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-11-30T22:27:11.692 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-30T22:27:11.692 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-30T22:27:11.692 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-30T22:27:11.692 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-30T22:27:11.693 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-11-30T22:27:11.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:27:11.823 INFO:teuthology.dispatcher.supervisor:Running job 7472687 2023-11-30T22:27:11.824 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_595fad1080bd379e3c0231a8e02595924c59a9da/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472687 --name yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi --description rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} -- /home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472687/orig.config.yaml 2023-11-30T22:27:11.827 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472687 2023-11-30T22:27:11.827 INFO:teuthology.dispatcher.supervisor:Job PID: 2867830 2023-11-30T22:27:11.827 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-30T22:29:11.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:31:12.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:33:12.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:35:12.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:37:12.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:39:12.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:41:12.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:43:13.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:45:13.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:47:16.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:49:16.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-30T22:49:16.365 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-30T22:49:16.463 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-30T22:49:16.464 INFO:teuthology.nuke:Checking targets against current locks 2023-11-30T22:49:16.509 DEBUG:teuthology.nuke:shortname: smithi115 2023-11-30T22:49:16.510 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-30T22:49:16.530 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472687', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 22:22:08.445657', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFuUQ6p9RdVLolveluGY3dO0gKoo2YVZA9t58slgLZmU/4IKjgJV+RAhVHZ1ybBPkO1+rjqfv/paIzn/bD5KstA='} 2023-11-30T22:49:16.535 DEBUG:teuthology.nuke:shortname: smithi132 2023-11-30T22:49:16.536 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-30T22:49:16.561 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_16:00:27-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472687', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-30 22:22:08.443700', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHeTQREcvMrDBLYCOsAokHqXgb7kXcq2B41zJADhgjQQqG/RAJzQ0+UEqIzYN/S/nx4xewIxwtBQmf5rKuTYXKI='} 2023-11-30T22:49:16.589 INFO:teuthology.orchestra.console.smithi115:Power off 2023-11-30T22:49:16.589 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T22:49:16.614 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2023-11-30T22:49:16.615 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:49:16.631 INFO:teuthology.orchestra.console.smithi132:Power off 2023-11-30T22:49:16.631 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-30T22:49:16.641 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2023-11-30T22:49:16.654 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-11-30T22:49:16.655 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-30T22:49:16.678 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-11-30T22:49:16.742 INFO:teuthology.orchestra.console.smithi115:Power off completed 2023-11-30T22:49:16.779 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-11-30T22:49:16.898 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2023-11-30T22:49:16.924 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com