2024-01-13T03:51:26.471 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-13T03:51:26.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T03:51:26.616 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6136ed5c10>, signals=[15]) 2024-01-13T03:51:26.617 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2024-01-13T03:51:26.617 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T03:51:26.618 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-01-13T03:51:26.647 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2024-01-13T03:51:26.647 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T03:51:26.648 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-01-13T03:51:26.762 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T03:51:26.788 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T03:51:26.810 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of rhel 8.6 2024-01-13T03:51:26.835 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of rhel 8.6 2024-01-13T03:51:27.053 INFO:teuthology.orchestra.console.smithi191:Power off 2024-01-13T03:51:27.054 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T03:51:27.067 INFO:teuthology.orchestra.console.smithi194:Power off 2024-01-13T03:51:27.067 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T03:51:27.078 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-01-13T03:51:27.078 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:51:27.088 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-01-13T03:51:27.089 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:51:27.101 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-01-13T03:51:27.111 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-01-13T03:51:31.107 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:51:31.114 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:51:31.216 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-01-13T03:51:31.222 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-01-13T03:51:35.220 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:51:35.227 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:51:35.329 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-01-13T03:51:35.336 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-13T03:51:35.431 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-01-13T03:51:35.437 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-01-13T03:51:35.532 INFO:teuthology.orchestra.console.smithi191:Power on 2024-01-13T03:51:35.532 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T03:51:35.540 INFO:teuthology.orchestra.console.smithi194:Power on 2024-01-13T03:51:35.540 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T03:51:35.557 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2024-01-13T03:51:35.558 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:51:35.567 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2024-01-13T03:51:35.567 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:51:35.579 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-01-13T03:51:35.588 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-13T03:51:39.584 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:51:39.591 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:51:39.693 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-01-13T03:51:39.699 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-13T03:51:39.795 INFO:teuthology.orchestra.console.smithi191:Power on completed 2024-01-13T03:51:39.895 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2024-01-13T03:51:43.704 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T03:51:43.813 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-01-13T03:51:43.913 INFO:teuthology.orchestra.console.smithi194:Power on completed 2024-01-13T03:51:44.014 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2024-01-13T03:54:25.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:54:28.860 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-01-13T03:54:29.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:54:32.992 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-13T03:54:34.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:54:37.916 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-01-13T03:54:38.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:54:42.044 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-13T03:54:43.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:54:46.972 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-01-13T03:54:48.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:54:51.100 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-13T03:54:52.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:54:56.028 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-01-13T03:54:57.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:55:00.160 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-13T03:55:02.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:55:05.088 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-01-13T03:55:06.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:55:09.212 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-01-13T03:55:11.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:55:14.140 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-01-13T03:55:15.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:55:20.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:56:15.269 WARNING:teuthology.provision.fog.smithi194:timed out 2024-01-13T03:56:20.152 WARNING:teuthology.provision.fog.smithi191:timed out 2024-01-13T03:56:21.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:56:21.514 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T03:56:21.514 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T03:56:21.783 INFO:teuthology.provision.fog.smithi194:Node is ready 2024-01-13T03:56:21.784 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2024-01-13T03:56:21.802 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194 2024-01-13T03:56:21.802 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194 /etc/hosts 2024-01-13T03:56:21.860 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2024-01-13T03:56:21.861 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-01-13T03:56:21.977 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194/smithi194/g' /etc/hosts 2024-01-13T03:56:22.007 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2024-01-13T03:56:22.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194/smithi194/g' /etc/hostname 2024-01-13T03:56:22.145 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-01-13T03:56:22.213 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-01-13T03:56:22.270 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T03:56:22.271 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T03:56:22.271 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2024-01-13T03:56:22.271 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2024-01-13T03:56:22.271 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6" 2024-01-13T03:56:22.271 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2024-01-13T03:56:22.271 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T03:56:22.271 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-01-13T03:56:22.271 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T03:56:22.271 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T03:56:22.271 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T03:56:22.271 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T03:56:22.272 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-01-13T03:56:22.272 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T03:56:22.272 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T03:56:22.272 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T03:56:22.272 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T03:56:22.272 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2024-01-13T03:56:22.274 DEBUG:teuthology.parallel:result is None 2024-01-13T03:56:26.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:56:26.375 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T03:56:26.376 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T03:56:26.615 INFO:teuthology.provision.fog.smithi191:Node is ready 2024-01-13T03:56:26.616 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2024-01-13T03:56:26.672 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191 2024-01-13T03:56:26.673 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191 /etc/hosts 2024-01-13T03:56:26.729 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2024-01-13T03:56:26.730 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-01-13T03:56:26.853 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191/smithi191/g' /etc/hosts 2024-01-13T03:56:26.880 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2024-01-13T03:56:26.947 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191/smithi191/g' /etc/hostname 2024-01-13T03:56:27.014 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-01-13T03:56:27.081 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-01-13T03:56:27.139 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T03:56:27.139 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T03:56:27.139 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2024-01-13T03:56:27.139 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2024-01-13T03:56:27.139 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6" 2024-01-13T03:56:27.140 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2024-01-13T03:56:27.140 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T03:56:27.140 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-01-13T03:56:27.140 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T03:56:27.140 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T03:56:27.141 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T03:56:27.141 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T03:56:27.141 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-13T03:56:27.141 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T03:56:27.141 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T03:56:27.141 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T03:56:27.142 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T03:56:27.142 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2024-01-13T03:56:27.143 DEBUG:teuthology.parallel:result is None 2024-01-13T03:56:27.295 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2024-01-13T03:56:27.296 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T03:56:27.323 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2024-01-13T03:56:27.323 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T03:56:27.349 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2024-01-13T03:56:27.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-01-13T03:56:27.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:56:27.422 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-01-13T03:56:27.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-01-13T03:56:27.489 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-01-13T03:56:27.545 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-01-13T03:56:27.545 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-01-13T03:56:27.602 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T03:56:27.602 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T03:56:27.602 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2024-01-13T03:56:27.602 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2024-01-13T03:56:27.602 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6" 2024-01-13T03:56:27.602 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2024-01-13T03:56:27.602 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T03:56:27.602 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-01-13T03:56:27.603 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T03:56:27.603 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T03:56:27.603 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T03:56:27.603 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T03:56:27.603 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-13T03:56:27.603 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T03:56:27.603 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T03:56:27.603 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T03:56:27.603 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T03:56:27.604 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-01-13T03:56:27.622 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2024-01-13T03:56:27.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-01-13T03:56:27.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T03:56:27.696 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-01-13T03:56:27.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-01-13T03:56:27.772 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-01-13T03:56:27.834 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-01-13T03:56:27.834 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-01-13T03:56:27.894 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T03:56:27.894 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T03:56:27.895 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2024-01-13T03:56:27.895 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2024-01-13T03:56:27.895 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6" 2024-01-13T03:56:27.895 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2024-01-13T03:56:27.895 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T03:56:27.895 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-01-13T03:56:27.895 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T03:56:27.895 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T03:56:27.895 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T03:56:27.896 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T03:56:27.896 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-01-13T03:56:27.896 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T03:56:27.896 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T03:56:27.896 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T03:56:27.896 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T03:56:27.897 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-01-13T03:56:27.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T03:56:28.035 INFO:teuthology.dispatcher.supervisor:Running job 7515127 2024-01-13T03:56:28.035 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515127 --name yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi --description rados/upgrade/parallel/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515127/orig.config.yaml 2024-01-13T03:56:28.038 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515127 2024-01-13T03:56:28.038 INFO:teuthology.dispatcher.supervisor:Job PID: 2037247 2024-01-13T03:56:28.038 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-13T03:58:28.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:00:28.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:02:28.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:04:28.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:06:28.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:08:28.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:10:29.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:12:29.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:14:29.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:16:29.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:18:29.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:20:29.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:22:30.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:24:30.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:26:30.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:28:30.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:30:30.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:30:30.857 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-13T04:30:30.969 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-13T04:30:30.969 INFO:teuthology.nuke:Checking targets against current locks 2024-01-13T04:30:31.019 DEBUG:teuthology.nuke:shortname: smithi191 2024-01-13T04:30:31.020 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T04:30:31.040 DEBUG:teuthology.nuke:shortname: smithi194 2024-01-13T04:30:31.040 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T04:30:31.043 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515127', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 03:51:25.395741', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFbsrEJE/v9957W2qcJox4k0uvdAt1iV/6jIksZfWUrYKXFdboakfZJpHynMzxlgPyIaLl3ZKtmQE1ldxoGG98s='} 2024-01-13T04:30:31.068 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515127', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 03:51:25.393775', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP6tx2UUX/8Hb8nLbISyRyKOAR5i9EoPMpagcLBwUUuUreYrqzQKzvoFDIFP1FtPOY1/13JBnxWGK4vV3e+esPw='} 2024-01-13T04:30:31.094 INFO:teuthology.orchestra.console.smithi191:Power off 2024-01-13T04:30:31.094 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T04:30:31.116 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-01-13T04:30:31.116 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:30:31.135 INFO:teuthology.orchestra.console.smithi194:Power off 2024-01-13T04:30:31.135 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T04:30:31.145 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-01-13T04:30:31.157 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-01-13T04:30:31.158 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:30:31.179 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-01-13T04:30:31.246 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-01-13T04:30:31.280 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-01-13T04:30:31.395 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com 2024-01-13T04:30:31.420 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com