2023-12-01T16:55:10.355 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-01T16:55:10.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T16:55:10.534 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6229ebf550>, signals=[15]) 2023-12-01T16:55:10.535 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2023-12-01T16:55:10.535 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T16:55:10.535 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-12-01T16:55:10.558 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-12-01T16:55:10.558 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T16:55:10.558 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-12-01T16:55:10.582 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-12-01T16:55:10.582 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T16:55:10.583 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-12-01T16:55:10.676 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-01T16:55:10.687 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-01T16:55:10.721 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-01T16:55:10.727 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.6 2023-12-01T16:55:10.735 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of rhel 8.6 2023-12-01T16:55:10.776 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of rhel 8.6 2023-12-01T16:55:11.028 INFO:teuthology.orchestra.console.smithi191:Power off 2023-12-01T16:55:11.029 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T16:55:11.051 INFO:teuthology.orchestra.console.smithi078:Power off 2023-12-01T16:55:11.051 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T16:55:11.075 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-12-01T16:55:11.075 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:11.089 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-12-01T16:55:11.090 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:11.112 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-01T16:55:11.112 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T16:55:11.126 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-12-01T16:55:11.126 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-12-01T16:55:11.140 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-01T16:55:11.140 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:11.166 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-01T16:55:15.130 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:15.138 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:15.167 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:15.240 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-12-01T16:55:15.246 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-12-01T16:55:15.276 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-01T16:55:19.244 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:19.251 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:19.277 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:19.353 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-12-01T16:55:19.362 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-12-01T16:55:19.386 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-01T16:55:23.354 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:23.362 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:23.387 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:23.464 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-12-01T16:55:23.472 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-12-01T16:55:23.496 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-01T16:55:23.565 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-12-01T16:55:23.573 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-12-01T16:55:23.597 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-01T16:55:23.667 INFO:teuthology.orchestra.console.smithi078:Power on 2023-12-01T16:55:23.667 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T16:55:23.675 INFO:teuthology.orchestra.console.smithi191:Power on 2023-12-01T16:55:23.675 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T16:55:23.691 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On 2023-12-01T16:55:23.691 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:23.700 INFO:teuthology.orchestra.console.smithi195:Power on 2023-12-01T16:55:23.701 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T16:55:23.709 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2023-12-01T16:55:23.709 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:23.718 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-12-01T16:55:23.723 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-12-01T16:55:23.724 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:23.734 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-12-01T16:55:23.751 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-01T16:55:27.722 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:27.736 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:27.752 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:27.832 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-12-01T16:55:27.847 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-12-01T16:55:27.862 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-01T16:55:27.933 INFO:teuthology.orchestra.console.smithi078:Power on completed 2023-12-01T16:55:27.948 INFO:teuthology.orchestra.console.smithi191:Power on completed 2023-12-01T16:55:28.034 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2023-12-01T16:55:28.049 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-12-01T16:55:31.866 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T16:55:31.977 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-01T16:55:32.078 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-12-01T16:55:32.179 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-12-01T16:58:03.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:58:03.236 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-01T16:58:14.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:58:17.154 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-01T16:58:23.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:58:26.214 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-01T16:58:32.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:58:35.266 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-01T16:58:41.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:58:44.326 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-01T16:58:50.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:58:53.378 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-01T16:58:59.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:59:02.434 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-01T16:59:07.242 WARNING:teuthology.provision.fog.smithi195:timed out 2023-12-01T16:59:08.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:59:13.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:59:16.322 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-01T16:59:22.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:59:25.378 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-01T16:59:31.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:59:34.434 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-01T16:59:40.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T16:59:40.768 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T16:59:40.769 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T16:59:41.089 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-12-01T16:59:41.089 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-12-01T16:59:41.106 INFO:teuthology.orchestra.run.smithi195.stdout:smithi022 2023-12-01T16:59:41.106 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi022 /etc/hosts 2023-12-01T16:59:41.163 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-12-01T16:59:41.163 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-12-01T16:59:41.290 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi022/smithi195/g' /etc/hosts 2023-12-01T16:59:41.317 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.22/172.21.15.195/g' /etc/hosts 2023-12-01T16:59:41.384 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi022/smithi195/g' /etc/hostname 2023-12-01T16:59:41.450 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-12-01T16:59:41.517 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-12-01T16:59:41.573 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T16:59:41.574 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T16:59:41.574 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-12-01T16:59:41.574 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-12-01T16:59:41.574 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2023-12-01T16:59:41.575 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-12-01T16:59:41.575 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T16:59:41.575 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-12-01T16:59:41.575 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T16:59:41.575 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T16:59:41.575 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T16:59:41.575 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T16:59:41.575 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-01T16:59:41.575 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T16:59:41.576 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T16:59:41.576 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T16:59:41.576 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T16:59:41.576 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-12-01T16:59:41.578 DEBUG:teuthology.parallel:result is None 2023-12-01T16:59:59.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:00:02.694 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-12-01T17:00:08.439 WARNING:teuthology.provision.fog.smithi078:timed out 2023-12-01T17:00:08.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:00:11.750 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-12-01T17:00:14.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:00:14.774 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T17:00:14.775 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T17:00:15.063 INFO:teuthology.provision.fog.smithi078:Node is ready 2023-12-01T17:00:15.063 DEBUG:teuthology.orchestra.run.smithi078:> hostname 2023-12-01T17:00:15.082 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078 2023-12-01T17:00:15.083 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078 /etc/hosts 2023-12-01T17:00:15.143 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2023-12-01T17:00:15.143 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-12-01T17:00:15.266 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078/smithi078/g' /etc/hosts 2023-12-01T17:00:15.300 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts 2023-12-01T17:00:15.373 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078/smithi078/g' /etc/hostname 2023-12-01T17:00:15.446 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-12-01T17:00:15.518 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-12-01T17:00:15.578 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T17:00:15.578 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T17:00:15.578 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-12-01T17:00:15.579 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-12-01T17:00:15.579 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6" 2023-12-01T17:00:15.579 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-12-01T17:00:15.579 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T17:00:15.579 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-12-01T17:00:15.579 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T17:00:15.579 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T17:00:15.580 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T17:00:15.580 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T17:00:15.580 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-01T17:00:15.580 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T17:00:15.581 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T17:00:15.581 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T17:00:15.581 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T17:00:15.581 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2023-12-01T17:00:15.582 DEBUG:teuthology.parallel:result is None 2023-12-01T17:00:17.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:00:20.809 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-12-01T17:00:26.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:00:29.890 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-12-01T17:00:35.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:00:38.946 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-12-01T17:00:44.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:00:48.002 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-12-01T17:00:54.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:00:57.058 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-12-01T17:01:03.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:02:03.063 WARNING:teuthology.provision.fog.smithi191:timed out 2023-12-01T17:02:09.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:02:09.493 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T17:02:09.493 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T17:02:09.790 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-12-01T17:02:09.790 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2023-12-01T17:02:09.807 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191 2023-12-01T17:02:09.807 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191 /etc/hosts 2023-12-01T17:02:09.868 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-12-01T17:02:09.868 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-12-01T17:02:09.995 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191/smithi191/g' /etc/hosts 2023-12-01T17:02:10.022 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2023-12-01T17:02:10.093 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191/smithi191/g' /etc/hostname 2023-12-01T17:02:10.163 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-12-01T17:02:10.232 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-12-01T17:02:10.292 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T17:02:10.292 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T17:02:10.292 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-12-01T17:02:10.292 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-12-01T17:02:10.292 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6" 2023-12-01T17:02:10.292 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-12-01T17:02:10.292 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T17:02:10.292 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-12-01T17:02:10.292 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T17:02:10.292 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T17:02:10.292 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T17:02:10.293 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T17:02:10.293 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-12-01T17:02:10.293 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T17:02:10.293 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T17:02:10.293 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T17:02:10.293 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T17:02:10.293 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-12-01T17:02:10.294 DEBUG:teuthology.parallel:result is None 2023-12-01T17:02:10.480 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2023-12-01T17:02:10.481 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T17:02:10.506 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-12-01T17:02:10.506 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T17:02:10.523 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-12-01T17:02:10.523 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T17:02:10.549 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2023-12-01T17:02:10.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-01T17:02:10.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:02:10.618 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-12-01T17:02:10.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-01T17:02:10.762 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-12-01T17:02:10.823 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-12-01T17:02:10.823 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-12-01T17:02:10.883 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T17:02:10.883 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T17:02:10.883 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-12-01T17:02:10.883 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-12-01T17:02:10.883 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6" 2023-12-01T17:02:10.883 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-12-01T17:02:10.883 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T17:02:10.883 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-12-01T17:02:10.883 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T17:02:10.884 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T17:02:10.884 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T17:02:10.884 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T17:02:10.884 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-01T17:02:10.884 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T17:02:10.884 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T17:02:10.884 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T17:02:10.884 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T17:02:10.885 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-12-01T17:02:10.906 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-12-01T17:02:10.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-12-01T17:02:10.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:02:10.973 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-12-01T17:02:11.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-12-01T17:02:11.043 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-12-01T17:02:11.100 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-12-01T17:02:11.101 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-12-01T17:02:11.158 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T17:02:11.158 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T17:02:11.158 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-12-01T17:02:11.158 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-12-01T17:02:11.158 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6" 2023-12-01T17:02:11.158 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-12-01T17:02:11.158 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T17:02:11.158 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-12-01T17:02:11.158 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T17:02:11.159 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T17:02:11.159 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T17:02:11.159 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T17:02:11.159 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-12-01T17:02:11.159 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T17:02:11.159 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T17:02:11.159 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T17:02:11.159 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T17:02:11.160 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-12-01T17:02:11.181 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-12-01T17:02:11.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-01T17:02:11.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:02:11.248 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-12-01T17:02:11.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-01T17:02:11.384 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-12-01T17:02:11.441 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-12-01T17:02:11.442 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-12-01T17:02:11.498 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T17:02:11.498 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T17:02:11.498 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T17:02:11.499 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T17:02:11.500 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T17:02:11.500 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-12-01T17:02:11.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:02:11.608 INFO:teuthology.dispatcher.supervisor:Running job 7473843 2023-12-01T17:02:11.608 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-01_15:09:25-rados-wip-neorados-learning-from-experience-distro-default-smithi/7473843 --name yuriw-2023-12-01_15:09:25-rados-wip-neorados-learning-from-experience-distro-default-smithi --description rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_set_mon_crush_locations} -- /home/teuthworker/archive/yuriw-2023-12-01_15:09:25-rados-wip-neorados-learning-from-experience-distro-default-smithi/7473843/orig.config.yaml 2023-12-01T17:02:11.611 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-01_15:09:25-rados-wip-neorados-learning-from-experience-distro-default-smithi/7473843 2023-12-01T17:02:11.612 INFO:teuthology.dispatcher.supervisor:Job PID: 2921435 2023-12-01T17:02:11.612 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-01T17:04:11.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:06:11.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:08:11.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:10:11.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:12:11.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:14:11.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:16:12.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:16:12.146 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-01T17:16:12.262 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-01T17:16:12.262 INFO:teuthology.nuke:Checking targets against current locks 2023-12-01T17:16:12.309 DEBUG:teuthology.nuke:shortname: smithi078 2023-12-01T17:16:12.310 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T17:16:12.336 DEBUG:teuthology.nuke:shortname: smithi191 2023-12-01T17:16:12.337 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T17:16:12.341 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:09:25-rados-wip-neorados-learning-from-experience-distro-default-smithi/7473843', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 16:55:09.468725', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-01T17:16:12.365 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:09:25-rados-wip-neorados-learning-from-experience-distro-default-smithi/7473843', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 16:55:09.466958', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-01T17:16:12.370 DEBUG:teuthology.nuke:shortname: smithi195 2023-12-01T17:16:12.370 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T17:16:12.397 INFO:teuthology.orchestra.console.smithi078:Power off 2023-12-01T17:16:12.398 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T17:16:12.409 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:09:25-rados-wip-neorados-learning-from-experience-distro-default-smithi/7473843', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 16:55:09.469946', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-01T17:16:12.421 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-12-01T17:16:12.421 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T17:16:12.441 INFO:teuthology.orchestra.console.smithi191:Power off 2023-12-01T17:16:12.441 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T17:16:12.454 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-12-01T17:16:12.465 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-12-01T17:16:12.465 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T17:16:12.486 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-01T17:16:12.486 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T17:16:12.495 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-12-01T17:16:12.510 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-01T17:16:12.510 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T17:16:12.538 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-01T17:16:12.555 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-12-01T17:16:12.596 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-12-01T17:16:12.639 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-01T17:16:12.712 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2023-12-01T17:16:12.745 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com 2023-12-01T17:16:12.786 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com