2023-12-11T04:20:45.394 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-11T04:20:45.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T04:20:45.627 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f23f3c5c940>, signals=[15]) 2023-12-11T04:20:45.627 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2023-12-11T04:20:45.627 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2023-12-11T04:20:45.627 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-12-11T04:20:45.649 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2023-12-11T04:20:45.649 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2023-12-11T04:20:45.649 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-12-11T04:20:45.673 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-12-11T04:20:45.674 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-12-11T04:20:45.674 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-12-11T04:20:45.698 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging 2023-12-11T04:20:45.698 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server 2023-12-11T04:20:45.698 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2023-12-11T04:20:45.723 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2023-12-11T04:20:45.723 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2023-12-11T04:20:45.723 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-12-11T04:20:45.754 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-11T04:20:45.784 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-11T04:20:45.795 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of rhel 8.6 2023-12-11T04:20:45.803 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-11T04:20:45.832 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of rhel 8.6 2023-12-11T04:20:45.849 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-11T04:20:45.853 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-11T04:20:45.856 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.6 2023-12-11T04:20:45.910 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of rhel 8.6 2023-12-11T04:20:45.913 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of rhel 8.6 2023-12-11T04:20:46.355 INFO:teuthology.orchestra.console.smithi059:Power off 2023-12-11T04:20:46.355 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T04:20:46.368 INFO:teuthology.orchestra.console.smithi071:Power off 2023-12-11T04:20:46.368 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T04:20:46.379 INFO:teuthology.orchestra.console.smithi072:Power off 2023-12-11T04:20:46.380 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T04:20:46.386 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-12-11T04:20:46.387 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:46.393 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2023-12-11T04:20:46.393 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:46.401 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-12-11T04:20:46.401 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:46.408 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-12-11T04:20:46.415 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-12-11T04:20:46.423 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-12-11T04:20:46.487 INFO:teuthology.orchestra.console.smithi163:Power off 2023-12-11T04:20:46.487 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T04:20:46.502 INFO:teuthology.orchestra.console.smithi113:Power off 2023-12-11T04:20:46.502 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T04:20:46.510 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-12-11T04:20:46.511 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-12-11T04:20:46.511 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:46.517 INFO:teuthology.orchestra.console.smithi071:Power off completed 2023-12-11T04:20:46.523 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2023-12-11T04:20:46.523 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:46.532 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-12-11T04:20:46.546 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-11T04:20:46.610 INFO:teuthology.orchestra.console.smithi059:Power on 2023-12-11T04:20:46.611 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-11T04:20:46.618 INFO:teuthology.orchestra.console.smithi071:Power on 2023-12-11T04:20:46.618 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-11T04:20:46.631 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2023-12-11T04:20:46.632 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:46.639 DEBUG:teuthology.orchestra.console.smithi071:power on output: Chassis Power Control: Up/On 2023-12-11T04:20:46.640 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:46.653 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-12-11T04:20:46.659 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-12-11T04:20:50.427 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:50.533 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:50.542 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-12-11T04:20:50.547 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:50.641 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-12-11T04:20:50.653 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:50.660 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:50.666 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-11T04:20:50.761 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-12-11T04:20:50.767 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-12-11T04:20:50.863 INFO:teuthology.orchestra.console.smithi059:Power on completed 2023-12-11T04:20:50.868 INFO:teuthology.orchestra.console.smithi071:Power on completed 2023-12-11T04:20:50.964 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2023-12-11T04:20:50.969 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2023-12-11T04:20:54.546 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:54.642 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:54.655 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-12-11T04:20:54.667 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:54.751 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-12-11T04:20:54.756 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-12-11T04:20:54.776 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-11T04:20:54.857 INFO:teuthology.orchestra.console.smithi072:Power on 2023-12-11T04:20:54.858 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-11T04:20:54.877 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2023-12-11T04:20:54.877 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:54.899 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-12-11T04:20:58.756 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:58.777 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:58.864 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-12-11T04:20:58.886 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-11T04:20:58.900 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:58.966 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-12-11T04:20:58.987 INFO:teuthology.orchestra.console.smithi113:Power off completed 2023-12-11T04:20:59.008 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-12-11T04:20:59.067 INFO:teuthology.orchestra.console.smithi163:Power on 2023-12-11T04:20:59.067 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-11T04:20:59.087 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2023-12-11T04:20:59.087 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:59.093 INFO:teuthology.orchestra.console.smithi113:Power on 2023-12-11T04:20:59.093 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-11T04:20:59.106 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-12-11T04:20:59.112 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On 2023-12-11T04:20:59.112 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:20:59.131 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-11T04:21:03.012 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:21:03.106 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:21:03.121 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-12-11T04:21:03.132 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:21:03.214 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-12-11T04:21:03.221 INFO:teuthology.orchestra.console.smithi072:Power on completed 2023-12-11T04:21:03.239 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-11T04:21:03.315 INFO:teuthology.orchestra.console.smithi163:Power on completed 2023-12-11T04:21:03.323 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-12-11T04:21:03.416 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2023-12-11T04:21:07.241 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:21:07.349 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-11T04:21:07.450 INFO:teuthology.orchestra.console.smithi113:Power on completed 2023-12-11T04:21:07.550 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish 2023-12-11T04:23:48.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:24:07.010 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-12-11T04:24:13.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:24:16.066 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-12-11T04:24:22.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:24:25.122 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-12-11T04:24:31.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:25:31.132 WARNING:teuthology.provision.fog.smithi059:timed out 2023-12-11T04:25:37.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:25:37.383 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-11T04:25:37.383 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-11T04:25:37.680 INFO:teuthology.provision.fog.smithi059:Node is ready 2023-12-11T04:25:37.681 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2023-12-11T04:25:37.699 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2023-12-11T04:25:37.699 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2023-12-11T04:25:37.757 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2023-12-11T04:25:37.758 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-12-11T04:25:37.875 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2023-12-11T04:25:37.903 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2023-12-11T04:25:37.971 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2023-12-11T04:25:38.039 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-12-11T04:25:38.106 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-12-11T04:25:38.163 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T04:25:38.163 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T04:25:38.163 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2023-12-11T04:25:38.163 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2023-12-11T04:25:38.163 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.6" 2023-12-11T04:25:38.163 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-12-11T04:25:38.163 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T04:25:38.163 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-12-11T04:25:38.164 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T04:25:38.164 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T04:25:38.164 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T04:25:38.164 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T04:25:38.164 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-12-11T04:25:38.164 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T04:25:38.164 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T04:25:38.165 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T04:25:38.165 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T04:25:38.165 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2023-12-11T04:25:38.166 DEBUG:teuthology.parallel:result is None 2023-12-11T04:26:03.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:26:06.150 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-11T04:26:12.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:26:15.238 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-11T04:26:21.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:26:24.322 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-11T04:26:30.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:26:33.378 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-11T04:26:39.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:26:42.434 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-11T04:26:48.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:26:51.490 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-11T04:26:57.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:27:15.942 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-11T04:27:21.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:27:25.026 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-11T04:27:31.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:27:34.082 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-12-11T04:27:40.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:27:40.415 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-11T04:27:40.415 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-11T04:27:40.677 INFO:teuthology.provision.fog.smithi071:Node is ready 2023-12-11T04:27:40.678 DEBUG:teuthology.orchestra.run.smithi071:> hostname 2023-12-11T04:27:40.693 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2023-12-11T04:27:40.693 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi071.front.sepia.ceph.com /etc/hosts 2023-12-11T04:27:40.749 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2023-12-11T04:27:40.750 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-12-11T04:27:40.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hosts 2023-12-11T04:27:40.906 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.71/172.21.15.71/g' /etc/hosts 2023-12-11T04:27:40.972 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hostname 2023-12-11T04:27:41.038 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-12-11T04:27:41.103 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-12-11T04:27:41.159 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T04:27:41.159 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T04:27:41.159 INFO:teuthology.orchestra.run.smithi071.stdout:ID="rhel" 2023-12-11T04:27:41.159 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="fedora" 2023-12-11T04:27:41.159 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8.6" 2023-12-11T04:27:41.159 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-12-11T04:27:41.159 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T04:27:41.159 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-12-11T04:27:41.159 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T04:27:41.159 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T04:27:41.160 INFO:teuthology.orchestra.run.smithi071.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T04:27:41.160 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T04:27:41.160 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-12-11T04:27:41.160 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T04:27:41.160 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T04:27:41.160 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T04:27:41.160 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T04:27:41.160 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2023-12-11T04:27:41.161 DEBUG:teuthology.parallel:result is None 2023-12-11T04:28:18.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:28:33.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:28:36.322 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-11T04:28:42.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:28:45.378 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-11T04:28:51.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:28:54.439 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-11T04:29:00.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:29:03.522 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-11T04:29:09.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:29:12.578 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-12-11T04:29:18.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:29:49.039 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2023-12-11T04:30:06.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:30:09.858 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-11T04:30:11.554 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-12-11T04:30:15.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:30:17.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:30:18.582 WARNING:teuthology.provision.fog.smithi072:timed out 2023-12-11T04:30:18.914 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-11T04:30:20.611 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-12-11T04:30:24.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:30:24.909 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-11T04:30:24.909 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-11T04:30:24.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:30:25.250 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-12-11T04:30:25.250 DEBUG:teuthology.orchestra.run.smithi072:> hostname 2023-12-11T04:30:25.269 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2023-12-11T04:30:25.269 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts 2023-12-11T04:30:25.328 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2023-12-11T04:30:25.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-12-11T04:30:25.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts 2023-12-11T04:30:25.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2023-12-11T04:30:25.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname 2023-12-11T04:30:25.678 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-12-11T04:30:25.744 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-12-11T04:30:25.801 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T04:30:25.801 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T04:30:25.802 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2023-12-11T04:30:25.802 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2023-12-11T04:30:25.802 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6" 2023-12-11T04:30:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-12-11T04:30:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T04:30:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-12-11T04:30:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T04:30:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T04:30:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T04:30:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T04:30:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-11T04:30:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T04:30:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T04:30:25.807 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T04:30:25.807 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T04:30:25.807 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-12-11T04:30:25.807 DEBUG:teuthology.parallel:result is None 2023-12-11T04:30:26.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:30:26.707 ERROR:paramiko.transport:Unknown exception: The socket has already been closed by another greenlet 2023-12-11T04:30:26.709 ERROR:paramiko.transport:Traceback (most recent call last): 2023-12-11T04:30:26.709 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2110, in run 2023-12-11T04:30:26.709 ERROR:paramiko.transport: ptype, m = self.packetizer.read_message() 2023-12-11T04:30:26.709 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message 2023-12-11T04:30:26.709 ERROR:paramiko.transport: header = self.read_all(self.__block_size_in, check_rekey=True) 2023-12-11T04:30:26.709 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all 2023-12-11T04:30:26.709 ERROR:paramiko.transport: x = self.__socket.recv(n) 2023-12-11T04:30:26.709 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 663, in recv 2023-12-11T04:30:26.709 ERROR:paramiko.transport: self._wait(self._read_event) 2023-12-11T04:30:26.709 ERROR:paramiko.transport: File "src/gevent/_hub_primitives.py", line 317, in gevent._gevent_c_hub_primitives.wait_on_socket 2023-12-11T04:30:26.709 ERROR:paramiko.transport: File "src/gevent/_hub_primitives.py", line 321, in gevent._gevent_c_hub_primitives.wait_on_socket 2023-12-11T04:30:26.710 ERROR:paramiko.transport:gevent.exceptions.ConcurrentObjectUseError: The socket has already been closed by another greenlet 2023-12-11T04:30:26.710 ERROR:paramiko.transport: 2023-12-11T04:30:26.956 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-11T04:30:26.956 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-11T04:30:27.271 INFO:teuthology.provision.fog.smithi163:Node is ready 2023-12-11T04:30:27.272 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2023-12-11T04:30:27.288 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2023-12-11T04:30:27.289 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts 2023-12-11T04:30:27.346 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2023-12-11T04:30:27.347 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-12-11T04:30:27.455 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts 2023-12-11T04:30:27.482 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2023-12-11T04:30:27.548 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname 2023-12-11T04:30:27.616 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-12-11T04:30:27.682 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-12-11T04:30:27.738 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T04:30:27.738 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T04:30:27.738 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel" 2023-12-11T04:30:27.738 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora" 2023-12-11T04:30:27.738 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.6" 2023-12-11T04:30:27.738 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2023-12-11T04:30:27.738 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T04:30:27.738 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-12-11T04:30:27.738 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T04:30:27.739 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T04:30:27.739 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T04:30:27.739 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T04:30:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-12-11T04:30:27.739 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T04:30:27.739 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T04:30:27.740 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T04:30:27.740 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T04:30:27.741 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2023-12-11T04:30:27.741 DEBUG:teuthology.parallel:result is None 2023-12-11T04:30:27.970 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-11T04:30:33.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:30:37.030 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-11T04:30:43.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:30:46.082 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-11T04:30:52.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:30:55.138 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-11T04:31:01.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:31:03.266 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-12-11T04:31:04.194 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-11T04:31:10.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:31:13.254 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-11T04:31:19.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:32:19.323 WARNING:teuthology.provision.fog.smithi113:timed out 2023-12-11T04:32:25.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:32:25.661 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-11T04:32:25.661 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-11T04:32:25.967 INFO:teuthology.provision.fog.smithi113:Node is ready 2023-12-11T04:32:25.968 DEBUG:teuthology.orchestra.run.smithi113:> hostname 2023-12-11T04:32:25.989 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113 2023-12-11T04:32:25.990 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113 /etc/hosts 2023-12-11T04:32:26.048 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113 2023-12-11T04:32:26.048 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2023-12-11T04:32:26.174 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113/smithi113/g' /etc/hosts 2023-12-11T04:32:26.202 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts 2023-12-11T04:32:26.270 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113/smithi113/g' /etc/hostname 2023-12-11T04:32:26.337 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2023-12-11T04:32:26.404 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2023-12-11T04:32:26.467 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T04:32:26.467 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T04:32:26.467 INFO:teuthology.orchestra.run.smithi113.stdout:ID="rhel" 2023-12-11T04:32:26.467 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="fedora" 2023-12-11T04:32:26.467 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8.6" 2023-12-11T04:32:26.467 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8" 2023-12-11T04:32:26.467 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T04:32:26.467 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2023-12-11T04:32:26.467 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T04:32:26.468 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T04:32:26.468 INFO:teuthology.orchestra.run.smithi113.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T04:32:26.468 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T04:32:26.468 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-11T04:32:26.468 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T04:32:26.468 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T04:32:26.468 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T04:32:26.468 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T04:32:26.468 INFO:teuthology.provision.fog.smithi113:Deploy complete! 2023-12-11T04:32:26.469 DEBUG:teuthology.parallel:result is None 2023-12-11T04:32:26.770 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2023-12-11T04:32:26.845 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-11T04:32:26.871 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2023-12-11T04:32:26.871 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-11T04:32:26.887 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-12-11T04:32:26.887 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-11T04:32:26.904 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com 2023-12-11T04:32:26.904 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-11T04:32:26.929 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2023-12-11T04:32:26.929 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-11T04:32:26.947 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2023-12-11T04:32:26.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-12-11T04:32:26.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:32:27.022 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-12-11T04:32:27.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-12-11T04:32:27.161 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-12-11T04:32:27.220 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-12-11T04:32:27.220 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-12-11T04:32:27.278 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T04:32:27.278 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T04:32:27.278 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.6" 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T04:32:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T04:32:27.280 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T04:32:27.280 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-12-11T04:32:27.305 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2023-12-11T04:32:27.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-12-11T04:32:27.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:32:27.375 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-12-11T04:32:27.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-12-11T04:32:27.514 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2023-12-11T04:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2023-12-11T04:32:27.575 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-12-11T04:32:27.632 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T04:32:27.632 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T04:32:27.632 INFO:teuthology.orchestra.run.smithi071.stdout:ID="rhel" 2023-12-11T04:32:27.632 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="fedora" 2023-12-11T04:32:27.632 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8.6" 2023-12-11T04:32:27.632 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-12-11T04:32:27.634 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T04:32:27.634 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-12-11T04:32:27.634 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T04:32:27.634 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T04:32:27.634 INFO:teuthology.orchestra.run.smithi071.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T04:32:27.634 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T04:32:27.634 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-12-11T04:32:27.634 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T04:32:27.634 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T04:32:27.634 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T04:32:27.635 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T04:32:27.635 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-12-11T04:32:27.662 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-12-11T04:32:27.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-12-11T04:32:27.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:32:27.771 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-12-11T04:32:27.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-12-11T04:32:27.900 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-12-11T04:32:27.958 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-12-11T04:32:27.959 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-12-11T04:32:28.015 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T04:32:28.016 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T04:32:28.016 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2023-12-11T04:32:28.016 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2023-12-11T04:32:28.016 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6" 2023-12-11T04:32:28.016 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-12-11T04:32:28.016 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T04:32:28.016 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-12-11T04:32:28.016 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T04:32:28.016 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T04:32:28.016 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T04:32:28.016 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T04:32:28.017 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-12-11T04:32:28.017 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T04:32:28.017 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T04:32:28.017 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T04:32:28.019 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T04:32:28.020 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-12-11T04:32:28.054 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server 2023-12-11T04:32:28.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-11T04:32:28.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:32:28.123 DEBUG:teuthology.orchestra.run.smithi113:> true 2023-12-11T04:32:28.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-11T04:32:28.198 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2023-12-11T04:32:28.257 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2023-12-11T04:32:28.258 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2023-12-11T04:32:28.323 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T04:32:28.323 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T04:32:28.323 INFO:teuthology.orchestra.run.smithi113.stdout:ID="rhel" 2023-12-11T04:32:28.323 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="fedora" 2023-12-11T04:32:28.323 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8.6" 2023-12-11T04:32:28.323 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8" 2023-12-11T04:32:28.323 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T04:32:28.323 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2023-12-11T04:32:28.323 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T04:32:28.324 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T04:32:28.324 INFO:teuthology.orchestra.run.smithi113.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T04:32:28.324 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T04:32:28.324 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-11T04:32:28.324 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T04:32:28.324 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T04:32:28.324 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T04:32:28.324 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T04:32:28.325 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2023-12-11T04:32:28.354 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2023-12-11T04:32:28.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-12-11T04:32:28.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T04:32:28.422 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-12-11T04:32:28.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-12-11T04:32:28.560 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-12-11T04:32:28.620 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-12-11T04:32:28.620 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-12-11T04:32:28.678 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T04:32:28.678 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T04:32:28.679 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel" 2023-12-11T04:32:28.679 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora" 2023-12-11T04:32:28.679 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.6" 2023-12-11T04:32:28.679 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2023-12-11T04:32:28.679 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T04:32:28.679 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-12-11T04:32:28.679 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T04:32:28.679 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T04:32:28.679 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T04:32:28.679 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T04:32:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-12-11T04:32:28.679 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T04:32:28.680 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T04:32:28.680 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T04:32:28.680 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T04:32:28.680 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-12-11T04:32:28.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T04:32:28.802 INFO:teuthology.dispatcher.supervisor:Running job 7486570 2023-12-11T04:32:28.803 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-12-11_04:19:36-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486570 --name adking-2023-12-11_04:19:36-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi --description orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} -- /home/teuthworker/archive/adking-2023-12-11_04:19:36-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486570/orig.config.yaml 2023-12-11T04:32:28.809 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-12-11_04:19:36-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486570 2023-12-11T04:32:28.809 INFO:teuthology.dispatcher.supervisor:Job PID: 1283310 2023-12-11T04:32:28.809 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-11T04:34:28.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T04:36:29.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T04:38:29.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T04:40:29.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T04:42:29.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T04:44:29.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T04:46:30.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T04:48:30.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T04:50:30.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T04:52:30.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T04:52:30.578 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-11T04:52:30.733 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-11T04:52:30.733 INFO:teuthology.nuke:Checking targets against current locks 2023-12-11T04:52:30.784 DEBUG:teuthology.nuke:shortname: smithi059 2023-12-11T04:52:30.784 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T04:52:30.805 DEBUG:teuthology.nuke:shortname: smithi071 2023-12-11T04:52:30.806 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T04:52:30.808 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-11_04:19:36-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 04:20:44.506895', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T04:52:30.825 DEBUG:teuthology.nuke:shortname: smithi072 2023-12-11T04:52:30.825 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T04:52:30.829 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-11_04:19:36-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 04:20:44.509493', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T04:52:30.844 DEBUG:teuthology.nuke:shortname: smithi113 2023-12-11T04:52:30.845 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T04:52:30.849 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-11_04:19:36-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 04:20:44.508286', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T04:52:30.858 INFO:teuthology.orchestra.console.smithi059:Power off 2023-12-11T04:52:30.858 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T04:52:30.870 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-11_04:19:36-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 04:20:44.510646', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T04:52:30.871 DEBUG:teuthology.nuke:shortname: smithi163 2023-12-11T04:52:30.871 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T04:52:30.878 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-12-11T04:52:30.878 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:52:30.896 INFO:teuthology.orchestra.console.smithi071:Power off 2023-12-11T04:52:30.896 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T04:52:30.905 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-11_04:19:36-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 04:20:44.511807', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T04:52:30.910 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-12-11T04:52:30.915 INFO:teuthology.orchestra.console.smithi072:Power off 2023-12-11T04:52:30.915 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T04:52:30.922 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2023-12-11T04:52:30.923 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:52:30.933 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-12-11T04:52:30.933 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:52:30.945 INFO:teuthology.orchestra.console.smithi113:Power off 2023-12-11T04:52:30.945 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T04:52:30.956 INFO:teuthology.orchestra.console.smithi163:Power off 2023-12-11T04:52:30.957 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T04:52:30.963 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-12-11T04:52:30.964 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2023-12-11T04:52:30.964 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:52:30.970 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-12-11T04:52:30.977 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-12-11T04:52:30.977 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T04:52:30.988 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-11T04:52:31.001 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-12-11T04:52:31.011 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-12-11T04:52:31.065 INFO:teuthology.orchestra.console.smithi071:Power off completed 2023-12-11T04:52:31.071 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-12-11T04:52:31.089 INFO:teuthology.orchestra.console.smithi113:Power off completed 2023-12-11T04:52:31.102 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-12-11T04:52:31.160 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com 2023-12-11T04:52:31.213 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com 2023-12-11T04:52:31.219 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com 2023-12-11T04:52:31.236 INFO:teuthology.lock.ops:unlocked: smithi113.front.sepia.ceph.com 2023-12-11T04:52:31.243 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com