2024-04-11T16:16:22.017 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-11T16:16:22.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:16:22.190 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb333535c10>, signals=[15]) 2024-04-11T16:16:22.191 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2024-04-11T16:16:22.191 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2024-04-11T16:16:22.191 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-04-11T16:16:22.211 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2024-04-11T16:16:22.211 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2024-04-11T16:16:22.211 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-04-11T16:16:22.236 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2024-04-11T16:16:22.236 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2024-04-11T16:16:22.236 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-04-11T16:16:22.330 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_centos_9.stream (ID 10) 2024-04-11T16:16:22.342 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_centos_9.stream (ID 10) 2024-04-11T16:16:22.373 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_centos_9.stream (ID 10) 2024-04-11T16:16:22.376 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 9.stream 2024-04-11T16:16:22.397 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 9.stream 2024-04-11T16:16:22.429 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 9.stream 2024-04-11T16:16:22.606 INFO:teuthology.orchestra.console.smithi121:Power off 2024-04-11T16:16:22.607 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-11T16:16:22.621 INFO:teuthology.orchestra.console.smithi167:Power off 2024-04-11T16:16:22.621 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-11T16:16:22.632 INFO:teuthology.orchestra.console.smithi071:Power off 2024-04-11T16:16:22.633 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-11T16:16:22.641 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2024-04-11T16:16:22.642 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:22.650 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2024-04-11T16:16:22.650 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:22.658 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2024-04-11T16:16:22.658 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:22.667 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-04-11T16:16:22.671 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-04-11T16:16:22.681 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-04-11T16:16:26.670 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:26.677 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:26.684 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:26.780 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-04-11T16:16:26.786 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-04-11T16:16:26.792 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-04-11T16:16:30.785 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:30.791 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:30.797 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:30.894 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-04-11T16:16:30.899 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-04-11T16:16:30.904 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-04-11T16:16:31.005 INFO:teuthology.orchestra.console.smithi071:Power off completed 2024-04-11T16:16:31.106 INFO:teuthology.orchestra.console.smithi071:Power on 2024-04-11T16:16:31.106 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-11T16:16:31.126 DEBUG:teuthology.orchestra.console.smithi071:power on output: Chassis Power Control: Up/On 2024-04-11T16:16:31.126 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:31.147 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2024-04-11T16:16:34.898 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:34.905 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:35.008 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-04-11T16:16:35.016 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-04-11T16:16:35.110 INFO:teuthology.orchestra.console.smithi121:Power off completed 2024-04-11T16:16:35.116 INFO:teuthology.orchestra.console.smithi167:Power off completed 2024-04-11T16:16:35.149 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:35.211 INFO:teuthology.orchestra.console.smithi121:Power on 2024-04-11T16:16:35.211 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-11T16:16:35.220 INFO:teuthology.orchestra.console.smithi167:Power on 2024-04-11T16:16:35.220 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-11T16:16:35.234 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On 2024-04-11T16:16:35.234 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:35.243 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2024-04-11T16:16:35.243 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:35.256 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-04-11T16:16:35.258 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2024-04-11T16:16:35.264 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-04-11T16:16:35.359 INFO:teuthology.orchestra.console.smithi071:Power on completed 2024-04-11T16:16:35.459 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2024-04-11T16:16:39.262 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:39.268 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:39.371 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2024-04-11T16:16:39.377 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-04-11T16:16:39.477 INFO:teuthology.orchestra.console.smithi167:Power on completed 2024-04-11T16:16:39.578 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2024-04-11T16:16:43.374 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-11T16:16:43.550 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2024-04-11T16:16:43.651 INFO:teuthology.orchestra.console.smithi121:Power on completed 2024-04-11T16:16:43.751 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2024-04-11T16:19:14.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:19:21.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:19:25.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:19:33.022 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-11T16:19:39.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:19:39.678 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-04-11T16:19:42.078 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-11T16:19:43.774 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-11T16:19:45.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:19:48.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:19:48.734 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-04-11T16:19:49.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:19:51.139 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-11T16:19:52.830 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-11T16:19:54.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:19:57.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:19:57.790 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-04-11T16:19:58.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:20:00.222 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-11T16:20:01.886 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-11T16:20:03.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:20:06.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:20:06.846 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-04-11T16:20:07.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:20:09.282 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-11T16:20:10.942 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-11T16:20:12.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:20:15.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:20:15.902 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-04-11T16:20:16.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:20:18.370 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-04-11T16:20:19.998 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-11T16:20:21.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:20:24.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:20:26.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:21:21.963 WARNING:teuthology.provision.fog.smithi071:timed out 2024-04-11T16:21:24.376 WARNING:teuthology.provision.fog.smithi121:timed out 2024-04-11T16:21:26.003 WARNING:teuthology.provision.fog.smithi167:timed out 2024-04-11T16:21:27.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:21:28.224 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-11T16:21:28.224 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-11T16:21:28.536 INFO:teuthology.provision.fog.smithi071:Node is ready 2024-04-11T16:21:28.536 DEBUG:teuthology.orchestra.run.smithi071:> hostname 2024-04-11T16:21:28.550 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2024-04-11T16:21:28.551 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi071.front.sepia.ceph.com /etc/hosts 2024-04-11T16:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2024-04-11T16:21:28.606 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2024-04-11T16:21:28.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hosts 2024-04-11T16:21:28.725 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.71/172.21.15.71/g' /etc/hosts 2024-04-11T16:21:28.792 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hostname 2024-04-11T16:21:28.859 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2024-04-11T16:21:28.926 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-04-11T16:21:28.980 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-11T16:21:28.981 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-11T16:21:28.982 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2024-04-11T16:21:28.983 DEBUG:teuthology.parallel:result is None 2024-04-11T16:21:30.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:21:30.579 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-11T16:21:30.579 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-11T16:21:30.899 INFO:teuthology.provision.fog.smithi121:Node is ready 2024-04-11T16:21:30.899 DEBUG:teuthology.orchestra.run.smithi121:> hostname 2024-04-11T16:21:30.914 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2024-04-11T16:21:30.914 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts 2024-04-11T16:21:30.970 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2024-04-11T16:21:30.970 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2024-04-11T16:21:31.079 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts 2024-04-11T16:21:31.108 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2024-04-11T16:21:31.175 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname 2024-04-11T16:21:31.242 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2024-04-11T16:21:31.308 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-04-11T16:21:31.362 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-04-11T16:21:31.362 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-04-11T16:21:31.362 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-04-11T16:21:31.362 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-04-11T16:21:31.362 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-04-11T16:21:31.362 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-04-11T16:21:31.362 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-11T16:21:31.362 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-04-11T16:21:31.362 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-04-11T16:21:31.363 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-11T16:21:31.363 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-04-11T16:21:31.363 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-11T16:21:31.363 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-11T16:21:31.363 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-11T16:21:31.363 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2024-04-11T16:21:31.364 DEBUG:teuthology.parallel:result is None 2024-04-11T16:21:32.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:21:32.196 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-11T16:21:32.196 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-11T16:21:32.581 INFO:teuthology.provision.fog.smithi167:Node is ready 2024-04-11T16:21:32.613 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2024-04-11T16:21:32.628 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2024-04-11T16:21:32.629 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts 2024-04-11T16:21:32.684 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2024-04-11T16:21:32.685 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2024-04-11T16:21:32.796 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts 2024-04-11T16:21:32.825 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2024-04-11T16:21:32.892 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname 2024-04-11T16:21:32.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2024-04-11T16:21:33.026 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-04-11T16:21:33.081 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-11T16:21:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-11T16:21:33.083 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2024-04-11T16:21:33.083 DEBUG:teuthology.parallel:result is None 2024-04-11T16:21:33.324 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2024-04-11T16:21:33.324 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-11T16:21:33.351 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2024-04-11T16:21:33.351 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-11T16:21:33.376 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2024-04-11T16:21:33.376 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-11T16:21:33.394 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2024-04-11T16:21:33.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-11T16:21:33.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:21:33.485 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-04-11T16:21:33.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-11T16:21:33.554 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-04-11T16:21:33.610 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-04-11T16:21:33.610 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-04-11T16:21:33.665 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-04-11T16:21:33.666 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-04-11T16:21:33.666 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-04-11T16:21:33.666 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-04-11T16:21:33.666 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-04-11T16:21:33.666 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-04-11T16:21:33.666 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-11T16:21:33.666 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-04-11T16:21:33.666 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-04-11T16:21:33.666 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-11T16:21:33.666 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-04-11T16:21:33.667 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-11T16:21:33.667 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-11T16:21:33.667 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-11T16:21:33.667 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-04-11T16:21:33.684 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2024-04-11T16:21:33.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-11T16:21:33.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:21:33.773 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-04-11T16:21:33.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-04-11T16:21:33.848 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-04-11T16:21:33.905 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-04-11T16:21:33.905 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-04-11T16:21:33.961 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-04-11T16:21:33.962 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-04-11T16:21:33.962 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-04-11T16:21:33.962 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-04-11T16:21:33.962 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-04-11T16:21:33.962 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-04-11T16:21:33.962 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-11T16:21:33.962 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-04-11T16:21:33.962 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-04-11T16:21:33.962 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-11T16:21:33.962 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-04-11T16:21:33.962 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-11T16:21:33.962 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-11T16:21:33.963 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-11T16:21:33.963 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-04-11T16:21:33.984 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2024-04-11T16:21:33.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-11T16:21:33.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-11T16:21:34.073 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-04-11T16:21:34.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-11T16:21:34.141 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-04-11T16:21:34.196 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-04-11T16:21:34.196 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-04-11T16:21:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-04-11T16:21:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-04-11T16:21:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-04-11T16:21:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-04-11T16:21:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-04-11T16:21:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-04-11T16:21:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-11T16:21:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-04-11T16:21:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-04-11T16:21:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-11T16:21:34.252 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-04-11T16:21:34.252 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-11T16:21:34.252 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-11T16:21:34.252 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-11T16:21:34.252 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-04-11T16:21:34.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:21:34.370 INFO:teuthology.dispatcher.supervisor:Running job 7652030 2024-04-11T16:21:34.370 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rzarzynski@teuthology --archive /home/teuthworker/archive/rzarzynski-2024-04-11_10:07:18-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7652030 --name rzarzynski-2024-04-11_10:07:18-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} -- /home/teuthworker/archive/rzarzynski-2024-04-11_10:07:18-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7652030/orig.config.yaml 2024-04-11T16:21:34.373 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rzarzynski-2024-04-11_10:07:18-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7652030 2024-04-11T16:21:34.374 INFO:teuthology.dispatcher.supervisor:Job PID: 2596381 2024-04-11T16:21:34.374 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-11T16:23:34.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:25:34.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:27:34.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:29:35.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:31:35.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:33:35.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:35:35.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:37:35.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:39:35.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:41:35.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-11T16:41:36.070 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1