2024-04-04T19:17:03.039 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60 2024-04-04T19:17:03.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T19:17:03.217 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2c33576c10>, signals=[15]) 2024-04-04T19:17:03.217 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging 2024-04-04T19:17:03.218 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server 2024-04-04T19:17:03.218 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-04-04T19:17:03.240 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2024-04-04T19:17:03.240 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2024-04-04T19:17:03.240 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-04-04T19:17:03.256 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2024-04-04T19:17:03.256 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2024-04-04T19:17:03.256 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-04-04T19:17:03.358 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_9.stream (ID 10) 2024-04-04T19:17:03.362 DEBUG:teuthology.provision.fog.smithi106:Requesting image smithi_centos_9.stream (ID 10) 2024-04-04T19:17:03.378 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_9.stream (ID 10) 2024-04-04T19:17:03.395 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 9.stream 2024-04-04T19:17:03.407 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of centos 9.stream 2024-04-04T19:17:03.438 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 9.stream 2024-04-04T19:17:03.651 INFO:teuthology.orchestra.console.smithi129:Power off 2024-04-04T19:17:03.651 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-04T19:17:03.665 INFO:teuthology.orchestra.console.smithi195:Power off 2024-04-04T19:17:03.665 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-04T19:17:03.676 INFO:teuthology.orchestra.console.smithi106:Power off 2024-04-04T19:17:03.676 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-04T19:17:03.685 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-04-04T19:17:03.686 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:03.694 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-04-04T19:17:03.694 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:03.703 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off 2024-04-04T19:17:03.703 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:03.711 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-04T19:17:03.717 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-04-04T19:17:03.724 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-04-04T19:17:03.812 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-04-04T19:17:03.913 INFO:teuthology.orchestra.console.smithi129:Power on 2024-04-04T19:17:03.913 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-04T19:17:03.935 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2024-04-04T19:17:03.936 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:03.964 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-04T19:17:07.718 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:07.726 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:07.828 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-04-04T19:17:07.835 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-04-04T19:17:07.966 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:08.075 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-04T19:17:11.830 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:11.838 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:11.940 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-04-04T19:17:11.947 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-04-04T19:17:12.042 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-04-04T19:17:12.048 INFO:teuthology.orchestra.console.smithi106:Power off completed 2024-04-04T19:17:12.076 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:12.143 INFO:teuthology.orchestra.console.smithi195:Power on 2024-04-04T19:17:12.144 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-04T19:17:12.150 INFO:teuthology.orchestra.console.smithi106:Power on 2024-04-04T19:17:12.151 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-04T19:17:12.165 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2024-04-04T19:17:12.165 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:12.174 DEBUG:teuthology.orchestra.console.smithi106:power on output: Chassis Power Control: Up/On 2024-04-04T19:17:12.174 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:12.187 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-04-04T19:17:12.195 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-04-04T19:17:12.303 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-04-04T19:17:12.404 INFO:teuthology.orchestra.console.smithi129:Power on completed 2024-04-04T19:17:12.504 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2024-04-04T19:17:16.190 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:16.199 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:16.301 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-04-04T19:17:16.308 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-04-04T19:17:20.302 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:20.312 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T19:17:20.414 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-04-04T19:17:20.422 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-04-04T19:17:20.515 INFO:teuthology.orchestra.console.smithi195:Power on completed 2024-04-04T19:17:20.523 INFO:teuthology.orchestra.console.smithi106:Power on completed 2024-04-04T19:17:20.616 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2024-04-04T19:17:20.624 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish 2024-04-04T19:19:43.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:19:46.334 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-04T19:19:51.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:19:51.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:19:52.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:19:54.430 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-04-04T19:19:54.431 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-04T19:19:55.390 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-04T19:20:00.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:00.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:01.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:03.486 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-04-04T19:20:03.487 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-04T19:20:04.446 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-04T19:20:09.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:09.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:10.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:12.542 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-04-04T19:20:12.543 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-04T19:20:13.502 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-04T19:20:18.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:18.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:19.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:21.634 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-04-04T19:20:21.635 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-04T19:20:22.562 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-04T19:20:27.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:27.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:28.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:30.718 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-04-04T19:20:30.719 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-04T19:20:31.614 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-04T19:20:36.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:36.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:37.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:39.774 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-04-04T19:20:39.806 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-04T19:20:40.670 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-04T19:20:45.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:45.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:46.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:20:48.862 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-04T19:20:54.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:21:45.831 WARNING:teuthology.provision.fog.smithi195:timed out 2024-04-04T19:21:46.675 WARNING:teuthology.provision.fog.smithi129:timed out 2024-04-04T19:21:51.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:21:52.052 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-04T19:21:52.053 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-04T19:21:52.384 INFO:teuthology.provision.fog.smithi195:Node is ready 2024-04-04T19:21:52.384 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2024-04-04T19:21:52.399 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2024-04-04T19:21:52.400 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2024-04-04T19:21:52.454 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2024-04-04T19:21:52.455 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2024-04-04T19:21:52.552 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2024-04-04T19:21:52.579 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2024-04-04T19:21:52.646 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2024-04-04T19:21:52.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:21:52.713 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2024-04-04T19:21:52.793 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-04-04T19:21:52.847 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T19:21:52.848 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T19:21:52.849 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2024-04-04T19:21:52.851 DEBUG:teuthology.parallel:result is None 2024-04-04T19:21:52.897 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-04T19:21:52.898 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-04T19:21:53.210 INFO:teuthology.provision.fog.smithi129:Node is ready 2024-04-04T19:21:53.210 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2024-04-04T19:21:53.225 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2024-04-04T19:21:53.225 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2024-04-04T19:21:53.280 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2024-04-04T19:21:53.280 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2024-04-04T19:21:53.396 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2024-04-04T19:21:53.424 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2024-04-04T19:21:53.491 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2024-04-04T19:21:53.557 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2024-04-04T19:21:53.622 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-04-04T19:21:53.674 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T19:21:53.675 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T19:21:53.676 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2024-04-04T19:21:53.676 DEBUG:teuthology.parallel:result is None 2024-04-04T19:21:54.870 WARNING:teuthology.provision.fog.smithi106:timed out 2024-04-04T19:22:00.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:22:01.206 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-04T19:22:01.207 DEBUG:teuthology.orchestra.run.smithi106:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-04T19:22:01.520 INFO:teuthology.provision.fog.smithi106:Node is ready 2024-04-04T19:22:01.520 DEBUG:teuthology.orchestra.run.smithi106:> hostname 2024-04-04T19:22:01.534 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com 2024-04-04T19:22:01.535 DEBUG:teuthology.orchestra.run.smithi106:> grep smithi106.front.sepia.ceph.com /etc/hosts 2024-04-04T19:22:01.590 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106 2024-04-04T19:22:01.590 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2024-04-04T19:22:01.715 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hosts 2024-04-04T19:22:01.743 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/172.21.15.106/172.21.15.106/g' /etc/hosts 2024-04-04T19:22:01.810 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hostname 2024-04-04T19:22:01.877 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2024-04-04T19:22:01.943 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-04-04T19:22:01.998 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-04-04T19:22:01.998 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-04-04T19:22:01.998 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-04-04T19:22:01.998 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-04-04T19:22:01.998 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-04-04T19:22:01.998 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-04-04T19:22:01.998 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T19:22:01.998 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-04-04T19:22:01.998 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-04-04T19:22:01.999 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T19:22:01.999 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-04-04T19:22:01.999 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T19:22:01.999 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T19:22:01.999 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T19:22:01.999 INFO:teuthology.provision.fog.smithi106:Deploy complete! 2024-04-04T19:22:02.000 DEBUG:teuthology.parallel:result is None 2024-04-04T19:22:02.237 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com 2024-04-04T19:22:02.238 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-04T19:22:02.466 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2024-04-04T19:22:02.467 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-04T19:22:02.490 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2024-04-04T19:22:02.490 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-04T19:22:02.508 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server 2024-04-04T19:22:02.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-04T19:22:02.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:22:02.596 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-04-04T19:22:02.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-04T19:22:02.661 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-04-04T19:22:02.715 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-04-04T19:22:02.716 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-04-04T19:22:02.770 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-04-04T19:22:02.770 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-04-04T19:22:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-04-04T19:22:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-04-04T19:22:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-04-04T19:22:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-04-04T19:22:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T19:22:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-04-04T19:22:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-04-04T19:22:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T19:22:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-04-04T19:22:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T19:22:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T19:22:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T19:22:02.772 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-04-04T19:22:02.798 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2024-04-04T19:22:02.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-04-04T19:22:02.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:22:02.889 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-04-04T19:22:02.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-04-04T19:22:02.962 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-04-04T19:22:03.018 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-04-04T19:22:03.019 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-04-04T19:22:03.074 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-04-04T19:22:03.074 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-04-04T19:22:03.074 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-04-04T19:22:03.074 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-04-04T19:22:03.074 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-04-04T19:22:03.074 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-04-04T19:22:03.074 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T19:22:03.075 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-04-04T19:22:03.075 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-04-04T19:22:03.075 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T19:22:03.075 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-04-04T19:22:03.075 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T19:22:03.075 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T19:22:03.075 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T19:22:03.075 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-04-04T19:22:03.099 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2024-04-04T19:22:03.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-04T19:22:03.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T19:22:03.186 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-04T19:22:03.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-04T19:22:03.353 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-04-04T19:22:03.407 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-04-04T19:22:03.407 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-04-04T19:22:03.462 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-04-04T19:22:03.462 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-04-04T19:22:03.462 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-04-04T19:22:03.462 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-04-04T19:22:03.462 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-04-04T19:22:03.462 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-04-04T19:22:03.462 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T19:22:03.462 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-04-04T19:22:03.462 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-04-04T19:22:03.463 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T19:22:03.463 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-04-04T19:22:03.463 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T19:22:03.463 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T19:22:03.463 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T19:22:03.463 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-04-04T19:22:03.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T19:22:03.587 INFO:teuthology.dispatcher.supervisor:Running job 7639935 2024-04-04T19:22:03.587 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-04_14:50:58-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7639935 --name yuriw-2024-04-04_14:50:58-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} -- /home/teuthworker/archive/yuriw-2024-04-04_14:50:58-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7639935/orig.config.yaml 2024-04-04T19:22:03.590 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-04_14:50:58-rados-wip-ceph_test_rados-partial-reads-distro-default-smithi/7639935 2024-04-04T19:22:03.590 INFO:teuthology.dispatcher.supervisor:Job PID: 702014 2024-04-04T19:22:03.590 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-04T19:24:03.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T19:26:03.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T19:28:03.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T19:30:04.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T19:32:04.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T19:34:04.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T19:36:04.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T19:38:04.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T19:40:04.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T19:42:05.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T19:42:05.225 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1