2024-02-18T11:14:54.586 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-18T11:14:54.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:14:54.774 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f001940ac10>, signals=[15]) 2024-02-18T11:14:54.774 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2024-02-18T11:14:54.774 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2024-02-18T11:14:54.774 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-02-18T11:14:54.800 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2024-02-18T11:14:54.801 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2024-02-18T11:14:54.801 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2024-02-18T11:14:54.816 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2024-02-18T11:14:54.817 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2024-02-18T11:14:54.817 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-02-18T11:14:54.922 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_centos_9.stream (ID 10) 2024-02-18T11:14:54.929 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10) 2024-02-18T11:14:54.933 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_9.stream (ID 10) 2024-02-18T11:14:54.973 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 9.stream 2024-02-18T11:14:54.978 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 9.stream 2024-02-18T11:14:54.980 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream 2024-02-18T11:14:55.174 INFO:teuthology.orchestra.console.smithi158:Power off 2024-02-18T11:14:55.174 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-18T11:14:55.188 INFO:teuthology.orchestra.console.smithi012:Power off 2024-02-18T11:14:55.188 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-18T11:14:55.200 INFO:teuthology.orchestra.console.smithi188:Power off 2024-02-18T11:14:55.200 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-18T11:14:55.208 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2024-02-18T11:14:55.208 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:14:55.216 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2024-02-18T11:14:55.216 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:14:55.225 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2024-02-18T11:14:55.225 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:14:55.233 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2024-02-18T11:14:55.237 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-02-18T11:14:55.246 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-02-18T11:14:59.236 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:14:59.243 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:14:59.251 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:14:59.346 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2024-02-18T11:14:59.353 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-02-18T11:14:59.359 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-02-18T11:15:03.348 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:03.355 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:03.362 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:03.458 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2024-02-18T11:15:03.464 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-02-18T11:15:03.471 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-02-18T11:15:03.559 INFO:teuthology.orchestra.console.smithi158:Power off completed 2024-02-18T11:15:03.660 INFO:teuthology.orchestra.console.smithi158:Power on 2024-02-18T11:15:03.660 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-18T11:15:03.683 DEBUG:teuthology.orchestra.console.smithi158:power on output: Chassis Power Control: Up/On 2024-02-18T11:15:03.684 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:03.714 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2024-02-18T11:15:07.468 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:07.474 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:07.577 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-02-18T11:15:07.583 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-02-18T11:15:07.678 INFO:teuthology.orchestra.console.smithi012:Power off completed 2024-02-18T11:15:07.684 INFO:teuthology.orchestra.console.smithi188:Power off completed 2024-02-18T11:15:07.714 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:07.780 INFO:teuthology.orchestra.console.smithi012:Power on 2024-02-18T11:15:07.780 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-18T11:15:07.788 INFO:teuthology.orchestra.console.smithi188:Power on 2024-02-18T11:15:07.788 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-18T11:15:07.802 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On 2024-02-18T11:15:07.802 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:07.813 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On 2024-02-18T11:15:07.814 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:07.823 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2024-02-18T11:15:07.826 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-02-18T11:15:07.836 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-02-18T11:15:11.828 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:11.835 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:11.842 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:11.944 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-02-18T11:15:11.952 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-02-18T11:15:11.994 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2024-02-18T11:15:12.095 INFO:teuthology.orchestra.console.smithi158:Power on completed 2024-02-18T11:15:12.196 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2024-02-18T11:15:15.948 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:15.955 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:15:16.057 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-02-18T11:15:16.063 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-02-18T11:15:16.159 INFO:teuthology.orchestra.console.smithi012:Power on completed 2024-02-18T11:15:16.164 INFO:teuthology.orchestra.console.smithi188:Power on completed 2024-02-18T11:15:16.260 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2024-02-18T11:15:16.265 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2024-02-18T11:17:31.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:17:34.972 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-02-18T11:17:40.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:17:44.028 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-02-18T11:17:46.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:17:50.012 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-02-18T11:17:50.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:17:53.084 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-02-18T11:17:56.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:17:59.069 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-02-18T11:17:59.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:02.140 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-02-18T11:18:05.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:08.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:08.160 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-02-18T11:18:11.200 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-02-18T11:18:13.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:14.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:16.124 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-18T11:18:17.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:17.244 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-02-18T11:18:22.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:23.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:25.184 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-18T11:18:26.300 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-02-18T11:18:31.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:32.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:34.268 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-18T11:18:35.356 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2024-02-18T11:18:40.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:41.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:43.324 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-18T11:18:49.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:18:52.412 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-18T11:18:58.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:19:01.468 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-18T11:19:07.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:19:10.528 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-18T11:19:16.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:19:17.207 WARNING:teuthology.provision.fog.smithi012:timed out 2024-02-18T11:19:19.616 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2024-02-18T11:19:23.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:19:23.480 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-18T11:19:23.481 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-18T11:19:23.827 INFO:teuthology.provision.fog.smithi012:Node is ready 2024-02-18T11:19:23.827 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2024-02-18T11:19:23.842 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2024-02-18T11:19:23.842 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2024-02-18T11:19:23.898 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2024-02-18T11:19:23.898 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2024-02-18T11:19:24.003 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2024-02-18T11:19:24.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2024-02-18T11:19:24.106 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2024-02-18T11:19:24.177 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2024-02-18T11:19:24.247 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-02-18T11:19:24.302 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-02-18T11:19:24.302 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-02-18T11:19:24.302 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-02-18T11:19:24.302 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-02-18T11:19:24.302 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-02-18T11:19:24.302 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-02-18T11:19:24.302 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-18T11:19:24.303 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-02-18T11:19:24.303 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-02-18T11:19:24.303 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-18T11:19:24.303 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-02-18T11:19:24.303 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-18T11:19:24.303 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-18T11:19:24.303 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-18T11:19:24.304 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2024-02-18T11:19:24.305 DEBUG:teuthology.parallel:result is None 2024-02-18T11:19:25.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:19:41.376 WARNING:teuthology.provision.fog.smithi188:timed out 2024-02-18T11:19:47.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:19:47.697 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-18T11:19:47.697 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-18T11:19:48.036 INFO:teuthology.provision.fog.smithi188:Node is ready 2024-02-18T11:19:48.036 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2024-02-18T11:19:48.050 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2024-02-18T11:19:48.050 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2024-02-18T11:19:48.105 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2024-02-18T11:19:48.106 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2024-02-18T11:19:48.230 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2024-02-18T11:19:48.258 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2024-02-18T11:19:48.329 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2024-02-18T11:19:48.397 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2024-02-18T11:19:48.465 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-02-18T11:19:48.523 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2024-02-18T11:19:48.524 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2024-02-18T11:19:48.524 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2024-02-18T11:19:48.524 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2024-02-18T11:19:48.524 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2024-02-18T11:19:48.524 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2024-02-18T11:19:48.524 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-18T11:19:48.525 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2024-02-18T11:19:48.525 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2024-02-18T11:19:48.525 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-18T11:19:48.525 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2024-02-18T11:19:48.525 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-18T11:19:48.525 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-18T11:19:48.525 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-18T11:19:48.526 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2024-02-18T11:19:48.527 DEBUG:teuthology.parallel:result is None 2024-02-18T11:20:25.656 WARNING:teuthology.provision.fog.smithi158:timed out 2024-02-18T11:20:31.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:20:31.979 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-18T11:20:31.979 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-18T11:20:32.296 INFO:teuthology.provision.fog.smithi158:Node is ready 2024-02-18T11:20:32.296 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2024-02-18T11:20:32.312 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2024-02-18T11:20:32.313 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2024-02-18T11:20:32.369 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2024-02-18T11:20:32.369 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2024-02-18T11:20:32.465 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2024-02-18T11:20:32.493 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2024-02-18T11:20:32.562 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2024-02-18T11:20:32.630 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2024-02-18T11:20:32.698 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2024-02-18T11:20:32.753 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2024-02-18T11:20:32.753 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="9" 2024-02-18T11:20:32.753 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2024-02-18T11:20:32.753 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2024-02-18T11:20:32.753 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="9" 2024-02-18T11:20:32.753 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el9" 2024-02-18T11:20:32.753 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-18T11:20:32.753 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2024-02-18T11:20:32.753 INFO:teuthology.orchestra.run.smithi158.stdout:LOGO="fedora-logo-icon" 2024-02-18T11:20:32.753 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-18T11:20:32.753 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2024-02-18T11:20:32.753 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-18T11:20:32.754 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-18T11:20:32.754 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-18T11:20:32.754 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2024-02-18T11:20:32.755 DEBUG:teuthology.parallel:result is None 2024-02-18T11:20:32.990 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2024-02-18T11:20:32.991 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-18T11:20:33.025 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2024-02-18T11:20:33.026 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-18T11:20:33.061 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2024-02-18T11:20:33.061 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-18T11:20:33.095 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2024-02-18T11:20:33.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-02-18T11:20:33.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:20:33.202 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-02-18T11:20:33.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-02-18T11:20:33.386 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-02-18T11:20:33.441 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-02-18T11:20:33.442 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-02-18T11:20:33.497 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-02-18T11:20:33.497 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-02-18T11:20:33.497 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-02-18T11:20:33.497 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-02-18T11:20:33.497 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-02-18T11:20:33.497 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-02-18T11:20:33.497 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-18T11:20:33.497 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-02-18T11:20:33.498 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-02-18T11:20:33.498 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-18T11:20:33.498 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-02-18T11:20:33.498 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-18T11:20:33.498 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-18T11:20:33.498 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-18T11:20:33.498 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-02-18T11:20:33.528 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2024-02-18T11:20:33.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2024-02-18T11:20:33.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:20:33.619 DEBUG:teuthology.orchestra.run.smithi158:> true 2024-02-18T11:20:33.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2024-02-18T11:20:33.644 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2024-02-18T11:20:33.702 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2024-02-18T11:20:33.702 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2024-02-18T11:20:33.759 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2024-02-18T11:20:33.760 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="9" 2024-02-18T11:20:33.760 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2024-02-18T11:20:33.760 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2024-02-18T11:20:33.760 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="9" 2024-02-18T11:20:33.760 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el9" 2024-02-18T11:20:33.760 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-18T11:20:33.760 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2024-02-18T11:20:33.760 INFO:teuthology.orchestra.run.smithi158.stdout:LOGO="fedora-logo-icon" 2024-02-18T11:20:33.760 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-18T11:20:33.760 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2024-02-18T11:20:33.760 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-18T11:20:33.760 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-18T11:20:33.761 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-18T11:20:33.761 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2024-02-18T11:20:33.794 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2024-02-18T11:20:33.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-18T11:20:33.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T11:20:33.888 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-02-18T11:20:34.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-18T11:20:34.059 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-02-18T11:20:34.114 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-02-18T11:20:34.114 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-02-18T11:20:34.170 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2024-02-18T11:20:34.170 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2024-02-18T11:20:34.170 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2024-02-18T11:20:34.170 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2024-02-18T11:20:34.170 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2024-02-18T11:20:34.170 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2024-02-18T11:20:34.170 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-18T11:20:34.170 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2024-02-18T11:20:34.170 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2024-02-18T11:20:34.171 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-18T11:20:34.171 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2024-02-18T11:20:34.171 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-18T11:20:34.171 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-18T11:20:34.171 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-18T11:20:34.171 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-02-18T11:20:34.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:20:34.298 INFO:teuthology.dispatcher.supervisor:Running job 7564362 2024-02-18T11:20:34.298 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564362 --name vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/iogen}} -- /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564362/orig.config.yaml 2024-02-18T11:20:34.302 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564362 2024-02-18T11:20:34.302 INFO:teuthology.dispatcher.supervisor:Job PID: 2246190 2024-02-18T11:20:34.302 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-18T11:22:34.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:24:34.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:26:34.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:28:34.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:30:35.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:32:35.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:34:35.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:36:35.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:38:35.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:40:35.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:42:36.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:44:36.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:46:36.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:48:36.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:50:36.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:52:36.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:54:37.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:56:37.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:58:37.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T12:00:37.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T12:02:37.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T12:02:37.859 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1