2024-02-17T14:46:34.713 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-17T14:46:34.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:46:34.891 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f036ece0c10>, signals=[15]) 2024-02-17T14:46:34.891 INFO:teuthology.lock.ops:Start node 'smithi082.front.sepia.ceph.com' reimaging 2024-02-17T14:46:34.891 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T14:46:34.891 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-02-17T14:46:34.912 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging 2024-02-17T14:46:34.913 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T14:46:34.913 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-02-17T14:46:34.939 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2024-02-17T14:46:34.939 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T14:46:34.939 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-02-17T14:46:35.032 DEBUG:teuthology.provision.fog.smithi082:Requesting image smithi_centos_8.stream (ID 3) 2024-02-17T14:46:35.064 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_centos_8.stream (ID 3) 2024-02-17T14:46:35.076 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_centos_8.stream (ID 3) 2024-02-17T14:46:35.096 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of centos 8.stream 2024-02-17T14:46:35.124 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of centos 8.stream 2024-02-17T14:46:35.135 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 8.stream 2024-02-17T14:46:35.315 INFO:teuthology.orchestra.console.smithi082:Power off 2024-02-17T14:46:35.315 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T14:46:35.330 INFO:teuthology.orchestra.console.smithi113:Power off 2024-02-17T14:46:35.331 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T14:46:35.347 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-02-17T14:46:35.347 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:35.358 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2024-02-17T14:46:35.358 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:35.368 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-02-17T14:46:35.380 INFO:teuthology.orchestra.console.smithi136:Power off 2024-02-17T14:46:35.380 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T14:46:35.388 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-17T14:46:35.404 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-02-17T14:46:35.405 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:35.429 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-17T14:46:39.373 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:39.389 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:39.430 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:39.481 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-02-17T14:46:39.498 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-17T14:46:39.539 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-17T14:46:43.486 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:43.499 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:43.540 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:43.595 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-02-17T14:46:43.608 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-17T14:46:43.649 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-17T14:46:43.697 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-02-17T14:46:43.797 INFO:teuthology.orchestra.console.smithi082:Power on 2024-02-17T14:46:43.797 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T14:46:43.819 DEBUG:teuthology.orchestra.console.smithi082:power on output: Chassis Power Control: Up/On 2024-02-17T14:46:43.819 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:43.871 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-02-17T14:46:47.612 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:47.650 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:47.721 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-02-17T14:46:47.759 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-02-17T14:46:47.823 INFO:teuthology.orchestra.console.smithi113:Power off completed 2024-02-17T14:46:47.860 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-02-17T14:46:47.872 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:47.924 INFO:teuthology.orchestra.console.smithi113:Power on 2024-02-17T14:46:47.924 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T14:46:47.945 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On 2024-02-17T14:46:47.945 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:47.961 INFO:teuthology.orchestra.console.smithi136:Power on 2024-02-17T14:46:47.961 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T14:46:47.969 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-02-17T14:46:47.980 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2024-02-17T14:46:47.981 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:47.987 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-02-17T14:46:48.001 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-02-17T14:46:48.088 INFO:teuthology.orchestra.console.smithi082:Power on completed 2024-02-17T14:46:48.189 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2024-02-17T14:46:51.974 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:52.002 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:46:52.086 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-17T14:46:52.111 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-17T14:46:52.188 INFO:teuthology.orchestra.console.smithi113:Power on completed 2024-02-17T14:46:52.212 INFO:teuthology.orchestra.console.smithi136:Power on completed 2024-02-17T14:46:52.289 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish 2024-02-17T14:46:52.313 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2024-02-17T14:49:34.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:49:37.084 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-02-17T14:49:38.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:49:41.116 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-17T14:49:43.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:49:46.144 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-02-17T14:49:47.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:49:50.172 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-17T14:49:52.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:49:53.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:49:55.228 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-02-17T14:49:56.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:49:56.192 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-17T14:49:59.228 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-17T14:50:01.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:02.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:04.288 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-02-17T14:50:05.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:05.244 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-17T14:50:08.284 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-17T14:50:10.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:11.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:13.372 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-02-17T14:50:14.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:14.300 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-17T14:50:17.344 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-17T14:50:19.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:20.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:22.431 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-02-17T14:50:23.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:23.356 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-17T14:50:26.428 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-17T14:50:28.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:29.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:32.412 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-17T14:50:32.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:35.484 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-17T14:50:38.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:41.468 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-17T14:50:41.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:47.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:50.524 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-17T14:50:56.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:50:59.612 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-17T14:51:00.274 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T14:51:00.274 DEBUG:teuthology.orchestra.run.smithi082:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T14:51:05.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:51:08.671 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-17T14:51:13.326 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T14:51:13.326 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T14:51:14.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:51:25.561 INFO:teuthology.provision.fog.smithi082:Node is ready 2024-02-17T14:51:25.584 DEBUG:teuthology.orchestra.run.smithi082:> hostname 2024-02-17T14:51:25.609 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com 2024-02-17T14:51:25.609 DEBUG:teuthology.orchestra.run.smithi082:> grep smithi082.front.sepia.ceph.com /etc/hosts 2024-02-17T14:51:25.669 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082 2024-02-17T14:51:25.669 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2024-02-17T14:51:25.806 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hosts 2024-02-17T14:51:25.839 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/172.21.15.82/172.21.15.82/g' /etc/hosts 2024-02-17T14:51:25.909 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hostname 2024-02-17T14:51:25.981 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2024-02-17T14:51:26.050 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-02-17T14:51:26.109 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-02-17T14:51:26.110 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8" 2024-02-17T14:51:26.110 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-02-17T14:51:26.110 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:51:26.110 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8" 2024-02-17T14:51:26.110 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2024-02-17T14:51:26.110 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T14:51:26.110 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-02-17T14:51:26.110 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T14:51:26.110 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:51:26.110 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:51:26.110 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T14:51:26.110 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:51:26.111 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2024-02-17T14:51:26.112 DEBUG:teuthology.parallel:result is None 2024-02-17T14:51:38.579 INFO:teuthology.provision.fog.smithi136:Node is ready 2024-02-17T14:51:38.580 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2024-02-17T14:51:38.603 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2024-02-17T14:51:38.604 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts 2024-02-17T14:51:38.663 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2024-02-17T14:51:38.664 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-02-17T14:51:38.780 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts 2024-02-17T14:51:38.811 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2024-02-17T14:51:38.880 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname 2024-02-17T14:51:38.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-02-17T14:51:39.017 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-02-17T14:51:39.075 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-02-17T14:51:39.076 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8" 2024-02-17T14:51:39.076 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-02-17T14:51:39.076 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:51:39.076 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8" 2024-02-17T14:51:39.076 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2024-02-17T14:51:39.076 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T14:51:39.076 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-02-17T14:51:39.076 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T14:51:39.076 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:51:39.076 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:51:39.077 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T14:51:39.077 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:51:39.077 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2024-02-17T14:51:39.078 DEBUG:teuthology.parallel:result is None 2024-02-17T14:51:46.316 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T14:51:46.316 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T14:52:11.721 INFO:teuthology.provision.fog.smithi113:Node is ready 2024-02-17T14:52:11.721 DEBUG:teuthology.orchestra.run.smithi113:> hostname 2024-02-17T14:52:11.745 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com 2024-02-17T14:52:11.746 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts 2024-02-17T14:52:11.807 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113 2024-02-17T14:52:11.807 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2024-02-17T14:52:11.923 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts 2024-02-17T14:52:11.955 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts 2024-02-17T14:52:12.026 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname 2024-02-17T14:52:12.095 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2024-02-17T14:52:12.163 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-02-17T14:52:12.221 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2024-02-17T14:52:12.221 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8" 2024-02-17T14:52:12.222 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2024-02-17T14:52:12.222 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:52:12.222 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8" 2024-02-17T14:52:12.222 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8" 2024-02-17T14:52:12.222 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T14:52:12.222 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-02-17T14:52:12.222 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T14:52:12.222 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:52:12.222 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:52:12.222 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T14:52:12.222 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:52:12.222 INFO:teuthology.provision.fog.smithi113:Deploy complete! 2024-02-17T14:52:12.223 DEBUG:teuthology.parallel:result is None 2024-02-17T14:52:12.410 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2024-02-17T14:52:12.410 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T14:52:12.438 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com 2024-02-17T14:52:12.438 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T14:52:12.454 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2024-02-17T14:52:12.454 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T14:52:12.472 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2024-02-17T14:52:12.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-02-17T14:52:12.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:52:12.549 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-02-17T14:52:12.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-02-17T14:52:12.690 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-02-17T14:52:12.749 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-02-17T14:52:12.750 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-02-17T14:52:12.810 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-02-17T14:52:12.810 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8" 2024-02-17T14:52:12.810 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-02-17T14:52:12.810 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:52:12.810 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8" 2024-02-17T14:52:12.810 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2024-02-17T14:52:12.810 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T14:52:12.810 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-02-17T14:52:12.811 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T14:52:12.811 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:52:12.811 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:52:12.811 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T14:52:12.811 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:52:12.811 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-02-17T14:52:12.830 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server 2024-02-17T14:52:12.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-02-17T14:52:12.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:52:12.901 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-02-17T14:52:12.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-02-17T14:52:12.975 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2024-02-17T14:52:13.036 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2024-02-17T14:52:13.036 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-02-17T14:52:13.096 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2024-02-17T14:52:13.096 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8" 2024-02-17T14:52:13.096 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2024-02-17T14:52:13.096 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:52:13.097 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8" 2024-02-17T14:52:13.097 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8" 2024-02-17T14:52:13.097 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T14:52:13.097 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-02-17T14:52:13.097 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T14:52:13.097 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:52:13.097 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:52:13.097 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T14:52:13.097 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:52:13.097 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-02-17T14:52:13.122 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2024-02-17T14:52:13.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-17T14:52:13.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:52:13.197 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-02-17T14:52:13.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-17T14:52:13.293 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-02-17T14:52:13.351 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-02-17T14:52:13.351 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-02-17T14:52:13.410 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-02-17T14:52:13.410 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8" 2024-02-17T14:52:13.410 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-02-17T14:52:13.410 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:52:13.410 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8" 2024-02-17T14:52:13.410 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2024-02-17T14:52:13.410 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T14:52:13.410 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-02-17T14:52:13.410 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T14:52:13.410 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:52:13.410 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:52:13.411 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T14:52:13.411 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:52:13.411 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-02-17T14:52:13.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:52:13.523 INFO:teuthology.dispatcher.supervisor:Running job 7563363 2024-02-17T14:52:13.524 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563363 --name yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563363/orig.config.yaml 2024-02-17T14:52:13.527 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563363 2024-02-17T14:52:13.527 INFO:teuthology.dispatcher.supervisor:Job PID: 18175 2024-02-17T14:52:13.527 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-17T14:54:13.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:56:13.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:58:13.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:00:14.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:02:14.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:04:14.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:06:14.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:08:14.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:10:14.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:12:15.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:14:15.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:16:15.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:18:15.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:20:15.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:22:15.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:24:16.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:26:16.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:28:16.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:30:16.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:32:16.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:34:16.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:36:17.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:38:17.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:40:17.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:42:17.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:44:17.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:46:17.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:48:18.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:50:18.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:52:18.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:54:18.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:56:18.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:58:18.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:00:19.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T16:00:19.173 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1