2024-02-17T14:19:57.351 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-17T14:19:57.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:19:57.510 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb6c648ec10>, signals=[15]) 2024-02-17T14:19:57.510 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2024-02-17T14:19:57.511 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T14:19:57.511 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-02-17T14:19:57.529 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging 2024-02-17T14:19:57.529 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T14:19:57.530 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-02-17T14:19:57.555 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2024-02-17T14:19:57.555 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T14:19:57.556 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-02-17T14:19:57.648 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_9.stream (ID 10) 2024-02-17T14:19:57.676 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_centos_9.stream (ID 10) 2024-02-17T14:19:57.691 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_9.stream (ID 10) 2024-02-17T14:19:57.694 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 9.stream 2024-02-17T14:19:57.727 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 9.stream 2024-02-17T14:19:57.730 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 9.stream 2024-02-17T14:19:57.912 INFO:teuthology.orchestra.console.smithi059:Power off 2024-02-17T14:19:57.913 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T14:19:57.936 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2024-02-17T14:19:57.937 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:19:57.962 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-02-17T14:19:57.984 INFO:teuthology.orchestra.console.smithi173:Power off 2024-02-17T14:19:57.985 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T14:19:57.999 INFO:teuthology.orchestra.console.smithi146:Power off 2024-02-17T14:19:57.999 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T14:19:58.008 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-02-17T14:19:58.008 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:19:58.023 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2024-02-17T14:19:58.023 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:19:58.030 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-02-17T14:19:58.045 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2024-02-17T14:20:01.964 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:02.031 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:02.045 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:02.073 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-02-17T14:20:02.140 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-02-17T14:20:02.153 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2024-02-17T14:20:06.077 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:06.140 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:06.154 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:06.186 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-02-17T14:20:06.251 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-02-17T14:20:06.263 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2024-02-17T14:20:06.364 INFO:teuthology.orchestra.console.smithi146:Power off completed 2024-02-17T14:20:06.465 INFO:teuthology.orchestra.console.smithi146:Power on 2024-02-17T14:20:06.465 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T14:20:06.486 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On 2024-02-17T14:20:06.487 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:06.509 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2024-02-17T14:20:10.190 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:10.253 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:10.299 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-02-17T14:20:10.362 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-02-17T14:20:10.400 INFO:teuthology.orchestra.console.smithi059:Power off completed 2024-02-17T14:20:10.463 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-02-17T14:20:10.501 INFO:teuthology.orchestra.console.smithi059:Power on 2024-02-17T14:20:10.502 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T14:20:10.510 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:10.522 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2024-02-17T14:20:10.523 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:10.542 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-02-17T14:20:10.564 INFO:teuthology.orchestra.console.smithi173:Power on 2024-02-17T14:20:10.564 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T14:20:10.590 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On 2024-02-17T14:20:10.590 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:10.613 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-02-17T14:20:10.619 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2024-02-17T14:20:14.548 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:14.614 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:14.621 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:14.659 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-02-17T14:20:14.723 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-02-17T14:20:14.732 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2024-02-17T14:20:14.825 INFO:teuthology.orchestra.console.smithi173:Power on completed 2024-02-17T14:20:14.833 INFO:teuthology.orchestra.console.smithi146:Power on completed 2024-02-17T14:20:14.925 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2024-02-17T14:20:14.934 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2024-02-17T14:20:18.660 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T14:20:18.885 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-02-17T14:20:18.986 INFO:teuthology.orchestra.console.smithi059:Power on completed 2024-02-17T14:20:19.087 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2024-02-17T14:22:45.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:22:45.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:22:46.046 ERROR:teuthology.orchestra.connection:Error authenticating with smithi173.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-17T14:22:48.797 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-02-17T14:22:49.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:22:52.924 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-02-17T14:22:54.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:22:57.852 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-02-17T14:22:58.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:23:01.980 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-02-17T14:23:03.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:23:06.912 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-02-17T14:23:07.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:23:11.036 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-02-17T14:23:12.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:23:15.964 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-02-17T14:23:17.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:23:20.092 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-02-17T14:23:21.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:23:25.025 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-02-17T14:23:26.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:23:29.148 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-02-17T14:23:31.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:23:34.080 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-02-17T14:23:35.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:23:40.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:23:43.132 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-02-17T14:23:49.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:23:50.050 WARNING:teuthology.provision.fog.smithi173:timed out 2024-02-17T14:23:56.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:24:14.396 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-02-17T14:24:20.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:24:23.452 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-02-17T14:24:29.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:24:29.988 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T14:24:29.989 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T14:24:35.151 WARNING:teuthology.provision.fog.smithi059:timed out 2024-02-17T14:24:41.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:24:41.401 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T14:24:41.402 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T14:24:41.743 INFO:teuthology.provision.fog.smithi059:Node is ready 2024-02-17T14:24:41.743 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2024-02-17T14:24:41.758 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2024-02-17T14:24:41.758 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2024-02-17T14:24:41.815 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2024-02-17T14:24:41.816 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2024-02-17T14:24:41.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2024-02-17T14:24:41.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2024-02-17T14:24:42.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2024-02-17T14:24:42.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2024-02-17T14:24:42.163 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-02-17T14:24:42.218 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-02-17T14:24:42.218 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-02-17T14:24:42.218 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-02-17T14:24:42.218 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:24:42.218 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-02-17T14:24:42.218 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-02-17T14:24:42.219 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T14:24:42.219 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-02-17T14:24:42.219 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-02-17T14:24:42.219 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T14:24:42.219 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:24:42.219 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:24:42.219 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T14:24:42.219 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:24:42.220 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2024-02-17T14:24:42.221 DEBUG:teuthology.parallel:result is None 2024-02-17T14:24:49.135 WARNING:teuthology.provision.fog.smithi146:timed out 2024-02-17T14:24:50.331 INFO:teuthology.provision.fog.smithi173:Node is ready 2024-02-17T14:24:50.332 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2024-02-17T14:24:50.350 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2024-02-17T14:24:50.350 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts 2024-02-17T14:24:50.409 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2024-02-17T14:24:50.409 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2024-02-17T14:24:50.534 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts 2024-02-17T14:24:50.564 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2024-02-17T14:24:50.634 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname 2024-02-17T14:24:50.702 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2024-02-17T14:24:50.770 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-02-17T14:24:50.826 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-02-17T14:24:50.826 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-02-17T14:24:50.826 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-02-17T14:24:50.826 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:24:50.826 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-02-17T14:24:50.826 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-02-17T14:24:50.826 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T14:24:50.826 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-02-17T14:24:50.826 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-02-17T14:24:50.827 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T14:24:50.827 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:24:50.827 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:24:50.827 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T14:24:50.827 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:24:50.827 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2024-02-17T14:24:50.828 DEBUG:teuthology.parallel:result is None 2024-02-17T14:24:55.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:24:55.407 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T14:24:55.407 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T14:24:55.740 INFO:teuthology.provision.fog.smithi146:Node is ready 2024-02-17T14:24:55.740 DEBUG:teuthology.orchestra.run.smithi146:> hostname 2024-02-17T14:24:55.756 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2024-02-17T14:24:55.756 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts 2024-02-17T14:24:55.812 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2024-02-17T14:24:55.812 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2024-02-17T14:24:55.917 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts 2024-02-17T14:24:55.946 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2024-02-17T14:24:56.014 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname 2024-02-17T14:24:56.082 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2024-02-17T14:24:56.150 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-02-17T14:24:56.205 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-02-17T14:24:56.205 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2024-02-17T14:24:56.205 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-02-17T14:24:56.205 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:24:56.205 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2024-02-17T14:24:56.205 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2024-02-17T14:24:56.205 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T14:24:56.205 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-02-17T14:24:56.206 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2024-02-17T14:24:56.206 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T14:24:56.206 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:24:56.206 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:24:56.206 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T14:24:56.206 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:24:56.206 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2024-02-17T14:24:56.207 DEBUG:teuthology.parallel:result is None 2024-02-17T14:24:56.425 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2024-02-17T14:24:56.425 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T14:24:56.478 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2024-02-17T14:24:56.478 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T14:24:56.521 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2024-02-17T14:24:56.521 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T14:24:56.673 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2024-02-17T14:24:56.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-02-17T14:24:56.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:24:56.778 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-02-17T14:24:56.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-02-17T14:24:56.962 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-02-17T14:24:57.018 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-02-17T14:24:57.018 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-02-17T14:24:57.073 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-02-17T14:24:57.073 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-02-17T14:24:57.073 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-02-17T14:24:57.073 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:24:57.073 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-02-17T14:24:57.073 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-02-17T14:24:57.073 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T14:24:57.073 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-02-17T14:24:57.073 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-02-17T14:24:57.073 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T14:24:57.074 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:24:57.074 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:24:57.074 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T14:24:57.074 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:24:57.074 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-02-17T14:24:57.097 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2024-02-17T14:24:57.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-02-17T14:24:57.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:24:57.188 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-02-17T14:24:57.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-02-17T14:24:57.255 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-02-17T14:24:57.311 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-02-17T14:24:57.312 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-02-17T14:24:57.367 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-02-17T14:24:57.367 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2024-02-17T14:24:57.367 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-02-17T14:24:57.368 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:24:57.368 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2024-02-17T14:24:57.368 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2024-02-17T14:24:57.368 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T14:24:57.368 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-02-17T14:24:57.368 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2024-02-17T14:24:57.368 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T14:24:57.368 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:24:57.368 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:24:57.368 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T14:24:57.368 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:24:57.369 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-02-17T14:24:57.397 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2024-02-17T14:24:57.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-02-17T14:24:57.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T14:24:57.488 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-02-17T14:24:57.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-02-17T14:24:57.561 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-02-17T14:24:57.617 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-02-17T14:24:57.617 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-02-17T14:24:57.673 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-02-17T14:24:57.673 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-02-17T14:24:57.673 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-02-17T14:24:57.673 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-02-17T14:24:57.673 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-02-17T14:24:57.673 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-02-17T14:24:57.673 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T14:24:57.673 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-02-17T14:24:57.674 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-02-17T14:24:57.674 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T14:24:57.674 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-02-17T14:24:57.674 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T14:24:57.674 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T14:24:57.674 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T14:24:57.674 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-02-17T14:24:57.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:24:57.820 INFO:teuthology.dispatcher.supervisor:Running job 7563327 2024-02-17T14:24:57.821 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563327 --name yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563327/orig.config.yaml 2024-02-17T14:24:57.824 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563327 2024-02-17T14:24:57.824 INFO:teuthology.dispatcher.supervisor:Job PID: 4073770 2024-02-17T14:24:57.824 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-17T14:26:57.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:28:57.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:30:57.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:32:58.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:34:58.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:36:58.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:38:58.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:40:58.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:42:58.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:44:58.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:46:58.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:48:58.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:50:58.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:52:58.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:54:58.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:56:58.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T14:58:59.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:00:59.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T15:00:59.136 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1