2024-02-17T11:09:16.138 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-17T11:09:16.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T11:09:16.292 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fed0d61fc10>, signals=[15]) 2024-02-17T11:09:16.293 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2024-02-17T11:09:16.293 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T11:09:16.293 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-02-17T11:09:16.310 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2024-02-17T11:09:16.311 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T11:09:16.311 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-02-17T11:09:16.327 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-02-17T11:09:16.327 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T11:09:16.327 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-02-17T11:09:16.426 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_9.stream (ID 10) 2024-02-17T11:09:16.440 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2024-02-17T11:09:16.461 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10) 2024-02-17T11:09:16.468 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 9.stream 2024-02-17T11:09:16.486 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2024-02-17T11:09:16.507 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream 2024-02-17T11:09:16.732 INFO:teuthology.orchestra.console.smithi088:Power off 2024-02-17T11:09:16.732 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T11:09:16.745 INFO:teuthology.orchestra.console.smithi161:Power off 2024-02-17T11:09:16.746 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T11:09:16.757 INFO:teuthology.orchestra.console.smithi112:Power off 2024-02-17T11:09:16.758 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T11:09:16.765 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-02-17T11:09:16.766 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T11:09:16.774 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-02-17T11:09:16.774 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T11:09:16.781 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-02-17T11:09:16.781 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T11:09:16.790 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-02-17T11:09:16.794 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-02-17T11:09:16.803 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-02-17T11:09:16.891 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-02-17T11:09:16.895 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-02-17T11:09:16.903 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-02-17T11:09:16.992 INFO:teuthology.orchestra.console.smithi088:Power on 2024-02-17T11:09:16.993 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T11:09:17.000 INFO:teuthology.orchestra.console.smithi161:Power on 2024-02-17T11:09:17.000 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T11:09:17.007 INFO:teuthology.orchestra.console.smithi112:Power on 2024-02-17T11:09:17.007 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T11:09:17.015 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2024-02-17T11:09:17.016 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T11:09:17.023 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-02-17T11:09:17.023 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T11:09:17.032 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2024-02-17T11:09:17.032 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T11:09:17.040 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-02-17T11:09:17.045 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-02-17T11:09:17.052 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-02-17T11:09:21.044 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T11:09:21.051 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T11:09:21.058 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T11:09:21.154 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-02-17T11:09:21.160 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-02-17T11:09:21.167 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-02-17T11:09:25.159 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T11:09:25.167 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T11:09:25.173 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T11:09:25.269 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-02-17T11:09:25.275 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-02-17T11:09:25.281 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-02-17T11:09:25.370 INFO:teuthology.orchestra.console.smithi088:Power on completed 2024-02-17T11:09:25.375 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-02-17T11:09:25.382 INFO:teuthology.orchestra.console.smithi112:Power on completed 2024-02-17T11:09:25.471 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2024-02-17T11:09:25.476 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-02-17T11:09:25.483 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2024-02-17T11:11:56.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:11:59.484 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-17T11:12:05.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:08.540 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-17T11:12:11.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:11.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:11.588 ERROR:teuthology.orchestra.connection:Error authenticating with smithi088.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-17T11:12:14.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:14.560 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-17T11:12:17.596 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-17T11:12:20.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:23.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:23.612 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-17T11:12:26.652 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-17T11:12:29.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:32.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:32.668 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-17T11:12:35.708 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-17T11:12:38.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:41.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:41.724 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-17T11:12:44.764 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-17T11:12:47.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:50.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:50.780 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-17T11:12:53.820 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-17T11:12:56.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:59.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:12:59.836 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-17T11:13:05.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:13:15.591 WARNING:teuthology.provision.fog.smithi088:timed out 2024-02-17T11:13:18.140 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-17T11:13:21.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:13:24.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:13:24.284 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-17T11:13:24.668 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-02-17T11:13:27.196 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-17T11:13:30.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:13:30.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:13:33.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:13:33.344 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-17T11:13:36.252 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-02-17T11:13:39.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:13:42.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:13:42.432 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-17T11:13:42.547 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T11:13:42.547 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T11:13:48.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:13:48.853 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T11:13:48.853 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T11:14:02.917 INFO:teuthology.provision.fog.smithi112:Node is ready 2024-02-17T11:14:02.917 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2024-02-17T11:14:02.935 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2024-02-17T11:14:02.935 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2024-02-17T11:14:02.992 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2024-02-17T11:14:02.993 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-02-17T11:14:03.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2024-02-17T11:14:03.145 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2024-02-17T11:14:03.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2024-02-17T11:14:03.284 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-02-17T11:14:03.352 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-02-17T11:14:03.407 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-02-17T11:14:03.408 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-02-17T11:14:03.408 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-02-17T11:14:03.408 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-02-17T11:14:03.408 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-02-17T11:14:03.408 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-02-17T11:14:03.408 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T11:14:03.408 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-02-17T11:14:03.408 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-02-17T11:14:03.408 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T11:14:03.408 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-02-17T11:14:03.408 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T11:14:03.409 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T11:14:03.409 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T11:14:03.409 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2024-02-17T11:14:03.411 DEBUG:teuthology.parallel:result is None 2024-02-17T11:14:04.229 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-02-17T11:14:04.229 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-02-17T11:14:04.246 INFO:teuthology.orchestra.run.smithi161.stdout:smithi046 2024-02-17T11:14:04.246 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi046 /etc/hosts 2024-02-17T11:14:04.304 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-02-17T11:14:04.304 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-02-17T11:14:04.444 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi046/smithi161/g' /etc/hosts 2024-02-17T11:14:04.476 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.46/172.21.15.161/g' /etc/hosts 2024-02-17T11:14:04.546 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi046/smithi161/g' /etc/hostname 2024-02-17T11:14:04.615 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-02-17T11:14:04.684 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-02-17T11:14:04.740 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-02-17T11:14:04.740 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-02-17T11:14:04.740 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-02-17T11:14:04.740 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-02-17T11:14:04.740 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-02-17T11:14:04.740 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-02-17T11:14:04.740 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T11:14:04.740 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-02-17T11:14:04.740 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-02-17T11:14:04.741 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T11:14:04.741 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-02-17T11:14:04.741 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T11:14:04.741 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T11:14:04.741 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T11:14:04.741 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-02-17T11:14:04.741 DEBUG:teuthology.parallel:result is None 2024-02-17T11:14:30.671 WARNING:teuthology.provision.fog.smithi088:timed out 2024-02-17T11:14:36.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:14:36.877 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T11:14:36.877 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T11:14:37.212 INFO:teuthology.provision.fog.smithi088:Node is ready 2024-02-17T11:14:37.212 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2024-02-17T11:14:37.227 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2024-02-17T11:14:37.227 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2024-02-17T11:14:37.282 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2024-02-17T11:14:37.282 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-02-17T11:14:37.389 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2024-02-17T11:14:37.417 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2024-02-17T11:14:37.485 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2024-02-17T11:14:37.553 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-02-17T11:14:37.619 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-02-17T11:14:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-02-17T11:14:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-02-17T11:14:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-02-17T11:14:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-02-17T11:14:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-02-17T11:14:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-02-17T11:14:37.673 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T11:14:37.674 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-02-17T11:14:37.674 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-02-17T11:14:37.674 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T11:14:37.674 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-02-17T11:14:37.674 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T11:14:37.674 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T11:14:37.674 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T11:14:37.674 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2024-02-17T11:14:37.675 DEBUG:teuthology.parallel:result is None 2024-02-17T11:14:37.884 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2024-02-17T11:14:37.884 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T11:14:37.921 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2024-02-17T11:14:37.921 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T11:14:37.937 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-02-17T11:14:37.937 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T11:14:37.955 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2024-02-17T11:14:37.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-02-17T11:14:37.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:14:38.041 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-02-17T11:14:38.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-02-17T11:14:38.106 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-02-17T11:14:38.159 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-02-17T11:14:38.160 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-02-17T11:14:38.214 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-02-17T11:14:38.214 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-02-17T11:14:38.214 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-02-17T11:14:38.214 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-02-17T11:14:38.214 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-02-17T11:14:38.214 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-02-17T11:14:38.214 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T11:14:38.215 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-02-17T11:14:38.215 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-02-17T11:14:38.215 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T11:14:38.215 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-02-17T11:14:38.215 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T11:14:38.215 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T11:14:38.215 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T11:14:38.216 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-02-17T11:14:38.238 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2024-02-17T11:14:38.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-02-17T11:14:38.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:14:38.327 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-02-17T11:14:38.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-02-17T11:14:38.494 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-02-17T11:14:38.548 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-02-17T11:14:38.549 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-02-17T11:14:38.603 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-02-17T11:14:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-02-17T11:14:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-02-17T11:14:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-02-17T11:14:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-02-17T11:14:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-02-17T11:14:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T11:14:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-02-17T11:14:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-02-17T11:14:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T11:14:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-02-17T11:14:38.604 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T11:14:38.605 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T11:14:38.605 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T11:14:38.605 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-02-17T11:14:38.655 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-02-17T11:14:38.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-17T11:14:38.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:14:38.743 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-02-17T11:14:38.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-17T11:14:38.813 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-02-17T11:14:38.869 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-02-17T11:14:38.870 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-02-17T11:14:38.926 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-02-17T11:14:38.926 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-02-17T11:14:38.926 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-02-17T11:14:38.926 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-02-17T11:14:38.926 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-02-17T11:14:38.926 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-02-17T11:14:38.927 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-17T11:14:38.927 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-02-17T11:14:38.927 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-02-17T11:14:38.927 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-17T11:14:38.927 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-02-17T11:14:38.927 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T11:14:38.927 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-17T11:14:38.927 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T11:14:38.927 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-02-17T11:14:38.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T11:14:39.048 INFO:teuthology.dispatcher.supervisor:Running job 7563095 2024-02-17T11:14:39.048 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563095 --name yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563095/orig.config.yaml 2024-02-17T11:14:39.051 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563095 2024-02-17T11:14:39.051 INFO:teuthology.dispatcher.supervisor:Job PID: 3206677 2024-02-17T11:14:39.051 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-17T11:16:39.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T11:18:39.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T11:20:39.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T11:22:39.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T11:24:39.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T11:26:39.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T11:28:39.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T11:28:39.613 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1