2024-02-19T16:08:58.276 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T16:08:58.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:08:58.439 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0b7a609c10>, signals=[15]) 2024-02-19T16:08:58.440 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2024-02-19T16:08:58.440 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T16:08:58.440 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-02-19T16:08:58.459 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2024-02-19T16:08:58.459 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T16:08:58.459 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2024-02-19T16:08:58.484 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2024-02-19T16:08:58.484 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T16:08:58.484 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-02-19T16:08:58.572 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T16:08:58.602 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T16:08:58.608 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T16:08:58.617 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 9.stream 2024-02-19T16:08:58.648 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 9.stream 2024-02-19T16:08:58.653 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 9.stream 2024-02-19T16:08:58.907 INFO:teuthology.orchestra.console.smithi098:Power off 2024-02-19T16:08:58.908 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T16:08:58.921 INFO:teuthology.orchestra.console.smithi145:Power off 2024-02-19T16:08:58.922 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T16:08:58.932 INFO:teuthology.orchestra.console.smithi125:Power off 2024-02-19T16:08:58.933 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T16:08:58.941 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2024-02-19T16:08:58.941 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:08:58.948 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2024-02-19T16:08:58.949 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:08:58.958 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2024-02-19T16:08:58.958 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:08:58.967 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-02-19T16:08:58.973 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-19T16:08:58.980 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-02-19T16:09:02.968 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:02.975 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:02.981 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:03.078 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-02-19T16:09:03.083 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-19T16:09:03.089 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-02-19T16:09:07.081 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:07.093 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:07.100 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:07.195 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-02-19T16:09:07.202 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-19T16:09:07.209 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-02-19T16:09:07.296 INFO:teuthology.orchestra.console.smithi098:Power off completed 2024-02-19T16:09:07.310 INFO:teuthology.orchestra.console.smithi125:Power off completed 2024-02-19T16:09:07.397 INFO:teuthology.orchestra.console.smithi098:Power on 2024-02-19T16:09:07.398 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T16:09:07.411 INFO:teuthology.orchestra.console.smithi125:Power on 2024-02-19T16:09:07.411 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T16:09:07.419 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2024-02-19T16:09:07.420 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:07.433 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On 2024-02-19T16:09:07.433 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:07.442 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-02-19T16:09:07.453 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-02-19T16:09:11.204 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:11.313 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-02-19T16:09:11.414 INFO:teuthology.orchestra.console.smithi145:Power off completed 2024-02-19T16:09:11.443 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:11.455 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:11.515 INFO:teuthology.orchestra.console.smithi145:Power on 2024-02-19T16:09:11.516 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T16:09:11.537 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On 2024-02-19T16:09:11.537 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:11.553 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-02-19T16:09:11.560 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-02-19T16:09:11.563 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-02-19T16:09:15.556 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:15.563 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:15.569 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:09:15.666 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-02-19T16:09:15.671 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-19T16:09:15.677 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-02-19T16:09:15.768 INFO:teuthology.orchestra.console.smithi098:Power on completed 2024-02-19T16:09:15.772 INFO:teuthology.orchestra.console.smithi145:Power on completed 2024-02-19T16:09:15.778 INFO:teuthology.orchestra.console.smithi125:Power on completed 2024-02-19T16:09:15.869 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2024-02-19T16:09:15.873 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2024-02-19T16:09:15.879 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2024-02-19T16:11:47.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:11:47.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:11:50.140 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-02-19T16:11:56.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:11:59.196 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-02-19T16:12:02.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:12:05.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:12:05.244 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-19T16:12:08.252 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-02-19T16:12:11.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:12:14.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:12:14.300 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-19T16:12:17.308 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-02-19T16:12:20.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:12:23.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:12:23.360 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-19T16:12:26.364 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-02-19T16:12:29.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:12:32.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:12:32.412 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-19T16:12:35.420 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-02-19T16:12:38.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:12:41.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:12:41.468 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-19T16:12:47.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:12:50.524 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-19T16:12:56.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:12:59.836 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-02-19T16:13:05.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:08.892 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-02-19T16:13:14.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:17.948 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-02-19T16:13:18.105 ERROR:teuthology.orchestra.connection:Error authenticating with smithi125.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2024-02-19T16:13:23.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:24.278 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T16:13:24.278 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T16:13:25.184 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-02-19T16:13:31.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:33.116 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T16:13:33.117 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T16:13:39.668 INFO:teuthology.provision.fog.smithi098:Node is ready 2024-02-19T16:13:39.668 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2024-02-19T16:13:39.685 INFO:teuthology.orchestra.run.smithi098.stdout:smithi046 2024-02-19T16:13:39.686 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi046 /etc/hosts 2024-02-19T16:13:39.742 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-02-19T16:13:39.743 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-02-19T16:13:39.892 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi046/smithi098/g' /etc/hosts 2024-02-19T16:13:39.924 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.46/172.21.15.98/g' /etc/hosts 2024-02-19T16:13:39.994 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi046/smithi098/g' /etc/hostname 2024-02-19T16:13:40.064 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-02-19T16:13:40.131 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-02-19T16:13:40.187 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-02-19T16:13:40.187 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-02-19T16:13:40.187 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-02-19T16:13:40.187 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-02-19T16:13:40.187 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-02-19T16:13:40.187 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-02-19T16:13:40.187 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T16:13:40.187 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-02-19T16:13:40.187 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-02-19T16:13:40.187 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T16:13:40.187 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-02-19T16:13:40.187 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T16:13:40.188 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T16:13:40.188 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T16:13:40.188 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2024-02-19T16:13:40.190 DEBUG:teuthology.parallel:result is None 2024-02-19T16:13:53.445 INFO:teuthology.provision.fog.smithi125:Node is ready 2024-02-19T16:13:53.445 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2024-02-19T16:13:53.463 INFO:teuthology.orchestra.run.smithi125.stdout:smithi046 2024-02-19T16:13:53.463 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi046 /etc/hosts 2024-02-19T16:13:53.521 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-02-19T16:13:53.521 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2024-02-19T16:13:53.661 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi046/smithi125/g' /etc/hosts 2024-02-19T16:13:53.694 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.46/172.21.15.125/g' /etc/hosts 2024-02-19T16:13:53.766 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi046/smithi125/g' /etc/hostname 2024-02-19T16:13:53.837 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2024-02-19T16:13:53.907 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2024-02-19T16:13:53.964 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2024-02-19T16:13:53.964 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9" 2024-02-19T16:13:53.964 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2024-02-19T16:13:53.964 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2024-02-19T16:13:53.964 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9" 2024-02-19T16:13:53.964 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9" 2024-02-19T16:13:53.964 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T16:13:53.964 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2024-02-19T16:13:53.964 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon" 2024-02-19T16:13:53.965 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T16:13:53.965 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2024-02-19T16:13:53.965 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T16:13:53.965 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T16:13:53.965 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T16:13:53.965 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2024-02-19T16:13:53.966 DEBUG:teuthology.parallel:result is None 2024-02-19T16:13:56.528 WARNING:teuthology.provision.fog.smithi145:timed out 2024-02-19T16:14:01.280 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-02-19T16:14:02.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:02.866 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T16:14:02.866 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T16:14:03.201 INFO:teuthology.provision.fog.smithi145:Node is ready 2024-02-19T16:14:03.201 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2024-02-19T16:14:03.216 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2024-02-19T16:14:03.216 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2024-02-19T16:14:03.271 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2024-02-19T16:14:03.271 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2024-02-19T16:14:03.386 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2024-02-19T16:14:03.414 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2024-02-19T16:14:03.481 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2024-02-19T16:14:03.549 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2024-02-19T16:14:03.615 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-02-19T16:14:03.669 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-02-19T16:14:03.670 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-02-19T16:14:03.670 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-02-19T16:14:03.670 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-02-19T16:14:03.670 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-02-19T16:14:03.670 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-02-19T16:14:03.670 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T16:14:03.670 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-02-19T16:14:03.670 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-02-19T16:14:03.670 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T16:14:03.670 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-02-19T16:14:03.670 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T16:14:03.670 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T16:14:03.671 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T16:14:03.671 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2024-02-19T16:14:03.671 DEBUG:teuthology.parallel:result is None 2024-02-19T16:14:03.880 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2024-02-19T16:14:03.880 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T16:14:03.905 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2024-02-19T16:14:03.905 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T16:14:03.921 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2024-02-19T16:14:03.922 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T16:14:03.939 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2024-02-19T16:14:03.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-02-19T16:14:03.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:04.033 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-02-19T16:14:04.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-02-19T16:14:04.202 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-02-19T16:14:04.257 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-02-19T16:14:04.257 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-02-19T16:14:04.312 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-02-19T16:14:04.312 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-02-19T16:14:04.312 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-02-19T16:14:04.312 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-02-19T16:14:04.312 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-02-19T16:14:04.312 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-02-19T16:14:04.312 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T16:14:04.313 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-02-19T16:14:04.313 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-02-19T16:14:04.313 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T16:14:04.313 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-02-19T16:14:04.313 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T16:14:04.313 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T16:14:04.313 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T16:14:04.313 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-02-19T16:14:04.330 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2024-02-19T16:14:04.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-02-19T16:14:04.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:04.436 DEBUG:teuthology.orchestra.run.smithi125:> true 2024-02-19T16:14:04.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-02-19T16:14:04.505 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2024-02-19T16:14:04.561 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2024-02-19T16:14:04.561 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2024-02-19T16:14:04.616 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2024-02-19T16:14:04.616 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9" 2024-02-19T16:14:04.616 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2024-02-19T16:14:04.617 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2024-02-19T16:14:04.617 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9" 2024-02-19T16:14:04.617 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9" 2024-02-19T16:14:04.617 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T16:14:04.617 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2024-02-19T16:14:04.617 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon" 2024-02-19T16:14:04.617 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T16:14:04.617 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2024-02-19T16:14:04.617 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T16:14:04.617 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T16:14:04.617 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T16:14:04.618 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2024-02-19T16:14:04.638 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2024-02-19T16:14:04.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-02-19T16:14:04.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:04.731 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-02-19T16:14:04.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-02-19T16:14:04.799 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-02-19T16:14:04.853 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-02-19T16:14:04.854 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-02-19T16:14:04.909 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-02-19T16:14:04.909 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-02-19T16:14:04.909 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-02-19T16:14:04.909 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-02-19T16:14:04.909 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-02-19T16:14:04.909 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-02-19T16:14:04.909 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T16:14:04.909 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-02-19T16:14:04.910 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-02-19T16:14:04.910 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T16:14:04.910 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-02-19T16:14:04.910 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T16:14:04.910 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T16:14:04.910 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T16:14:04.910 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-02-19T16:14:04.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:14:05.021 INFO:teuthology.dispatcher.supervisor:Running job 7566500 2024-02-19T16:14:05.021 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi/7566500 --name leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/pjd}} -- /home/teuthworker/archive/leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi/7566500/orig.config.yaml 2024-02-19T16:14:05.024 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi/7566500 2024-02-19T16:14:05.024 INFO:teuthology.dispatcher.supervisor:Job PID: 3028668 2024-02-19T16:14:05.025 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-19T16:16:05.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:18:05.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:20:05.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:22:05.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:24:05.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:26:06.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:28:06.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:28:06.280 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1