2024-02-22T15:04:09.133 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-22T15:04:09.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:04:09.331 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f59a8a82c10>, signals=[15]) 2024-02-22T15:04:09.332 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2024-02-22T15:04:09.332 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2024-02-22T15:04:09.332 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-02-22T15:04:09.357 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2024-02-22T15:04:09.357 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2024-02-22T15:04:09.357 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-02-22T15:04:09.382 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2024-02-22T15:04:09.382 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2024-02-22T15:04:09.382 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-02-22T15:04:09.481 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_9.stream (ID 10) 2024-02-22T15:04:09.490 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_centos_9.stream (ID 10) 2024-02-22T15:04:09.524 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_9.stream (ID 10) 2024-02-22T15:04:09.527 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 9.stream 2024-02-22T15:04:09.534 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 9.stream 2024-02-22T15:04:09.570 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 9.stream 2024-02-22T15:04:09.744 INFO:teuthology.orchestra.console.smithi114:Power off 2024-02-22T15:04:09.744 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-22T15:04:09.758 INFO:teuthology.orchestra.console.smithi079:Power off 2024-02-22T15:04:09.759 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-22T15:04:09.773 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2024-02-22T15:04:09.773 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:09.781 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2024-02-22T15:04:09.781 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:09.798 INFO:teuthology.orchestra.console.smithi169:Power off 2024-02-22T15:04:09.799 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-22T15:04:09.807 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-02-22T15:04:09.807 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-02-22T15:04:09.820 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2024-02-22T15:04:09.821 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:09.843 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-02-22T15:04:13.810 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:13.818 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:13.844 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:13.920 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-02-22T15:04:13.927 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-02-22T15:04:13.953 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-02-22T15:04:17.925 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:17.933 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:17.954 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:18.035 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-02-22T15:04:18.041 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-02-22T15:04:18.062 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-02-22T15:04:18.136 INFO:teuthology.orchestra.console.smithi079:Power off completed 2024-02-22T15:04:18.239 INFO:teuthology.orchestra.console.smithi079:Power on 2024-02-22T15:04:18.239 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-22T15:04:18.263 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2024-02-22T15:04:18.264 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:18.292 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-02-22T15:04:22.044 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:22.062 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:22.153 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2024-02-22T15:04:22.172 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-02-22T15:04:22.254 INFO:teuthology.orchestra.console.smithi114:Power off completed 2024-02-22T15:04:22.273 INFO:teuthology.orchestra.console.smithi169:Power off completed 2024-02-22T15:04:22.293 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:22.356 INFO:teuthology.orchestra.console.smithi114:Power on 2024-02-22T15:04:22.356 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-22T15:04:22.374 INFO:teuthology.orchestra.console.smithi169:Power on 2024-02-22T15:04:22.375 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-22T15:04:22.383 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On 2024-02-22T15:04:22.384 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:22.396 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2024-02-22T15:04:22.397 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:22.405 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2024-02-22T15:04:22.405 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-02-22T15:04:22.417 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-02-22T15:04:26.408 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:26.416 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:26.422 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:26.518 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-02-22T15:04:26.524 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-02-22T15:04:26.530 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-02-22T15:04:26.620 INFO:teuthology.orchestra.console.smithi114:Power on completed 2024-02-22T15:04:26.625 INFO:teuthology.orchestra.console.smithi079:Power on completed 2024-02-22T15:04:26.721 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2024-02-22T15:04:26.726 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2024-02-22T15:04:30.535 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T15:04:30.644 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-02-22T15:04:30.745 INFO:teuthology.orchestra.console.smithi169:Power on completed 2024-02-22T15:04:30.846 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2024-02-22T15:06:57.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:00.924 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-22T15:07:06.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:10.012 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-22T15:07:12.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:15.996 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-22T15:07:16.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:17.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:19.068 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-22T15:07:20.252 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-02-22T15:07:22.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:25.052 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-22T15:07:25.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:26.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:28.124 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-22T15:07:29.308 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-02-22T15:07:31.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:34.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:34.140 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-22T15:07:35.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:37.180 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-22T15:07:38.364 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-02-22T15:07:40.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:43.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:43.200 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-22T15:07:44.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:46.236 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-02-22T15:07:47.424 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-02-22T15:07:49.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:52.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:52.288 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-22T15:07:53.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:07:56.476 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-02-22T15:07:58.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:08:01.376 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-22T15:08:02.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:08:05.532 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-02-22T15:08:07.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:08:11.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:08:14.624 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-02-22T15:08:20.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:08:52.271 WARNING:teuthology.provision.fog.smithi079:timed out 2024-02-22T15:08:58.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:08:58.556 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-22T15:08:58.557 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-22T15:08:58.873 INFO:teuthology.provision.fog.smithi079:Node is ready 2024-02-22T15:08:58.873 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2024-02-22T15:08:58.887 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2024-02-22T15:08:58.888 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2024-02-22T15:08:58.942 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2024-02-22T15:08:58.943 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2024-02-22T15:08:59.052 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2024-02-22T15:08:59.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2024-02-22T15:08:59.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2024-02-22T15:08:59.216 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2024-02-22T15:08:59.282 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-02-22T15:08:59.337 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-02-22T15:08:59.337 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-02-22T15:08:59.337 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-02-22T15:08:59.337 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-02-22T15:08:59.337 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-02-22T15:08:59.337 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-02-22T15:08:59.337 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-22T15:08:59.337 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-02-22T15:08:59.337 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-02-22T15:08:59.337 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-22T15:08:59.338 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-02-22T15:08:59.338 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-22T15:08:59.338 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-22T15:08:59.338 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-22T15:08:59.339 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2024-02-22T15:08:59.340 DEBUG:teuthology.parallel:result is None 2024-02-22T15:09:07.388 WARNING:teuthology.provision.fog.smithi114:timed out 2024-02-22T15:09:13.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:09:13.652 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-22T15:09:13.653 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-22T15:09:13.985 INFO:teuthology.provision.fog.smithi114:Node is ready 2024-02-22T15:09:13.985 DEBUG:teuthology.orchestra.run.smithi114:> hostname 2024-02-22T15:09:14.000 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2024-02-22T15:09:14.000 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts 2024-02-22T15:09:14.056 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2024-02-22T15:09:14.056 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2024-02-22T15:09:14.161 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts 2024-02-22T15:09:14.190 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts 2024-02-22T15:09:14.258 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname 2024-02-22T15:09:14.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2024-02-22T15:09:14.392 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-02-22T15:09:14.447 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2024-02-22T15:09:14.448 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2024-02-22T15:09:14.448 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2024-02-22T15:09:14.448 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2024-02-22T15:09:14.448 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2024-02-22T15:09:14.448 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2024-02-22T15:09:14.448 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-22T15:09:14.448 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-02-22T15:09:14.448 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2024-02-22T15:09:14.449 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-22T15:09:14.449 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2024-02-22T15:09:14.449 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-22T15:09:14.449 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-22T15:09:14.449 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-22T15:09:14.449 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2024-02-22T15:09:14.450 DEBUG:teuthology.parallel:result is None 2024-02-22T15:09:20.639 WARNING:teuthology.provision.fog.smithi169:timed out 2024-02-22T15:09:26.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:09:26.901 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-22T15:09:26.901 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-22T15:09:27.223 INFO:teuthology.provision.fog.smithi169:Node is ready 2024-02-22T15:09:27.223 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2024-02-22T15:09:27.238 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2024-02-22T15:09:27.238 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2024-02-22T15:09:27.295 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2024-02-22T15:09:27.295 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-02-22T15:09:27.436 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2024-02-22T15:09:27.465 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2024-02-22T15:09:27.533 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2024-02-22T15:09:27.602 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-02-22T15:09:27.672 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-02-22T15:09:27.727 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-02-22T15:09:27.727 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-02-22T15:09:27.727 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-02-22T15:09:27.727 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-02-22T15:09:27.727 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-02-22T15:09:27.727 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-02-22T15:09:27.727 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-22T15:09:27.727 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-02-22T15:09:27.728 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-02-22T15:09:27.728 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-22T15:09:27.728 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-02-22T15:09:27.728 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-22T15:09:27.728 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-22T15:09:27.728 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-22T15:09:27.728 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2024-02-22T15:09:27.729 DEBUG:teuthology.parallel:result is None 2024-02-22T15:09:27.994 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2024-02-22T15:09:27.994 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-22T15:09:28.017 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2024-02-22T15:09:28.017 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-22T15:09:28.033 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2024-02-22T15:09:28.033 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-22T15:09:28.051 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2024-02-22T15:09:28.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-02-22T15:09:28.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:09:28.139 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-02-22T15:09:28.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-02-22T15:09:28.263 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-02-22T15:09:28.317 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-02-22T15:09:28.318 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-02-22T15:09:28.372 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-02-22T15:09:28.372 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-02-22T15:09:28.372 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-02-22T15:09:28.373 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-02-22T15:09:28.373 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-02-22T15:09:28.373 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-02-22T15:09:28.373 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-22T15:09:28.373 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-02-22T15:09:28.373 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-02-22T15:09:28.373 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-22T15:09:28.373 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-02-22T15:09:28.373 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-22T15:09:28.373 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-22T15:09:28.373 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-22T15:09:28.374 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-02-22T15:09:28.400 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2024-02-22T15:09:28.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-02-22T15:09:28.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:09:28.488 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-02-22T15:09:28.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-02-22T15:09:28.654 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-02-22T15:09:28.709 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-02-22T15:09:28.709 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-02-22T15:09:28.764 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-22T15:09:28.765 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-22T15:09:28.766 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-02-22T15:09:28.783 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2024-02-22T15:09:28.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-02-22T15:09:28.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T15:09:28.872 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-02-22T15:09:28.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-02-22T15:09:28.940 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-02-22T15:09:28.996 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-02-22T15:09:28.997 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-02-22T15:09:29.052 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-02-22T15:09:29.052 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-02-22T15:09:29.052 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-02-22T15:09:29.052 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-02-22T15:09:29.052 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-02-22T15:09:29.052 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-02-22T15:09:29.053 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-22T15:09:29.053 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-02-22T15:09:29.053 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-02-22T15:09:29.053 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-22T15:09:29.053 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-02-22T15:09:29.053 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-22T15:09:29.053 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-22T15:09:29.053 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-22T15:09:29.053 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-02-22T15:09:29.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:09:29.188 INFO:teuthology.dispatcher.supervisor:Running job 7570082 2024-02-22T15:09:29.188 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7570082 --name leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7570082/orig.config.yaml 2024-02-22T15:09:29.191 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7570082 2024-02-22T15:09:29.192 INFO:teuthology.dispatcher.supervisor:Job PID: 1108191 2024-02-22T15:09:29.192 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-22T15:11:29.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:13:29.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:15:29.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:17:29.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:19:29.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:21:30.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:23:30.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:25:30.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:27:30.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:29:30.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:31:31.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:33:31.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:35:31.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:37:31.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:39:31.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:41:31.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:43:32.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:45:32.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:47:32.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:49:32.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T15:49:32.657 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1