2024-02-19T15:51:40.556 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T15:51:40.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T15:51:40.745 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f62ba13bc10>, signals=[15]) 2024-02-19T15:51:40.745 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2024-02-19T15:51:40.745 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T15:51:40.745 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-02-19T15:51:40.764 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2024-02-19T15:51:40.764 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T15:51:40.764 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-02-19T15:51:40.789 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2024-02-19T15:51:40.789 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T15:51:40.790 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-02-19T15:51:40.880 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T15:51:40.903 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T15:51:40.940 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T15:51:40.944 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream 2024-02-19T15:51:40.948 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 9.stream 2024-02-19T15:51:40.989 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 9.stream 2024-02-19T15:51:41.159 INFO:teuthology.orchestra.console.smithi156:Power off 2024-02-19T15:51:41.160 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T15:51:41.175 INFO:teuthology.orchestra.console.smithi008:Power off 2024-02-19T15:51:41.175 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T15:51:41.186 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2024-02-19T15:51:41.186 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T15:51:41.197 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2024-02-19T15:51:41.197 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T15:51:41.208 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-02-19T15:51:41.213 INFO:teuthology.orchestra.console.smithi191:Power off 2024-02-19T15:51:41.214 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T15:51:41.222 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-02-19T15:51:41.236 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-02-19T15:51:41.236 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T15:51:41.260 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-19T15:51:41.309 INFO:teuthology.orchestra.console.smithi156:Power off completed 2024-02-19T15:51:41.323 INFO:teuthology.orchestra.console.smithi008:Power off completed 2024-02-19T15:51:41.361 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-02-19T15:51:41.410 INFO:teuthology.orchestra.console.smithi156:Power on 2024-02-19T15:51:41.411 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T15:51:41.424 INFO:teuthology.orchestra.console.smithi008:Power on 2024-02-19T15:51:41.424 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T15:51:41.433 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2024-02-19T15:51:41.433 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T15:51:41.445 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On 2024-02-19T15:51:41.445 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T15:51:41.455 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-02-19T15:51:41.462 INFO:teuthology.orchestra.console.smithi191:Power on 2024-02-19T15:51:41.462 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T15:51:41.471 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-02-19T15:51:41.484 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2024-02-19T15:51:41.484 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T15:51:41.512 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-19T15:51:45.456 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T15:51:45.471 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T15:51:45.514 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T15:51:45.565 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-02-19T15:51:45.580 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-02-19T15:51:45.622 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-19T15:51:45.681 INFO:teuthology.orchestra.console.smithi008:Power on completed 2024-02-19T15:51:45.723 INFO:teuthology.orchestra.console.smithi191:Power on completed 2024-02-19T15:51:45.782 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2024-02-19T15:51:45.823 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2024-02-19T15:51:49.568 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T15:51:49.677 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-02-19T15:51:49.778 INFO:teuthology.orchestra.console.smithi156:Power on completed 2024-02-19T15:51:49.878 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2024-02-19T15:54:16.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:16.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:19.648 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-19T15:54:19.676 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-19T15:54:25.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:25.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:28.736 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-19T15:54:28.736 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-19T15:54:34.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:34.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:35.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:37.824 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-19T15:54:37.824 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-19T15:54:38.748 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-02-19T15:54:43.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:43.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:44.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:46.908 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-19T15:54:46.908 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-19T15:54:47.804 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-02-19T15:54:52.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:52.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:53.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:54:55.964 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-19T15:54:55.964 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-19T15:54:56.864 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-02-19T15:55:01.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:55:01.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:55:02.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:55:05.020 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-19T15:55:05.052 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-19T15:55:05.948 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-02-19T15:55:11.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:55:11.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:55:11.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:55:14.112 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-19T15:55:15.004 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-02-19T15:55:20.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:55:21.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:55:24.060 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-02-19T15:55:29.472 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-19T15:55:30.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:55:35.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:55:38.556 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-02-19T15:55:44.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:55:47.567 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T15:55:47.568 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T15:56:07.972 INFO:teuthology.provision.fog.smithi008:Node is ready 2024-02-19T15:56:07.973 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2024-02-19T15:56:07.992 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2024-02-19T15:56:07.992 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2024-02-19T15:56:08.051 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2024-02-19T15:56:08.051 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-02-19T15:56:08.177 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2024-02-19T15:56:08.213 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2024-02-19T15:56:08.287 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2024-02-19T15:56:08.359 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-02-19T15:56:08.431 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-02-19T15:56:08.488 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-02-19T15:56:08.488 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-02-19T15:56:08.488 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-02-19T15:56:08.488 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-02-19T15:56:08.489 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-02-19T15:56:08.489 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-02-19T15:56:08.489 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T15:56:08.489 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-02-19T15:56:08.489 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-02-19T15:56:08.489 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T15:56:08.489 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-02-19T15:56:08.489 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T15:56:08.489 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T15:56:08.489 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T15:56:08.490 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2024-02-19T15:56:08.492 DEBUG:teuthology.parallel:result is None 2024-02-19T15:56:20.128 WARNING:teuthology.provision.fog.smithi191:timed out 2024-02-19T15:56:26.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:56:26.392 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T15:56:26.392 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T15:56:26.734 INFO:teuthology.provision.fog.smithi191:Node is ready 2024-02-19T15:56:26.734 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2024-02-19T15:56:26.748 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2024-02-19T15:56:26.749 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2024-02-19T15:56:26.803 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2024-02-19T15:56:26.803 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-02-19T15:56:26.927 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2024-02-19T15:56:26.953 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2024-02-19T15:56:27.023 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2024-02-19T15:56:27.092 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-02-19T15:56:27.161 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-02-19T15:56:27.217 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T15:56:27.218 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T15:56:27.219 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2024-02-19T15:56:27.219 DEBUG:teuthology.parallel:result is None 2024-02-19T15:56:30.067 WARNING:teuthology.provision.fog.smithi156:timed out 2024-02-19T15:56:36.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:56:36.299 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T15:56:36.299 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T15:56:36.629 INFO:teuthology.provision.fog.smithi156:Node is ready 2024-02-19T15:56:36.629 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2024-02-19T15:56:36.644 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2024-02-19T15:56:36.644 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2024-02-19T15:56:36.700 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2024-02-19T15:56:36.700 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2024-02-19T15:56:36.809 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2024-02-19T15:56:36.838 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2024-02-19T15:56:36.905 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2024-02-19T15:56:36.974 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2024-02-19T15:56:37.040 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-02-19T15:56:37.094 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2024-02-19T15:56:37.094 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2024-02-19T15:56:37.095 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2024-02-19T15:56:37.095 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2024-02-19T15:56:37.095 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2024-02-19T15:56:37.095 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2024-02-19T15:56:37.095 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T15:56:37.095 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2024-02-19T15:56:37.095 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2024-02-19T15:56:37.095 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T15:56:37.095 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2024-02-19T15:56:37.095 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T15:56:37.095 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T15:56:37.095 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T15:56:37.095 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2024-02-19T15:56:37.096 DEBUG:teuthology.parallel:result is None 2024-02-19T15:56:37.313 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2024-02-19T15:56:37.313 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T15:56:37.337 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2024-02-19T15:56:37.337 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T15:56:37.353 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2024-02-19T15:56:37.353 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T15:56:37.371 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2024-02-19T15:56:37.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-02-19T15:56:37.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:56:37.474 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-02-19T15:56:37.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-02-19T15:56:37.663 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2024-02-19T15:56:37.717 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2024-02-19T15:56:37.718 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-02-19T15:56:37.773 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-02-19T15:56:37.773 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-02-19T15:56:37.774 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-02-19T15:56:37.774 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-02-19T15:56:37.774 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-02-19T15:56:37.774 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-02-19T15:56:37.774 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T15:56:37.774 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-02-19T15:56:37.774 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-02-19T15:56:37.774 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T15:56:37.774 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-02-19T15:56:37.774 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T15:56:37.774 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T15:56:37.774 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T15:56:37.775 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-02-19T15:56:37.795 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2024-02-19T15:56:37.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-02-19T15:56:37.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:56:37.881 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-02-19T15:56:37.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-02-19T15:56:37.946 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2024-02-19T15:56:38.001 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2024-02-19T15:56:38.001 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-02-19T15:56:38.056 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2024-02-19T15:56:38.056 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2024-02-19T15:56:38.056 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2024-02-19T15:56:38.056 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2024-02-19T15:56:38.056 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2024-02-19T15:56:38.056 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2024-02-19T15:56:38.056 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T15:56:38.057 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2024-02-19T15:56:38.057 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2024-02-19T15:56:38.057 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T15:56:38.057 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2024-02-19T15:56:38.057 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T15:56:38.057 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T15:56:38.057 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T15:56:38.058 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-02-19T15:56:38.079 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2024-02-19T15:56:38.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-02-19T15:56:38.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T15:56:38.168 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-02-19T15:56:38.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-02-19T15:56:38.339 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-02-19T15:56:38.393 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-02-19T15:56:38.393 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-02-19T15:56:38.448 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-02-19T15:56:38.448 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-02-19T15:56:38.448 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-02-19T15:56:38.448 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-02-19T15:56:38.448 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-02-19T15:56:38.448 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-02-19T15:56:38.448 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T15:56:38.448 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-02-19T15:56:38.448 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-02-19T15:56:38.448 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T15:56:38.448 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-02-19T15:56:38.449 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T15:56:38.449 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T15:56:38.449 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T15:56:38.449 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-02-19T15:56:38.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T15:56:38.568 INFO:teuthology.dispatcher.supervisor:Running job 7566488 2024-02-19T15:56:38.568 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi/7566488 --name leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi/7566488/orig.config.yaml 2024-02-19T15:56:38.571 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi/7566488 2024-02-19T15:56:38.572 INFO:teuthology.dispatcher.supervisor:Job PID: 2985026 2024-02-19T15:56:38.572 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-19T15:58:38.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:00:38.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:02:39.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:04:39.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:06:39.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:08:39.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:10:39.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:12:39.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:14:40.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:16:40.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:18:40.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:20:40.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:22:40.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:24:40.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:26:41.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:28:41.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:30:41.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:32:41.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:34:41.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:36:41.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:38:42.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:38:42.176 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1