2024-04-01T17:06:01.764 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T17:06:01.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T17:06:01.930 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f658734dc10>, signals=[15]) 2024-04-01T17:06:01.931 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2024-04-01T17:06:01.931 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T17:06:01.931 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-04-01T17:06:01.948 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2024-04-01T17:06:01.948 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T17:06:01.948 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-04-01T17:06:01.973 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging 2024-04-01T17:06:01.973 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T17:06:01.973 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-04-01T17:06:02.060 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T17:06:02.078 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T17:06:02.097 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T17:06:02.109 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 9.stream 2024-04-01T17:06:02.112 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 9.stream 2024-04-01T17:06:02.144 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of centos 9.stream 2024-04-01T17:06:02.355 INFO:teuthology.orchestra.console.smithi090:Power off 2024-04-01T17:06:02.356 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T17:06:02.370 INFO:teuthology.orchestra.console.smithi097:Power off 2024-04-01T17:06:02.370 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T17:06:02.383 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2024-04-01T17:06:02.383 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:06:02.390 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2024-04-01T17:06:02.391 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:06:02.403 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-04-01T17:06:02.414 INFO:teuthology.orchestra.console.smithi100:Power off 2024-04-01T17:06:02.414 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T17:06:02.422 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2024-04-01T17:06:02.435 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2024-04-01T17:06:02.435 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:06:02.455 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-04-01T17:06:02.504 INFO:teuthology.orchestra.console.smithi090:Power off completed 2024-04-01T17:06:02.523 INFO:teuthology.orchestra.console.smithi097:Power off completed 2024-04-01T17:06:02.557 INFO:teuthology.orchestra.console.smithi100:Power off completed 2024-04-01T17:06:02.605 INFO:teuthology.orchestra.console.smithi090:Power on 2024-04-01T17:06:02.605 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T17:06:02.624 INFO:teuthology.orchestra.console.smithi097:Power on 2024-04-01T17:06:02.624 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T17:06:02.632 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On 2024-04-01T17:06:02.633 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:06:02.645 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On 2024-04-01T17:06:02.645 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:06:02.653 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-04-01T17:06:02.657 INFO:teuthology.orchestra.console.smithi100:Power on 2024-04-01T17:06:02.658 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T17:06:02.666 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2024-04-01T17:06:02.680 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On 2024-04-01T17:06:02.680 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:06:02.704 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-04-01T17:06:06.657 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:06:06.667 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:06:06.705 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:06:06.766 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2024-04-01T17:06:06.774 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2024-04-01T17:06:06.813 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-04-01T17:06:06.867 INFO:teuthology.orchestra.console.smithi090:Power on completed 2024-04-01T17:06:06.968 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2024-04-01T17:06:10.779 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:06:10.814 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T17:06:10.888 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2024-04-01T17:06:10.922 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-04-01T17:06:10.989 INFO:teuthology.orchestra.console.smithi097:Power on completed 2024-04-01T17:06:11.022 INFO:teuthology.orchestra.console.smithi100:Power on completed 2024-04-01T17:06:11.090 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2024-04-01T17:06:11.124 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish 2024-04-01T17:08:42.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:08:42.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:00.579 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-01T17:09:00.579 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-04-01T17:09:06.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:06.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:09.666 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-04-01T17:09:09.667 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-01T17:09:15.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:15.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:18.750 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-04-01T17:09:18.751 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-01T17:09:24.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:24.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:27.806 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-04-01T17:09:27.807 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-01T17:09:33.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:33.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:36.862 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-04-01T17:09:36.863 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-01T17:09:38.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:41.347 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-01T17:09:42.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:42.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:47.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:50.430 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-01T17:09:56.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:09:59.486 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-01T17:10:01.246 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-04-01T17:10:01.247 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-01T17:10:05.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:10:07.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:10:07.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:10:08.546 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-01T17:10:10.302 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-04-01T17:10:10.303 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-01T17:10:14.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:10:16.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:10:16.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:10:17.630 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-01T17:10:19.358 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-04-01T17:10:19.359 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-01T17:10:23.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:10:25.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:10:25.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:10:25.642 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T17:10:25.643 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T17:10:25.724 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T17:10:25.725 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T17:10:26.686 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-01T17:10:32.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:10:35.742 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-01T17:10:41.192 INFO:teuthology.provision.fog.smithi100:Node is ready 2024-04-01T17:10:41.192 DEBUG:teuthology.orchestra.run.smithi100:> hostname 2024-04-01T17:10:41.210 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com 2024-04-01T17:10:41.210 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts 2024-04-01T17:10:41.266 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100 2024-04-01T17:10:41.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2024-04-01T17:10:41.382 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts 2024-04-01T17:10:41.411 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts 2024-04-01T17:10:41.480 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname 2024-04-01T17:10:41.548 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2024-04-01T17:10:41.615 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-04-01T17:10:41.669 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-04-01T17:10:41.670 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-04-01T17:10:41.670 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-04-01T17:10:41.670 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-04-01T17:10:41.670 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-04-01T17:10:41.670 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-04-01T17:10:41.670 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T17:10:41.670 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-04-01T17:10:41.670 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-04-01T17:10:41.670 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T17:10:41.670 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-04-01T17:10:41.670 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T17:10:41.671 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T17:10:41.671 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T17:10:41.671 INFO:teuthology.provision.fog.smithi100:Deploy complete! 2024-04-01T17:10:41.673 DEBUG:teuthology.parallel:result is None 2024-04-01T17:10:41.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:10:44.798 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-01T17:10:46.246 INFO:teuthology.provision.fog.smithi097:Node is ready 2024-04-01T17:10:46.246 DEBUG:teuthology.orchestra.run.smithi097:> hostname 2024-04-01T17:10:46.264 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com 2024-04-01T17:10:46.264 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts 2024-04-01T17:10:46.321 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2024-04-01T17:10:46.322 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2024-04-01T17:10:46.451 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts 2024-04-01T17:10:46.481 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts 2024-04-01T17:10:46.550 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname 2024-04-01T17:10:46.619 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2024-04-01T17:10:46.687 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-04-01T17:10:46.742 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T17:10:46.743 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T17:10:46.744 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2024-04-01T17:10:46.744 DEBUG:teuthology.parallel:result is None 2024-04-01T17:10:50.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:10:53.854 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-04-01T17:10:59.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:11:59.915 WARNING:teuthology.provision.fog.smithi090:timed out 2024-04-01T17:12:05.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:12:06.200 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T17:12:06.201 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T17:12:06.544 INFO:teuthology.provision.fog.smithi090:Node is ready 2024-04-01T17:12:06.544 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2024-04-01T17:12:06.559 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2024-04-01T17:12:06.559 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2024-04-01T17:12:06.615 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2024-04-01T17:12:06.615 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2024-04-01T17:12:06.738 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2024-04-01T17:12:06.765 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2024-04-01T17:12:06.832 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2024-04-01T17:12:06.900 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2024-04-01T17:12:06.966 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-04-01T17:12:07.020 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-04-01T17:12:07.021 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-04-01T17:12:07.021 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-04-01T17:12:07.021 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-04-01T17:12:07.021 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-04-01T17:12:07.021 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-04-01T17:12:07.021 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T17:12:07.021 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-04-01T17:12:07.021 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-04-01T17:12:07.021 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T17:12:07.021 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-04-01T17:12:07.021 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T17:12:07.022 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T17:12:07.022 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T17:12:07.022 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2024-04-01T17:12:07.022 DEBUG:teuthology.parallel:result is None 2024-04-01T17:12:07.236 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2024-04-01T17:12:07.237 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T17:12:07.256 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2024-04-01T17:12:07.256 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T17:12:07.272 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com 2024-04-01T17:12:07.272 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T17:12:07.290 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2024-04-01T17:12:07.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-04-01T17:12:07.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:12:07.379 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-04-01T17:12:07.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-04-01T17:12:07.444 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-04-01T17:12:07.498 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-04-01T17:12:07.498 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-04-01T17:12:07.552 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-04-01T17:12:07.552 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-04-01T17:12:07.552 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-04-01T17:12:07.553 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-04-01T17:12:07.553 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-04-01T17:12:07.553 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-04-01T17:12:07.553 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T17:12:07.553 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-04-01T17:12:07.553 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-04-01T17:12:07.553 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T17:12:07.553 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-04-01T17:12:07.553 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T17:12:07.553 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T17:12:07.553 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T17:12:07.554 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-04-01T17:12:07.572 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2024-04-01T17:12:07.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-01T17:12:07.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:12:07.662 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-04-01T17:12:07.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-01T17:12:07.837 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-04-01T17:12:07.892 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-04-01T17:12:07.892 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-04-01T17:12:07.947 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2024-04-01T17:12:07.947 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2024-04-01T17:12:07.947 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2024-04-01T17:12:07.947 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2024-04-01T17:12:07.947 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2024-04-01T17:12:07.948 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2024-04-01T17:12:07.948 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T17:12:07.948 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2024-04-01T17:12:07.948 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2024-04-01T17:12:07.948 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T17:12:07.948 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2024-04-01T17:12:07.948 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T17:12:07.948 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T17:12:07.948 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T17:12:07.949 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-04-01T17:12:07.972 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server 2024-04-01T17:12:07.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-04-01T17:12:07.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T17:12:08.062 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-04-01T17:12:08.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-04-01T17:12:08.233 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-04-01T17:12:08.287 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-04-01T17:12:08.287 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-04-01T17:12:08.342 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-04-01T17:12:08.342 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-04-01T17:12:08.342 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-04-01T17:12:08.342 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-04-01T17:12:08.342 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-04-01T17:12:08.342 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-04-01T17:12:08.342 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T17:12:08.343 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-04-01T17:12:08.343 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-04-01T17:12:08.343 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T17:12:08.343 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-04-01T17:12:08.343 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T17:12:08.343 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T17:12:08.343 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T17:12:08.344 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-04-01T17:12:08.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T17:12:08.458 INFO:teuthology.dispatcher.supervisor:Running job 7634012 2024-04-01T17:12:08.459 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-01_14:11:32-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7634012 --name vshankar-2024-04-01_14:11:32-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/iozone}} -- /home/teuthworker/archive/vshankar-2024-04-01_14:11:32-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7634012/orig.config.yaml 2024-04-01T17:12:08.462 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-01_14:11:32-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7634012 2024-04-01T17:12:08.462 INFO:teuthology.dispatcher.supervisor:Job PID: 3592886 2024-04-01T17:12:08.462 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-01T17:14:08.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T17:16:08.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T17:18:08.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T17:20:09.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T17:22:09.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T17:24:09.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T17:26:09.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T17:28:09.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T17:28:09.802 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1