2024-04-17T09:31:06.122 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T09:31:06.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:31:06.294 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1f1961dc10>, signals=[15]) 2024-04-17T09:31:06.294 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2024-04-17T09:31:06.295 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:31:06.295 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-04-17T09:31:06.319 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging 2024-04-17T09:31:06.319 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:31:06.319 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-04-17T09:31:06.335 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2024-04-17T09:31:06.335 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:31:06.335 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-17T09:31:06.425 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:31:06.439 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:31:06.457 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:31:06.482 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 9.stream 2024-04-17T09:31:06.489 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of centos 9.stream 2024-04-17T09:31:06.504 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 9.stream 2024-04-17T09:31:06.741 INFO:teuthology.orchestra.console.smithi050:Power off 2024-04-17T09:31:06.741 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:31:06.761 INFO:teuthology.orchestra.console.smithi070:Power off 2024-04-17T09:31:06.762 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:31:06.773 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2024-04-17T09:31:06.773 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:31:06.783 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2024-04-17T09:31:06.783 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:31:06.800 INFO:teuthology.orchestra.console.smithi172:Power off 2024-04-17T09:31:06.801 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:31:06.808 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-04-17T09:31:06.809 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2024-04-17T09:31:06.821 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-04-17T09:31:06.821 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:31:06.845 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-17T09:31:06.909 INFO:teuthology.orchestra.console.smithi070:Power off completed 2024-04-17T09:31:06.910 INFO:teuthology.orchestra.console.smithi050:Power off completed 2024-04-17T09:31:06.946 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-04-17T09:31:07.011 INFO:teuthology.orchestra.console.smithi070:Power on 2024-04-17T09:31:07.011 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:31:07.018 INFO:teuthology.orchestra.console.smithi050:Power on 2024-04-17T09:31:07.019 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:31:07.033 DEBUG:teuthology.orchestra.console.smithi070:power on output: Chassis Power Control: Up/On 2024-04-17T09:31:07.033 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:31:07.042 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On 2024-04-17T09:31:07.042 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:31:07.049 INFO:teuthology.orchestra.console.smithi172:Power on 2024-04-17T09:31:07.049 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:31:07.057 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-04-17T09:31:07.063 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2024-04-17T09:31:07.071 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2024-04-17T09:31:07.074 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:31:07.096 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-17T09:31:11.058 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:31:11.066 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:31:11.098 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:31:11.168 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-04-17T09:31:11.174 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2024-04-17T09:31:11.206 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-17T09:31:11.270 INFO:teuthology.orchestra.console.smithi070:Power on completed 2024-04-17T09:31:11.371 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2024-04-17T09:31:15.178 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:31:15.207 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:31:15.287 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-04-17T09:31:15.316 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-17T09:31:15.388 INFO:teuthology.orchestra.console.smithi050:Power on completed 2024-04-17T09:31:15.417 INFO:teuthology.orchestra.console.smithi172:Power on completed 2024-04-17T09:31:15.489 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2024-04-17T09:31:15.518 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2024-04-17T09:33:46.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:33:49.826 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-04-17T09:33:55.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:33:57.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:33:58.910 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-04-17T09:34:00.830 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T09:34:04.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:06.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:07.966 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-04-17T09:34:09.886 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T09:34:13.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:15.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:17.054 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-04-17T09:34:18.942 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T09:34:23.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:24.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:26.110 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-04-17T09:34:27.998 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T09:34:32.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:32.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:34.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:35.102 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-17T09:34:35.170 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-04-17T09:34:37.055 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T09:34:41.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:41.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:43.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:44.158 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-17T09:34:50.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:34:53.246 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-17T09:34:59.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:35:01.406 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T09:35:02.302 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-17T09:35:07.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:35:08.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:35:10.462 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T09:35:11.358 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-17T09:35:16.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:35:17.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:35:19.550 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-17T09:35:20.414 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-17T09:35:25.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:35:25.781 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:35:25.782 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:35:26.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:35:29.470 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-17T09:35:35.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:35:41.173 WARNING:teuthology.provision.fog.smithi050:timed out 2024-04-17T09:35:46.118 INFO:teuthology.provision.fog.smithi070:Node is ready 2024-04-17T09:35:46.118 DEBUG:teuthology.orchestra.run.smithi070:> hostname 2024-04-17T09:35:46.137 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2024-04-17T09:35:46.137 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts 2024-04-17T09:35:46.195 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2024-04-17T09:35:46.195 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2024-04-17T09:35:46.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts 2024-04-17T09:35:46.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts 2024-04-17T09:35:46.415 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname 2024-04-17T09:35:46.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2024-04-17T09:35:46.552 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-04-17T09:35:46.608 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-04-17T09:35:46.608 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-04-17T09:35:46.608 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-04-17T09:35:46.608 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:35:46.608 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-04-17T09:35:46.608 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:35:46.608 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:35:46.608 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-04-17T09:35:46.608 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:35:46.608 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:35:46.609 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:35:46.609 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:35:46.609 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:35:46.609 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:35:46.609 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2024-04-17T09:35:46.611 DEBUG:teuthology.parallel:result is None 2024-04-17T09:35:47.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:35:47.448 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:35:47.449 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:35:47.771 INFO:teuthology.provision.fog.smithi050:Node is ready 2024-04-17T09:35:47.771 DEBUG:teuthology.orchestra.run.smithi050:> hostname 2024-04-17T09:35:47.785 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2024-04-17T09:35:47.786 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts 2024-04-17T09:35:47.841 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2024-04-17T09:35:47.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2024-04-17T09:35:47.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts 2024-04-17T09:35:47.972 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts 2024-04-17T09:35:48.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname 2024-04-17T09:35:48.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2024-04-17T09:35:48.184 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-04-17T09:35:48.239 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-04-17T09:35:48.240 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-04-17T09:35:48.240 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-04-17T09:35:48.240 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:35:48.240 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-04-17T09:35:48.240 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:35:48.240 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:35:48.240 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-04-17T09:35:48.241 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:35:48.241 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:35:48.241 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:35:48.241 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:35:48.241 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:35:48.241 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:35:48.242 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2024-04-17T09:35:48.242 DEBUG:teuthology.parallel:result is None 2024-04-17T09:35:53.886 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-17T09:35:59.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:36:02.946 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-17T09:36:08.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:36:12.030 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-17T09:36:18.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:36:18.483 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:36:18.483 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:36:33.833 INFO:teuthology.provision.fog.smithi172:Node is ready 2024-04-17T09:36:33.834 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2024-04-17T09:36:33.891 INFO:teuthology.orchestra.run.smithi172.stdout:smithi046 2024-04-17T09:36:33.891 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi046 /etc/hosts 2024-04-17T09:36:33.949 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-17T09:36:33.949 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2024-04-17T09:36:34.093 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi046/smithi172/g' /etc/hosts 2024-04-17T09:36:34.122 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.46/172.21.15.172/g' /etc/hosts 2024-04-17T09:36:34.192 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi046/smithi172/g' /etc/hostname 2024-04-17T09:36:34.260 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2024-04-17T09:36:34.327 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-17T09:36:34.382 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-04-17T09:36:34.382 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-04-17T09:36:34.382 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-04-17T09:36:34.382 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:36:34.382 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-04-17T09:36:34.382 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:36:34.382 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:36:34.383 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-17T09:36:34.383 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:36:34.383 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:36:34.383 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:36:34.383 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:36:34.383 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:36:34.383 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:36:34.383 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2024-04-17T09:36:34.383 DEBUG:teuthology.parallel:result is None 2024-04-17T09:36:34.599 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2024-04-17T09:36:34.600 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:36:34.623 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2024-04-17T09:36:34.623 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:36:34.638 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2024-04-17T09:36:34.638 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:36:34.655 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:36:34.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-17T09:36:34.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:36:34.760 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-04-17T09:36:34.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-04-17T09:36:34.945 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-04-17T09:36:35.000 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-04-17T09:36:35.000 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-04-17T09:36:35.055 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:36:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:36:35.057 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-04-17T09:36:35.080 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:36:35.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-17T09:36:35.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:36:35.180 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-04-17T09:36:35.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-17T09:36:35.349 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-04-17T09:36:35.404 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-04-17T09:36:35.404 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-04-17T09:36:35.459 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-04-17T09:36:35.459 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-04-17T09:36:35.459 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-04-17T09:36:35.459 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:36:35.459 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-04-17T09:36:35.459 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:36:35.459 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:36:35.459 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-04-17T09:36:35.459 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:36:35.459 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:36:35.459 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:36:35.459 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:36:35.460 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:36:35.460 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:36:35.460 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-04-17T09:36:35.504 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:36:35.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-17T09:36:35.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:36:35.592 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-17T09:36:35.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-17T09:36:35.665 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-04-17T09:36:35.720 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-04-17T09:36:35.720 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-17T09:36:35.774 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-04-17T09:36:35.774 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-04-17T09:36:35.775 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-04-17T09:36:35.775 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:36:35.775 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-04-17T09:36:35.775 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:36:35.775 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:36:35.775 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-17T09:36:35.775 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:36:35.775 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:36:35.775 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:36:35.775 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:36:35.775 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:36:35.775 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:36:35.776 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-17T09:36:35.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:36:35.888 INFO:teuthology.dispatcher.supervisor:Running job 7660024 2024-04-17T09:36:35.888 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660024 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/iogen}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660024/orig.config.yaml 2024-04-17T09:36:35.891 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660024 2024-04-17T09:36:35.892 INFO:teuthology.dispatcher.supervisor:Job PID: 665528 2024-04-17T09:36:35.892 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T09:38:35.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:40:36.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:42:36.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:44:36.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:44:36.574 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1