2024-03-21T15:31:18.994 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-21T15:31:18.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:31:19.192 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc1207a0c10>, signals=[15]) 2024-03-21T15:31:19.192 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2024-03-21T15:31:19.192 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T15:31:19.193 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-03-21T15:31:19.218 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-03-21T15:31:19.218 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T15:31:19.218 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-03-21T15:31:19.243 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2024-03-21T15:31:19.243 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T15:31:19.243 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-03-21T15:31:19.331 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T15:31:19.352 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T15:31:19.378 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 9.stream 2024-03-21T15:31:19.389 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T15:31:19.405 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream 2024-03-21T15:31:19.444 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 9.stream 2024-03-21T15:31:19.616 INFO:teuthology.orchestra.console.smithi059:Power off 2024-03-21T15:31:19.616 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T15:31:19.631 INFO:teuthology.orchestra.console.smithi161:Power off 2024-03-21T15:31:19.632 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T15:31:19.640 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2024-03-21T15:31:19.640 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:19.653 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-03-21T15:31:19.654 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:19.668 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-03-21T15:31:19.676 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-21T15:31:19.693 INFO:teuthology.orchestra.console.smithi173:Power off 2024-03-21T15:31:19.693 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T15:31:19.715 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-03-21T15:31:19.715 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:19.736 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-03-21T15:31:23.670 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:23.678 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:23.738 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:23.780 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-03-21T15:31:23.786 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-21T15:31:23.846 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-03-21T15:31:27.785 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:27.793 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:27.847 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:27.895 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-03-21T15:31:27.902 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-21T15:31:27.957 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-03-21T15:31:28.003 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-03-21T15:31:28.103 INFO:teuthology.orchestra.console.smithi161:Power on 2024-03-21T15:31:28.104 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T15:31:28.127 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-03-21T15:31:28.127 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:28.149 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-21T15:31:31.898 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:31.959 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:32.009 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-03-21T15:31:32.068 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-03-21T15:31:32.110 INFO:teuthology.orchestra.console.smithi059:Power off completed 2024-03-21T15:31:32.150 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:32.168 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-03-21T15:31:32.211 INFO:teuthology.orchestra.console.smithi059:Power on 2024-03-21T15:31:32.211 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T15:31:32.235 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2024-03-21T15:31:32.235 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:32.257 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-03-21T15:31:32.258 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-21T15:31:32.270 INFO:teuthology.orchestra.console.smithi173:Power on 2024-03-21T15:31:32.270 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T15:31:32.291 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On 2024-03-21T15:31:32.292 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:32.313 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-03-21T15:31:36.262 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:36.269 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:36.314 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T15:31:36.371 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-03-21T15:31:36.378 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-21T15:31:36.423 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-03-21T15:31:36.473 INFO:teuthology.orchestra.console.smithi059:Power on completed 2024-03-21T15:31:36.479 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-03-21T15:31:36.524 INFO:teuthology.orchestra.console.smithi173:Power on completed 2024-03-21T15:31:36.574 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2024-03-21T15:31:36.580 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-03-21T15:31:36.625 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2024-03-21T15:34:07.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:07.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:10.622 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-03-21T15:34:10.623 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-21T15:34:16.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:16.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:19.678 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-03-21T15:34:19.710 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-21T15:34:22.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:25.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:25.698 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-21T15:34:25.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:28.738 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-03-21T15:34:28.766 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-21T15:34:31.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:34.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:34.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:34.785 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-21T15:34:37.822 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-03-21T15:34:37.823 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-21T15:34:40.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:43.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:43.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:43.842 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-21T15:34:46.882 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-03-21T15:34:46.910 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-21T15:34:49.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:52.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:52.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:34:52.926 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-21T15:34:55.966 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-21T15:34:58.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:35:01.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:35:01.982 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-21T15:35:05.022 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-21T15:35:07.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:35:11.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:35:11.038 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-21T15:35:17.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:35:52.923 WARNING:teuthology.provision.fog.smithi059:timed out 2024-03-21T15:35:58.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:35:59.139 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T15:35:59.140 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T15:35:59.480 INFO:teuthology.provision.fog.smithi059:Node is ready 2024-03-21T15:35:59.481 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2024-03-21T15:35:59.495 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2024-03-21T15:35:59.496 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2024-03-21T15:35:59.551 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2024-03-21T15:35:59.551 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2024-03-21T15:35:59.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2024-03-21T15:35:59.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2024-03-21T15:35:59.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2024-03-21T15:35:59.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2024-03-21T15:35:59.912 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-03-21T15:35:59.967 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-03-21T15:35:59.967 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-03-21T15:35:59.967 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-03-21T15:35:59.967 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-03-21T15:35:59.967 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-03-21T15:35:59.967 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-03-21T15:35:59.967 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T15:35:59.967 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-03-21T15:35:59.967 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-03-21T15:35:59.967 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T15:35:59.968 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-03-21T15:35:59.968 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T15:35:59.968 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T15:35:59.968 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T15:35:59.969 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2024-03-21T15:35:59.970 DEBUG:teuthology.parallel:result is None 2024-03-21T15:36:11.037 WARNING:teuthology.provision.fog.smithi161:timed out 2024-03-21T15:36:17.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:36:17.045 WARNING:teuthology.provision.fog.smithi173:timed out 2024-03-21T15:36:17.275 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T15:36:17.275 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T15:36:17.615 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-03-21T15:36:17.615 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-03-21T15:36:17.629 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2024-03-21T15:36:17.630 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2024-03-21T15:36:17.685 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2024-03-21T15:36:17.686 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-03-21T15:36:17.811 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2024-03-21T15:36:17.839 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2024-03-21T15:36:17.907 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2024-03-21T15:36:17.974 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-03-21T15:36:18.040 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-03-21T15:36:18.094 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-03-21T15:36:18.094 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-03-21T15:36:18.094 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-03-21T15:36:18.094 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-03-21T15:36:18.095 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-03-21T15:36:18.095 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-03-21T15:36:18.095 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T15:36:18.095 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-03-21T15:36:18.095 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-03-21T15:36:18.095 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T15:36:18.095 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-03-21T15:36:18.095 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T15:36:18.096 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T15:36:18.096 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T15:36:18.096 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-03-21T15:36:18.096 DEBUG:teuthology.parallel:result is None 2024-03-21T15:36:23.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:36:23.386 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T15:36:23.386 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T15:36:23.718 INFO:teuthology.provision.fog.smithi173:Node is ready 2024-03-21T15:36:23.719 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2024-03-21T15:36:23.733 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2024-03-21T15:36:23.733 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts 2024-03-21T15:36:23.788 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2024-03-21T15:36:23.788 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2024-03-21T15:36:23.910 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts 2024-03-21T15:36:23.938 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2024-03-21T15:36:24.004 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname 2024-03-21T15:36:24.073 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2024-03-21T15:36:24.139 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-03-21T15:36:24.193 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-03-21T15:36:24.193 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-03-21T15:36:24.193 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-03-21T15:36:24.193 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-03-21T15:36:24.193 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-03-21T15:36:24.194 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-03-21T15:36:24.194 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T15:36:24.194 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-03-21T15:36:24.194 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-03-21T15:36:24.194 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T15:36:24.194 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-03-21T15:36:24.194 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T15:36:24.194 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T15:36:24.194 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T15:36:24.194 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2024-03-21T15:36:24.195 DEBUG:teuthology.parallel:result is None 2024-03-21T15:36:24.450 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2024-03-21T15:36:24.450 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T15:36:24.475 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-03-21T15:36:24.476 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T15:36:24.500 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2024-03-21T15:36:24.500 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T15:36:24.518 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2024-03-21T15:36:24.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-21T15:36:24.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:36:24.634 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-03-21T15:36:24.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-21T15:36:24.813 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-03-21T15:36:24.869 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-03-21T15:36:24.869 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-03-21T15:36:24.923 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T15:36:24.924 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T15:36:24.925 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-03-21T15:36:25.026 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-03-21T15:36:25.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-21T15:36:25.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:36:25.114 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-03-21T15:36:25.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-21T15:36:25.184 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-03-21T15:36:25.240 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-03-21T15:36:25.240 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-03-21T15:36:25.296 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-03-21T15:36:25.297 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-03-21T15:36:25.297 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-03-21T15:36:25.297 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-03-21T15:36:25.297 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-03-21T15:36:25.297 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-03-21T15:36:25.297 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T15:36:25.297 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-03-21T15:36:25.297 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-03-21T15:36:25.297 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T15:36:25.297 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-03-21T15:36:25.297 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T15:36:25.297 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T15:36:25.298 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T15:36:25.298 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-03-21T15:36:25.417 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2024-03-21T15:36:25.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-03-21T15:36:25.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T15:36:25.506 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-03-21T15:36:25.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-03-21T15:36:25.575 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-03-21T15:36:25.632 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-03-21T15:36:25.632 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-03-21T15:36:25.689 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-03-21T15:36:25.689 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-03-21T15:36:25.690 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-03-21T15:36:25.690 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-03-21T15:36:25.690 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-03-21T15:36:25.690 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-03-21T15:36:25.690 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T15:36:25.690 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-03-21T15:36:25.690 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-03-21T15:36:25.690 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T15:36:25.690 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-03-21T15:36:25.690 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T15:36:25.690 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T15:36:25.690 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T15:36:25.693 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-03-21T15:36:25.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:36:25.821 INFO:teuthology.dispatcher.supervisor:Running job 7613857 2024-03-21T15:36:25.821 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613857 --name teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613857/orig.config.yaml 2024-03-21T15:36:25.824 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613857 2024-03-21T15:36:25.824 INFO:teuthology.dispatcher.supervisor:Job PID: 1681449 2024-03-21T15:36:25.824 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-21T15:38:25.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:40:26.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:42:26.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:44:26.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:46:26.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:48:26.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:50:26.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:52:27.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:54:27.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:56:27.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:58:27.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:00:27.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:02:27.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:04:28.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:06:28.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:08:28.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:10:28.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:12:28.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:14:28.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:16:29.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:18:29.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:20:29.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:20:29.515 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1