2024-04-17T09:00:15.887 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T09:00:15.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:00:16.053 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe92e71ec10>, signals=[15]) 2024-04-17T09:00:16.054 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2024-04-17T09:00:16.054 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:00:16.054 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-04-17T09:00:16.075 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging 2024-04-17T09:00:16.075 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:00:16.075 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-04-17T09:00:16.099 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2024-04-17T09:00:16.100 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:00:16.100 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-04-17T09:00:16.184 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:00:16.215 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:00:16.225 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:00:16.230 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 9.stream 2024-04-17T09:00:16.255 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of centos 9.stream 2024-04-17T09:00:16.273 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 9.stream 2024-04-17T09:00:16.472 INFO:teuthology.orchestra.console.smithi079:Power off 2024-04-17T09:00:16.472 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:00:16.486 INFO:teuthology.orchestra.console.smithi113:Power off 2024-04-17T09:00:16.486 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:00:16.500 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2024-04-17T09:00:16.500 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:16.510 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2024-04-17T09:00:16.511 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:16.523 INFO:teuthology.orchestra.console.smithi192:Power off 2024-04-17T09:00:16.523 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:00:16.533 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-04-17T09:00:16.533 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-04-17T09:00:16.545 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2024-04-17T09:00:16.546 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:16.567 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-04-17T09:00:16.634 INFO:teuthology.orchestra.console.smithi113:Power off completed 2024-04-17T09:00:16.634 INFO:teuthology.orchestra.console.smithi079:Power off completed 2024-04-17T09:00:16.669 INFO:teuthology.orchestra.console.smithi192:Power off completed 2024-04-17T09:00:16.735 INFO:teuthology.orchestra.console.smithi113:Power on 2024-04-17T09:00:16.735 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:00:16.744 INFO:teuthology.orchestra.console.smithi079:Power on 2024-04-17T09:00:16.745 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:00:16.758 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On 2024-04-17T09:00:16.758 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:16.769 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2024-04-17T09:00:16.770 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:16.775 INFO:teuthology.orchestra.console.smithi192:Power on 2024-04-17T09:00:16.776 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:00:16.785 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-04-17T09:00:16.792 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-04-17T09:00:16.799 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2024-04-17T09:00:16.799 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:16.822 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-04-17T09:00:20.786 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:20.793 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:20.823 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:00:20.895 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-04-17T09:00:20.901 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-04-17T09:00:20.932 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2024-04-17T09:00:20.996 INFO:teuthology.orchestra.console.smithi113:Power on completed 2024-04-17T09:00:21.002 INFO:teuthology.orchestra.console.smithi079:Power on completed 2024-04-17T09:00:21.033 INFO:teuthology.orchestra.console.smithi192:Power on completed 2024-04-17T09:00:21.098 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish 2024-04-17T09:00:21.103 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2024-04-17T09:00:21.134 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2024-04-17T09:03:07.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:07.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:10.623 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T09:03:10.623 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-04-17T09:03:16.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:16.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:19.710 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T09:03:19.711 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-04-17T09:03:25.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:25.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:28.766 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T09:03:28.767 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-04-17T09:03:34.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:34.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:37.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:37.854 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T09:03:37.855 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-04-17T09:03:40.766 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-17T09:03:43.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:43.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:46.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:46.910 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T09:03:46.910 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-04-17T09:03:49.822 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-17T09:03:52.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:52.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:55.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:03:55.966 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-17T09:03:55.967 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-04-17T09:03:58.878 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-17T09:04:01.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:01.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:04.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:07.934 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-17T09:04:13.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:17.022 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-17T09:04:23.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:26.078 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-17T09:04:32.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:35.170 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-17T09:04:41.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:44.254 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-17T09:04:50.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:04:53.310 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-04-17T09:04:59.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:05:01.974 WARNING:teuthology.provision.fog.smithi079:timed out 2024-04-17T09:05:01.975 WARNING:teuthology.provision.fog.smithi192:timed out 2024-04-17T09:05:07.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:05:07.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:05:08.285 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:05:08.286 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:05:08.337 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:05:08.338 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:05:08.586 INFO:teuthology.provision.fog.smithi079:Node is ready 2024-04-17T09:05:08.587 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2024-04-17T09:05:08.601 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2024-04-17T09:05:08.602 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2024-04-17T09:05:08.642 INFO:teuthology.provision.fog.smithi192:Node is ready 2024-04-17T09:05:08.643 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2024-04-17T09:05:08.656 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2024-04-17T09:05:08.656 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2024-04-17T09:05:08.657 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2024-04-17T09:05:08.658 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2024-04-17T09:05:08.713 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2024-04-17T09:05:08.713 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2024-04-17T09:05:08.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2024-04-17T09:05:08.793 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2024-04-17T09:05:08.819 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2024-04-17T09:05:08.847 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2024-04-17T09:05:08.860 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2024-04-17T09:05:08.915 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2024-04-17T09:05:08.927 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2024-04-17T09:05:08.983 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2024-04-17T09:05:08.991 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-04-17T09:05:09.044 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-04-17T09:05:09.044 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-04-17T09:05:09.044 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-04-17T09:05:09.044 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:05:09.045 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-04-17T09:05:09.045 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:05:09.045 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:05:09.045 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-04-17T09:05:09.045 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:05:09.045 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:05:09.045 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:05:09.045 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:05:09.045 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:05:09.045 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:05:09.046 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2024-04-17T09:05:09.047 DEBUG:teuthology.parallel:result is None 2024-04-17T09:05:09.048 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-04-17T09:05:09.103 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-04-17T09:05:09.103 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-04-17T09:05:09.103 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-04-17T09:05:09.103 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:05:09.103 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-04-17T09:05:09.103 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:05:09.104 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:05:09.104 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-04-17T09:05:09.104 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:05:09.104 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:05:09.104 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:05:09.104 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:05:09.104 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:05:09.104 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:05:09.104 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2024-04-17T09:05:09.105 DEBUG:teuthology.parallel:result is None 2024-04-17T09:05:59.367 WARNING:teuthology.provision.fog.smithi113:timed out 2024-04-17T09:06:05.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:06:05.601 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:06:05.601 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:06:05.907 INFO:teuthology.provision.fog.smithi113:Node is ready 2024-04-17T09:06:05.907 DEBUG:teuthology.orchestra.run.smithi113:> hostname 2024-04-17T09:06:05.922 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com 2024-04-17T09:06:05.922 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts 2024-04-17T09:06:05.977 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113 2024-04-17T09:06:05.977 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2024-04-17T09:06:06.075 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts 2024-04-17T09:06:06.103 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts 2024-04-17T09:06:06.170 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname 2024-04-17T09:06:06.238 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2024-04-17T09:06:06.305 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-04-17T09:06:06.360 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2024-04-17T09:06:06.360 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9" 2024-04-17T09:06:06.360 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2024-04-17T09:06:06.360 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:06:06.360 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9" 2024-04-17T09:06:06.361 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:06:06.361 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:06:06.361 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-04-17T09:06:06.361 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:06:06.361 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:06:06.361 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:06:06.361 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:06:06.361 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:06:06.361 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:06:06.361 INFO:teuthology.provision.fog.smithi113:Deploy complete! 2024-04-17T09:06:06.362 DEBUG:teuthology.parallel:result is None 2024-04-17T09:06:06.567 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2024-04-17T09:06:06.567 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:06:06.674 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com 2024-04-17T09:06:06.674 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:06:06.780 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2024-04-17T09:06:06.780 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:06:06.933 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:06:06.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-17T09:06:06.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:06:07.023 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-04-17T09:06:07.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-17T09:06:07.193 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-04-17T09:06:07.247 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-04-17T09:06:07.247 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-04-17T09:06:07.302 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-04-17T09:06:07.302 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-04-17T09:06:07.302 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-04-17T09:06:07.302 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:06:07.302 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-04-17T09:06:07.302 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:06:07.302 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:06:07.302 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-04-17T09:06:07.302 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:06:07.302 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:06:07.303 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:06:07.303 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:06:07.303 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:06:07.303 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:06:07.303 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-04-17T09:06:07.326 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:06:07.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-17T09:06:07.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:06:07.412 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-04-17T09:06:07.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-04-17T09:06:07.482 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2024-04-17T09:06:07.539 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2024-04-17T09:06:07.539 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-04-17T09:06:07.595 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2024-04-17T09:06:07.595 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9" 2024-04-17T09:06:07.595 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2024-04-17T09:06:07.595 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:06:07.595 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9" 2024-04-17T09:06:07.595 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:06:07.595 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:06:07.596 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-04-17T09:06:07.596 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:06:07.596 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:06:07.596 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:06:07.596 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:06:07.596 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:06:07.596 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:06:07.597 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-04-17T09:06:07.626 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:06:07.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-04-17T09:06:07.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:06:07.714 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-04-17T09:06:07.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-04-17T09:06:07.881 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-04-17T09:06:07.936 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-04-17T09:06:07.936 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-04-17T09:06:07.990 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-04-17T09:06:07.991 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-04-17T09:06:07.991 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-04-17T09:06:07.991 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:06:07.991 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-04-17T09:06:07.991 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:06:07.991 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:06:07.991 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-04-17T09:06:07.991 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:06:07.991 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:06:07.991 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:06:07.991 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:06:07.992 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:06:07.992 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:06:07.992 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-04-17T09:06:08.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:06:08.127 INFO:teuthology.dispatcher.supervisor:Running job 7659985 2024-04-17T09:06:08.127 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659985 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/misc}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659985/orig.config.yaml 2024-04-17T09:06:08.131 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659985 2024-04-17T09:06:08.131 INFO:teuthology.dispatcher.supervisor:Job PID: 540981 2024-04-17T09:06:08.131 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T09:08:08.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:10:08.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:12:08.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:14:08.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:16:08.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:18:09.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:18:09.166 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1