2024-02-14T12:43:26.220 INFO:root:teuthology version: 0.0.1.dev258+g9e44c16 2024-02-14T12:43:26.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T12:43:26.393 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7ca5500c10>, signals=[15]) 2024-02-14T12:43:26.394 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2024-02-14T12:43:26.394 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2024-02-14T12:43:26.394 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-02-14T12:43:26.414 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2024-02-14T12:43:26.414 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2024-02-14T12:43:26.414 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-02-14T12:43:26.439 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2024-02-14T12:43:26.439 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2024-02-14T12:43:26.439 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-02-14T12:43:26.529 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_centos_9.stream (ID 10) 2024-02-14T12:43:26.552 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_9.stream (ID 10) 2024-02-14T12:43:26.571 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_centos_9.stream (ID 10) 2024-02-14T12:43:26.574 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 9.stream 2024-02-14T12:43:26.595 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 9.stream 2024-02-14T12:43:26.630 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 9.stream 2024-02-14T12:43:26.864 INFO:teuthology.orchestra.console.smithi162:Power off 2024-02-14T12:43:26.864 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T12:43:26.885 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2024-02-14T12:43:26.885 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T12:43:26.907 INFO:teuthology.orchestra.console.smithi175:Power off 2024-02-14T12:43:26.907 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T12:43:26.921 INFO:teuthology.orchestra.console.smithi190:Power off 2024-02-14T12:43:26.922 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T12:43:26.928 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-02-14T12:43:26.929 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-02-14T12:43:26.929 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T12:43:26.941 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2024-02-14T12:43:26.942 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T12:43:26.951 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-02-14T12:43:26.964 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-02-14T12:43:27.029 INFO:teuthology.orchestra.console.smithi162:Power off completed 2024-02-14T12:43:27.052 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-02-14T12:43:27.065 INFO:teuthology.orchestra.console.smithi190:Power off completed 2024-02-14T12:43:27.129 INFO:teuthology.orchestra.console.smithi162:Power on 2024-02-14T12:43:27.130 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-14T12:43:27.153 INFO:teuthology.orchestra.console.smithi175:Power on 2024-02-14T12:43:27.154 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-14T12:43:27.162 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On 2024-02-14T12:43:27.162 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T12:43:27.169 INFO:teuthology.orchestra.console.smithi190:Power on 2024-02-14T12:43:27.169 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-14T12:43:27.177 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2024-02-14T12:43:27.178 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T12:43:27.186 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-02-14T12:43:27.190 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2024-02-14T12:43:27.190 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T12:43:27.199 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-02-14T12:43:27.212 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-02-14T12:43:31.188 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T12:43:31.200 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T12:43:31.213 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T12:43:31.297 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-02-14T12:43:31.308 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-02-14T12:43:31.322 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-02-14T12:43:31.409 INFO:teuthology.orchestra.console.smithi175:Power on completed 2024-02-14T12:43:31.423 INFO:teuthology.orchestra.console.smithi190:Power on completed 2024-02-14T12:43:31.510 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2024-02-14T12:43:31.524 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2024-02-14T12:43:35.302 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T12:43:35.411 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-14T12:43:35.512 INFO:teuthology.orchestra.console.smithi162:Power on completed 2024-02-14T12:43:35.612 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2024-02-14T12:46:17.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:46:20.828 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-02-14T12:46:26.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:46:29.884 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-02-14T12:46:32.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:46:35.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:46:35.900 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-02-14T12:46:36.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:46:38.940 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-02-14T12:46:39.968 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-14T12:46:41.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:46:44.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:46:44.956 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-02-14T12:46:45.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:46:48.000 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-02-14T12:46:49.052 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-14T12:46:50.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:46:54.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:46:54.012 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-02-14T12:46:55.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:46:57.084 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-02-14T12:46:58.108 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-14T12:47:00.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:47:03.068 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-02-14T12:47:03.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:47:04.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:47:06.144 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-02-14T12:47:07.168 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-14T12:47:09.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:47:12.124 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-02-14T12:47:12.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:47:13.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:47:16.220 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-14T12:47:18.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:47:21.184 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-02-14T12:47:22.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:47:25.280 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-14T12:47:27.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:47:31.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:47:34.336 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-14T12:47:40.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:47:45.728 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-02-14T12:47:51.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:47:54.812 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-02-14T12:48:00.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:48:03.868 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-02-14T12:48:09.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:48:10.088 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-14T12:48:10.089 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-14T12:48:12.148 WARNING:teuthology.provision.fog.smithi175:timed out 2024-02-14T12:48:18.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:48:18.436 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-14T12:48:18.437 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-14T12:48:18.770 INFO:teuthology.provision.fog.smithi175:Node is ready 2024-02-14T12:48:18.771 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2024-02-14T12:48:18.785 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2024-02-14T12:48:18.786 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2024-02-14T12:48:18.842 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2024-02-14T12:48:18.842 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-02-14T12:48:18.944 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2024-02-14T12:48:18.973 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2024-02-14T12:48:19.041 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2024-02-14T12:48:19.109 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-02-14T12:48:19.175 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-02-14T12:48:19.229 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T12:48:19.230 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T12:48:19.231 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2024-02-14T12:48:19.233 DEBUG:teuthology.parallel:result is None 2024-02-14T12:48:25.509 INFO:teuthology.provision.fog.smithi190:Node is ready 2024-02-14T12:48:25.509 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2024-02-14T12:48:25.527 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2024-02-14T12:48:25.528 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2024-02-14T12:48:25.585 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2024-02-14T12:48:25.586 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2024-02-14T12:48:25.686 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2024-02-14T12:48:25.717 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2024-02-14T12:48:25.786 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2024-02-14T12:48:25.855 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2024-02-14T12:48:25.923 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-02-14T12:48:25.978 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2024-02-14T12:48:25.978 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9" 2024-02-14T12:48:25.978 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2024-02-14T12:48:25.979 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2024-02-14T12:48:25.979 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9" 2024-02-14T12:48:25.979 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9" 2024-02-14T12:48:25.979 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T12:48:25.979 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-02-14T12:48:25.979 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon" 2024-02-14T12:48:25.979 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T12:48:25.979 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2024-02-14T12:48:25.979 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T12:48:25.979 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T12:48:25.979 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T12:48:25.980 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2024-02-14T12:48:25.980 DEBUG:teuthology.parallel:result is None 2024-02-14T12:48:40.349 WARNING:teuthology.provision.fog.smithi162:timed out 2024-02-14T12:48:46.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:48:46.614 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-14T12:48:46.614 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-14T12:48:46.924 INFO:teuthology.provision.fog.smithi162:Node is ready 2024-02-14T12:48:46.924 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2024-02-14T12:48:46.939 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2024-02-14T12:48:46.939 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts 2024-02-14T12:48:46.996 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2024-02-14T12:48:46.996 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2024-02-14T12:48:47.107 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts 2024-02-14T12:48:47.136 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2024-02-14T12:48:47.204 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname 2024-02-14T12:48:47.272 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2024-02-14T12:48:47.339 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-02-14T12:48:47.394 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-02-14T12:48:47.394 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-02-14T12:48:47.394 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-02-14T12:48:47.394 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-02-14T12:48:47.394 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-02-14T12:48:47.394 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-02-14T12:48:47.395 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T12:48:47.395 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-02-14T12:48:47.395 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-02-14T12:48:47.395 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T12:48:47.395 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-02-14T12:48:47.395 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T12:48:47.395 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T12:48:47.395 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T12:48:47.395 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2024-02-14T12:48:47.396 DEBUG:teuthology.parallel:result is None 2024-02-14T12:48:47.604 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2024-02-14T12:48:47.604 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-14T12:48:47.627 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2024-02-14T12:48:47.627 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-14T12:48:47.643 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2024-02-14T12:48:47.643 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-14T12:48:47.661 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2024-02-14T12:48:47.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-02-14T12:48:47.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:48:47.755 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-02-14T12:48:47.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-02-14T12:48:47.823 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-02-14T12:48:47.877 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-02-14T12:48:47.878 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-02-14T12:48:47.932 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-02-14T12:48:47.932 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-02-14T12:48:47.932 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-02-14T12:48:47.932 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-02-14T12:48:47.932 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-02-14T12:48:47.933 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-02-14T12:48:47.933 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T12:48:47.933 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-02-14T12:48:47.933 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-02-14T12:48:47.933 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T12:48:47.933 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-02-14T12:48:47.933 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T12:48:47.933 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T12:48:47.933 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T12:48:47.934 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-02-14T12:48:47.960 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2024-02-14T12:48:47.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-02-14T12:48:47.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:48:48.048 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-02-14T12:48:48.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-02-14T12:48:48.214 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-02-14T12:48:48.269 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-02-14T12:48:48.269 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-02-14T12:48:48.324 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-02-14T12:48:48.324 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-02-14T12:48:48.324 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-02-14T12:48:48.324 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-02-14T12:48:48.324 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-02-14T12:48:48.324 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-02-14T12:48:48.324 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T12:48:48.324 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-02-14T12:48:48.324 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-02-14T12:48:48.325 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T12:48:48.325 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-02-14T12:48:48.325 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T12:48:48.325 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T12:48:48.325 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T12:48:48.325 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-02-14T12:48:48.343 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2024-02-14T12:48:48.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-02-14T12:48:48.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:48:48.434 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-02-14T12:48:48.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-02-14T12:48:48.611 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-02-14T12:48:48.665 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-02-14T12:48:48.666 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-02-14T12:48:48.720 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2024-02-14T12:48:48.720 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9" 2024-02-14T12:48:48.720 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2024-02-14T12:48:48.720 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2024-02-14T12:48:48.720 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9" 2024-02-14T12:48:48.720 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9" 2024-02-14T12:48:48.720 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T12:48:48.720 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-02-14T12:48:48.720 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon" 2024-02-14T12:48:48.721 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T12:48:48.721 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2024-02-14T12:48:48.721 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T12:48:48.721 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T12:48:48.721 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T12:48:48.721 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-02-14T12:48:48.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T12:48:48.837 INFO:teuthology.dispatcher.supervisor:Running job 7559602 2024-02-14T12:48:48.837 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559602 --name vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/iozone}} -- /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559602/orig.config.yaml 2024-02-14T12:48:48.840 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559602 2024-02-14T12:48:48.840 INFO:teuthology.dispatcher.supervisor:Job PID: 1192548 2024-02-14T12:48:48.840 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-14T12:50:48.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T12:52:49.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T12:52:49.105 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1