2024-04-17T08:44:50.247 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T08:44:50.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:44:50.435 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9d9f057c10>, signals=[15]) 2024-04-17T08:44:50.435 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2024-04-17T08:44:50.436 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T08:44:50.436 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-04-17T08:44:50.462 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging 2024-04-17T08:44:50.462 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T08:44:50.462 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-04-17T08:44:50.486 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2024-04-17T08:44:50.487 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T08:44:50.487 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-04-17T08:44:50.579 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T08:44:50.594 DEBUG:teuthology.provision.fog.smithi106:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T08:44:50.608 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T08:44:50.620 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 9.stream 2024-04-17T08:44:50.641 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of centos 9.stream 2024-04-17T08:44:50.647 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 9.stream 2024-04-17T08:44:50.966 INFO:teuthology.orchestra.console.smithi049:Power off 2024-04-17T08:44:50.966 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T08:44:50.979 INFO:teuthology.orchestra.console.smithi106:Power off 2024-04-17T08:44:50.979 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T08:44:50.990 INFO:teuthology.orchestra.console.smithi129:Power off 2024-04-17T08:44:50.991 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T08:44:50.998 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-04-17T08:44:50.999 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:51.007 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off 2024-04-17T08:44:51.007 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:51.016 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-04-17T08:44:51.016 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:51.023 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-04-17T08:44:51.028 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-04-17T08:44:51.036 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-17T08:44:51.124 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-04-17T08:44:51.137 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-04-17T08:44:51.225 INFO:teuthology.orchestra.console.smithi049:Power on 2024-04-17T08:44:51.226 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T08:44:51.238 INFO:teuthology.orchestra.console.smithi129:Power on 2024-04-17T08:44:51.239 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T08:44:51.248 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2024-04-17T08:44:51.249 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:51.259 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2024-04-17T08:44:51.259 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:51.270 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-04-17T08:44:51.278 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-17T08:44:55.031 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:55.140 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-04-17T08:44:55.271 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:55.279 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:55.379 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-04-17T08:44:55.388 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-17T08:44:59.145 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:59.253 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-04-17T08:44:59.354 INFO:teuthology.orchestra.console.smithi106:Power off completed 2024-04-17T08:44:59.381 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:59.389 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:59.455 INFO:teuthology.orchestra.console.smithi106:Power on 2024-04-17T08:44:59.455 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T08:44:59.477 DEBUG:teuthology.orchestra.console.smithi106:power on output: Chassis Power Control: Up/On 2024-04-17T08:44:59.477 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:44:59.497 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-04-17T08:44:59.501 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-04-17T08:44:59.578 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-04-17T08:44:59.598 INFO:teuthology.orchestra.console.smithi129:Power on completed 2024-04-17T08:44:59.679 INFO:teuthology.orchestra.console.smithi049:Power on completed 2024-04-17T08:44:59.700 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2024-04-17T08:44:59.780 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2024-04-17T08:45:03.506 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:45:03.614 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-04-17T08:45:07.619 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T08:45:07.830 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-04-17T08:45:07.931 INFO:teuthology.orchestra.console.smithi106:Power on completed 2024-04-17T08:45:08.031 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish 2024-04-17T08:47:54.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:47:57.534 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T08:48:01.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:03.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:04.286 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T08:48:06.590 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T08:48:10.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:12.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:13.342 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T08:48:15.646 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T08:48:19.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:21.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:22.398 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T08:48:24.702 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T08:48:28.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:30.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:31.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:31.458 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T08:48:33.758 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T08:48:34.430 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-17T08:48:37.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:39.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:40.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:40.542 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T08:48:42.818 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T08:48:43.486 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-17T08:48:46.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:48.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:49.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:49.598 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T08:48:52.542 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-17T08:48:55.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:58.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:48:58.654 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T08:49:01.598 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-17T08:49:04.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:07.358 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T08:49:07.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:10.654 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-17T08:49:13.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:16.415 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T08:49:16.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:19.710 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-17T08:49:22.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:25.470 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-17T08:49:25.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:28.766 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-17T08:49:31.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:31.745 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T08:49:31.745 DEBUG:teuthology.orchestra.run.smithi106:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T08:49:34.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:37.822 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-17T08:49:43.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:46.878 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-17T08:49:52.088 INFO:teuthology.provision.fog.smithi106:Node is ready 2024-04-17T08:49:52.088 DEBUG:teuthology.orchestra.run.smithi106:> hostname 2024-04-17T08:49:52.147 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com 2024-04-17T08:49:52.148 DEBUG:teuthology.orchestra.run.smithi106:> grep smithi106.front.sepia.ceph.com /etc/hosts 2024-04-17T08:49:52.205 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106 2024-04-17T08:49:52.206 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2024-04-17T08:49:52.343 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hosts 2024-04-17T08:49:52.376 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/172.21.15.106/172.21.15.106/g' /etc/hosts 2024-04-17T08:49:52.447 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hostname 2024-04-17T08:49:52.520 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2024-04-17T08:49:52.591 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-04-17T08:49:52.649 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-04-17T08:49:52.649 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-04-17T08:49:52.649 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-04-17T08:49:52.649 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:49:52.649 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-04-17T08:49:52.649 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:49:52.649 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:49:52.649 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-04-17T08:49:52.649 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:49:52.649 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:49:52.650 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:49:52.650 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:49:52.650 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:49:52.650 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:49:52.650 INFO:teuthology.provision.fog.smithi106:Deploy complete! 2024-04-17T08:49:52.652 DEBUG:teuthology.parallel:result is None 2024-04-17T08:49:52.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:49:55.938 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-17T08:50:01.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:50:04.664 WARNING:teuthology.provision.fog.smithi129:timed out 2024-04-17T08:50:05.022 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-17T08:50:10.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:50:11.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:50:11.174 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T08:50:11.176 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T08:50:11.478 INFO:teuthology.provision.fog.smithi129:Node is ready 2024-04-17T08:50:11.478 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2024-04-17T08:50:11.492 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2024-04-17T08:50:11.492 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2024-04-17T08:50:11.547 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2024-04-17T08:50:11.547 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2024-04-17T08:50:11.672 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2024-04-17T08:50:11.699 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2024-04-17T08:50:11.766 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2024-04-17T08:50:11.833 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2024-04-17T08:50:11.899 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-04-17T08:50:11.953 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-04-17T08:50:11.953 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-04-17T08:50:11.953 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-04-17T08:50:11.953 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:50:11.953 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-04-17T08:50:11.953 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:50:11.954 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:50:11.954 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-04-17T08:50:11.954 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:50:11.954 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:50:11.954 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:50:11.954 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:50:11.954 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:50:11.954 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:50:11.954 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2024-04-17T08:50:11.955 DEBUG:teuthology.parallel:result is None 2024-04-17T08:51:11.083 WARNING:teuthology.provision.fog.smithi049:timed out 2024-04-17T08:51:17.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:51:17.375 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T08:51:17.376 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T08:51:17.729 INFO:teuthology.provision.fog.smithi049:Node is ready 2024-04-17T08:51:17.730 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2024-04-17T08:51:17.744 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2024-04-17T08:51:17.745 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2024-04-17T08:51:17.800 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2024-04-17T08:51:17.801 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2024-04-17T08:51:17.917 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2024-04-17T08:51:17.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2024-04-17T08:51:18.019 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2024-04-17T08:51:18.091 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2024-04-17T08:51:18.161 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-04-17T08:51:18.215 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-04-17T08:51:18.215 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-04-17T08:51:18.215 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-04-17T08:51:18.216 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:51:18.216 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-04-17T08:51:18.216 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:51:18.216 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:51:18.216 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-04-17T08:51:18.216 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:51:18.216 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:51:18.216 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:51:18.216 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:51:18.216 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:51:18.216 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:51:18.216 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2024-04-17T08:51:18.217 DEBUG:teuthology.parallel:result is None 2024-04-17T08:51:18.429 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2024-04-17T08:51:18.430 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T08:51:18.456 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com 2024-04-17T08:51:18.457 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T08:51:18.473 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2024-04-17T08:51:18.473 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T08:51:18.491 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2024-04-17T08:51:18.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-04-17T08:51:18.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:51:18.592 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-04-17T08:51:18.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-04-17T08:51:18.657 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-04-17T08:51:18.711 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-04-17T08:51:18.711 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-04-17T08:51:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-04-17T08:51:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-04-17T08:51:18.766 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-04-17T08:51:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:51:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-04-17T08:51:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:51:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:51:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-04-17T08:51:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:51:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:51:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:51:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:51:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:51:18.767 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:51:18.768 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-04-17T08:51:18.790 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server 2024-04-17T08:51:18.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-17T08:51:18.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:51:18.881 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-04-17T08:51:19.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-17T08:51:19.049 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-04-17T08:51:19.105 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-04-17T08:51:19.105 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-04-17T08:51:19.161 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-04-17T08:51:19.161 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-04-17T08:51:19.161 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-04-17T08:51:19.161 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:51:19.161 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-04-17T08:51:19.161 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:51:19.161 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:51:19.161 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-04-17T08:51:19.161 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:51:19.161 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:51:19.161 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:51:19.162 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:51:19.162 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:51:19.162 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:51:19.162 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-04-17T08:51:19.190 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2024-04-17T08:51:19.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-04-17T08:51:19.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T08:51:19.278 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-04-17T08:51:19.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-04-17T08:51:19.445 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-04-17T08:51:19.499 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-04-17T08:51:19.499 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-04-17T08:51:19.553 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-04-17T08:51:19.554 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-04-17T08:51:19.554 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-04-17T08:51:19.554 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-04-17T08:51:19.554 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-04-17T08:51:19.554 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-04-17T08:51:19.554 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T08:51:19.554 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-04-17T08:51:19.554 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-04-17T08:51:19.554 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T08:51:19.554 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-04-17T08:51:19.554 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T08:51:19.554 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T08:51:19.555 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T08:51:19.555 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-04-17T08:51:19.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:51:19.677 INFO:teuthology.dispatcher.supervisor:Running job 7659976 2024-04-17T08:51:19.677 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659976 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/iogen}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659976/orig.config.yaml 2024-04-17T08:51:19.680 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659976 2024-04-17T08:51:19.681 INFO:teuthology.dispatcher.supervisor:Job PID: 469935 2024-04-17T08:51:19.681 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T08:53:19.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:55:19.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:57:20.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T08:59:20.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:01:20.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:03:20.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:03:20.662 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1