2024-01-30T11:23:20.654 INFO:root:teuthology version: 0.0.1.dev253+g6128cc3 2024-01-30T11:23:20.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-30T11:23:20.821 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3aca2bec10>, signals=[15]) 2024-01-30T11:23:20.821 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2024-01-30T11:23:20.822 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2024-01-30T11:23:20.822 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-01-30T11:23:20.839 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2024-01-30T11:23:20.839 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2024-01-30T11:23:20.839 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-01-30T11:23:20.863 INFO:teuthology.lock.ops:Start node 'smithi076.front.sepia.ceph.com' reimaging 2024-01-30T11:23:20.864 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: reset os type and version on server 2024-01-30T11:23:20.864 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-01-30T11:23:20.950 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_centos_9.stream (ID 10) 2024-01-30T11:23:20.993 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_9.stream (ID 10) 2024-01-30T11:23:20.997 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 9.stream 2024-01-30T11:23:21.007 DEBUG:teuthology.provision.fog.smithi076:Requesting image smithi_centos_9.stream (ID 10) 2024-01-30T11:23:21.034 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 9.stream 2024-01-30T11:23:21.051 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of centos 9.stream 2024-01-30T11:23:21.223 INFO:teuthology.orchestra.console.smithi037:Power off 2024-01-30T11:23:21.223 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-30T11:23:21.242 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2024-01-30T11:23:21.242 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T11:23:21.262 INFO:teuthology.orchestra.console.smithi043:Power off 2024-01-30T11:23:21.262 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-30T11:23:21.274 INFO:teuthology.orchestra.console.smithi076:Power off 2024-01-30T11:23:21.275 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-30T11:23:21.281 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2024-01-30T11:23:21.282 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2024-01-30T11:23:21.283 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T11:23:21.295 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2024-01-30T11:23:21.295 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T11:23:21.302 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-01-30T11:23:21.316 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-01-30T11:23:21.382 INFO:teuthology.orchestra.console.smithi037:Power off completed 2024-01-30T11:23:21.403 INFO:teuthology.orchestra.console.smithi043:Power off completed 2024-01-30T11:23:21.416 INFO:teuthology.orchestra.console.smithi076:Power off completed 2024-01-30T11:23:21.483 INFO:teuthology.orchestra.console.smithi037:Power on 2024-01-30T11:23:21.483 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-30T11:23:21.504 INFO:teuthology.orchestra.console.smithi043:Power on 2024-01-30T11:23:21.504 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-30T11:23:21.511 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On 2024-01-30T11:23:21.511 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T11:23:21.518 INFO:teuthology.orchestra.console.smithi076:Power on 2024-01-30T11:23:21.519 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-30T11:23:21.526 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On 2024-01-30T11:23:21.526 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T11:23:21.533 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2024-01-30T11:23:21.539 DEBUG:teuthology.orchestra.console.smithi076:power on output: Chassis Power Control: Up/On 2024-01-30T11:23:21.539 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T11:23:21.546 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-01-30T11:23:21.559 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-01-30T11:23:25.538 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T11:23:25.546 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T11:23:25.560 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T11:23:25.649 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2024-01-30T11:23:25.657 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-01-30T11:23:25.670 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-01-30T11:23:25.770 INFO:teuthology.orchestra.console.smithi076:Power on completed 2024-01-30T11:23:25.871 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish 2024-01-30T11:23:29.652 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T11:23:29.661 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-30T11:23:29.763 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-01-30T11:23:29.771 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-01-30T11:23:29.864 INFO:teuthology.orchestra.console.smithi037:Power on completed 2024-01-30T11:23:29.872 INFO:teuthology.orchestra.console.smithi043:Power on completed 2024-01-30T11:23:29.965 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2024-01-30T11:23:29.973 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2024-01-30T11:25:45.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:00.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:04.092 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-01-30T11:26:10.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:11.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:13.180 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-01-30T11:26:19.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:19.196 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-01-30T11:26:22.268 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-01-30T11:26:25.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:28.252 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-01-30T11:26:28.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:30.204 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-30T11:26:31.324 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-01-30T11:26:34.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:36.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:37.308 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-01-30T11:26:37.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:39.260 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-30T11:26:43.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:45.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:46.396 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-01-30T11:26:48.316 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-30T11:26:52.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:54.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:26:57.404 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-30T11:27:03.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:27:06.492 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-30T11:27:12.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:27:15.548 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-30T11:27:21.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:27:37.348 WARNING:teuthology.provision.fog.smithi037:timed out 2024-01-30T11:27:43.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:27:43.639 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-30T11:27:43.640 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-30T11:27:43.995 INFO:teuthology.provision.fog.smithi037:Node is ready 2024-01-30T11:27:43.995 DEBUG:teuthology.orchestra.run.smithi037:> hostname 2024-01-30T11:27:44.011 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2024-01-30T11:27:44.011 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts 2024-01-30T11:27:44.067 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2024-01-30T11:27:44.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2024-01-30T11:27:44.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts 2024-01-30T11:27:44.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts 2024-01-30T11:27:44.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname 2024-01-30T11:27:44.341 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2024-01-30T11:27:44.411 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-01-30T11:27:44.466 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-01-30T11:27:44.466 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-01-30T11:27:44.466 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-01-30T11:27:44.466 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-01-30T11:27:44.467 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-01-30T11:27:44.467 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-01-30T11:27:44.467 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-30T11:27:44.467 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-01-30T11:27:44.467 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-01-30T11:27:44.467 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-30T11:27:44.467 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-01-30T11:27:44.467 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-30T11:27:44.467 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-30T11:27:44.467 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-30T11:27:44.468 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2024-01-30T11:27:44.470 DEBUG:teuthology.parallel:result is None 2024-01-30T11:27:52.413 WARNING:teuthology.provision.fog.smithi043:timed out 2024-01-30T11:27:58.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:27:58.719 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-30T11:27:58.720 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-30T11:27:59.048 INFO:teuthology.provision.fog.smithi043:Node is ready 2024-01-30T11:27:59.048 DEBUG:teuthology.orchestra.run.smithi043:> hostname 2024-01-30T11:27:59.064 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2024-01-30T11:27:59.064 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts 2024-01-30T11:27:59.122 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2024-01-30T11:27:59.122 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2024-01-30T11:27:59.241 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts 2024-01-30T11:27:59.274 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts 2024-01-30T11:27:59.346 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname 2024-01-30T11:27:59.418 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2024-01-30T11:27:59.489 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-01-30T11:27:59.545 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-01-30T11:27:59.545 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-01-30T11:27:59.545 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-01-30T11:27:59.545 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-01-30T11:27:59.545 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-01-30T11:27:59.545 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-01-30T11:27:59.545 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-30T11:27:59.545 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-01-30T11:27:59.546 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-01-30T11:27:59.546 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-30T11:27:59.546 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-01-30T11:27:59.546 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-30T11:27:59.546 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-30T11:27:59.546 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-30T11:27:59.546 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2024-01-30T11:27:59.547 DEBUG:teuthology.parallel:result is None 2024-01-30T11:28:21.567 WARNING:teuthology.provision.fog.smithi076:timed out 2024-01-30T11:28:27.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:28:27.842 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-30T11:28:27.842 DEBUG:teuthology.orchestra.run.smithi076:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-30T11:28:28.164 INFO:teuthology.provision.fog.smithi076:Node is ready 2024-01-30T11:28:28.164 DEBUG:teuthology.orchestra.run.smithi076:> hostname 2024-01-30T11:28:28.178 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076.front.sepia.ceph.com 2024-01-30T11:28:28.178 DEBUG:teuthology.orchestra.run.smithi076:> grep smithi076.front.sepia.ceph.com /etc/hosts 2024-01-30T11:28:28.233 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2024-01-30T11:28:28.233 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2024-01-30T11:28:28.335 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hosts 2024-01-30T11:28:28.362 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/172.21.15.76/172.21.15.76/g' /etc/hosts 2024-01-30T11:28:28.429 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hostname 2024-01-30T11:28:28.496 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2024-01-30T11:28:28.563 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-01-30T11:28:28.620 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-01-30T11:28:28.621 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="9" 2024-01-30T11:28:28.621 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-01-30T11:28:28.621 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-01-30T11:28:28.621 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="9" 2024-01-30T11:28:28.621 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el9" 2024-01-30T11:28:28.621 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-30T11:28:28.621 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-01-30T11:28:28.621 INFO:teuthology.orchestra.run.smithi076.stdout:LOGO="fedora-logo-icon" 2024-01-30T11:28:28.621 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-30T11:28:28.622 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-01-30T11:28:28.622 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-30T11:28:28.622 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-30T11:28:28.622 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-30T11:28:28.622 INFO:teuthology.provision.fog.smithi076:Deploy complete! 2024-01-30T11:28:28.623 DEBUG:teuthology.parallel:result is None 2024-01-30T11:28:28.892 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2024-01-30T11:28:28.893 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-30T11:28:28.929 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2024-01-30T11:28:28.930 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-30T11:28:28.954 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com 2024-01-30T11:28:28.954 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-30T11:28:28.980 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2024-01-30T11:28:28.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-01-30T11:28:28.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:28:29.126 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-01-30T11:28:29.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-01-30T11:28:29.311 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-01-30T11:28:29.367 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-01-30T11:28:29.367 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-01-30T11:28:29.422 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-01-30T11:28:29.422 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-01-30T11:28:29.422 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-01-30T11:28:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-01-30T11:28:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-01-30T11:28:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-01-30T11:28:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-30T11:28:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-01-30T11:28:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-01-30T11:28:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-30T11:28:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-01-30T11:28:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-30T11:28:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-30T11:28:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-30T11:28:29.424 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-01-30T11:28:29.446 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2024-01-30T11:28:29.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-01-30T11:28:29.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:28:29.546 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-01-30T11:28:29.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-01-30T11:28:29.728 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-01-30T11:28:29.783 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-01-30T11:28:29.784 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-01-30T11:28:29.839 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-01-30T11:28:29.839 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-01-30T11:28:29.839 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-01-30T11:28:29.839 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-01-30T11:28:29.839 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-01-30T11:28:29.839 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-01-30T11:28:29.839 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-30T11:28:29.839 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-01-30T11:28:29.839 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-01-30T11:28:29.840 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-30T11:28:29.840 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-01-30T11:28:29.840 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-30T11:28:29.840 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-30T11:28:29.840 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-30T11:28:29.840 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-01-30T11:28:29.862 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server 2024-01-30T11:28:29.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-01-30T11:28:29.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-30T11:28:29.949 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-01-30T11:28:30.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-01-30T11:28:30.021 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2024-01-30T11:28:30.076 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2024-01-30T11:28:30.077 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-01-30T11:28:30.133 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-01-30T11:28:30.133 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="9" 2024-01-30T11:28:30.133 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-01-30T11:28:30.133 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-01-30T11:28:30.133 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="9" 2024-01-30T11:28:30.133 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el9" 2024-01-30T11:28:30.133 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-30T11:28:30.133 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-01-30T11:28:30.133 INFO:teuthology.orchestra.run.smithi076.stdout:LOGO="fedora-logo-icon" 2024-01-30T11:28:30.133 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-30T11:28:30.133 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-01-30T11:28:30.133 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-30T11:28:30.134 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-30T11:28:30.134 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-30T11:28:30.134 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-01-30T11:28:30.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-30T11:28:30.246 INFO:teuthology.dispatcher.supervisor:Running job 7537556 2024-01-30T11:28:30.246 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6128cc3ecb49b7d62475e3595041c19b5326ca7c/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537556 --name vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537556/orig.config.yaml 2024-01-30T11:28:30.249 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-30_07:34:06-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7537556 2024-01-30T11:28:30.250 INFO:teuthology.dispatcher.supervisor:Job PID: 2560860 2024-01-30T11:28:30.250 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-30T11:30:30.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-30T11:32:30.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-30T11:34:30.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-30T11:36:31.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-30T11:38:31.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-30T11:40:31.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-30T11:42:31.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-30T11:44:31.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-30T11:44:31.903 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1