2024-04-18T03:03:31.808 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T03:03:31.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:03:31.976 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fed7bcddc10>, signals=[15]) 2024-04-18T03:03:31.976 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2024-04-18T03:03:31.977 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T03:03:31.977 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-04-18T03:03:32.002 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2024-04-18T03:03:32.002 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T03:03:32.002 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-04-18T03:03:32.027 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2024-04-18T03:03:32.027 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T03:03:32.027 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-04-18T03:03:32.105 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T03:03:32.148 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of rhel 8.6 2024-04-18T03:03:32.149 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T03:03:32.153 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T03:03:32.192 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of rhel 8.6 2024-04-18T03:03:32.197 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.6 2024-04-18T03:03:32.417 INFO:teuthology.orchestra.console.smithi008:Power off 2024-04-18T03:03:32.418 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T03:03:32.439 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2024-04-18T03:03:32.439 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:03:32.465 INFO:teuthology.orchestra.console.smithi169:Power off 2024-04-18T03:03:32.465 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T03:03:32.474 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-04-18T03:03:32.486 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2024-04-18T03:03:32.487 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:03:32.499 INFO:teuthology.orchestra.console.smithi193:Power off 2024-04-18T03:03:32.499 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T03:03:32.508 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-04-18T03:03:32.519 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2024-04-18T03:03:32.519 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:03:32.541 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2024-04-18T03:03:32.576 INFO:teuthology.orchestra.console.smithi008:Power off completed 2024-04-18T03:03:32.609 INFO:teuthology.orchestra.console.smithi169:Power off completed 2024-04-18T03:03:32.642 INFO:teuthology.orchestra.console.smithi193:Power off completed 2024-04-18T03:03:32.676 INFO:teuthology.orchestra.console.smithi008:Power on 2024-04-18T03:03:32.676 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T03:03:32.700 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On 2024-04-18T03:03:32.700 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:03:32.710 INFO:teuthology.orchestra.console.smithi169:Power on 2024-04-18T03:03:32.710 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T03:03:32.722 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-04-18T03:03:32.733 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2024-04-18T03:03:32.733 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:03:32.742 INFO:teuthology.orchestra.console.smithi193:Power on 2024-04-18T03:03:32.743 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T03:03:32.755 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-04-18T03:03:32.764 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On 2024-04-18T03:03:32.764 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:03:32.786 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2024-04-18T03:03:36.726 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:03:36.757 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:03:36.786 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:03:36.835 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-04-18T03:03:36.865 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-04-18T03:03:36.895 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2024-04-18T03:03:36.936 INFO:teuthology.orchestra.console.smithi008:Power on completed 2024-04-18T03:03:36.966 INFO:teuthology.orchestra.console.smithi169:Power on completed 2024-04-18T03:03:36.996 INFO:teuthology.orchestra.console.smithi193:Power on completed 2024-04-18T03:03:37.038 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2024-04-18T03:03:37.067 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2024-04-18T03:03:37.097 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2024-04-18T03:06:23.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:23.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:23.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:26.402 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-04-18T03:06:26.403 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-18T03:06:32.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:32.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:35.490 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-04-18T03:06:35.491 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-18T03:06:41.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:41.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:41.822 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-18T03:06:44.574 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-04-18T03:06:44.574 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-18T03:06:47.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:50.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:50.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:50.878 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-18T03:06:53.630 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-04-18T03:06:53.631 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-18T03:06:56.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:59.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:59.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:06:59.934 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-18T03:07:02.690 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-04-18T03:07:02.691 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-18T03:07:05.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:07:08.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:07:08.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:07:08.990 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-18T03:07:11.774 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-04-18T03:07:14.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:07:17.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:07:18.046 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-18T03:07:20.830 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-04-18T03:07:24.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:07:26.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:07:42.495 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-18T03:07:48.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:07:51.550 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-18T03:07:57.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:08:00.638 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-18T03:08:06.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:08:06.859 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T03:08:06.860 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T03:08:08.699 WARNING:teuthology.provision.fog.smithi008:timed out 2024-04-18T03:08:14.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:08:14.959 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T03:08:14.960 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T03:08:15.237 INFO:teuthology.provision.fog.smithi008:Node is ready 2024-04-18T03:08:15.237 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2024-04-18T03:08:15.258 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2024-04-18T03:08:15.258 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2024-04-18T03:08:15.320 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2024-04-18T03:08:15.320 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-04-18T03:08:15.454 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2024-04-18T03:08:15.488 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2024-04-18T03:08:15.563 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2024-04-18T03:08:15.638 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-04-18T03:08:15.712 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-04-18T03:08:15.774 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T03:08:15.774 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T03:08:15.774 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2024-04-18T03:08:15.774 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2024-04-18T03:08:15.774 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6" 2024-04-18T03:08:15.774 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2024-04-18T03:08:15.774 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T03:08:15.774 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-04-18T03:08:15.774 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T03:08:15.774 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T03:08:15.774 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T03:08:15.774 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T03:08:15.775 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-04-18T03:08:15.775 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T03:08:15.775 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T03:08:15.775 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T03:08:15.775 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T03:08:15.777 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2024-04-18T03:08:15.778 DEBUG:teuthology.parallel:result is None 2024-04-18T03:08:26.837 WARNING:teuthology.provision.fog.smithi193:timed out 2024-04-18T03:08:27.106 INFO:teuthology.provision.fog.smithi169:Node is ready 2024-04-18T03:08:27.107 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2024-04-18T03:08:27.129 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2024-04-18T03:08:27.129 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2024-04-18T03:08:27.189 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2024-04-18T03:08:27.189 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-04-18T03:08:27.317 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2024-04-18T03:08:27.347 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2024-04-18T03:08:27.415 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2024-04-18T03:08:27.483 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-04-18T03:08:27.551 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-04-18T03:08:27.607 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T03:08:27.607 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T03:08:27.608 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T03:08:27.609 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2024-04-18T03:08:27.609 DEBUG:teuthology.parallel:result is None 2024-04-18T03:08:32.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:08:33.062 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T03:08:33.063 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T03:08:33.332 INFO:teuthology.provision.fog.smithi193:Node is ready 2024-04-18T03:08:33.332 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2024-04-18T03:08:33.349 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com 2024-04-18T03:08:33.350 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts 2024-04-18T03:08:33.407 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2024-04-18T03:08:33.408 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2024-04-18T03:08:33.521 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts 2024-04-18T03:08:33.548 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2024-04-18T03:08:33.614 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname 2024-04-18T03:08:33.681 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2024-04-18T03:08:33.747 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-04-18T03:08:33.802 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T03:08:33.802 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T03:08:33.802 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel" 2024-04-18T03:08:33.802 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora" 2024-04-18T03:08:33.802 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.6" 2024-04-18T03:08:33.802 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2024-04-18T03:08:33.802 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T03:08:33.803 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-04-18T03:08:33.803 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T03:08:33.803 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T03:08:33.803 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T03:08:33.803 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T03:08:33.803 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-18T03:08:33.803 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T03:08:33.803 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T03:08:33.803 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T03:08:33.803 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T03:08:33.803 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2024-04-18T03:08:33.804 DEBUG:teuthology.parallel:result is None 2024-04-18T03:08:33.997 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2024-04-18T03:08:33.997 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T03:08:34.015 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2024-04-18T03:08:34.015 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T03:08:34.040 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2024-04-18T03:08:34.040 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T03:08:34.058 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2024-04-18T03:08:34.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-04-18T03:08:34.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:08:34.132 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-04-18T03:08:34.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-04-18T03:08:34.275 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2024-04-18T03:08:34.335 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2024-04-18T03:08:34.335 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-04-18T03:08:34.396 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6" 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-04-18T03:08:34.397 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T03:08:34.398 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T03:08:34.398 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T03:08:34.398 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T03:08:34.398 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-04-18T03:08:34.424 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2024-04-18T03:08:34.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-18T03:08:34.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:08:34.497 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-04-18T03:08:34.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-18T03:08:34.567 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-04-18T03:08:34.625 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-04-18T03:08:34.626 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-04-18T03:08:34.684 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T03:08:34.684 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T03:08:34.684 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2024-04-18T03:08:34.684 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2024-04-18T03:08:34.684 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2024-04-18T03:08:34.685 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2024-04-18T03:08:34.685 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T03:08:34.685 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-04-18T03:08:34.685 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T03:08:34.685 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T03:08:34.685 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T03:08:34.685 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T03:08:34.685 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-18T03:08:34.685 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T03:08:34.685 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T03:08:34.685 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T03:08:34.685 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T03:08:34.686 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-04-18T03:08:34.707 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2024-04-18T03:08:34.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-04-18T03:08:34.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:08:34.777 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-04-18T03:08:34.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-04-18T03:08:34.850 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-04-18T03:08:34.908 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-04-18T03:08:34.909 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-04-18T03:08:34.966 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T03:08:34.966 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel" 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora" 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.6" 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T03:08:34.967 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T03:08:34.968 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T03:08:34.968 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T03:08:34.968 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-04-18T03:08:34.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:08:35.092 INFO:teuthology.dispatcher.supervisor:Running job 7661416 2024-04-18T03:08:35.092 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661416 --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/iozone}} -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661416/orig.config.yaml 2024-04-18T03:08:35.095 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661416 2024-04-18T03:08:35.095 INFO:teuthology.dispatcher.supervisor:Job PID: 817235 2024-04-18T03:08:35.095 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T03:10:35.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:12:35.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:14:35.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:16:35.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:18:35.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:20:36.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:22:36.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:24:36.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:26:36.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:28:36.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:28:36.831 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1