2024-04-13T16:18:29.881 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-13T16:18:29.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T16:18:30.059 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f071ccb8c10>, signals=[15]) 2024-04-13T16:18:30.060 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2024-04-13T16:18:30.060 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2024-04-13T16:18:30.061 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-13T16:18:30.090 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2024-04-13T16:18:30.090 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2024-04-13T16:18:30.090 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-04-13T16:18:30.112 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2024-04-13T16:18:30.112 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2024-04-13T16:18:30.112 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-04-13T16:18:30.212 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-13T16:18:30.226 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-13T16:18:30.240 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-13T16:18:30.258 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of rhel 8.6 2024-04-13T16:18:30.280 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of rhel 8.6 2024-04-13T16:18:30.297 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of rhel 8.6 2024-04-13T16:18:30.500 INFO:teuthology.orchestra.console.smithi040:Power off 2024-04-13T16:18:30.501 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-13T16:18:30.517 INFO:teuthology.orchestra.console.smithi079:Power off 2024-04-13T16:18:30.518 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-13T16:18:30.529 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2024-04-13T16:18:30.529 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T16:18:30.540 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2024-04-13T16:18:30.540 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T16:18:30.554 INFO:teuthology.orchestra.console.smithi192:Power off 2024-04-13T16:18:30.555 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-13T16:18:30.562 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-04-13T16:18:30.562 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-04-13T16:18:30.575 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2024-04-13T16:18:30.575 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T16:18:30.595 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-04-13T16:18:30.663 INFO:teuthology.orchestra.console.smithi079:Power off completed 2024-04-13T16:18:30.663 INFO:teuthology.orchestra.console.smithi040:Power off completed 2024-04-13T16:18:30.697 INFO:teuthology.orchestra.console.smithi192:Power off completed 2024-04-13T16:18:30.764 INFO:teuthology.orchestra.console.smithi079:Power on 2024-04-13T16:18:30.764 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-13T16:18:30.772 INFO:teuthology.orchestra.console.smithi040:Power on 2024-04-13T16:18:30.772 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-13T16:18:30.785 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2024-04-13T16:18:30.786 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T16:18:30.794 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On 2024-04-13T16:18:30.795 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T16:18:30.801 INFO:teuthology.orchestra.console.smithi192:Power on 2024-04-13T16:18:30.802 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-13T16:18:30.810 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2024-04-13T16:18:30.815 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-04-13T16:18:30.822 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2024-04-13T16:18:30.823 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T16:18:30.844 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-04-13T16:18:34.814 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T16:18:34.822 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T16:18:34.845 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-13T16:18:34.924 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2024-04-13T16:18:34.929 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-13T16:18:34.953 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2024-04-13T16:18:35.025 INFO:teuthology.orchestra.console.smithi079:Power on completed 2024-04-13T16:18:35.030 INFO:teuthology.orchestra.console.smithi040:Power on completed 2024-04-13T16:18:35.053 INFO:teuthology.orchestra.console.smithi192:Power on completed 2024-04-13T16:18:35.127 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2024-04-13T16:18:35.131 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2024-04-13T16:18:35.154 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2024-04-13T16:21:06.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:21:06.293 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-13T16:21:21.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:21:21.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:21:39.742 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-13T16:21:39.743 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-04-13T16:21:45.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:21:45.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:21:48.798 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-13T16:21:48.801 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-04-13T16:21:54.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:21:54.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:21:57.854 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-13T16:21:57.886 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-04-13T16:22:03.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:22:03.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:22:06.910 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-04-13T16:22:06.942 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-04-13T16:22:10.297 WARNING:teuthology.provision.fog.smithi040:timed out 2024-04-13T16:22:12.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:22:12.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:22:15.998 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-04-13T16:22:16.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:22:21.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:22:34.782 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-13T16:22:40.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:22:43.838 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-13T16:22:49.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:22:50.092 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-13T16:22:50.093 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-13T16:23:05.001 INFO:teuthology.provision.fog.smithi040:Node is ready 2024-04-13T16:23:05.001 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2024-04-13T16:23:05.024 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2024-04-13T16:23:05.025 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2024-04-13T16:23:05.086 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2024-04-13T16:23:05.086 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2024-04-13T16:23:05.230 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2024-04-13T16:23:05.264 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2024-04-13T16:23:05.338 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2024-04-13T16:23:05.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2024-04-13T16:23:05.488 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-13T16:23:05.549 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Red Hat Enterprise Linux" 2024-04-13T16:23:05.549 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8.6 (Ootpa)" 2024-04-13T16:23:05.549 INFO:teuthology.orchestra.run.smithi040.stdout:ID="rhel" 2024-04-13T16:23:05.549 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="fedora" 2024-04-13T16:23:05.549 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8.6" 2024-04-13T16:23:05.550 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2024-04-13T16:23:05.550 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-13T16:23:05.550 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-13T16:23:05.550 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-13T16:23:05.550 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.redhat.com/" 2024-04-13T16:23:05.550 INFO:teuthology.orchestra.run.smithi040.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-13T16:23:05.550 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T16:23:05.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-13T16:23:05.550 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T16:23:05.550 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-13T16:23:05.550 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-13T16:23:05.550 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-13T16:23:05.551 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2024-04-13T16:23:05.553 DEBUG:teuthology.parallel:result is None 2024-04-13T16:23:12.914 WARNING:teuthology.provision.fog.smithi079:timed out 2024-04-13T16:23:18.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:23:19.182 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-13T16:23:19.182 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-13T16:23:19.437 INFO:teuthology.provision.fog.smithi079:Node is ready 2024-04-13T16:23:19.437 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2024-04-13T16:23:19.453 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079 2024-04-13T16:23:19.454 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079 /etc/hosts 2024-04-13T16:23:19.510 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2024-04-13T16:23:19.510 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2024-04-13T16:23:19.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079/smithi079/g' /etc/hosts 2024-04-13T16:23:19.674 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2024-04-13T16:23:19.742 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079/smithi079/g' /etc/hostname 2024-04-13T16:23:19.809 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2024-04-13T16:23:19.875 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-04-13T16:23:19.932 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2024-04-13T16:23:19.932 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2024-04-13T16:23:19.932 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2024-04-13T16:23:19.932 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2024-04-13T16:23:19.932 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2024-04-13T16:23:19.932 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2024-04-13T16:23:19.933 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-13T16:23:19.933 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-04-13T16:23:19.933 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-13T16:23:19.933 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2024-04-13T16:23:19.933 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-13T16:23:19.933 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T16:23:19.933 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-13T16:23:19.933 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T16:23:19.933 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-13T16:23:19.933 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-13T16:23:19.933 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-13T16:23:19.933 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2024-04-13T16:23:19.934 DEBUG:teuthology.parallel:result is None 2024-04-13T16:23:22.001 WARNING:teuthology.provision.fog.smithi192:timed out 2024-04-13T16:23:28.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:23:28.279 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-13T16:23:28.279 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-13T16:23:28.545 INFO:teuthology.provision.fog.smithi192:Node is ready 2024-04-13T16:23:28.545 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2024-04-13T16:23:28.563 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192 2024-04-13T16:23:28.563 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192 /etc/hosts 2024-04-13T16:23:28.625 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2024-04-13T16:23:28.625 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2024-04-13T16:23:28.743 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192/smithi192/g' /etc/hosts 2024-04-13T16:23:28.771 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2024-04-13T16:23:28.843 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192/smithi192/g' /etc/hostname 2024-04-13T16:23:28.913 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2024-04-13T16:23:28.983 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-04-13T16:23:29.043 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux" 2024-04-13T16:23:29.043 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.6 (Ootpa)" 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel" 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora" 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.6" 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/" 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T16:23:29.044 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-13T16:23:29.045 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-13T16:23:29.045 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-13T16:23:29.045 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2024-04-13T16:23:29.046 DEBUG:teuthology.parallel:result is None 2024-04-13T16:23:29.237 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2024-04-13T16:23:29.237 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-13T16:23:29.262 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2024-04-13T16:23:29.263 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-13T16:23:29.278 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2024-04-13T16:23:29.279 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-13T16:23:29.296 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2024-04-13T16:23:29.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-13T16:23:29.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:23:29.372 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-04-13T16:23:29.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-13T16:23:29.519 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-04-13T16:23:29.580 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-04-13T16:23:29.580 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-13T16:23:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Red Hat Enterprise Linux" 2024-04-13T16:23:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8.6 (Ootpa)" 2024-04-13T16:23:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ID="rhel" 2024-04-13T16:23:29.641 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="fedora" 2024-04-13T16:23:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8.6" 2024-04-13T16:23:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2024-04-13T16:23:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-13T16:23:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-13T16:23:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-13T16:23:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.redhat.com/" 2024-04-13T16:23:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-13T16:23:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T16:23:29.642 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-13T16:23:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T16:23:29.642 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-13T16:23:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-13T16:23:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-13T16:23:29.643 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-13T16:23:29.662 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2024-04-13T16:23:29.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-13T16:23:29.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:23:29.736 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-04-13T16:23:29.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-04-13T16:23:29.806 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-04-13T16:23:29.865 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-04-13T16:23:29.865 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-04-13T16:23:29.923 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-04-13T16:23:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T16:23:29.925 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-13T16:23:29.925 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-13T16:23:29.925 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-13T16:23:29.925 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-04-13T16:23:29.946 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2024-04-13T16:23:29.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-04-13T16:23:29.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-13T16:23:30.022 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-04-13T16:23:30.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-04-13T16:23:30.098 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-04-13T16:23:30.161 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-04-13T16:23:30.162 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-04-13T16:23:30.225 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux" 2024-04-13T16:23:30.225 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.6 (Ootpa)" 2024-04-13T16:23:30.225 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel" 2024-04-13T16:23:30.225 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora" 2024-04-13T16:23:30.225 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.6" 2024-04-13T16:23:30.225 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2024-04-13T16:23:30.225 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-13T16:23:30.225 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-04-13T16:23:30.225 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-13T16:23:30.225 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/" 2024-04-13T16:23:30.226 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-13T16:23:30.226 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-13T16:23:30.226 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-13T16:23:30.226 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-13T16:23:30.226 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-13T16:23:30.226 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-13T16:23:30.226 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-13T16:23:30.226 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-04-13T16:23:30.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T16:23:30.369 INFO:teuthology.dispatcher.supervisor:Running job 7651391 2024-04-13T16:23:30.369 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651391 --name teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651391/orig.config.yaml 2024-04-13T16:23:30.372 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651391 2024-04-13T16:23:30.372 INFO:teuthology.dispatcher.supervisor:Job PID: 1036556 2024-04-13T16:23:30.373 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-13T16:25:30.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T16:27:30.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T16:29:30.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T16:31:30.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T16:33:30.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T16:35:30.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T16:37:30.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-13T16:37:30.874 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1