2024-01-20T08:54:31.839 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-20T08:54:31.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-20T08:54:31.985 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f38cac28c10>, signals=[15]) 2024-01-20T08:54:31.985 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging 2024-01-20T08:54:31.985 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server 2024-01-20T08:54:31.985 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-01-20T08:54:32.008 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging 2024-01-20T08:54:32.009 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server 2024-01-20T08:54:32.009 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-01-20T08:54:32.114 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-20T08:54:32.148 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-20T08:54:32.154 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of rhel 8.6 2024-01-20T08:54:32.196 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of rhel 8.6 2024-01-20T08:54:32.364 INFO:teuthology.orchestra.console.smithi067:Power off 2024-01-20T08:54:32.364 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-20T08:54:32.386 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2024-01-20T08:54:32.387 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:54:32.407 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-01-20T08:54:32.420 INFO:teuthology.orchestra.console.smithi131:Power off 2024-01-20T08:54:32.421 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-20T08:54:32.441 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2024-01-20T08:54:32.441 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:54:32.463 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-01-20T08:54:36.412 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:54:36.465 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:54:36.521 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-01-20T08:54:36.573 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-01-20T08:54:40.526 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:54:40.574 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:54:40.636 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-01-20T08:54:40.683 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-01-20T08:54:40.737 INFO:teuthology.orchestra.console.smithi067:Power off completed 2024-01-20T08:54:40.783 INFO:teuthology.orchestra.console.smithi131:Power off completed 2024-01-20T08:54:40.838 INFO:teuthology.orchestra.console.smithi067:Power on 2024-01-20T08:54:40.839 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-20T08:54:40.860 DEBUG:teuthology.orchestra.console.smithi067:power on output: Chassis Power Control: Up/On 2024-01-20T08:54:40.860 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:54:40.880 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-01-20T08:54:40.885 INFO:teuthology.orchestra.console.smithi131:Power on 2024-01-20T08:54:40.885 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-20T08:54:40.905 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On 2024-01-20T08:54:40.905 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:54:40.926 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-01-20T08:54:44.885 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:54:44.927 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:54:44.993 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-01-20T08:54:45.035 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-01-20T08:54:48.996 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:54:49.036 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:54:49.106 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-01-20T08:54:49.145 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-01-20T08:54:49.207 INFO:teuthology.orchestra.console.smithi067:Power on completed 2024-01-20T08:54:49.245 INFO:teuthology.orchestra.console.smithi131:Power on completed 2024-01-20T08:54:49.308 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2024-01-20T08:54:49.346 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2024-01-20T08:57:20.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:57:35.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:57:38.620 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-01-20T08:57:44.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:57:47.676 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-01-20T08:57:53.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:57:53.724 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-20T08:57:56.736 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-01-20T08:57:59.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:58:02.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:58:02.784 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-20T08:58:05.820 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-01-20T08:58:08.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:58:11.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:58:11.872 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-20T08:58:17.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:58:20.956 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-20T08:58:26.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:58:30.012 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-20T08:58:36.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:59:11.860 WARNING:teuthology.provision.fog.smithi131:timed out 2024-01-20T08:59:17.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:59:18.130 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-20T08:59:18.131 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-20T08:59:18.396 INFO:teuthology.provision.fog.smithi131:Node is ready 2024-01-20T08:59:18.396 DEBUG:teuthology.orchestra.run.smithi131:> hostname 2024-01-20T08:59:18.414 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131 2024-01-20T08:59:18.415 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131 /etc/hosts 2024-01-20T08:59:18.474 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2024-01-20T08:59:18.474 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2024-01-20T08:59:18.605 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131/smithi131/g' /etc/hosts 2024-01-20T08:59:18.635 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts 2024-01-20T08:59:18.704 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131/smithi131/g' /etc/hostname 2024-01-20T08:59:18.773 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2024-01-20T08:59:18.840 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-01-20T08:59:18.897 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Red Hat Enterprise Linux" 2024-01-20T08:59:18.897 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8.6 (Ootpa)" 2024-01-20T08:59:18.897 INFO:teuthology.orchestra.run.smithi131.stdout:ID="rhel" 2024-01-20T08:59:18.897 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="fedora" 2024-01-20T08:59:18.897 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8.6" 2024-01-20T08:59:18.897 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2024-01-20T08:59:18.898 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-20T08:59:18.898 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-01-20T08:59:18.898 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-20T08:59:18.898 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.redhat.com/" 2024-01-20T08:59:18.898 INFO:teuthology.orchestra.run.smithi131.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-20T08:59:18.898 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-20T08:59:18.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-01-20T08:59:18.898 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-20T08:59:18.898 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-20T08:59:18.898 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-20T08:59:18.898 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-20T08:59:18.899 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2024-01-20T08:59:18.900 DEBUG:teuthology.parallel:result is None 2024-01-20T08:59:36.035 WARNING:teuthology.provision.fog.smithi067:timed out 2024-01-20T08:59:42.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:59:42.247 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-20T08:59:42.247 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-20T08:59:42.507 INFO:teuthology.provision.fog.smithi067:Node is ready 2024-01-20T08:59:42.507 DEBUG:teuthology.orchestra.run.smithi067:> hostname 2024-01-20T08:59:42.525 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2024-01-20T08:59:42.526 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts 2024-01-20T08:59:42.585 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2024-01-20T08:59:42.585 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2024-01-20T08:59:42.717 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts 2024-01-20T08:59:42.747 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts 2024-01-20T08:59:42.816 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname 2024-01-20T08:59:42.885 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2024-01-20T08:59:42.953 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-01-20T08:59:43.011 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2024-01-20T08:59:43.011 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.6 (Ootpa)" 2024-01-20T08:59:43.011 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2024-01-20T08:59:43.011 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2024-01-20T08:59:43.011 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.6" 2024-01-20T08:59:43.011 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2024-01-20T08:59:43.011 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-20T08:59:43.011 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-01-20T08:59:43.011 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-20T08:59:43.012 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2024-01-20T08:59:43.012 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-20T08:59:43.012 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-20T08:59:43.012 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-20T08:59:43.012 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-20T08:59:43.012 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-20T08:59:43.012 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-20T08:59:43.012 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-20T08:59:43.012 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2024-01-20T08:59:43.013 DEBUG:teuthology.parallel:result is None 2024-01-20T08:59:43.164 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2024-01-20T08:59:43.164 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-20T08:59:43.189 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2024-01-20T08:59:43.189 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-20T08:59:43.215 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2024-01-20T08:59:43.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-20T08:59:43.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:59:43.291 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-01-20T08:59:43.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-20T08:59:43.361 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-01-20T08:59:43.418 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-01-20T08:59:43.418 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-01-20T08:59:43.474 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2024-01-20T08:59:43.474 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.6 (Ootpa)" 2024-01-20T08:59:43.474 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2024-01-20T08:59:43.474 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.6" 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-20T08:59:43.475 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-20T08:59:43.476 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-01-20T08:59:43.497 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2024-01-20T08:59:43.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-01-20T08:59:43.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:59:43.571 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-01-20T08:59:43.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-01-20T08:59:43.706 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-01-20T08:59:43.762 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-01-20T08:59:43.762 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-01-20T08:59:43.819 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Red Hat Enterprise Linux" 2024-01-20T08:59:43.819 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8.6 (Ootpa)" 2024-01-20T08:59:43.819 INFO:teuthology.orchestra.run.smithi131.stdout:ID="rhel" 2024-01-20T08:59:43.819 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="fedora" 2024-01-20T08:59:43.819 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8.6" 2024-01-20T08:59:43.820 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2024-01-20T08:59:43.820 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-20T08:59:43.820 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-01-20T08:59:43.820 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-20T08:59:43.820 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.redhat.com/" 2024-01-20T08:59:43.820 INFO:teuthology.orchestra.run.smithi131.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-20T08:59:43.820 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-20T08:59:43.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-01-20T08:59:43.820 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-20T08:59:43.820 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-20T08:59:43.820 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-20T08:59:43.820 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-20T08:59:43.821 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-01-20T08:59:43.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-20T08:59:43.924 INFO:teuthology.dispatcher.supervisor:Running job 7522485 2024-01-20T08:59:43.925 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522485 --name yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} -- /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522485/orig.config.yaml 2024-01-20T08:59:43.928 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522485 2024-01-20T08:59:43.928 INFO:teuthology.dispatcher.supervisor:Job PID: 1633505 2024-01-20T08:59:43.928 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-20T09:01:44.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-20T09:03:44.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-20T09:05:44.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-20T09:07:44.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-20T09:09:44.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-20T09:09:44.724 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-20T09:09:44.844 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-20T09:09:44.845 INFO:teuthology.nuke:Checking targets against current locks 2024-01-20T09:09:44.894 DEBUG:teuthology.nuke:shortname: smithi067 2024-01-20T09:09:44.894 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-20T09:09:44.916 DEBUG:teuthology.nuke:shortname: smithi131 2024-01-20T09:09:44.916 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-20T09:09:44.919 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522485', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 08:54:30.850931', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGQwgclFpmY2HByZ1UBChwQRgVgrAmjqD+YyecWEEne8mui97AaCVTnPiyY1QIwGm5DPGkYqjote7MbY4/bSKw='} 2024-01-20T09:09:44.940 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522485', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 08:54:30.852285', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGnYWzwFJjGk0Zb9o6usMepJEwmz+rsfCvyRxIGrH37RfAmXjnLd812nHvhs/o2mXLDNgpgY8+TfedA366EWAzQ='} 2024-01-20T09:09:44.972 INFO:teuthology.orchestra.console.smithi067:Power off 2024-01-20T09:09:44.972 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-20T09:09:44.995 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2024-01-20T09:09:44.995 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T09:09:45.009 INFO:teuthology.orchestra.console.smithi131:Power off 2024-01-20T09:09:45.009 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-20T09:09:45.020 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-01-20T09:09:45.033 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2024-01-20T09:09:45.033 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T09:09:45.053 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-01-20T09:09:45.122 INFO:teuthology.orchestra.console.smithi067:Power off completed 2024-01-20T09:09:45.154 INFO:teuthology.orchestra.console.smithi131:Power off completed 2024-01-20T09:09:45.281 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com 2024-01-20T09:09:45.306 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com