2024-01-19T00:59:03.339 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-19T00:59:03.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T00:59:03.488 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0b252adc10>, signals=[15]) 2024-01-19T00:59:03.488 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2024-01-19T00:59:03.488 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2024-01-19T00:59:03.488 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-01-19T00:59:03.507 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-01-19T00:59:03.507 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-01-19T00:59:03.507 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-01-19T00:59:03.637 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-19T00:59:03.655 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-19T00:59:03.689 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of rhel 8.6 2024-01-19T00:59:03.700 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of rhel 8.6 2024-01-19T00:59:03.925 INFO:teuthology.orchestra.console.smithi116:Power off 2024-01-19T00:59:03.926 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T00:59:03.937 INFO:teuthology.orchestra.console.smithi161:Power off 2024-01-19T00:59:03.937 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T00:59:03.947 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2024-01-19T00:59:03.947 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:03.958 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-01-19T00:59:03.959 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:03.968 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-01-19T00:59:03.979 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-19T00:59:07.972 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:07.980 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:08.081 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-01-19T00:59:08.088 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-19T00:59:12.084 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:12.091 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:12.193 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-01-19T00:59:12.199 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-19T00:59:12.295 INFO:teuthology.orchestra.console.smithi116:Power off completed 2024-01-19T00:59:12.395 INFO:teuthology.orchestra.console.smithi116:Power on 2024-01-19T00:59:12.396 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-19T00:59:12.417 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2024-01-19T00:59:12.417 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:12.440 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-01-19T00:59:16.204 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:16.312 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-01-19T00:59:16.413 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-01-19T00:59:16.441 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:16.514 INFO:teuthology.orchestra.console.smithi161:Power on 2024-01-19T00:59:16.514 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-19T00:59:16.540 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-01-19T00:59:16.540 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:16.550 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-01-19T00:59:16.560 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-01-19T00:59:20.555 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:20.562 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:20.669 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-01-19T00:59:20.674 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-01-19T00:59:20.775 INFO:teuthology.orchestra.console.smithi116:Power on completed 2024-01-19T00:59:20.875 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2024-01-19T00:59:24.675 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T00:59:24.785 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-19T00:59:24.886 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-01-19T00:59:24.987 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-01-19T01:02:06.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:02:11.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:02:25.340 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-01-19T01:02:29.436 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-19T01:02:31.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:02:34.400 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-01-19T01:02:35.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:02:38.492 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-19T01:02:40.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:02:43.488 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-01-19T01:02:44.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:02:47.548 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-19T01:02:49.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:02:52.572 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-01-19T01:02:53.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:02:56.604 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-19T01:02:58.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:03:02.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:03:05.660 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-19T01:03:11.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:03:14.716 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-19T01:03:20.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:03:58.613 WARNING:teuthology.provision.fog.smithi116:timed out 2024-01-19T01:04:04.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:04:04.840 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-19T01:04:04.841 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-19T01:04:05.144 INFO:teuthology.provision.fog.smithi116:Node is ready 2024-01-19T01:04:05.145 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2024-01-19T01:04:05.161 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116 2024-01-19T01:04:05.161 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116 /etc/hosts 2024-01-19T01:04:05.217 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2024-01-19T01:04:05.218 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2024-01-19T01:04:05.340 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116/smithi116/g' /etc/hosts 2024-01-19T01:04:05.368 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2024-01-19T01:04:05.435 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116/smithi116/g' /etc/hostname 2024-01-19T01:04:05.502 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2024-01-19T01:04:05.568 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-01-19T01:04:05.625 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.6 (Ootpa)" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.6" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-19T01:04:05.626 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-19T01:04:05.627 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-19T01:04:05.627 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2024-01-19T01:04:05.629 DEBUG:teuthology.parallel:result is None 2024-01-19T01:04:20.735 WARNING:teuthology.provision.fog.smithi161:timed out 2024-01-19T01:04:26.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:04:27.006 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-19T01:04:27.006 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-19T01:04:27.267 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-01-19T01:04:27.267 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-01-19T01:04:27.285 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161 2024-01-19T01:04:27.285 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161 /etc/hosts 2024-01-19T01:04:27.342 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2024-01-19T01:04:27.342 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-01-19T01:04:27.467 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161/smithi161/g' /etc/hosts 2024-01-19T01:04:27.496 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2024-01-19T01:04:27.563 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161/smithi161/g' /etc/hostname 2024-01-19T01:04:27.630 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-01-19T01:04:27.696 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-01-19T01:04:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2024-01-19T01:04:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)" 2024-01-19T01:04:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2024-01-19T01:04:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2024-01-19T01:04:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6" 2024-01-19T01:04:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2024-01-19T01:04:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-19T01:04:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-01-19T01:04:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-19T01:04:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2024-01-19T01:04:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-19T01:04:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-19T01:04:27.754 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-19T01:04:27.754 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-19T01:04:27.754 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-19T01:04:27.754 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-19T01:04:27.754 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-19T01:04:27.754 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-01-19T01:04:27.755 DEBUG:teuthology.parallel:result is None 2024-01-19T01:04:27.902 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2024-01-19T01:04:27.902 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-19T01:04:27.919 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-01-19T01:04:27.919 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-19T01:04:27.936 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2024-01-19T01:04:27.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-01-19T01:04:27.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:04:28.006 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-01-19T01:04:28.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-01-19T01:04:28.142 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-01-19T01:04:28.200 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-01-19T01:04:28.200 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-01-19T01:04:28.257 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2024-01-19T01:04:28.257 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.6 (Ootpa)" 2024-01-19T01:04:28.257 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2024-01-19T01:04:28.257 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2024-01-19T01:04:28.257 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.6" 2024-01-19T01:04:28.257 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2024-01-19T01:04:28.257 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-19T01:04:28.257 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-01-19T01:04:28.257 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-19T01:04:28.257 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2024-01-19T01:04:28.258 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-19T01:04:28.258 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-19T01:04:28.258 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-19T01:04:28.258 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-19T01:04:28.258 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-19T01:04:28.258 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-19T01:04:28.258 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-19T01:04:28.258 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-01-19T01:04:28.277 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-01-19T01:04:28.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-19T01:04:28.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-19T01:04:28.347 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-01-19T01:04:28.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-19T01:04:28.413 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-01-19T01:04:28.470 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-01-19T01:04:28.470 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-01-19T01:04:28.527 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2024-01-19T01:04:28.527 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)" 2024-01-19T01:04:28.527 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2024-01-19T01:04:28.527 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2024-01-19T01:04:28.527 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6" 2024-01-19T01:04:28.527 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2024-01-19T01:04:28.527 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-19T01:04:28.527 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-01-19T01:04:28.528 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-19T01:04:28.528 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2024-01-19T01:04:28.528 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-19T01:04:28.528 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-19T01:04:28.528 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-19T01:04:28.528 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-19T01:04:28.528 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-19T01:04:28.528 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-19T01:04:28.528 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-19T01:04:28.529 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-01-19T01:04:28.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T01:04:28.646 INFO:teuthology.dispatcher.supervisor:Running job 7520819 2024-01-19T01:04:28.646 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520819 --name yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} -- /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520819/orig.config.yaml 2024-01-19T01:04:28.650 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520819 2024-01-19T01:04:28.650 INFO:teuthology.dispatcher.supervisor:Job PID: 3751142 2024-01-19T01:04:28.650 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-19T01:06:28.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T01:08:28.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T01:10:29.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T01:12:29.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-19T01:12:29.303 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-19T01:12:29.420 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-19T01:12:29.421 INFO:teuthology.nuke:Checking targets against current locks 2024-01-19T01:12:29.467 DEBUG:teuthology.nuke:shortname: smithi116 2024-01-19T01:12:29.468 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T01:12:29.491 DEBUG:teuthology.nuke:shortname: smithi161 2024-01-19T01:12:29.491 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-19T01:12:29.495 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520819', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 00:59:02.138542', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKDYaPYLxQ3O4SCsvvyweS5w8cv37qVWB9aB2Jvj+K1c0VU3+FwwlYXoHzvycl5KAwBPmJTPbLXhkvDhVwfmWI0='} 2024-01-19T01:12:29.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-18_21:19:14-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7520819', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-19 00:59:02.140493', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdogZNw1hR8IjBrNATANFVFM+5T9beDyKYRERgdZAnatwdOs/E12do35Cp7TBbmJ8Dl91jPLNWAKHZ2yJBTqSQ='} 2024-01-19T01:12:29.542 INFO:teuthology.orchestra.console.smithi116:Power off 2024-01-19T01:12:29.542 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T01:12:29.555 INFO:teuthology.orchestra.console.smithi161:Power off 2024-01-19T01:12:29.556 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-19T01:12:29.563 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2024-01-19T01:12:29.564 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T01:12:29.576 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-01-19T01:12:29.576 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-19T01:12:29.584 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-01-19T01:12:29.596 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-01-19T01:12:29.686 INFO:teuthology.orchestra.console.smithi116:Power off completed 2024-01-19T01:12:29.697 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-01-19T01:12:29.850 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2024-01-19T01:12:29.860 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com