2023-12-05T08:36:37.454 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-05T08:36:37.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T08:36:37.606 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f21e57ed550>, signals=[15]) 2023-12-05T08:36:37.607 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2023-12-05T08:36:37.607 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2023-12-05T08:36:37.607 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-12-05T08:36:37.633 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-12-05T08:36:37.634 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-12-05T08:36:37.634 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-12-05T08:36:37.796 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-05T08:36:37.806 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-05T08:36:37.868 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of rhel 8.6 2023-12-05T08:36:37.877 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of rhel 8.6 2023-12-05T08:36:38.425 INFO:teuthology.orchestra.console.smithi092:Power off 2023-12-05T08:36:38.426 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T08:36:38.439 INFO:teuthology.orchestra.console.smithi174:Power off 2023-12-05T08:36:38.439 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T08:36:38.469 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-12-05T08:36:38.470 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T08:36:38.485 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-12-05T08:36:38.486 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T08:36:38.519 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-12-05T08:36:38.530 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-05T08:36:38.621 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-12-05T08:36:38.631 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-12-05T08:36:38.722 INFO:teuthology.orchestra.console.smithi092:Power on 2023-12-05T08:36:38.722 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-05T08:36:38.732 INFO:teuthology.orchestra.console.smithi174:Power on 2023-12-05T08:36:38.732 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-05T08:36:38.762 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-12-05T08:36:38.763 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T08:36:38.771 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On 2023-12-05T08:36:38.771 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T08:36:38.803 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-12-05T08:36:38.812 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-05T08:36:42.806 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T08:36:42.813 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T08:36:42.915 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-12-05T08:36:42.921 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-05T08:36:46.917 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T08:36:46.924 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T08:36:47.026 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-12-05T08:36:47.076 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-12-05T08:36:47.127 INFO:teuthology.orchestra.console.smithi092:Power on completed 2023-12-05T08:36:47.178 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-12-05T08:36:47.228 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2023-12-05T08:36:47.279 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-12-05T08:40:51.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:40:54.466 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-05T08:41:00.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:41:03.554 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-05T08:41:09.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:41:12.642 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-05T08:41:18.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:41:21.733 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-05T08:41:27.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:41:30.818 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-05T08:41:36.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:41:39.906 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-12-05T08:41:45.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:42:45.922 WARNING:teuthology.provision.fog.smithi174:timed out 2023-12-05T08:42:51.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:42:52.281 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-05T08:42:52.281 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-05T08:42:52.573 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-12-05T08:42:52.573 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-12-05T08:42:52.591 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-12-05T08:42:52.591 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2023-12-05T08:42:52.649 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-12-05T08:42:52.650 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-12-05T08:42:52.771 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2023-12-05T08:42:52.799 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-12-05T08:42:52.866 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2023-12-05T08:42:52.933 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-12-05T08:42:52.999 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-12-05T08:42:53.055 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-12-05T08:42:53.055 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.6 (Ootpa)" 2023-12-05T08:42:53.055 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-12-05T08:42:53.055 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-12-05T08:42:53.055 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.6" 2023-12-05T08:42:53.055 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-12-05T08:42:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-05T08:42:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-12-05T08:42:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-05T08:42:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-12-05T08:42:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-05T08:42:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T08:42:53.056 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-12-05T08:42:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T08:42:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-05T08:42:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-05T08:42:53.056 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-05T08:42:53.057 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-12-05T08:42:53.058 DEBUG:teuthology.parallel:result is None 2023-12-05T08:44:41.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:44:44.518 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-12-05T08:44:50.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:44:53.603 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-12-05T08:44:59.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:45:02.690 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-12-05T08:45:08.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:45:11.778 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-12-05T08:45:17.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:45:20.870 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-12-05T08:45:26.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:45:29.958 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-12-05T08:45:35.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:45:54.402 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-12-05T08:46:00.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:46:03.494 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-12-05T08:46:09.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:46:12.578 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-12-05T08:46:18.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:46:18.938 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-05T08:46:18.938 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-05T08:46:19.186 INFO:teuthology.provision.fog.smithi092:Node is ready 2023-12-05T08:46:19.186 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2023-12-05T08:46:19.242 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2023-12-05T08:46:19.243 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts 2023-12-05T08:46:19.299 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2023-12-05T08:46:19.299 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-12-05T08:46:19.422 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts 2023-12-05T08:46:19.449 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2023-12-05T08:46:19.515 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname 2023-12-05T08:46:19.581 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-12-05T08:46:19.647 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-12-05T08:46:19.704 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-12-05T08:46:19.704 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-12-05T08:46:19.705 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-12-05T08:46:19.705 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-12-05T08:46:19.705 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-12-05T08:46:19.705 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-12-05T08:46:19.705 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-05T08:46:19.705 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-12-05T08:46:19.705 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-05T08:46:19.706 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-12-05T08:46:19.706 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-05T08:46:19.706 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T08:46:19.706 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-12-05T08:46:19.706 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T08:46:19.706 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-05T08:46:19.706 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-05T08:46:19.706 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-05T08:46:19.707 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2023-12-05T08:46:19.707 DEBUG:teuthology.parallel:result is None 2023-12-05T08:46:20.024 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2023-12-05T08:46:20.024 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-05T08:46:20.056 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-12-05T08:46:20.056 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-05T08:46:20.073 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2023-12-05T08:46:20.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-12-05T08:46:20.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:46:20.147 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-12-05T08:46:20.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-12-05T08:46:20.170 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-12-05T08:46:20.227 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-12-05T08:46:20.227 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-12-05T08:46:20.283 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-12-05T08:46:20.283 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-12-05T08:46:20.283 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-05T08:46:20.284 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-05T08:46:20.285 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-12-05T08:46:20.314 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-12-05T08:46:20.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-05T08:46:20.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:46:20.391 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-12-05T08:46:20.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-12-05T08:46:20.532 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-12-05T08:46:20.590 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-12-05T08:46:20.590 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-12-05T08:46:20.646 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-12-05T08:46:20.646 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.6 (Ootpa)" 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.6" 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T08:46:20.647 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-05T08:46:20.648 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-05T08:46:20.648 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-05T08:46:20.648 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-12-05T08:46:20.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T08:46:20.781 INFO:teuthology.dispatcher.supervisor:Running job 7477418 2023-12-05T08:46:20.781 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477418 --name mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} -- /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477418/orig.config.yaml 2023-12-05T08:46:20.784 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477418 2023-12-05T08:46:20.785 INFO:teuthology.dispatcher.supervisor:Job PID: 3750470 2023-12-05T08:46:20.785 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-05T08:48:20.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T08:50:21.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T08:52:21.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T08:54:21.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T08:56:21.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T08:58:21.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T09:00:21.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T09:00:21.955 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-05T09:00:22.089 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-05T09:00:22.089 INFO:teuthology.nuke:Checking targets against current locks 2023-12-05T09:00:22.141 DEBUG:teuthology.nuke:shortname: smithi092 2023-12-05T09:00:22.141 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T09:00:22.167 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477418', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 08:36:36.638082', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-05T09:00:22.171 DEBUG:teuthology.nuke:shortname: smithi174 2023-12-05T09:00:22.171 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T09:00:22.197 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477418', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 08:36:36.636743', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-05T09:00:22.239 INFO:teuthology.orchestra.console.smithi092:Power off 2023-12-05T09:00:22.239 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T09:00:22.290 INFO:teuthology.orchestra.console.smithi174:Power off 2023-12-05T09:00:22.290 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T09:00:22.333 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-12-05T09:00:22.333 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:00:22.364 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-12-05T09:00:22.365 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:00:22.403 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-12-05T09:00:22.429 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-12-05T09:00:22.504 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-12-05T09:00:22.531 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-12-05T09:00:22.665 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com 2023-12-05T09:00:22.686 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com