2024-01-11T17:43:56.001 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-11T17:43:56.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:43:56.167 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdc5dd3fc10>, signals=[15]) 2024-01-11T17:43:56.168 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2024-01-11T17:43:56.168 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T17:43:56.168 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-01-11T17:43:56.192 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2024-01-11T17:43:56.192 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T17:43:56.192 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-01-11T17:43:56.217 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2024-01-11T17:43:56.217 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2024-01-11T17:43:56.217 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-01-11T17:43:56.313 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-11T17:43:56.329 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-11T17:43:56.364 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of rhel 8.6 2024-01-11T17:43:56.374 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of rhel 8.6 2024-01-11T17:43:56.388 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-11T17:43:56.436 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6 2024-01-11T17:43:56.605 INFO:teuthology.orchestra.console.smithi138:Power off 2024-01-11T17:43:56.605 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T17:43:56.618 INFO:teuthology.orchestra.console.smithi055:Power off 2024-01-11T17:43:56.618 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T17:43:56.630 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2024-01-11T17:43:56.630 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:43:56.640 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2024-01-11T17:43:56.641 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:43:56.652 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-01-11T17:43:56.660 INFO:teuthology.orchestra.console.smithi190:Power off 2024-01-11T17:43:56.660 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T17:43:56.671 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-01-11T17:43:56.681 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2024-01-11T17:43:56.681 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:43:56.702 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-01-11T17:44:00.656 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:00.673 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:00.703 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:00.764 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-01-11T17:44:00.782 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-01-11T17:44:00.815 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-01-11T17:44:04.769 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:04.783 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:04.816 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:04.878 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-01-11T17:44:04.892 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-01-11T17:44:04.925 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-01-11T17:44:04.979 INFO:teuthology.orchestra.console.smithi138:Power off completed 2024-01-11T17:44:05.026 INFO:teuthology.orchestra.console.smithi190:Power off completed 2024-01-11T17:44:05.080 INFO:teuthology.orchestra.console.smithi138:Power on 2024-01-11T17:44:05.080 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T17:44:05.103 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On 2024-01-11T17:44:05.103 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:05.126 INFO:teuthology.orchestra.console.smithi190:Power on 2024-01-11T17:44:05.126 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T17:44:05.135 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-01-11T17:44:05.147 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2024-01-11T17:44:05.147 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:05.168 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-01-11T17:44:08.896 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:09.005 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-01-11T17:44:09.106 INFO:teuthology.orchestra.console.smithi055:Power off completed 2024-01-11T17:44:09.136 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:09.169 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:09.207 INFO:teuthology.orchestra.console.smithi055:Power on 2024-01-11T17:44:09.207 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-11T17:44:09.228 DEBUG:teuthology.orchestra.console.smithi055:power on output: Chassis Power Control: Up/On 2024-01-11T17:44:09.228 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:09.245 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-01-11T17:44:09.250 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-01-11T17:44:09.277 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-01-11T17:44:13.248 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:13.256 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:13.278 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T17:44:13.365 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-01-11T17:44:13.386 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-01-11T17:44:13.460 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-01-11T17:44:13.466 INFO:teuthology.orchestra.console.smithi055:Power on completed 2024-01-11T17:44:13.487 INFO:teuthology.orchestra.console.smithi190:Power on completed 2024-01-11T17:44:13.561 INFO:teuthology.orchestra.console.smithi138:Power on completed 2024-01-11T17:44:13.568 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2024-01-11T17:44:13.588 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2024-01-11T17:44:13.662 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2024-01-11T17:46:44.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:46:47.580 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-01-11T17:46:53.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:46:56.636 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-01-11T17:46:59.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:46:59.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:02.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:02.652 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-01-11T17:47:02.652 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-01-11T17:47:05.692 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-01-11T17:47:08.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:08.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:11.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:11.708 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-01-11T17:47:11.708 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-01-11T17:47:14.752 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-01-11T17:47:17.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:17.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:20.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:20.764 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-01-11T17:47:20.768 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-01-11T17:47:23.836 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-01-11T17:47:26.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:26.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:29.824 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-01-11T17:47:29.824 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-01-11T17:47:29.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:35.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:35.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:38.908 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-01-11T17:47:38.908 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-01-11T17:47:44.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:44.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:47.964 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-01-11T17:47:47.996 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-01-11T17:47:53.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:53.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:47:57.020 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-01-11T17:48:03.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:48:29.864 WARNING:teuthology.provision.fog.smithi055:timed out 2024-01-11T17:48:35.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:48:36.210 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T17:48:36.211 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T17:48:36.481 INFO:teuthology.provision.fog.smithi055:Node is ready 2024-01-11T17:48:36.481 DEBUG:teuthology.orchestra.run.smithi055:> hostname 2024-01-11T17:48:36.502 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2024-01-11T17:48:36.502 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts 2024-01-11T17:48:36.563 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2024-01-11T17:48:36.563 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2024-01-11T17:48:36.678 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts 2024-01-11T17:48:36.713 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts 2024-01-11T17:48:36.787 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname 2024-01-11T17:48:36.862 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2024-01-11T17:48:36.937 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-01-11T17:48:36.998 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T17:48:36.998 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T17:48:36.998 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel" 2024-01-11T17:48:36.998 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora" 2024-01-11T17:48:36.998 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.6" 2024-01-11T17:48:36.998 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2024-01-11T17:48:36.998 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T17:48:36.998 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-01-11T17:48:36.998 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T17:48:36.999 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T17:48:36.999 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T17:48:36.999 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T17:48:36.999 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-01-11T17:48:36.999 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T17:48:36.999 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T17:48:36.999 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T17:48:36.999 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T17:48:37.000 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2024-01-11T17:48:37.001 DEBUG:teuthology.parallel:result is None 2024-01-11T17:48:54.016 WARNING:teuthology.provision.fog.smithi138:timed out 2024-01-11T17:49:00.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:49:00.279 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T17:49:00.280 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T17:49:00.579 INFO:teuthology.provision.fog.smithi138:Node is ready 2024-01-11T17:49:00.579 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2024-01-11T17:49:00.598 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2024-01-11T17:49:00.598 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts 2024-01-11T17:49:00.657 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2024-01-11T17:49:00.657 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2024-01-11T17:49:00.772 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts 2024-01-11T17:49:00.801 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts 2024-01-11T17:49:00.869 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname 2024-01-11T17:49:00.937 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2024-01-11T17:49:01.003 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-01-11T17:49:01.060 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T17:49:01.060 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T17:49:01.060 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2024-01-11T17:49:01.060 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2024-01-11T17:49:01.060 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2024-01-11T17:49:01.060 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2024-01-11T17:49:01.060 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T17:49:01.060 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-01-11T17:49:01.061 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T17:49:01.061 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T17:49:01.061 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T17:49:01.061 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T17:49:01.061 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-01-11T17:49:01.061 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T17:49:01.061 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T17:49:01.061 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T17:49:01.061 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T17:49:01.061 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2024-01-11T17:49:01.062 DEBUG:teuthology.parallel:result is None 2024-01-11T17:49:03.031 WARNING:teuthology.provision.fog.smithi190:timed out 2024-01-11T17:49:09.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:49:09.274 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-11T17:49:09.275 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-11T17:49:09.567 INFO:teuthology.provision.fog.smithi190:Node is ready 2024-01-11T17:49:09.567 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2024-01-11T17:49:09.585 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2024-01-11T17:49:09.585 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2024-01-11T17:49:09.646 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2024-01-11T17:49:09.646 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2024-01-11T17:49:09.767 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2024-01-11T17:49:09.794 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2024-01-11T17:49:09.865 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2024-01-11T17:49:09.936 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2024-01-11T17:49:10.005 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-01-11T17:49:10.064 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T17:49:10.064 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T17:49:10.064 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T17:49:10.065 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T17:49:10.066 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2024-01-11T17:49:10.066 DEBUG:teuthology.parallel:result is None 2024-01-11T17:49:10.251 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2024-01-11T17:49:10.251 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T17:49:10.274 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2024-01-11T17:49:10.274 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T17:49:10.298 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2024-01-11T17:49:10.299 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-11T17:49:10.317 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2024-01-11T17:49:10.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-01-11T17:49:10.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:49:10.392 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-01-11T17:49:10.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-01-11T17:49:10.535 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-01-11T17:49:10.596 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-01-11T17:49:10.597 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-01-11T17:49:10.657 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel" 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora" 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.6" 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-01-11T17:49:10.658 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T17:49:10.659 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T17:49:10.659 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T17:49:10.659 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T17:49:10.659 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-01-11T17:49:10.682 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2024-01-11T17:49:10.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-01-11T17:49:10.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:49:10.755 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-01-11T17:49:10.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-01-11T17:49:10.885 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-01-11T17:49:10.939 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-01-11T17:49:10.940 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-01-11T17:49:10.993 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T17:49:10.993 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T17:49:10.993 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2024-01-11T17:49:10.993 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2024-01-11T17:49:10.993 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2024-01-11T17:49:10.993 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2024-01-11T17:49:10.994 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T17:49:10.994 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-01-11T17:49:10.994 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T17:49:10.994 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T17:49:10.994 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T17:49:10.994 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T17:49:10.994 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-01-11T17:49:10.994 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T17:49:10.994 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T17:49:10.994 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T17:49:10.994 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T17:49:10.995 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-01-11T17:49:11.016 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2024-01-11T17:49:11.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-01-11T17:49:11.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-11T17:49:11.088 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-01-11T17:49:11.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-01-11T17:49:11.153 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-01-11T17:49:11.214 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-01-11T17:49:11.215 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-01-11T17:49:11.276 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2024-01-11T17:49:11.276 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2024-01-11T17:49:11.276 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2024-01-11T17:49:11.276 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2024-01-11T17:49:11.276 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2024-01-11T17:49:11.276 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2024-01-11T17:49:11.277 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-11T17:49:11.277 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-01-11T17:49:11.277 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-11T17:49:11.277 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2024-01-11T17:49:11.277 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-11T17:49:11.277 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-11T17:49:11.277 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-11T17:49:11.277 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-11T17:49:11.277 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-11T17:49:11.277 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-11T17:49:11.277 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-11T17:49:11.278 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-01-11T17:49:11.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:49:11.391 INFO:teuthology.dispatcher.supervisor:Running job 7511491 2024-01-11T17:49:11.391 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511491 --name vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/dbench}} -- /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511491/orig.config.yaml 2024-01-11T17:49:11.394 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511491 2024-01-11T17:49:11.395 INFO:teuthology.dispatcher.supervisor:Job PID: 3432121 2024-01-11T17:49:11.395 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-11T17:51:11.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:53:11.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:55:11.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:57:11.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T17:59:12.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:01:12.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:03:12.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:05:12.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:07:12.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:09:12.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-11T18:09:13.047 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-11T18:09:13.244 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-11T18:09:13.244 INFO:teuthology.nuke:Checking targets against current locks 2024-01-11T18:09:13.294 DEBUG:teuthology.nuke:shortname: smithi055 2024-01-11T18:09:13.295 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-11T18:09:13.317 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511491', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-11 17:43:54.928856', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNBSeIJ4qG5is/cCeZcjjC6BOU61tj3RqjOYNLqpW5NesVBImtYxh7NsNNP3aIIWeZ840R1kLEJgznwqUhfiwH0='} 2024-01-11T18:09:13.318 DEBUG:teuthology.nuke:shortname: smithi138 2024-01-11T18:09:13.318 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-11T18:09:13.342 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511491', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-11 17:43:54.927340', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPjucCvi8yj50Uili+ivuuZvqKjDBL7LpWzZqv/IC/O3tRhCHknzMOZ8RWJnl/iPyNAoWEFSoCPq+7pipRObX8o='} 2024-01-11T18:09:13.345 DEBUG:teuthology.nuke:shortname: smithi190 2024-01-11T18:09:13.345 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-11T18:09:13.370 INFO:teuthology.orchestra.console.smithi055:Power off 2024-01-11T18:09:13.370 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T18:09:13.381 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-10_15:00:23-fs-wip-vshankar-testing-20240103.072409-1-testing-default-smithi/7511491', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-11 17:43:54.925429', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLFKk2oi5NfrMmdmSevQcANiT5hdd5/h+FZUWgUjnp/Q8gkIxBAiAtnB9wQAgvByoBb6pusC4E3XkOwX8GcAb/s='} 2024-01-11T18:09:13.390 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2024-01-11T18:09:13.391 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T18:09:13.414 INFO:teuthology.orchestra.console.smithi138:Power off 2024-01-11T18:09:13.415 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T18:09:13.424 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-01-11T18:09:13.437 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2024-01-11T18:09:13.438 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T18:09:13.450 INFO:teuthology.orchestra.console.smithi190:Power off 2024-01-11T18:09:13.450 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-11T18:09:13.460 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-01-11T18:09:13.475 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2024-01-11T18:09:13.475 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-11T18:09:13.496 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-01-11T18:09:13.525 INFO:teuthology.orchestra.console.smithi055:Power off completed 2024-01-11T18:09:13.561 INFO:teuthology.orchestra.console.smithi138:Power off completed 2024-01-11T18:09:13.597 INFO:teuthology.orchestra.console.smithi190:Power off completed 2024-01-11T18:09:13.678 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2024-01-11T18:09:13.712 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com 2024-01-11T18:09:13.745 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com