2023-12-04T10:40:45.584 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-04T10:40:45.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:40:45.745 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe5c065de50>, signals=[15]) 2023-12-04T10:40:45.746 INFO:teuthology.lock.ops:Start node 'smithi082.front.sepia.ceph.com' reimaging 2023-12-04T10:40:45.746 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T10:40:45.746 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-12-04T10:40:45.767 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2023-12-04T10:40:45.768 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T10:40:45.768 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-12-04T10:40:45.791 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2023-12-04T10:40:45.791 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T10:40:45.791 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-12-04T10:40:45.890 DEBUG:teuthology.provision.fog.smithi082:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-04T10:40:45.906 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-04T10:40:45.922 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-04T10:40:45.938 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of rhel 8.6 2023-12-04T10:40:45.947 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of rhel 8.6 2023-12-04T10:40:45.967 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of rhel 8.6 2023-12-04T10:40:46.184 INFO:teuthology.orchestra.console.smithi082:Power off 2023-12-04T10:40:46.184 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T10:40:46.222 INFO:teuthology.orchestra.console.smithi134:Power off 2023-12-04T10:40:46.223 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T10:40:46.256 INFO:teuthology.orchestra.console.smithi158:Power off 2023-12-04T10:40:46.256 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T10:40:46.365 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2023-12-04T10:40:46.366 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:46.373 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-12-04T10:40:46.373 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:46.386 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-12-04T10:40:46.387 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:46.398 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-12-04T10:40:46.401 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-04T10:40:46.414 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-12-04T10:40:50.402 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:50.411 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:50.418 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:50.513 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-12-04T10:40:50.520 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-04T10:40:50.529 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-12-04T10:40:54.518 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:54.525 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:54.532 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:54.628 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-12-04T10:40:54.634 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-04T10:40:54.640 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-12-04T10:40:54.729 INFO:teuthology.orchestra.console.smithi082:Power off completed 2023-12-04T10:40:54.830 INFO:teuthology.orchestra.console.smithi082:Power on 2023-12-04T10:40:54.830 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T10:40:54.852 DEBUG:teuthology.orchestra.console.smithi082:power on output: Chassis Power Control: Up/On 2023-12-04T10:40:54.852 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:54.873 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-12-04T10:40:58.638 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:58.645 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:58.747 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-12-04T10:40:58.754 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-12-04T10:40:58.848 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-12-04T10:40:58.855 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-12-04T10:40:58.874 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:58.949 INFO:teuthology.orchestra.console.smithi134:Power on 2023-12-04T10:40:58.950 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T10:40:58.957 INFO:teuthology.orchestra.console.smithi158:Power on 2023-12-04T10:40:58.957 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T10:40:58.969 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On 2023-12-04T10:40:58.969 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:58.983 DEBUG:teuthology.orchestra.console.smithi158:power on output: Chassis Power Control: Up/On 2023-12-04T10:40:58.983 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:40:58.991 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-12-04T10:40:58.992 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-12-04T10:40:59.006 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-12-04T10:41:02.994 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:41:03.004 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:41:03.012 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:41:03.107 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-12-04T10:41:03.113 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-12-04T10:41:03.122 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-12-04T10:41:03.208 INFO:teuthology.orchestra.console.smithi082:Power on completed 2023-12-04T10:41:03.309 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2023-12-04T10:41:07.118 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:41:07.125 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:41:07.227 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-04T10:41:07.234 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-12-04T10:41:07.329 INFO:teuthology.orchestra.console.smithi134:Power on completed 2023-12-04T10:41:07.335 INFO:teuthology.orchestra.console.smithi158:Power on completed 2023-12-04T10:41:07.429 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2023-12-04T10:41:07.436 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2023-12-04T10:43:38.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:43:41.442 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-04T10:43:47.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:43:49.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:43:50.498 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-04T10:43:52.422 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-12-04T10:43:56.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:43:58.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:43:59.558 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-04T10:44:01.506 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-12-04T10:44:05.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:07.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:08.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:08.642 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-04T10:44:10.566 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-12-04T10:44:11.618 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-12-04T10:44:14.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:16.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:17.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:17.698 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-04T10:44:19.650 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-12-04T10:44:20.674 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-12-04T10:44:23.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:25.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:26.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:26.754 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-04T10:44:28.706 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-12-04T10:44:29.730 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-12-04T10:44:32.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:34.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:35.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:35.810 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-04T10:44:37.762 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-12-04T10:44:38.790 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-12-04T10:44:41.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:43.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:44.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:47.874 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-12-04T10:44:53.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:44:56.934 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-12-04T10:45:02.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:45:06.018 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-12-04T10:45:12.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:45:15.074 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-12-04T10:45:15.838 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T10:45:15.838 DEBUG:teuthology.orchestra.run.smithi082:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T10:45:16.250 INFO:teuthology.provision.fog.smithi082:Node is ready 2023-12-04T10:45:16.251 DEBUG:teuthology.orchestra.run.smithi082:> hostname 2023-12-04T10:45:16.271 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com 2023-12-04T10:45:16.272 DEBUG:teuthology.orchestra.run.smithi082:> grep smithi082.front.sepia.ceph.com /etc/hosts 2023-12-04T10:45:16.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082 2023-12-04T10:45:16.330 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2023-12-04T10:45:16.466 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hosts 2023-12-04T10:45:16.494 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/172.21.15.82/172.21.15.82/g' /etc/hosts 2023-12-04T10:45:16.560 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hostname 2023-12-04T10:45:16.627 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2023-12-04T10:45:16.693 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-12-04T10:45:16.749 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux" 2023-12-04T10:45:16.750 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8.6 (Ootpa)" 2023-12-04T10:45:16.750 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel" 2023-12-04T10:45:16.750 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora" 2023-12-04T10:45:16.750 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8.6" 2023-12-04T10:45:16.750 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2023-12-04T10:45:16.750 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-04T10:45:16.750 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2023-12-04T10:45:16.750 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-04T10:45:16.750 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/" 2023-12-04T10:45:16.750 INFO:teuthology.orchestra.run.smithi082.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-04T10:45:16.750 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T10:45:16.751 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-04T10:45:16.751 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-04T10:45:16.751 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-04T10:45:16.751 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-04T10:45:16.751 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-04T10:45:16.752 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2023-12-04T10:45:16.753 DEBUG:teuthology.parallel:result is None 2023-12-04T10:45:21.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:45:39.558 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-12-04T10:45:41.815 WARNING:teuthology.provision.fog.smithi134:timed out 2023-12-04T10:45:45.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:45:47.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:45:48.137 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T10:45:48.137 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T10:45:48.413 INFO:teuthology.provision.fog.smithi134:Node is ready 2023-12-04T10:45:48.413 DEBUG:teuthology.orchestra.run.smithi134:> hostname 2023-12-04T10:45:48.431 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134 2023-12-04T10:45:48.431 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134 /etc/hosts 2023-12-04T10:45:48.487 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2023-12-04T10:45:48.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-12-04T10:45:48.608 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134/smithi134/g' /etc/hosts 2023-12-04T10:45:48.637 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts 2023-12-04T10:45:48.642 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-12-04T10:45:48.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134/smithi134/g' /etc/hostname 2023-12-04T10:45:48.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-12-04T10:45:48.833 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-12-04T10:45:48.888 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2023-12-04T10:45:48.888 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.6 (Ootpa)" 2023-12-04T10:45:48.888 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2023-12-04T10:45:48.888 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2023-12-04T10:45:48.888 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.6" 2023-12-04T10:45:48.888 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-12-04T10:45:48.888 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-04T10:45:48.889 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-12-04T10:45:48.889 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-04T10:45:48.889 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2023-12-04T10:45:48.889 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-04T10:45:48.889 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T10:45:48.889 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-04T10:45:48.889 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-04T10:45:48.889 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-04T10:45:48.890 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-04T10:45:48.890 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-04T10:45:48.890 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2023-12-04T10:45:48.891 DEBUG:teuthology.parallel:result is None 2023-12-04T10:45:54.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:45:57.698 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-12-04T10:46:03.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:46:04.030 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T10:46:04.030 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T10:46:04.339 INFO:teuthology.provision.fog.smithi158:Node is ready 2023-12-04T10:46:04.339 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2023-12-04T10:46:04.355 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2023-12-04T10:46:04.355 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2023-12-04T10:46:04.411 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2023-12-04T10:46:04.412 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-12-04T10:46:04.527 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2023-12-04T10:46:04.555 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2023-12-04T10:46:04.622 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2023-12-04T10:46:04.689 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-12-04T10:46:04.754 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-12-04T10:46:04.811 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux" 2023-12-04T10:46:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)" 2023-12-04T10:46:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel" 2023-12-04T10:46:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora" 2023-12-04T10:46:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6" 2023-12-04T10:46:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-12-04T10:46:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-04T10:46:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-12-04T10:46:04.813 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-04T10:46:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/" 2023-12-04T10:46:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-04T10:46:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T10:46:04.814 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-12-04T10:46:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-04T10:46:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-04T10:46:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-04T10:46:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-04T10:46:04.814 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2023-12-04T10:46:04.815 DEBUG:teuthology.parallel:result is None 2023-12-04T10:46:05.032 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2023-12-04T10:46:05.032 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T10:46:05.055 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2023-12-04T10:46:05.056 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T10:46:05.080 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2023-12-04T10:46:05.080 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T10:46:05.098 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2023-12-04T10:46:05.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-12-04T10:46:05.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:46:05.167 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-12-04T10:46:05.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-12-04T10:46:05.304 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2023-12-04T10:46:05.362 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-12-04T10:46:05.363 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-12-04T10:46:05.420 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux" 2023-12-04T10:46:05.420 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8.6 (Ootpa)" 2023-12-04T10:46:05.420 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel" 2023-12-04T10:46:05.420 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora" 2023-12-04T10:46:05.420 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8.6" 2023-12-04T10:46:05.420 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2023-12-04T10:46:05.421 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-04T10:46:05.421 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2023-12-04T10:46:05.421 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-04T10:46:05.421 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/" 2023-12-04T10:46:05.421 INFO:teuthology.orchestra.run.smithi082.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-04T10:46:05.421 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T10:46:05.421 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-12-04T10:46:05.421 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-04T10:46:05.421 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-04T10:46:05.421 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-04T10:46:05.421 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-04T10:46:05.422 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-12-04T10:46:05.447 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2023-12-04T10:46:05.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-04T10:46:05.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:46:05.515 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-12-04T10:46:05.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-04T10:46:05.653 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2023-12-04T10:46:05.711 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2023-12-04T10:46:05.712 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-12-04T10:46:05.770 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2023-12-04T10:46:05.770 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.6 (Ootpa)" 2023-12-04T10:46:05.770 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2023-12-04T10:46:05.770 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2023-12-04T10:46:05.770 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.6" 2023-12-04T10:46:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-12-04T10:46:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-04T10:46:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-12-04T10:46:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-04T10:46:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2023-12-04T10:46:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-04T10:46:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T10:46:05.771 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-04T10:46:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-04T10:46:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-04T10:46:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-04T10:46:05.771 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-04T10:46:05.772 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-12-04T10:46:05.797 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2023-12-04T10:46:05.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-12-04T10:46:05.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:46:05.864 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-12-04T10:46:05.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-12-04T10:46:05.937 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-12-04T10:46:05.994 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-12-04T10:46:05.995 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-12-04T10:46:06.052 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux" 2023-12-04T10:46:06.052 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)" 2023-12-04T10:46:06.053 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel" 2023-12-04T10:46:06.053 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora" 2023-12-04T10:46:06.053 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6" 2023-12-04T10:46:06.053 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-12-04T10:46:06.054 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-04T10:46:06.054 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-12-04T10:46:06.054 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-04T10:46:06.054 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/" 2023-12-04T10:46:06.054 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-04T10:46:06.054 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T10:46:06.054 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-12-04T10:46:06.054 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-04T10:46:06.054 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-04T10:46:06.054 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-04T10:46:06.055 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-04T10:46:06.055 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-12-04T10:46:06.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:46:09.178 INFO:teuthology.dispatcher.supervisor:Running job 7476930 2023-12-04T10:46:09.178 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476930 --name vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/iozone}} -- /home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476930/orig.config.yaml 2023-12-04T10:46:09.182 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476930 2023-12-04T10:46:09.183 INFO:teuthology.dispatcher.supervisor:Job PID: 2956970 2023-12-04T10:46:09.183 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-04T10:48:09.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:50:09.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:52:09.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:54:09.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:56:09.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:58:10.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:58:10.235 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-04T10:58:10.379 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-04T10:58:10.379 INFO:teuthology.nuke:Checking targets against current locks 2023-12-04T10:58:10.428 DEBUG:teuthology.nuke:shortname: smithi082 2023-12-04T10:58:10.429 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T10:58:10.456 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476930', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 10:40:44.414952', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-04T10:58:10.460 DEBUG:teuthology.nuke:shortname: smithi134 2023-12-04T10:58:10.460 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T10:58:10.483 DEBUG:teuthology.nuke:shortname: smithi158 2023-12-04T10:58:10.483 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T10:58:10.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476930', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 10:40:44.418362', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-04T10:58:10.513 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476930', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 10:40:44.416749', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-04T10:58:10.519 INFO:teuthology.orchestra.console.smithi082:Power off 2023-12-04T10:58:10.520 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T10:58:10.541 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2023-12-04T10:58:10.542 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:58:10.559 INFO:teuthology.orchestra.console.smithi134:Power off 2023-12-04T10:58:10.560 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T10:58:10.571 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-12-04T10:58:10.580 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-12-04T10:58:10.581 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:58:10.597 INFO:teuthology.orchestra.console.smithi158:Power off 2023-12-04T10:58:10.598 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T10:58:10.606 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-12-04T10:58:10.617 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-12-04T10:58:10.618 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T10:58:10.639 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-12-04T10:58:10.672 INFO:teuthology.orchestra.console.smithi082:Power off completed 2023-12-04T10:58:10.707 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-12-04T10:58:10.739 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-12-04T10:58:10.826 INFO:teuthology.lock.ops:unlocked: smithi082.front.sepia.ceph.com 2023-12-04T10:58:10.851 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com 2023-12-04T10:58:10.884 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com