2023-06-22T14:32:47.595 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-22T14:32:47.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:32:47.597 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:32:47.789 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6c3649d670>, signals=[15]) 2023-06-22T14:32:47.790 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-06-22T14:32:47.791 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T14:32:47.791 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-06-22T14:32:47.809 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-06-22T14:32:47.810 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T14:32:47.810 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-06-22T14:32:47.812 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-06-22T14:32:47.834 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2023-06-22T14:32:47.834 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T14:32:47.835 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-06-22T14:32:47.837 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"} 2023-06-22T14:32:47.860 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /host {"name": "smithi178"} 2023-06-22T14:32:47.887 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-22T14:32:47.909 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-22T14:32:47.927 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-22T14:32:47.937 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-22T14:32:47.937 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 5} 2023-06-22T14:32:47.950 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-22T14:32:47.951 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 5} 2023-06-22T14:32:47.968 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-22T14:32:47.968 DEBUG:teuthology.provision.fog.smithi178:FOG request: PUT /host/283 {"imageID": 5} 2023-06-22T14:32:47.982 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.6 2023-06-22T14:32:47.982 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-06-22T14:32:47.993 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of rhel 8.6 2023-06-22T14:32:47.993 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:32:48.023 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of rhel 8.6 2023-06-22T14:32:48.023 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:32:48.030 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T14:32:48.051 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T14:32:48.065 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-06-22T14:32:48.069 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T14:32:48.082 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1} 2023-06-22T14:32:48.102 DEBUG:teuthology.provision.fog.smithi178:FOG request: POST /host/283/task {"taskTypeID": 1} 2023-06-22T14:32:48.112 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-06-22T14:32:48.125 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:32:48.168 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:32:48.205 INFO:teuthology.orchestra.console:Power off smithi031 2023-06-22T14:32:48.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T14:32:48.233 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:32:48.252 INFO:teuthology.orchestra.console:Power off smithi148 2023-06-22T14:32:48.253 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T14:32:48.269 INFO:teuthology.orchestra.console:Power off smithi178 2023-06-22T14:32:48.269 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T14:32:48.279 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:32:48.291 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:32:48.378 INFO:teuthology.orchestra.console:Power off for smithi031 completed 2023-06-22T14:32:48.402 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2023-06-22T14:32:48.414 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-06-22T14:32:48.480 INFO:teuthology.orchestra.console:Power on smithi031 2023-06-22T14:32:48.480 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T14:32:48.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:32:48.510 INFO:teuthology.orchestra.console:Power on smithi148 2023-06-22T14:32:48.510 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T14:32:48.519 INFO:teuthology.orchestra.console:Power on smithi178 2023-06-22T14:32:48.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T14:32:48.537 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:32:48.547 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:32:52.534 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:32:52.559 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:32:52.569 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:32:56.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:32:56.670 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:32:56.679 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:32:56.858 INFO:teuthology.orchestra.console:Power on for smithi031 completed 2023-06-22T14:32:56.882 INFO:teuthology.orchestra.console:Power on for smithi148 completed 2023-06-22T14:32:56.960 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-06-22T14:32:56.960 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-06-22T14:32:56.984 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-06-22T14:32:56.984 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:32:56.985 INFO:teuthology.orchestra.console:Power on for smithi178 completed 2023-06-22T14:32:57.087 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2023-06-22T14:32:57.087 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:33:12.048 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-06-22T14:33:12.055 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:33:12.145 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:33:27.136 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:33:27.137 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-06-22T14:33:27.206 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:33:42.216 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-06-22T14:33:42.218 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:33:42.268 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:33:57.308 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-06-22T14:33:57.310 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:33:57.342 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:34:12.406 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-06-22T14:34:12.408 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:34:12.415 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:34:27.492 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:34:27.493 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-06-22T14:34:27.494 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:34:42.572 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:34:42.574 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:34:42.575 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-06-22T14:34:57.648 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:34:57.649 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:34:57.650 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-06-22T14:35:12.726 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-06-22T14:35:12.727 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:35:12.728 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:35:12.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:35:12.904 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed. 2023-06-22T14:35:14.022 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed. 2023-06-22T14:35:15.140 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed. 2023-06-22T14:35:27.798 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:35:27.800 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:35:42.854 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-06-22T14:35:47.861 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:35:47.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:36:02.918 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-22T14:36:02.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:36:06.036 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-22T14:36:06.388 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-06-22T14:36:12.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:36:17.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:36:22.045 WARNING:teuthology.provision.fog.smithi031:timed out 2023-06-22T14:36:22.047 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-22T14:36:25.108 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-06-22T14:36:28.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:36:28.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:36:31.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:36:41.117 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-06-22T14:36:41.118 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-22T14:36:44.176 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-06-22T14:36:47.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:36:47.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:36:47.441 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T14:36:47.442 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T14:36:47.688 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-06-22T14:36:47.688 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-06-22T14:36:47.745 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2023-06-22T14:36:47.745 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2023-06-22T14:36:47.802 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2023-06-22T14:36:47.802 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-06-22T14:36:47.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2023-06-22T14:36:47.967 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2023-06-22T14:36:48.035 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2023-06-22T14:36:48.102 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-06-22T14:36:48.168 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-06-22T14:36:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T14:36:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T14:36:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel" 2023-06-22T14:36:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora" 2023-06-22T14:36:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6" 2023-06-22T14:36:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-06-22T14:36:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T14:36:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-06-22T14:36:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T14:36:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T14:36:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T14:36:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T14:36:48.226 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-06-22T14:36:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T14:36:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T14:36:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T14:36:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T14:36:48.227 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-06-22T14:36:48.229 DEBUG:teuthology.parallel:result is None 2023-06-22T14:36:50.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:36:50.192 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-22T14:36:56.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:36:59.248 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-22T14:37:05.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:37:50.180 WARNING:teuthology.provision.fog.smithi148:timed out 2023-06-22T14:37:56.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:37:56.425 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T14:37:56.425 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T14:37:56.761 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-06-22T14:37:56.761 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-06-22T14:37:56.780 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2023-06-22T14:37:56.780 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2023-06-22T14:37:56.839 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-06-22T14:37:56.840 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-06-22T14:37:56.959 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2023-06-22T14:37:56.989 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-06-22T14:37:57.057 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2023-06-22T14:37:57.124 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-06-22T14:37:57.190 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-06-22T14:37:57.246 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T14:37:57.247 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T14:37:57.247 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-06-22T14:37:57.247 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-06-22T14:37:57.247 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2023-06-22T14:37:57.247 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-06-22T14:37:57.247 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T14:37:57.248 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-06-22T14:37:57.248 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T14:37:57.248 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T14:37:57.248 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T14:37:57.248 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T14:37:57.248 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-06-22T14:37:57.248 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T14:37:57.249 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T14:37:57.249 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T14:37:57.249 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T14:37:57.249 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2023-06-22T14:37:57.250 DEBUG:teuthology.parallel:result is None 2023-06-22T14:38:05.252 WARNING:teuthology.provision.fog.smithi178:timed out 2023-06-22T14:38:11.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:38:11.683 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T14:38:11.684 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T14:38:11.961 INFO:teuthology.provision.fog.smithi178:Node is ready 2023-06-22T14:38:11.961 DEBUG:teuthology.orchestra.run.smithi178:> hostname 2023-06-22T14:38:11.979 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178 2023-06-22T14:38:11.980 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178 /etc/hosts 2023-06-22T14:38:12.037 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2023-06-22T14:38:12.037 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-06-22T14:38:12.160 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178/smithi178/g' /etc/hosts 2023-06-22T14:38:12.188 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts 2023-06-22T14:38:12.255 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178/smithi178/g' /etc/hostname 2023-06-22T14:38:12.321 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-06-22T14:38:12.386 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-06-22T14:38:12.442 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T14:38:12.443 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T14:38:12.443 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2023-06-22T14:38:12.443 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2023-06-22T14:38:12.443 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6" 2023-06-22T14:38:12.443 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-06-22T14:38:12.444 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T14:38:12.444 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-06-22T14:38:12.444 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T14:38:12.444 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T14:38:12.444 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T14:38:12.444 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T14:38:12.444 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-22T14:38:12.445 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T14:38:12.445 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T14:38:12.445 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T14:38:12.445 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T14:38:12.445 INFO:teuthology.provision.fog.smithi178:Deploy complete! 2023-06-22T14:38:12.446 DEBUG:teuthology.parallel:result is None 2023-06-22T14:38:37.645 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2023-06-22T14:38:37.646 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2023-06-22T14:38:37.646 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T14:38:42.672 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com 2023-06-22T14:38:42.674 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2023-06-22T14:38:42.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-06-22T14:38:42.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:38:52.751 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-06-22T14:38:52.890 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-06-22T14:38:52.948 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-06-22T14:38:52.948 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-06-22T14:38:53.006 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T14:38:53.006 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T14:38:53.006 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel" 2023-06-22T14:38:53.007 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora" 2023-06-22T14:38:53.007 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6" 2023-06-22T14:38:53.007 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-06-22T14:38:53.007 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T14:38:53.007 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-06-22T14:38:53.007 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T14:38:53.007 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T14:38:53.007 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T14:38:53.008 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T14:38:53.008 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-06-22T14:38:53.008 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T14:38:53.008 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T14:38:53.008 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T14:38:53.008 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T14:38:53.009 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-06-22T14:38:58.022 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2023-06-22T14:38:58.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-06-22T14:38:58.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:38:58.089 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-06-22T14:38:58.226 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-06-22T14:38:58.284 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-06-22T14:38:58.284 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-06-22T14:38:58.342 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T14:38:58.342 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T14:38:58.342 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-06-22T14:38:58.343 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-06-22T14:38:58.343 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6" 2023-06-22T14:38:58.343 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-06-22T14:38:58.343 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T14:38:58.343 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-06-22T14:38:58.343 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T14:38:58.343 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T14:38:58.343 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T14:38:58.344 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T14:38:58.344 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-06-22T14:38:58.344 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T14:38:58.344 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T14:38:58.344 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T14:38:58.344 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T14:38:58.345 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-06-22T14:39:03.369 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server 2023-06-22T14:39:03.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-06-22T14:39:03.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T14:39:08.438 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-06-22T14:39:08.570 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-06-22T14:39:08.628 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-06-22T14:39:08.628 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-06-22T14:39:08.685 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T14:39:08.685 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T14:39:08.685 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2023-06-22T14:39:08.685 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2023-06-22T14:39:08.685 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6" 2023-06-22T14:39:08.685 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-06-22T14:39:08.686 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T14:39:08.686 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-06-22T14:39:08.686 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T14:39:08.686 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T14:39:08.686 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T14:39:08.686 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T14:39:08.686 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-06-22T14:39:08.687 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T14:39:08.687 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T14:39:08.687 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T14:39:08.687 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T14:39:08.687 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-06-22T14:39:13.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:39:13.719 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:39:18.825 INFO:teuthology.dispatcher.supervisor:Running job 7311496 2023-06-22T14:39:18.825 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311496 --name rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/pjd}} -- /home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311496/orig.config.yaml 2023-06-22T14:39:18.829 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311496 2023-06-22T14:39:18.829 INFO:teuthology.dispatcher.supervisor:Job PID: 11361 2023-06-22T14:39:18.830 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-22T14:41:18.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:41:18.833 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:43:18.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:43:18.910 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:45:23.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:45:23.989 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:47:29.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:47:29.071 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:49:34.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:49:34.152 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:51:34.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:51:34.252 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:53:39.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:53:39.334 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:55:39.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:55:39.405 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:57:39.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:57:39.483 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:59:44.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:59:44.570 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:01:49.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:01:49.635 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:03:54.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:03:54.706 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:05:59.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:05:59.788 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:08:04.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:08:04.868 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:10:09.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:10:09.971 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:12:14.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:12:14.859 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:14:19.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:14:19.942 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:16:25.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T15:16:25.016 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T15:16:25.577 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-22T15:16:25.734 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-22T15:16:25.734 INFO:teuthology.nuke:Checking targets against current locks 2023-06-22T15:16:40.802 DEBUG:teuthology.nuke:shortname: smithi031 2023-06-22T15:16:40.803 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T15:16:55.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311496', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 14:32:46.741159', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-22T15:17:00.854 DEBUG:teuthology.nuke:shortname: smithi148 2023-06-22T15:17:00.855 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T15:17:07.939 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311496', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 14:32:46.743726', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-22T15:17:07.943 DEBUG:teuthology.nuke:shortname: smithi178 2023-06-22T15:17:07.943 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T15:17:07.984 INFO:teuthology.orchestra.console:Power off smithi031 2023-06-22T15:17:07.984 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T15:17:07.994 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311496', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 14:32:46.742657', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-22T15:17:08.003 INFO:teuthology.orchestra.console:Power off smithi148 2023-06-22T15:17:08.004 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T15:17:08.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:17:08.027 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:17:08.065 INFO:teuthology.orchestra.console:Power off smithi178 2023-06-22T15:17:08.065 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T15:17:08.142 INFO:teuthology.orchestra.console:Power off for smithi031 completed 2023-06-22T15:17:08.148 INFO:teuthology.orchestra.console:Power off for smithi148 completed 2023-06-22T15:17:13.099 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:17:13.161 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com 2023-06-22T15:17:13.169 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com 2023-06-22T15:17:18.110 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:17:23.221 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:17:28.331 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:17:33.442 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:17:38.574 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:17:43.684 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:17:48.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:17:53.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:17:59.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:18:04.138 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:18:09.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:18:14.359 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:18:19.470 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T15:18:19.681 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-06-22T15:18:19.835 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com