2023-06-28T18:45:33.335 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a 2023-06-28T18:45:33.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:45:33.337 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:45:49.576 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2a3992d8b0>, signals=[15]) 2023-06-28T18:45:49.578 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging 2023-06-28T18:45:49.578 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T18:45:49.579 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-06-28T18:45:54.616 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2023-06-28T18:45:54.617 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T18:45:54.617 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-06-28T18:45:54.618 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /host {"name": "smithi060"} 2023-06-28T18:46:09.639 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"} 2023-06-28T18:46:15.470 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-28T18:46:25.481 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-28T18:46:25.568 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-28T18:46:25.568 DEBUG:teuthology.provision.fog.smithi060:FOG request: PUT /host/165 {"imageID": 5} 2023-06-28T18:46:25.626 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-28T18:46:25.627 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 5} 2023-06-28T18:46:25.683 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of rhel 8.6 2023-06-28T18:46:25.683 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-06-28T18:46:25.720 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of rhel 8.6 2023-06-28T18:46:25.720 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-28T18:46:25.775 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T18:46:25.816 DEBUG:teuthology.provision.fog.smithi060:FOG request: POST /host/165/task {"taskTypeID": 1} 2023-06-28T18:46:25.827 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T18:46:25.869 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1} 2023-06-28T18:46:25.880 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-06-28T18:46:25.923 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-28T18:46:29.809 INFO:teuthology.orchestra.console:Power off smithi060 2023-06-28T18:46:29.810 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:46:29.832 INFO:teuthology.orchestra.console:Power off smithi111 2023-06-28T18:46:29.834 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:46:34.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:34.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:39.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:39.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:45.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:45.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:50.113 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:50.121 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:55.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:46:55.238 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:00.344 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:00.352 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:05.456 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:05.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:05.667 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2023-06-28T18:47:05.768 INFO:teuthology.orchestra.console:Power on smithi111 2023-06-28T18:47:05.769 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T18:47:10.576 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:10.795 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:15.688 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:15.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:15.898 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2023-06-28T18:47:16.000 INFO:teuthology.orchestra.console:Power on smithi060 2023-06-28T18:47:16.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T18:47:16.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:20.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:20.915 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:25.153 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:26.026 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:30.267 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:31.137 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:35.377 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:35.588 INFO:teuthology.orchestra.console:Power on for smithi060 completed 2023-06-28T18:47:35.689 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2023-06-28T18:47:35.689 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-06-28T18:47:40.697 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:47:40.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:47:41.291 INFO:teuthology.orchestra.console:Power on for smithi111 completed 2023-06-28T18:47:41.391 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2023-06-28T18:47:41.392 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-28T18:47:41.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:47:59.088 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-28T18:47:59.856 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-06-28T18:48:05.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:48:10.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:48:15.105 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-28T18:48:18.160 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-06-28T18:48:21.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:48:26.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:48:34.192 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-06-28T18:48:40.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:48:45.201 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-28T18:48:51.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:48:59.303 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T18:48:59.304 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T18:48:59.642 INFO:teuthology.provision.fog.smithi060:Node is ready 2023-06-28T18:48:59.643 DEBUG:teuthology.orchestra.run.smithi060:> hostname 2023-06-28T18:48:59.666 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060 2023-06-28T18:48:59.667 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060 /etc/hosts 2023-06-28T18:48:59.724 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2023-06-28T18:48:59.724 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-06-28T18:48:59.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060/smithi060/g' /etc/hosts 2023-06-28T18:48:59.918 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts 2023-06-28T18:49:00.006 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060/smithi060/g' /etc/hostname 2023-06-28T18:49:00.050 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-06-28T18:49:00.118 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-06-28T18:49:00.175 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux" 2023-06-28T18:49:00.176 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)" 2023-06-28T18:49:00.176 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel" 2023-06-28T18:49:00.176 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora" 2023-06-28T18:49:00.176 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6" 2023-06-28T18:49:00.176 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-06-28T18:49:00.176 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-28T18:49:00.177 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-06-28T18:49:00.177 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-28T18:49:00.177 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/" 2023-06-28T18:49:00.177 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-28T18:49:00.177 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T18:49:00.177 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-06-28T18:49:00.177 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T18:49:00.177 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-28T18:49:00.178 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-28T18:49:00.178 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-28T18:49:00.178 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2023-06-28T18:49:00.180 DEBUG:teuthology.parallel:result is None 2023-06-28T18:49:03.600 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-06-28T18:49:09.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:49:12.656 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-06-28T18:49:18.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:49:24.004 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T18:49:24.004 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T18:49:24.244 INFO:teuthology.provision.fog.smithi111:Node is ready 2023-06-28T18:49:24.245 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2023-06-28T18:49:24.262 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2023-06-28T18:49:24.262 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2023-06-28T18:49:24.318 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2023-06-28T18:49:24.318 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-06-28T18:49:24.450 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2023-06-28T18:49:24.476 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2023-06-28T18:49:24.542 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2023-06-28T18:49:24.608 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-06-28T18:49:24.674 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-06-28T18:49:24.729 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux" 2023-06-28T18:49:24.729 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)" 2023-06-28T18:49:24.730 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel" 2023-06-28T18:49:24.730 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora" 2023-06-28T18:49:24.730 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6" 2023-06-28T18:49:24.730 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2023-06-28T18:49:24.730 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-28T18:49:24.731 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-06-28T18:49:24.731 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-28T18:49:24.731 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/" 2023-06-28T18:49:24.731 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-28T18:49:24.731 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T18:49:24.732 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-06-28T18:49:24.732 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T18:49:24.732 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-28T18:49:24.732 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-28T18:49:24.732 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-28T18:49:24.732 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2023-06-28T18:49:24.733 DEBUG:teuthology.parallel:result is None 2023-06-28T18:49:49.933 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2023-06-28T18:49:49.934 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2023-06-28T18:49:49.934 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-28T18:49:54.968 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2023-06-28T18:49:54.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-06-28T18:49:54.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:50:00.039 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-06-28T18:50:00.179 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-06-28T18:50:00.237 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-06-28T18:50:00.237 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-06-28T18:50:00.294 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux" 2023-06-28T18:50:00.295 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)" 2023-06-28T18:50:00.295 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel" 2023-06-28T18:50:00.295 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora" 2023-06-28T18:50:00.295 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6" 2023-06-28T18:50:00.295 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-06-28T18:50:00.295 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-28T18:50:00.296 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-06-28T18:50:00.296 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-28T18:50:00.296 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/" 2023-06-28T18:50:00.296 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-28T18:50:00.296 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T18:50:00.296 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-06-28T18:50:00.296 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T18:50:00.297 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-28T18:50:00.297 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-28T18:50:00.297 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-28T18:50:00.297 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-06-28T18:50:05.333 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2023-06-28T18:50:05.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-06-28T18:50:05.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:50:10.401 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-06-28T18:50:10.534 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2023-06-28T18:50:10.591 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-06-28T18:50:10.591 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-06-28T18:50:10.648 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux" 2023-06-28T18:50:10.648 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)" 2023-06-28T18:50:10.648 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel" 2023-06-28T18:50:10.648 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora" 2023-06-28T18:50:10.649 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6" 2023-06-28T18:50:10.649 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2023-06-28T18:50:10.649 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-28T18:50:10.649 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-06-28T18:50:10.649 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-28T18:50:10.649 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/" 2023-06-28T18:50:10.649 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-28T18:50:10.650 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-28T18:50:10.650 INFO:teuthology.orchestra.run.smithi111.stdout: 2023-06-28T18:50:10.650 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-28T18:50:10.650 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-28T18:50:10.650 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-28T18:50:10.650 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-28T18:50:10.651 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-06-28T18:50:15.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:50:15.674 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:50:20.796 INFO:teuthology.dispatcher.supervisor:Running job 7319901 2023-06-28T18:50:20.797 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi/7319901 --name vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace} -- /home/teuthworker/archive/vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi/7319901/orig.config.yaml 2023-06-28T18:50:20.801 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi/7319901 2023-06-28T18:50:20.801 INFO:teuthology.dispatcher.supervisor:Job PID: 8703 2023-06-28T18:50:20.802 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-28T18:52:20.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:52:20.904 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:54:26.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:54:26.064 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:56:31.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:56:31.253 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:58:36.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:58:36.428 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T19:00:41.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T19:00:41.606 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T19:02:45.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T19:02:45.788 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T19:04:47.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T19:04:47.850 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T19:06:51.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T19:06:51.167 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T19:08:56.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T19:08:56.458 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T19:08:56.537 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-28T19:08:56.651 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-28T19:08:56.652 INFO:teuthology.nuke:Checking targets against current locks 2023-06-28T19:08:56.708 DEBUG:teuthology.nuke:shortname: smithi060 2023-06-28T19:08:56.708 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T19:08:56.732 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi/7319901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:45:32.515773', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-28T19:08:56.735 DEBUG:teuthology.nuke:shortname: smithi111 2023-06-28T19:08:56.735 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T19:08:56.762 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-28_10:04:29-fs-wip-vshankar-testing-20230628.043830-testing-default-smithi/7319901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:45:32.514220', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-28T19:08:56.799 INFO:teuthology.orchestra.console:Power off smithi060 2023-06-28T19:08:56.800 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T19:08:56.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T19:08:56.845 INFO:teuthology.orchestra.console:Power off smithi111 2023-06-28T19:08:56.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T19:08:56.872 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T19:08:56.957 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2023-06-28T19:08:56.996 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2023-06-28T19:09:12.161 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com 2023-06-28T19:09:12.167 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com