2023-07-02T15:51:01.201 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-02T15:51:01.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T15:51:01.203 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T15:51:01.397 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f59a9716670>, signals=[15]) 2023-07-02T15:51:01.398 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2023-07-02T15:51:01.399 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2023-07-02T15:51:01.399 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-07-02T15:51:01.423 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-07-02T15:51:01.423 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-07-02T15:51:01.424 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-07-02T15:51:01.425 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /host {"name": "smithi055"} 2023-07-02T15:51:01.451 INFO:teuthology.lock.ops:Start node 'smithi202.front.sepia.ceph.com' reimaging 2023-07-02T15:51:01.452 INFO:teuthology.lock.ops:Updating [smithi202.front.sepia.ceph.com]: reset os type and version on server 2023-07-02T15:51:01.452 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server 2023-07-02T15:51:01.453 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /host {"name": "smithi152"} 2023-07-02T15:51:01.476 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /host {"name": "smithi202"} 2023-07-02T15:51:01.491 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-02T15:51:01.507 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-02T15:51:01.527 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_centos_8.stream (ID 3) 2023-07-02T15:51:01.527 DEBUG:teuthology.provision.fog.smithi055:FOG request: PUT /host/160 {"imageID": 3} 2023-07-02T15:51:01.545 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_8.stream (ID 3) 2023-07-02T15:51:01.546 DEBUG:teuthology.provision.fog.smithi152:FOG request: PUT /host/257 {"imageID": 3} 2023-07-02T15:51:01.553 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-02T15:51:01.574 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 8.stream 2023-07-02T15:51:01.574 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:51:01.594 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.stream 2023-07-02T15:51:01.594 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:51:01.597 DEBUG:teuthology.provision.fog.smithi202:Requesting image smithi_centos_8.stream (ID 3) 2023-07-02T15:51:01.597 DEBUG:teuthology.provision.fog.smithi202:FOG request: PUT /host/306 {"imageID": 3} 2023-07-02T15:51:01.642 INFO:teuthology.provision.fog.smithi202:Scheduling deploy of centos 8.stream 2023-07-02T15:51:01.642 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:51:01.693 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /tasktype {"name": "deploy"} 2023-07-02T15:51:01.704 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /tasktype {"name": "deploy"} 2023-07-02T15:51:01.733 DEBUG:teuthology.provision.fog.smithi055:FOG request: POST /host/160/task {"taskTypeID": 1} 2023-07-02T15:51:01.738 DEBUG:teuthology.provision.fog.smithi152:FOG request: POST /host/257/task {"taskTypeID": 1} 2023-07-02T15:51:01.750 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /tasktype {"name": "deploy"} 2023-07-02T15:51:01.782 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:51:01.784 DEBUG:teuthology.provision.fog.smithi202:FOG request: POST /host/306/task {"taskTypeID": 1} 2023-07-02T15:51:01.791 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:51:01.852 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:51:01.969 INFO:teuthology.orchestra.console:Power off smithi152 2023-07-02T15:51:01.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-02T15:51:01.986 INFO:teuthology.orchestra.console:Power off smithi055 2023-07-02T15:51:01.987 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-02T15:51:01.997 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:02.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:02.042 INFO:teuthology.orchestra.console:Power off smithi202 2023-07-02T15:51:02.042 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-02T15:51:02.063 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:06.025 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:06.035 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:06.086 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:10.141 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:10.150 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:10.197 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:10.353 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2023-07-02T15:51:10.361 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2023-07-02T15:51:10.408 INFO:teuthology.orchestra.console:Power off for smithi202 completed 2023-07-02T15:51:10.455 INFO:teuthology.orchestra.console:Power on smithi152 2023-07-02T15:51:10.455 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-02T15:51:10.464 INFO:teuthology.orchestra.console:Power on smithi055 2023-07-02T15:51:10.465 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-02T15:51:10.477 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:10.485 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:10.509 INFO:teuthology.orchestra.console:Power on smithi202 2023-07-02T15:51:10.510 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-02T15:51:10.531 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:14.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:14.510 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:14.551 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:18.616 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:18.626 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:18.662 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T15:51:18.829 INFO:teuthology.orchestra.console:Power on for smithi152 completed 2023-07-02T15:51:18.837 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2023-07-02T15:51:18.872 INFO:teuthology.orchestra.console:Power on for smithi202 completed 2023-07-02T15:51:18.931 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-07-02T15:51:18.931 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:51:18.938 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2023-07-02T15:51:18.939 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:51:18.973 INFO:teuthology.provision.fog.smithi202:Waiting for deploy to finish 2023-07-02T15:51:18.973 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:51:34.092 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:51:34.126 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:51:34.138 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:51:49.312 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:51:49.314 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:51:49.317 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:52:04.494 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:52:04.502 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:52:04.506 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:52:19.674 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:52:19.682 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:52:19.691 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:52:34.852 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:52:34.879 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:52:34.896 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:52:50.044 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:52:50.045 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:52:50.068 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:53:05.204 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:53:05.205 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:53:06.175 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:53:20.357 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:53:20.369 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:53:21.430 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:53:35.492 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:53:35.493 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:53:36.532 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:53:50.657 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:53:50.659 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:53:51.660 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:54:05.805 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:54:05.806 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:54:06.813 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:54:20.950 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:54:20.952 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:54:21.972 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-02T15:54:22.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:54:22.148 ERROR:teuthology.orchestra.connection:Error authenticating with smithi055.front.sepia.ceph.com: Authentication failed. 2023-07-02T15:54:22.149 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-02T15:54:22.150 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-02T15:54:22.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-02T15:54:36.067 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:54:36.071 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:54:51.188 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:54:51.191 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:55:06.299 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:55:06.313 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:55:21.420 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:55:21.422 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:55:36.522 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:55:36.524 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:55:51.612 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:55:51.614 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:56:06.705 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:56:06.707 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:56:12.784 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-02T15:56:12.786 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi055 2023-07-02T15:56:21.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-02T15:56:21.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:56:21.797 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-07-02T15:56:21.799 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:56:21.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:56:22.043 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-07-02T15:56:22.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-02T15:56:22.303 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-02T15:56:22.303 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-02T15:56:22.322 INFO:teuthology.provision.fog.smithi055:Node is ready 2023-07-02T15:56:22.323 DEBUG:teuthology.orchestra.run.smithi055:> hostname 2023-07-02T15:56:22.382 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2023-07-02T15:56:22.383 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts 2023-07-02T15:56:22.442 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2023-07-02T15:56:22.442 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-07-02T15:56:22.533 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts 2023-07-02T15:56:22.563 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts 2023-07-02T15:56:22.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname 2023-07-02T15:56:22.700 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-07-02T15:56:22.768 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-07-02T15:56:22.826 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2023-07-02T15:56:22.826 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2023-07-02T15:56:22.826 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2023-07-02T15:56:22.827 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2023-07-02T15:56:22.827 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2023-07-02T15:56:22.827 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2023-07-02T15:56:22.827 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-02T15:56:22.827 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-07-02T15:56:22.827 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-02T15:56:22.827 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2023-07-02T15:56:22.828 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-02T15:56:22.828 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-02T15:56:22.828 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-02T15:56:22.829 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2023-07-02T15:56:22.830 DEBUG:teuthology.parallel:result is None 2023-07-02T15:56:24.944 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-02T15:56:30.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:56:34.000 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-02T15:56:36.877 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:56:40.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:56:43.056 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-02T15:56:49.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:56:51.951 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:56:52.112 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-02T15:56:58.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:57:01.168 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-02T15:57:07.020 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-02T15:57:07.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:57:07.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:57:10.128 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-02T15:57:10.224 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-02T15:57:16.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:57:16.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:57:19.184 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-02T15:57:25.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:57:28.244 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-02T15:57:34.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:57:34.704 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-02T15:57:37.328 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-02T15:57:40.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:57:43.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:57:43.760 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-07-02T15:57:46.384 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-02T15:57:49.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:57:52.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:57:55.441 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-02T15:57:58.162 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-02T15:57:58.163 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-02T15:58:01.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:58:04.500 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-02T15:58:10.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:58:18.573 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-07-02T15:58:18.573 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-07-02T15:58:18.599 INFO:teuthology.orchestra.run.smithi152.stdout:smithi193 2023-07-02T15:58:18.599 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi193 /etc/hosts 2023-07-02T15:58:18.667 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-07-02T15:58:18.667 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-07-02T15:58:18.844 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi193/smithi152/g' /etc/hosts 2023-07-02T15:58:18.875 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.193/172.21.15.152/g' /etc/hosts 2023-07-02T15:58:18.945 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi193/smithi152/g' /etc/hostname 2023-07-02T15:58:19.013 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-07-02T15:58:19.080 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-07-02T15:58:19.138 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-07-02T15:58:19.138 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2023-07-02T15:58:19.138 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-07-02T15:58:19.138 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-07-02T15:58:19.139 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2023-07-02T15:58:19.139 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-07-02T15:58:19.139 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-02T15:58:19.139 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-07-02T15:58:19.139 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-02T15:58:19.139 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-07-02T15:58:19.139 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-02T15:58:19.140 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-02T15:58:19.140 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-02T15:58:19.140 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-07-02T15:58:19.141 DEBUG:teuthology.parallel:result is None 2023-07-02T15:59:10.552 WARNING:teuthology.provision.fog.smithi202:timed out 2023-07-02T15:59:16.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:59:16.774 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-02T15:59:16.774 DEBUG:teuthology.orchestra.run.smithi202:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-02T15:59:17.052 INFO:teuthology.provision.fog.smithi202:Node is ready 2023-07-02T15:59:17.052 DEBUG:teuthology.orchestra.run.smithi202:> hostname 2023-07-02T15:59:17.073 INFO:teuthology.orchestra.run.smithi202.stdout:smithi202.front.sepia.ceph.com 2023-07-02T15:59:17.073 DEBUG:teuthology.orchestra.run.smithi202:> grep smithi202.front.sepia.ceph.com /etc/hosts 2023-07-02T15:59:17.135 INFO:teuthology.orchestra.run.smithi202.stdout:172.21.15.202 smithi202.front.sepia.ceph.com smithi202 2023-07-02T15:59:17.135 DEBUG:teuthology.orchestra.run.smithi202:> sudo hostname smithi202 2023-07-02T15:59:17.245 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i -e 's/smithi202.front.sepia.ceph.com/smithi202/g' /etc/hosts 2023-07-02T15:59:17.280 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i -e 's/172.21.15.202/172.21.15.202/g' /etc/hosts 2023-07-02T15:59:17.354 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i -e 's/smithi202.front.sepia.ceph.com/smithi202/g' /etc/hostname 2023-07-02T15:59:17.428 DEBUG:teuthology.orchestra.run.smithi202:> sudo hostname smithi202 2023-07-02T15:59:17.501 DEBUG:teuthology.orchestra.run.smithi202:> cat /etc/os-release 2023-07-02T15:59:17.563 INFO:teuthology.orchestra.run.smithi202.stdout:NAME="CentOS Stream" 2023-07-02T15:59:17.563 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION="8" 2023-07-02T15:59:17.564 INFO:teuthology.orchestra.run.smithi202.stdout:ID="centos" 2023-07-02T15:59:17.564 INFO:teuthology.orchestra.run.smithi202.stdout:ID_LIKE="rhel fedora" 2023-07-02T15:59:17.564 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION_ID="8" 2023-07-02T15:59:17.564 INFO:teuthology.orchestra.run.smithi202.stdout:PLATFORM_ID="platform:el8" 2023-07-02T15:59:17.564 INFO:teuthology.orchestra.run.smithi202.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-02T15:59:17.564 INFO:teuthology.orchestra.run.smithi202.stdout:ANSI_COLOR="0;31" 2023-07-02T15:59:17.564 INFO:teuthology.orchestra.run.smithi202.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-02T15:59:17.565 INFO:teuthology.orchestra.run.smithi202.stdout:HOME_URL="https://centos.org/" 2023-07-02T15:59:17.565 INFO:teuthology.orchestra.run.smithi202.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-02T15:59:17.565 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-02T15:59:17.565 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-02T15:59:17.565 INFO:teuthology.provision.fog.smithi202:Deploy complete! 2023-07-02T15:59:17.566 DEBUG:teuthology.parallel:result is None 2023-07-02T15:59:17.758 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2023-07-02T15:59:17.759 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-02T15:59:17.782 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2023-07-02T15:59:17.782 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-02T15:59:17.806 INFO:teuthology.lock.ops:Checking smithi202.front.sepia.ceph.com 2023-07-02T15:59:17.807 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-02T15:59:17.833 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2023-07-02T15:59:17.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-02T15:59:17.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:59:17.904 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-07-02T15:59:17.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-02T15:59:17.999 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2023-07-02T15:59:18.059 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2023-07-02T15:59:18.060 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-07-02T15:59:18.120 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2023-07-02T15:59:18.120 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2023-07-02T15:59:18.120 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2023-07-02T15:59:18.120 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2023-07-02T15:59:18.120 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2023-07-02T15:59:18.121 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2023-07-02T15:59:18.121 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-02T15:59:18.121 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-07-02T15:59:18.121 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-02T15:59:18.121 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2023-07-02T15:59:18.121 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-02T15:59:18.121 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-02T15:59:18.122 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-02T15:59:18.122 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-07-02T15:59:18.149 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2023-07-02T15:59:18.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-07-02T15:59:18.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:59:18.220 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-07-02T15:59:18.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-07-02T15:59:18.355 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-07-02T15:59:18.414 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-07-02T15:59:18.414 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-07-02T15:59:18.472 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-07-02T15:59:18.473 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2023-07-02T15:59:18.473 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-07-02T15:59:18.473 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-07-02T15:59:18.473 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2023-07-02T15:59:18.473 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-07-02T15:59:18.473 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-02T15:59:18.473 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-07-02T15:59:18.474 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-02T15:59:18.474 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-07-02T15:59:18.474 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-02T15:59:18.474 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-02T15:59:18.474 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-02T15:59:18.475 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-07-02T15:59:18.498 INFO:teuthology.lock.ops:Updating [smithi202.front.sepia.ceph.com]: set os type and version on server 2023-07-02T15:59:18.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com' 2023-07-02T15:59:18.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-02T15:59:18.565 DEBUG:teuthology.orchestra.run.smithi202:> true 2023-07-02T15:59:18.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi202.front.sepia.ceph.com' 2023-07-02T15:59:18.596 DEBUG:teuthology.orchestra.run.smithi202:> uname -m 2023-07-02T15:59:18.658 INFO:teuthology.orchestra.run.smithi202.stdout:x86_64 2023-07-02T15:59:18.658 DEBUG:teuthology.orchestra.run.smithi202:> cat /etc/os-release 2023-07-02T15:59:18.719 INFO:teuthology.orchestra.run.smithi202.stdout:NAME="CentOS Stream" 2023-07-02T15:59:18.719 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION="8" 2023-07-02T15:59:18.719 INFO:teuthology.orchestra.run.smithi202.stdout:ID="centos" 2023-07-02T15:59:18.720 INFO:teuthology.orchestra.run.smithi202.stdout:ID_LIKE="rhel fedora" 2023-07-02T15:59:18.720 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION_ID="8" 2023-07-02T15:59:18.720 INFO:teuthology.orchestra.run.smithi202.stdout:PLATFORM_ID="platform:el8" 2023-07-02T15:59:18.720 INFO:teuthology.orchestra.run.smithi202.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-02T15:59:18.720 INFO:teuthology.orchestra.run.smithi202.stdout:ANSI_COLOR="0;31" 2023-07-02T15:59:18.720 INFO:teuthology.orchestra.run.smithi202.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-02T15:59:18.721 INFO:teuthology.orchestra.run.smithi202.stdout:HOME_URL="https://centos.org/" 2023-07-02T15:59:18.721 INFO:teuthology.orchestra.run.smithi202.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-02T15:59:18.721 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-02T15:59:18.721 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-02T15:59:18.721 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server 2023-07-02T15:59:18.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T15:59:18.749 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T15:59:18.847 INFO:teuthology.dispatcher.supervisor:Running job 7324444 2023-07-02T15:59:18.847 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2023-07-02_15:50:52-rbd-quincy-distro-default-smithi/7324444 --name dis-2023-07-02_15:50:52-rbd-quincy-distro-default-smithi --description rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} -- /home/teuthworker/archive/dis-2023-07-02_15:50:52-rbd-quincy-distro-default-smithi/7324444/orig.config.yaml 2023-07-02T15:59:18.851 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2023-07-02_15:50:52-rbd-quincy-distro-default-smithi/7324444 2023-07-02T15:59:18.851 INFO:teuthology.dispatcher.supervisor:Job PID: 26027 2023-07-02T15:59:18.852 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-02T16:01:18.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:01:18.953 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:03:19.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:03:19.126 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:05:19.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:05:19.314 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:07:19.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:07:19.513 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:09:19.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:09:19.694 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:11:19.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:11:19.867 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:13:20.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:13:20.046 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:15:20.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:15:20.197 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:17:20.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:17:20.373 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:19:20.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:19:20.523 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:21:20.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:21:20.690 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:23:20.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:23:20.863 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:25:21.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:25:21.046 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:27:21.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-02T16:27:21.213 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-02T16:27:21.278 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-02T16:27:21.403 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-02T16:27:21.403 INFO:teuthology.nuke:Checking targets against current locks 2023-07-02T16:27:21.457 DEBUG:teuthology.nuke:shortname: smithi055 2023-07-02T16:27:21.457 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-02T16:27:21.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-07-02_15:50:52-rbd-quincy-distro-default-smithi/7324444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-02 15:51:00.305172', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBISfn4CHIx57+AbVSJQCHCs4jjWxDVV1oQ6OaGMScvE+smMKRhO6W7lBibcF6EUDFXvIOMbFUayq4OWO3Rxl4ec='} 2023-07-02T16:27:21.491 DEBUG:teuthology.nuke:shortname: smithi152 2023-07-02T16:27:21.491 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-02T16:27:21.508 DEBUG:teuthology.nuke:shortname: smithi202 2023-07-02T16:27:21.508 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-02T16:27:21.517 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-07-02_15:50:52-rbd-quincy-distro-default-smithi/7324444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-02 15:51:00.308023', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ7Za45gYv4fY+V+GP5lxQJdEo8fy5fayAqvUkrlHZDZa3L1/egoK2PHcHYP5lyQWt2WikbHAYhML73mUGUKuqLSbWd5U5KlDU+3DMhhGhrL/xrQrURc3r7aUoWrZAUF4Kk7+phMfXIDvKQVsBS+GLXP8AdhOqxhHEER+sMkj5MQPIb3YDuabhVvPf6eYW9gKHvFiHKKCp59ih2HwgnDKTQ2IiLjaWe6AfsSZ9RHTrDkLjWdvG3wzQcdaZbJO1lURViqN9w5TnYIVIuTWFLCWHf8cjRkPoxRj3N1yRKRvJ4ISnEoCZVk1fjQQX4Z98/Ic8gK48/jJ1cPePGdUeqRrk+pFE5xrDi2rZDd5mhVRvHWwxyJhz4Lz7+IKQYRrkS3aaSV+vV7FXLjHp2Vp+yu1mWXHkPX9Kxk+QGZPjSmOQuKbkSBQGU15cnyWVX0DGzN7MALOrkjijsDdmEjlqn2OlWb91ooZedqi54/8NQWwB+TL8rx3j5fFXAyY0Dk+QfWM='} 2023-07-02T16:27:21.528 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi202.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-07-02_15:50:52-rbd-quincy-distro-default-smithi/7324444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-02 15:51:00.306696', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC8GCMGmlV/R1JInj4elBJ1EEs8fNfR5kqro+9DlixWnVX2zaIS5xdBK9XM5ulTkxpcwkF+L13/yegQDeaqdflU='} 2023-07-02T16:27:21.544 INFO:teuthology.orchestra.console:Power off smithi055 2023-07-02T16:27:21.545 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-02T16:27:21.564 INFO:teuthology.orchestra.console:Power off smithi152 2023-07-02T16:27:21.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-02T16:27:21.573 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T16:27:21.583 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T16:27:21.600 INFO:teuthology.orchestra.console:Power off smithi202 2023-07-02T16:27:21.601 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-02T16:27:21.623 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-02T16:27:21.712 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2023-07-02T16:27:21.713 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2023-07-02T16:27:21.745 INFO:teuthology.orchestra.console:Power off for smithi202 completed 2023-07-02T16:27:21.870 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2023-07-02T16:27:21.879 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com 2023-07-02T16:27:21.887 INFO:teuthology.lock.ops:unlocked: smithi202.front.sepia.ceph.com