2023-06-18T17:53:24.076 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-18T17:53:24.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T17:53:24.078 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T17:53:24.266 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff0642e88b0>, signals=[15]) 2023-06-18T17:53:24.268 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2023-06-18T17:53:24.268 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2023-06-18T17:53:24.268 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-06-18T17:53:24.296 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2023-06-18T17:53:24.297 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2023-06-18T17:53:24.297 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-06-18T17:53:24.298 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /host {"name": "smithi055"} 2023-06-18T17:53:24.321 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-06-18T17:53:24.321 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-06-18T17:53:24.321 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-06-18T17:53:24.322 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"} 2023-06-18T17:53:24.337 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-06-18T17:53:24.370 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-18T17:53:24.407 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_centos_8.stream (ID 3) 2023-06-18T17:53:24.408 DEBUG:teuthology.provision.fog.smithi055:FOG request: PUT /host/160 {"imageID": 3} 2023-06-18T17:53:24.410 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-18T17:53:24.412 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-18T17:53:24.448 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_8.stream (ID 3) 2023-06-18T17:53:24.448 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 3} 2023-06-18T17:53:24.458 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 8.stream 2023-06-18T17:53:24.459 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:53:24.461 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_centos_8.stream (ID 3) 2023-06-18T17:53:24.461 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 3} 2023-06-18T17:53:24.485 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 8.stream 2023-06-18T17:53:24.486 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:53:24.527 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 8.stream 2023-06-18T17:53:24.527 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:53:24.629 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /tasktype {"name": "deploy"} 2023-06-18T17:53:24.635 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"} 2023-06-18T17:53:24.650 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-06-18T17:53:24.661 DEBUG:teuthology.provision.fog.smithi055:FOG request: POST /host/160/task {"taskTypeID": 1} 2023-06-18T17:53:24.681 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1} 2023-06-18T17:53:24.688 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-06-18T17:53:24.713 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:53:24.729 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:53:24.747 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:53:24.911 INFO:teuthology.orchestra.console:Power off smithi110 2023-06-18T17:53:24.912 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-18T17:53:24.928 INFO:teuthology.orchestra.console:Power off smithi190 2023-06-18T17:53:24.929 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-18T17:53:24.945 INFO:teuthology.orchestra.console:Power off smithi055 2023-06-18T17:53:24.946 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-18T17:53:24.953 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:24.961 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:24.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:28.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:28.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:28.997 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:33.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:33.103 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:33.110 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:33.312 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2023-06-18T17:53:33.319 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2023-06-18T17:53:33.414 INFO:teuthology.orchestra.console:Power on smithi110 2023-06-18T17:53:33.414 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-18T17:53:33.423 INFO:teuthology.orchestra.console:Power on smithi055 2023-06-18T17:53:33.424 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-18T17:53:33.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:33.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:37.208 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:37.420 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2023-06-18T17:53:37.458 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:37.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:37.522 INFO:teuthology.orchestra.console:Power on smithi190 2023-06-18T17:53:37.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-18T17:53:37.543 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:41.569 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:41.576 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:41.583 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:41.785 INFO:teuthology.orchestra.console:Power on for smithi110 completed 2023-06-18T17:53:41.791 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2023-06-18T17:53:41.887 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2023-06-18T17:53:41.887 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:53:41.893 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2023-06-18T17:53:41.893 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:53:45.683 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T17:53:45.892 INFO:teuthology.orchestra.console:Power on for smithi190 completed 2023-06-18T17:53:45.993 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-06-18T17:53:45.994 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:53:57.074 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:53:57.081 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:54:01.174 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:54:12.255 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:54:12.256 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:54:16.363 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:54:27.434 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:54:27.437 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:54:31.552 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:54:42.608 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:54:42.617 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:54:46.792 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:54:57.793 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:54:57.796 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:55:02.080 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:55:13.012 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:55:13.020 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:55:17.339 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:55:28.369 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:55:28.371 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:55:32.681 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:55:43.768 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:55:43.769 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:55:48.021 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:55:59.160 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:55:59.163 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:56:03.352 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:56:14.610 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-06-18T17:56:14.652 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:56:15.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:56:18.692 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:56:30.036 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:56:33.520 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-06-18T17:56:34.034 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:56:39.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:56:42.576 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-06-18T17:56:45.396 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:56:48.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:56:49.333 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:56:51.632 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-06-18T17:56:57.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:57:00.968 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:57:04.648 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:57:16.016 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-06-18T17:57:16.219 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:57:20.013 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:57:22.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:57:25.072 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-06-18T17:57:31.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:57:31.529 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:57:34.160 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-06-18T17:57:35.318 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:57:40.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:57:40.870 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-18T17:57:40.871 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-18T17:57:46.836 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:57:50.615 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:57:51.523 INFO:teuthology.provision.fog.smithi055:Node is ready 2023-06-18T17:57:51.523 DEBUG:teuthology.orchestra.run.smithi055:> hostname 2023-06-18T17:57:51.594 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2023-06-18T17:57:51.594 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts 2023-06-18T17:57:51.661 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2023-06-18T17:57:51.662 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-06-18T17:57:51.776 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts 2023-06-18T17:57:51.809 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts 2023-06-18T17:57:51.880 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname 2023-06-18T17:57:51.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-06-18T17:57:52.021 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-06-18T17:57:52.080 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2023-06-18T17:57:52.080 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2023-06-18T17:57:52.081 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2023-06-18T17:57:52.081 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2023-06-18T17:57:52.081 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2023-06-18T17:57:52.081 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2023-06-18T17:57:52.081 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-18T17:57:52.081 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-06-18T17:57:52.081 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-18T17:57:52.081 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2023-06-18T17:57:52.082 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-18T17:57:52.082 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-18T17:57:52.082 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-18T17:57:52.082 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2023-06-18T17:57:52.083 DEBUG:teuthology.parallel:result is None 2023-06-18T17:58:02.284 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-18T17:58:02.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:58:05.648 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-18T17:58:05.924 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:58:11.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:58:14.704 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-18T17:58:20.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:58:21.229 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:58:23.760 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-18T17:58:29.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:58:32.816 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-18T17:58:36.489 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:58:38.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:58:41.872 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-18T17:58:47.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:58:51.736 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:59:06.964 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:59:22.244 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:59:37.468 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:59:47.890 WARNING:teuthology.provision.fog.smithi110:timed out 2023-06-18T17:59:52.704 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T17:59:53.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T17:59:54.144 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-18T17:59:54.145 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-18T17:59:54.404 INFO:teuthology.provision.fog.smithi110:Node is ready 2023-06-18T17:59:54.405 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2023-06-18T17:59:54.423 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2023-06-18T17:59:54.424 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2023-06-18T17:59:54.482 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2023-06-18T17:59:54.483 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-06-18T17:59:54.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2023-06-18T17:59:54.608 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2023-06-18T17:59:54.676 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2023-06-18T17:59:54.743 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-06-18T17:59:54.809 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-06-18T17:59:54.866 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2023-06-18T17:59:54.866 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8" 2023-06-18T17:59:54.867 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2023-06-18T17:59:54.867 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2023-06-18T17:59:54.867 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8" 2023-06-18T17:59:54.867 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-06-18T17:59:54.867 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-18T17:59:54.867 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-06-18T17:59:54.867 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-18T17:59:54.868 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2023-06-18T17:59:54.868 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-18T17:59:54.868 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-18T17:59:54.868 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-18T17:59:54.868 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2023-06-18T17:59:54.869 DEBUG:teuthology.parallel:result is None 2023-06-18T18:00:07.896 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T18:00:23.168 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T18:00:38.396 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T18:00:53.598 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-18T18:00:53.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:00:56.848 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-18T18:01:02.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:01:05.904 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-18T18:01:11.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:01:14.960 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-18T18:01:20.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:01:24.016 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-18T18:01:30.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:01:33.072 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-18T18:01:39.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:01:42.132 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-18T18:01:48.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:02:48.200 WARNING:teuthology.provision.fog.smithi190:timed out 2023-06-18T18:02:54.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:02:54.502 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-18T18:02:54.503 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-18T18:02:54.753 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-06-18T18:02:54.753 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-06-18T18:02:54.812 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2023-06-18T18:02:54.812 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2023-06-18T18:02:54.871 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-06-18T18:02:54.872 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-06-18T18:02:54.987 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2023-06-18T18:02:55.016 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-06-18T18:02:55.084 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2023-06-18T18:02:55.153 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-06-18T18:02:55.220 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-06-18T18:02:55.278 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2023-06-18T18:02:55.278 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8" 2023-06-18T18:02:55.278 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2023-06-18T18:02:55.278 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2023-06-18T18:02:55.279 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8" 2023-06-18T18:02:55.279 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-06-18T18:02:55.279 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-18T18:02:55.279 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-06-18T18:02:55.279 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-18T18:02:55.279 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2023-06-18T18:02:55.279 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-18T18:02:55.280 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-18T18:02:55.280 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-18T18:02:55.280 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-06-18T18:02:55.280 DEBUG:teuthology.parallel:result is None 2023-06-18T18:02:55.474 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2023-06-18T18:02:55.475 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-18T18:02:55.499 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2023-06-18T18:02:55.500 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-18T18:02:55.516 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-06-18T18:02:55.517 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-18T18:02:55.577 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2023-06-18T18:02:55.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-06-18T18:02:55.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:02:55.649 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-06-18T18:02:55.792 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2023-06-18T18:02:55.853 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2023-06-18T18:02:55.853 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-06-18T18:02:55.913 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2023-06-18T18:02:55.913 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2023-06-18T18:02:55.914 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2023-06-18T18:02:55.914 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2023-06-18T18:02:55.914 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2023-06-18T18:02:55.915 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2023-06-18T18:02:55.915 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-18T18:02:55.915 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-06-18T18:02:55.915 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-18T18:02:55.916 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2023-06-18T18:02:55.916 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-18T18:02:55.916 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-18T18:02:55.917 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-18T18:02:55.918 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-06-18T18:02:55.949 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2023-06-18T18:02:55.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-06-18T18:02:55.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:02:56.019 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-06-18T18:02:56.160 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-06-18T18:02:56.219 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-06-18T18:02:56.219 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-06-18T18:02:56.277 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2023-06-18T18:02:56.278 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8" 2023-06-18T18:02:56.278 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2023-06-18T18:02:56.278 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2023-06-18T18:02:56.278 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8" 2023-06-18T18:02:56.278 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-06-18T18:02:56.278 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-18T18:02:56.279 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-06-18T18:02:56.279 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-18T18:02:56.279 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2023-06-18T18:02:56.279 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-18T18:02:56.279 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-18T18:02:56.279 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-18T18:02:56.280 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-06-18T18:02:56.307 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-06-18T18:02:56.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-06-18T18:02:56.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:02:56.373 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-06-18T18:02:56.445 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-06-18T18:02:56.506 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-06-18T18:02:56.507 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-06-18T18:02:56.567 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2023-06-18T18:02:56.568 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8" 2023-06-18T18:02:56.568 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2023-06-18T18:02:56.568 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2023-06-18T18:02:56.568 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8" 2023-06-18T18:02:56.568 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-06-18T18:02:56.568 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-18T18:02:56.569 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-06-18T18:02:56.569 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-18T18:02:56.569 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2023-06-18T18:02:56.569 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-18T18:02:56.569 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-18T18:02:56.569 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-18T18:02:56.570 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-06-18T18:02:56.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:02:56.591 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:02:56.696 INFO:teuthology.dispatcher.supervisor:Running job 7307119 2023-06-18T18:02:56.696 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2023-06-18_17:52:23-rbd-main-distro-default-smithi/7307119 --name dis-2023-06-18_17:52:23-rbd-main-distro-default-smithi --description rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_nbd_diff_continuous} -- /home/teuthworker/archive/dis-2023-06-18_17:52:23-rbd-main-distro-default-smithi/7307119/orig.config.yaml 2023-06-18T18:02:56.701 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2023-06-18_17:52:23-rbd-main-distro-default-smithi/7307119 2023-06-18T18:02:56.702 INFO:teuthology.dispatcher.supervisor:Job PID: 20105 2023-06-18T18:02:56.702 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-18T18:04:56.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:04:56.802 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:06:56.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:06:56.974 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:08:57.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:08:57.157 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:10:57.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:10:57.330 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:12:57.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:12:57.521 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:14:57.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:14:57.701 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:16:57.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:16:57.906 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:18:58.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:18:58.123 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:20:58.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:20:58.289 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:22:58.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:22:58.469 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:24:58.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:24:58.642 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:26:58.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:26:58.809 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:28:58.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:28:58.970 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:30:59.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:30:59.146 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:32:59.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:32:59.377 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:34:59.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:34:59.541 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:36:59.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:36:59.717 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:38:59.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:38:59.890 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:41:00.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:41:00.069 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:41:00.139 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-18T18:41:00.275 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-18T18:41:00.276 INFO:teuthology.nuke:Checking targets against current locks 2023-06-18T18:41:00.330 DEBUG:teuthology.nuke:shortname: smithi055 2023-06-18T18:41:00.331 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-18T18:41:00.358 DEBUG:teuthology.nuke:shortname: smithi110 2023-06-18T18:41:00.359 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-18T18:41:00.362 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-06-18_17:52:23-rbd-main-distro-default-smithi/7307119', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-18 17:53:23.256248', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSFrIpTI2wZCPvUI+JDkLLtpwA6WbXoSksHX6L5j3cuju0qhna5bLkIpwGC00LvxhbsHZEEUmSThT0EwEuYXAZd9v3wB3kVJ2zEzu9NVDsmHzrcqCkH2sgCY4s3HE0MsJ3KqRmh3HKKZDIuQuwuVWQ5lCfCFpAFg+zexzYi2EXFGVxfabMaOKGtMReG6i4Hjs7smdSHtMvPFptn1ZWArKKxuAWh2ZpUZR13I0eNBGd3wNJOGIpeRt705yD8nN733kY6Wqdjdl0HdcSehTfIHsiFFWOQDcVh43LfAaPnnqm+YHmv1FKrPqFBnwYQd/TC9VYPa8cEA9P1Yao6/Kd4jF2ZU5bYGIG7mmdzlp555lNYI/L0nK98Yu57UiEGo+euUK4N4WbcUXkdr6nISkwvW7huUEM3cEuyEdjdVME2whFY496mqM0R/Xn7Noyag7VUUrWhXuN0yALHAf0LbM8/Bm4h37rRdM59FbnNKm+BblGr+0n+aeKizF4tIZc1b0INnc='} 2023-06-18T18:41:00.390 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-06-18_17:52:23-rbd-main-distro-default-smithi/7307119', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-18 17:53:23.254828', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdutxn3Mk+ahyXi/kgHNfK7Ao7RqwIzqyqGd/2DsNtkIMYngGnWsFDTCugUF97TP2lImDZQQv6CfejMozAnaqKY7b5dZVIpXBW7WZuDwsp5FW2drOiGgXdnMUDcisnGZMvYG+clGCyNBOxbOehI51RuYDLB9JskpUswGXl0p+RmagQkNHODZj27RH5fTZnQLPTxorCc/UU4XgalBTDkT9l9cHWEJg3j2CI92gUhVNXX/T4aU86LW4XBCPiHZDtpph+d9fD7dSTwRjDqfhTXMzg/bnX/EYccv4YsXFIC5zKvh4zf2Y0YMkNCMehsd7JyRyoN1nI/2Y9Fl0hr9K3Y5yBOy++7lzJpXNcvBwuZvQlc7vRSrhIYSDf4k2v4vBTOrume6fIbbFxUaXDpWRcJlYnMkNgUC1mThgsLiHVQWJr1M9vy9tyXREJlV75Z2EYinRWja47GE2ZXrL/qT+ysD3fJdY2lKlrAR2m7El5Ww/9sNhmzgyQQOLIIhIZgyKTk9k='} 2023-06-18T18:41:00.393 DEBUG:teuthology.nuke:shortname: smithi190 2023-06-18T18:41:00.393 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-18T18:41:00.422 INFO:teuthology.orchestra.console:Power off smithi055 2023-06-18T18:41:00.423 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-18T18:41:00.434 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-06-18_17:52:23-rbd-main-distro-default-smithi/7307119', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-18 17:53:23.252752', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0O1NztVGT25EEOaydnmB2zJ58XV35RTKiCHjqxuHoqZsj61OQRy/7maL9dzavccKNx+cWn8UhOmrNTOwUC1lkKJR9TAd6g2xS3yuKtl/Hp/Z50yRlRijRYSo1Aju/r6zUyZFYChiBWNs4BJKoO/3DQzejpSh6n7muqj/QyneKG0oe9qg9jp7P1e2M91DrKPrmnmNILI6TWVT4xwa8LaPvTbBn1AYACuZTugyI6Fh3bqE73a+4E4yNnPnhtJ5Ce4DuM4EL3g9j799tFDwKXXy3e26pTjNBAgV3E4jStUO7x4rl+O2aOCmaewua7USMi9l8SKX8i8i4SibAHkzh6TiHIkYVk0RjuRuuSy1iiBMizUt1G6g7cis82W8j2VOMsdCp+oqcmwIM0bicP6VYPjbVNHRqOXlY49720CpT17LJpdmGZfkTby05dXEDHrH8F+Rt0QwgDMKhyhhDAzpDJWWcDObZPVjmGnTl+yki+8yaxR4Rl3SaZrrDajNSv1xw8ns='} 2023-06-18T18:41:00.466 INFO:teuthology.orchestra.console:Power off smithi110 2023-06-18T18:41:00.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-18T18:41:00.511 INFO:teuthology.orchestra.console:Power off smithi190 2023-06-18T18:41:00.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-18T18:41:00.531 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:41:00.546 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:41:00.558 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:41:00.670 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2023-06-18T18:41:00.672 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2023-06-18T18:41:00.683 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2023-06-18T18:41:00.830 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com 2023-06-18T18:41:00.839 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2023-06-18T18:41:00.847 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com