2023-07-05T11:54:39.220 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-05T11:54:39.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T11:54:39.222 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T11:54:39.359 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8029cab8b0>, signals=[15]) 2023-07-05T11:54:39.360 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-07-05T11:54:39.361 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-07-05T11:54:39.361 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-07-05T11:54:39.388 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-07-05T11:54:39.388 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-07-05T11:54:39.388 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-07-05T11:54:39.390 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /host {"name": "smithi069"} 2023-07-05T11:54:39.412 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"} 2023-07-05T11:54:39.459 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-05T11:54:39.488 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-05T11:54:39.510 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-05T11:54:39.511 DEBUG:teuthology.provision.fog.smithi069:FOG request: PUT /host/174 {"imageID": 6} 2023-07-05T11:54:39.520 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-05T11:54:39.520 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 6} 2023-07-05T11:54:39.551 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of ubuntu 22.04 2023-07-05T11:54:39.551 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:54:39.559 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of ubuntu 22.04 2023-07-05T11:54:39.559 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:54:39.653 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /tasktype {"name": "deploy"} 2023-07-05T11:54:39.657 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"} 2023-07-05T11:54:39.691 DEBUG:teuthology.provision.fog.smithi069:FOG request: POST /host/174/task {"taskTypeID": 1} 2023-07-05T11:54:39.694 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1} 2023-07-05T11:54:39.744 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:54:39.746 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:54:39.881 INFO:teuthology.orchestra.console:Power off smithi069 2023-07-05T11:54:39.882 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T11:54:39.895 INFO:teuthology.orchestra.console:Power off smithi167 2023-07-05T11:54:39.895 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T11:54:39.904 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:54:39.915 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:54:43.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:54:43.936 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:54:48.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:54:48.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:54:52.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:54:52.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:54:52.368 INFO:teuthology.orchestra.console:Power off for smithi069 completed 2023-07-05T11:54:52.374 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2023-07-05T11:54:52.470 INFO:teuthology.orchestra.console:Power on smithi069 2023-07-05T11:54:52.470 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-05T11:54:52.478 INFO:teuthology.orchestra.console:Power on smithi167 2023-07-05T11:54:52.479 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-05T11:54:52.491 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:54:52.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:54:56.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:54:56.522 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:55:00.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:55:00.633 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T11:55:00.834 INFO:teuthology.orchestra.console:Power on for smithi069 completed 2023-07-05T11:55:00.843 INFO:teuthology.orchestra.console:Power on for smithi167 completed 2023-07-05T11:55:00.935 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-07-05T11:55:00.936 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:55:00.944 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-07-05T11:55:00.944 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:55:16.099 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:55:16.100 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:55:31.255 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:55:31.257 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:55:46.406 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:55:46.409 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:56:01.610 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:56:01.612 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:56:16.774 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:56:16.776 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:56:31.988 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:56:31.989 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:56:47.197 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:56:47.199 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:57:02.418 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:57:02.420 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:57:17.665 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:57:17.666 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:57:32.884 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:57:32.886 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:57:48.104 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:57:48.105 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:58:03.324 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:58:03.326 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:58:18.520 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:58:18.521 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:58:33.744 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:58:33.745 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:58:48.952 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-05T11:58:48.953 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:58:49.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T11:58:52.176 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-07-05T11:58:58.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T11:59:01.264 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-07-05T11:59:04.125 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:59:07.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T11:59:10.320 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-07-05T11:59:16.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T11:59:19.322 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:59:19.408 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-07-05T11:59:25.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T11:59:28.464 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-07-05T11:59:34.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T11:59:34.499 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:59:37.552 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-07-05T11:59:43.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T11:59:46.608 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-07-05T11:59:49.664 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T11:59:52.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T12:00:04.828 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:00:19.980 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:00:35.148 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:00:50.286 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:00:52.616 WARNING:teuthology.provision.fog.smithi167:timed out 2023-07-05T12:00:58.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T12:00:58.807 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-05T12:00:58.808 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-05T12:00:59.272 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-07-05T12:00:59.272 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-07-05T12:00:59.319 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-07-05T12:00:59.319 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts 2023-07-05T12:00:59.367 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-07-05T12:00:59.367 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-07-05T12:00:59.499 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts 2023-07-05T12:00:59.513 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2023-07-05T12:00:59.566 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname 2023-07-05T12:00:59.622 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-07-05T12:00:59.674 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-07-05T12:00:59.723 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-05T12:00:59.723 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-07-05T12:00:59.723 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="22.04" 2023-07-05T12:00:59.723 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-05T12:00:59.724 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=jammy 2023-07-05T12:00:59.724 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-07-05T12:00:59.724 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-07-05T12:00:59.724 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-05T12:00:59.724 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-05T12:00:59.724 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-05T12:00:59.724 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-05T12:00:59.725 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=jammy 2023-07-05T12:00:59.725 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-07-05T12:00:59.727 DEBUG:teuthology.parallel:result is None 2023-07-05T12:01:05.388 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:01:20.512 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:01:35.632 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:01:50.751 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:02:05.841 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:02:20.936 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:02:36.032 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:02:51.116 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:03:06.220 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:03:21.320 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:03:36.392 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:03:51.468 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:04:06.540 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:04:21.608 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-05T12:04:21.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T12:04:24.720 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-05T12:04:30.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T12:04:33.808 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-05T12:04:39.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T12:04:42.864 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-05T12:04:48.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T12:04:51.920 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-05T12:04:57.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T12:05:00.976 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-05T12:05:06.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T12:05:10.036 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-05T12:05:16.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T12:06:16.100 WARNING:teuthology.provision.fog.smithi069:timed out 2023-07-05T12:06:22.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T12:06:22.358 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-05T12:06:22.359 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-05T12:06:22.795 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-07-05T12:06:22.795 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-07-05T12:06:22.841 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2023-07-05T12:06:22.842 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2023-07-05T12:06:22.889 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-07-05T12:06:22.890 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-07-05T12:06:23.028 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2023-07-05T12:06:23.043 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-07-05T12:06:23.099 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2023-07-05T12:06:23.153 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-07-05T12:06:23.208 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-07-05T12:06:23.257 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-05T12:06:23.257 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Ubuntu" 2023-07-05T12:06:23.257 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="22.04" 2023-07-05T12:06:23.257 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-05T12:06:23.257 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_CODENAME=jammy 2023-07-05T12:06:23.258 INFO:teuthology.orchestra.run.smithi069.stdout:ID=ubuntu 2023-07-05T12:06:23.258 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE=debian 2023-07-05T12:06:23.258 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-05T12:06:23.258 INFO:teuthology.orchestra.run.smithi069.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-05T12:06:23.258 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-05T12:06:23.258 INFO:teuthology.orchestra.run.smithi069.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-05T12:06:23.258 INFO:teuthology.orchestra.run.smithi069.stdout:UBUNTU_CODENAME=jammy 2023-07-05T12:06:23.259 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-07-05T12:06:23.259 DEBUG:teuthology.parallel:result is None 2023-07-05T12:06:23.433 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-07-05T12:06:23.434 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-05T12:06:23.463 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-07-05T12:06:23.464 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-05T12:06:23.490 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-07-05T12:06:23.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-07-05T12:06:23.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T12:06:23.564 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-07-05T12:06:23.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-07-05T12:06:23.649 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-07-05T12:06:23.693 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-07-05T12:06:23.694 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-07-05T12:06:23.745 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-05T12:06:23.746 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Ubuntu" 2023-07-05T12:06:23.746 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="22.04" 2023-07-05T12:06:23.746 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-05T12:06:23.746 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_CODENAME=jammy 2023-07-05T12:06:23.746 INFO:teuthology.orchestra.run.smithi069.stdout:ID=ubuntu 2023-07-05T12:06:23.746 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE=debian 2023-07-05T12:06:23.747 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-05T12:06:23.747 INFO:teuthology.orchestra.run.smithi069.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-05T12:06:23.747 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-05T12:06:23.747 INFO:teuthology.orchestra.run.smithi069.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-05T12:06:23.747 INFO:teuthology.orchestra.run.smithi069.stdout:UBUNTU_CODENAME=jammy 2023-07-05T12:06:23.748 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-07-05T12:06:23.771 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-07-05T12:06:23.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-07-05T12:06:23.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T12:06:23.849 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-07-05T12:06:24.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-07-05T12:06:24.041 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-07-05T12:06:24.088 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-07-05T12:06:24.089 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-07-05T12:06:24.135 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-05T12:06:24.136 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-07-05T12:06:24.136 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="22.04" 2023-07-05T12:06:24.136 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-05T12:06:24.136 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=jammy 2023-07-05T12:06:24.136 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-07-05T12:06:24.137 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-07-05T12:06:24.137 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-05T12:06:24.137 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-05T12:06:24.137 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-05T12:06:24.137 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-05T12:06:24.137 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=jammy 2023-07-05T12:06:24.138 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-07-05T12:06:24.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T12:06:24.166 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T12:06:24.285 INFO:teuthology.dispatcher.supervisor:Running job 7326958 2023-07-05T12:06:24.286 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-05_11:54:04-rados:mgr-wip-pdonnell-testing-20230705.003205-distro-default-smithi/7326958 --name pdonnell-2023-07-05_11:54:04-rados:mgr-wip-pdonnell-testing-20230705.003205-distro-default-smithi --description rados:mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/workunits} -- /home/teuthworker/archive/pdonnell-2023-07-05_11:54:04-rados:mgr-wip-pdonnell-testing-20230705.003205-distro-default-smithi/7326958/orig.config.yaml 2023-07-05T12:06:24.297 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-05_11:54:04-rados:mgr-wip-pdonnell-testing-20230705.003205-distro-default-smithi/7326958 2023-07-05T12:06:24.297 INFO:teuthology.dispatcher.supervisor:Job PID: 19367 2023-07-05T12:06:24.298 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-05T12:08:24.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T12:08:24.398 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T12:10:24.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T12:10:24.578 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T12:12:24.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T12:12:24.771 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T12:14:24.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T12:14:24.952 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T12:16:25.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T12:16:25.132 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T12:16:27.561 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-05T12:16:27.781 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-05T12:16:27.781 INFO:teuthology.nuke:Checking targets against current locks 2023-07-05T12:16:27.832 DEBUG:teuthology.nuke:shortname: smithi069 2023-07-05T12:16:27.833 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-05T12:16:27.852 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-05_11:54:04-rados:mgr-wip-pdonnell-testing-20230705.003205-distro-default-smithi/7326958', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 11:54:38.394223', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPMw6I6G1ZnSn57uXWjf4DTLKqbAyEcvpNBkawZiD5G2NQCjeyNa9TB6gxqL+lSl4QvTq0IDNybME0n0DDwrqfA='} 2023-07-05T12:16:27.860 DEBUG:teuthology.nuke:shortname: smithi167 2023-07-05T12:16:27.861 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-05T12:16:27.886 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-05_11:54:04-rados:mgr-wip-pdonnell-testing-20230705.003205-distro-default-smithi/7326958', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 11:54:38.392921', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGYBtS6+X5tNYSdQcC1lp/oomNvcaQhgyxeEbBYkNLAL0tWFrvk/xvQWRrTEgLpaYBX/ygtqv2KLUgh9VLAvyEQ='} 2023-07-05T12:16:27.893 INFO:teuthology.orchestra.console:Power off smithi069 2023-07-05T12:16:27.894 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T12:16:27.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T12:16:27.953 INFO:teuthology.orchestra.console:Power off smithi167 2023-07-05T12:16:27.954 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T12:16:27.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T12:16:28.038 INFO:teuthology.orchestra.console:Power off for smithi069 completed 2023-07-05T12:16:28.095 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2023-07-05T12:16:28.192 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com 2023-07-05T12:16:28.251 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com