2023-06-21T06:21:52.563 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-21T06:21:52.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:21:52.565 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:21:52.725 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f87a67398b0>, signals=[15]) 2023-06-21T06:21:52.727 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2023-06-21T06:21:52.727 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2023-06-21T06:21:52.728 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-06-21T06:21:52.752 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2023-06-21T06:21:52.753 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2023-06-21T06:21:52.753 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-06-21T06:21:52.755 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /host {"name": "smithi114"} 2023-06-21T06:21:52.777 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"} 2023-06-21T06:21:52.842 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-21T06:21:52.861 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-21T06:21:52.887 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-21T06:21:52.887 DEBUG:teuthology.provision.fog.smithi114:FOG request: PUT /host/219 {"imageID": 6} 2023-06-21T06:21:52.901 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-21T06:21:52.902 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 6} 2023-06-21T06:21:52.938 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of ubuntu 22.04 2023-06-21T06:21:52.939 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:21:52.941 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of ubuntu 22.04 2023-06-21T06:21:52.941 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:21:52.983 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"} 2023-06-21T06:21:52.987 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /tasktype {"name": "deploy"} 2023-06-21T06:21:53.029 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1} 2023-06-21T06:21:53.032 DEBUG:teuthology.provision.fog.smithi114:FOG request: POST /host/219/task {"taskTypeID": 1} 2023-06-21T06:21:53.082 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:21:53.103 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:21:53.159 INFO:teuthology.orchestra.console:Power off smithi158 2023-06-21T06:21:53.160 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T06:21:53.181 INFO:teuthology.orchestra.console:Power off smithi114 2023-06-21T06:21:53.181 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T06:21:53.191 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T06:21:53.203 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T06:21:53.315 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2023-06-21T06:21:53.326 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2023-06-21T06:21:53.416 INFO:teuthology.orchestra.console:Power on smithi158 2023-06-21T06:21:53.417 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-21T06:21:53.427 INFO:teuthology.orchestra.console:Power on smithi114 2023-06-21T06:21:53.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-21T06:21:53.438 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T06:21:53.447 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T06:21:57.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T06:21:57.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T06:21:57.681 INFO:teuthology.orchestra.console:Power on for smithi114 completed 2023-06-21T06:21:57.782 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2023-06-21T06:21:57.783 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:22:01.579 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T06:22:01.854 INFO:teuthology.orchestra.console:Power on for smithi158 completed 2023-06-21T06:22:01.955 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2023-06-21T06:22:01.956 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:22:12.838 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:22:17.008 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:22:27.896 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:22:32.070 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:22:42.956 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:22:47.136 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:22:58.040 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:23:02.212 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:23:13.113 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:23:17.275 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:23:28.190 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:23:32.359 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:23:43.272 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:23:47.432 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:23:58.368 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:24:02.516 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:24:13.455 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:24:17.606 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:24:28.549 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:24:32.683 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:24:43.645 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:24:47.774 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:24:58.732 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:25:02.864 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:25:13.825 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-06-21T06:25:13.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:25:16.976 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-21T06:25:17.938 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:25:22.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:25:26.032 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-21T06:25:32.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:25:33.012 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-06-21T06:25:33.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:25:35.120 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-21T06:25:36.144 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:25:41.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:25:42.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:25:44.176 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-21T06:25:45.200 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:25:50.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:25:51.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:25:53.232 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-21T06:25:54.256 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:25:59.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:26:00.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:26:02.288 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-21T06:26:03.312 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:26:08.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:26:09.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:26:11.344 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-21T06:26:12.368 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:26:17.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:26:18.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:26:21.424 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:26:27.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:26:30.480 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:26:36.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:26:39.568 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:26:45.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:26:48.656 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:26:48.820 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-21T06:26:54.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:26:54.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:26:54.823 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-21T06:27:00.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:27:00.829 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-21T06:27:06.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:27:06.835 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-06-21T06:27:12.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:27:13.041 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-21T06:27:13.042 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-21T06:27:13.449 INFO:teuthology.provision.fog.smithi114:Node is ready 2023-06-21T06:27:13.449 DEBUG:teuthology.orchestra.run.smithi114:> hostname 2023-06-21T06:27:13.494 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2023-06-21T06:27:13.494 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts 2023-06-21T06:27:13.542 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2023-06-21T06:27:13.542 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-06-21T06:27:13.691 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts 2023-06-21T06:27:13.705 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts 2023-06-21T06:27:13.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname 2023-06-21T06:27:13.818 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-06-21T06:27:13.873 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-06-21T06:27:13.926 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-21T06:27:13.926 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2023-06-21T06:27:13.926 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="22.04" 2023-06-21T06:27:13.927 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-21T06:27:13.927 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=jammy 2023-06-21T06:27:13.927 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2023-06-21T06:27:13.927 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2023-06-21T06:27:13.927 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-21T06:27:13.927 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-21T06:27:13.927 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-21T06:27:13.928 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-21T06:27:13.928 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=jammy 2023-06-21T06:27:13.928 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2023-06-21T06:27:13.930 DEBUG:teuthology.parallel:result is None 2023-06-21T06:27:26.192 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:27:32.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:27:32.200 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:27:38.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:27:38.208 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:27:44.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:27:44.214 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-21T06:27:50.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:27:50.413 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-21T06:27:50.413 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-21T06:27:50.871 INFO:teuthology.provision.fog.smithi158:Node is ready 2023-06-21T06:27:50.872 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2023-06-21T06:27:50.918 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2023-06-21T06:27:50.918 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2023-06-21T06:27:50.965 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2023-06-21T06:27:50.966 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-06-21T06:27:51.108 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2023-06-21T06:27:51.122 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2023-06-21T06:27:51.177 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2023-06-21T06:27:51.232 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-06-21T06:27:51.283 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-06-21T06:27:51.329 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-21T06:27:51.329 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu" 2023-06-21T06:27:51.329 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="22.04" 2023-06-21T06:27:51.330 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-21T06:27:51.330 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=jammy 2023-06-21T06:27:51.330 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu 2023-06-21T06:27:51.330 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian 2023-06-21T06:27:51.330 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-21T06:27:51.330 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-21T06:27:51.330 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-21T06:27:51.331 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-21T06:27:51.331 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=jammy 2023-06-21T06:27:51.331 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2023-06-21T06:27:51.331 DEBUG:teuthology.parallel:result is None 2023-06-21T06:27:51.498 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2023-06-21T06:27:51.499 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-21T06:27:51.531 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2023-06-21T06:27:51.531 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-21T06:27:51.560 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2023-06-21T06:27:51.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-06-21T06:27:51.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:27:51.636 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-06-21T06:27:51.843 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-06-21T06:27:51.894 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-06-21T06:27:51.894 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-06-21T06:27:51.943 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-21T06:27:51.943 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2023-06-21T06:27:51.943 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="22.04" 2023-06-21T06:27:51.944 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-21T06:27:51.944 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=jammy 2023-06-21T06:27:51.944 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2023-06-21T06:27:51.945 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2023-06-21T06:27:51.945 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-21T06:27:51.945 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-21T06:27:51.945 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-21T06:27:51.946 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-21T06:27:51.946 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=jammy 2023-06-21T06:27:51.946 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-06-21T06:27:51.975 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2023-06-21T06:27:51.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-06-21T06:27:51.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T06:27:52.054 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-06-21T06:27:52.164 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-06-21T06:27:52.209 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-06-21T06:27:52.209 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-06-21T06:27:52.260 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-21T06:27:52.260 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu" 2023-06-21T06:27:52.260 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="22.04" 2023-06-21T06:27:52.260 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-21T06:27:52.261 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=jammy 2023-06-21T06:27:52.261 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu 2023-06-21T06:27:52.261 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian 2023-06-21T06:27:52.261 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-21T06:27:52.261 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-21T06:27:52.261 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-21T06:27:52.261 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-21T06:27:52.262 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=jammy 2023-06-21T06:27:52.262 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-06-21T06:27:52.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:27:52.284 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:27:52.373 INFO:teuthology.dispatcher.supervisor:Running job 7309446 2023-06-21T06:27:52.373 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi/7309446 --name vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} -- /home/teuthworker/archive/vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi/7309446/orig.config.yaml 2023-06-21T06:27:52.376 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi/7309446 2023-06-21T06:27:52.377 INFO:teuthology.dispatcher.supervisor:Job PID: 27983 2023-06-21T06:27:52.377 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-21T06:29:52.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:29:52.478 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:31:52.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:31:52.654 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:33:52.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:33:52.822 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:35:52.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:35:52.989 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:37:53.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:37:53.139 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:39:53.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:39:53.313 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:41:53.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:41:53.486 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:43:53.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:43:53.664 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:45:53.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:45:53.836 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:47:54.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:47:54.010 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:49:54.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:49:54.192 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:51:54.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:51:54.370 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:53:54.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:53:54.533 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:55:54.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:55:54.710 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:57:54.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:57:54.890 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T06:59:55.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T06:59:55.083 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:01:55.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:01:55.280 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:03:55.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:03:55.449 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:05:55.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:05:55.618 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:07:55.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:07:55.799 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:09:55.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:09:55.974 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:11:56.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:11:56.154 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:13:56.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:13:56.334 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:15:56.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:15:56.503 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:17:56.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:17:56.686 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:19:56.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:19:56.868 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:21:57.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:21:57.040 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:23:57.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:23:57.222 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:25:57.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:25:57.398 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:27:57.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:27:57.573 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:29:57.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T07:29:57.750 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T07:29:57.814 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-21T07:29:57.971 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-21T07:29:57.971 INFO:teuthology.nuke:Checking targets against current locks 2023-06-21T07:29:58.027 DEBUG:teuthology.nuke:shortname: smithi114 2023-06-21T07:29:58.027 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-21T07:29:58.055 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi/7309446', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 06:21:51.730690', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFREmOpsPciP/hQDOrSm32eVhN4l6scSczMCrJSzyuJnEIb6lhJRB6imAsu9cki85fBUfeF1TtdvR9fy9ooSbm4='} 2023-06-21T07:29:58.058 DEBUG:teuthology.nuke:shortname: smithi158 2023-06-21T07:29:58.058 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-21T07:29:58.081 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi/7309446', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 06:21:51.732455', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOpLyO83dvj4BNmWlHR4eiNjAe0AX9Gn7Zb/Ue7anEdH'} 2023-06-21T07:29:58.110 INFO:teuthology.orchestra.console:Power off smithi114 2023-06-21T07:29:58.111 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T07:29:58.132 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T07:29:58.155 INFO:teuthology.orchestra.console:Power off smithi158 2023-06-21T07:29:58.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T07:29:58.177 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T07:29:58.266 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2023-06-21T07:29:58.298 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2023-06-21T07:29:58.431 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com 2023-06-21T07:29:58.446 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com