2023-06-27T00:36:44.365 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-27T00:36:44.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:36:44.367 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:36:44.534 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7476e568b0>, signals=[15]) 2023-06-27T00:36:44.535 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-06-27T00:36:44.536 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-06-27T00:36:44.536 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-06-27T00:36:44.559 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-06-27T00:36:44.560 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-06-27T00:36:44.560 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-06-27T00:36:44.562 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"} 2023-06-27T00:36:53.274 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-06-27T00:36:53.319 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-27T00:36:53.348 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-27T00:36:53.367 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-27T00:36:53.368 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 2} 2023-06-27T00:36:53.387 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-27T00:36:53.387 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 2} 2023-06-27T00:36:53.413 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of ubuntu 20.04 2023-06-27T00:36:53.413 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:36:53.425 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of ubuntu 20.04 2023-06-27T00:36:53.425 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:36:53.469 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"} 2023-06-27T00:36:53.480 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-06-27T00:36:53.502 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1} 2023-06-27T00:36:53.519 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-06-27T00:36:53.555 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:36:53.564 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:36:53.643 INFO:teuthology.orchestra.console:Power off smithi118 2023-06-27T00:36:53.644 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T00:36:53.659 INFO:teuthology.orchestra.console:Power off smithi123 2023-06-27T00:36:53.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T00:36:53.669 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:36:53.680 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:36:57.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:36:57.705 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:01.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:01.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:06.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:06.929 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:07.139 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-06-27T00:37:07.241 INFO:teuthology.orchestra.console:Power on smithi123 2023-06-27T00:37:07.241 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-27T00:37:07.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:11.284 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:11.495 INFO:teuthology.orchestra.console:Power on for smithi123 completed 2023-06-27T00:37:11.596 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-06-27T00:37:11.596 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:37:13.320 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:18.434 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:23.548 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:28.380 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:37:28.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:33.772 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:38.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:43.432 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:37:43.999 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:49.112 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:54.224 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:37:58.487 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:37:59.335 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:38:04.448 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:38:05.558 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-06-27T00:38:05.559 ERROR:teuthology.orchestra.console:Failed to power off smithi118 2023-06-27T00:38:05.560 INFO:teuthology.orchestra.console:Power on smithi118 2023-06-27T00:38:05.560 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-27T00:38:13.547 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:38:20.591 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:38:25.601 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:38:25.812 INFO:teuthology.orchestra.console:Power on for smithi118 completed 2023-06-27T00:38:25.913 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-06-27T00:38:25.914 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:38:33.608 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:38:40.971 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:38:53.676 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:38:56.027 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:39:08.732 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:39:21.088 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:39:28.794 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:39:36.144 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:39:47.012 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:39:56.204 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:40:06.464 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:40:11.264 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:40:21.815 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:40:26.821 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:40:41.888 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:40:41.890 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:40:56.960 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-06-27T00:40:56.961 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:40:57.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:41:00.080 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-27T00:41:06.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:41:12.024 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:41:17.032 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-27T00:41:23.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:41:26.096 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-27T00:41:32.088 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:41:37.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:41:57.164 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:42:17.236 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:42:37.328 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-27T00:42:42.334 WARNING:teuthology.provision.fog.smithi123:timed out 2023-06-27T00:42:42.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:42:45.456 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-27T00:42:48.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:42:48.546 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-27T00:42:48.548 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-27T00:42:49.086 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-06-27T00:42:49.087 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-06-27T00:42:49.135 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-06-27T00:42:49.136 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-06-27T00:42:49.143 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-06-27T00:42:49.143 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-06-27T00:42:49.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-06-27T00:42:49.235 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-06-27T00:42:49.249 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-06-27T00:42:49.261 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-06-27T00:42:49.317 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-06-27T00:42:49.323 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-06-27T00:42:49.323 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-27T00:42:49.323 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-06-27T00:42:49.324 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-06-27T00:42:49.324 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-27T00:42:49.324 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="20.04" 2023-06-27T00:42:49.324 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-27T00:42:49.324 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-27T00:42:49.324 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-27T00:42:49.324 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-27T00:42:49.325 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=focal 2023-06-27T00:42:49.325 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=focal 2023-06-27T00:42:49.325 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-06-27T00:42:49.327 DEBUG:teuthology.parallel:result is None 2023-06-27T00:42:51.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:42:54.512 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-27T00:43:00.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:43:08.592 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-27T00:43:14.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:43:22.672 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-27T00:43:28.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:43:31.732 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-27T00:43:37.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:43:40.816 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-27T00:43:46.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:44:46.873 WARNING:teuthology.provision.fog.smithi118:timed out 2023-06-27T00:44:52.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:44:53.119 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-27T00:44:53.120 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-27T00:44:53.675 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-06-27T00:44:53.676 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2023-06-27T00:44:53.682 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com 2023-06-27T00:44:53.682 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts 2023-06-27T00:44:53.687 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2023-06-27T00:44:53.687 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-06-27T00:44:53.817 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts 2023-06-27T00:44:53.833 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts 2023-06-27T00:44:53.850 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname 2023-06-27T00:44:53.863 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-06-27T00:44:53.920 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-06-27T00:44:53.926 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2023-06-27T00:44:53.926 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-27T00:44:53.926 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2023-06-27T00:44:53.927 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2023-06-27T00:44:53.927 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-27T00:44:53.927 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="20.04" 2023-06-27T00:44:53.927 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-27T00:44:53.927 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-27T00:44:53.927 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-27T00:44:53.927 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-27T00:44:53.928 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=focal 2023-06-27T00:44:53.928 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=focal 2023-06-27T00:44:53.928 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-06-27T00:44:53.928 DEBUG:teuthology.parallel:result is None 2023-06-27T00:44:59.211 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2023-06-27T00:44:59.212 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-27T00:44:59.239 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-06-27T00:44:59.239 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-27T00:44:59.265 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2023-06-27T00:44:59.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-06-27T00:44:59.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:44:59.313 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-06-27T00:44:59.437 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-06-27T00:44:59.443 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-06-27T00:44:59.444 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-06-27T00:44:59.449 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2023-06-27T00:44:59.450 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-27T00:44:59.450 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2023-06-27T00:44:59.450 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2023-06-27T00:44:59.450 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-27T00:44:59.450 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="20.04" 2023-06-27T00:44:59.450 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-27T00:44:59.450 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-27T00:44:59.451 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-27T00:44:59.451 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-27T00:44:59.451 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=focal 2023-06-27T00:44:59.451 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=focal 2023-06-27T00:44:59.451 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-06-27T00:44:59.473 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-06-27T00:44:59.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-06-27T00:44:59.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:44:59.520 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-06-27T00:44:59.721 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-06-27T00:44:59.768 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-06-27T00:44:59.768 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-06-27T00:44:59.775 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-06-27T00:44:59.775 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-27T00:44:59.775 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-06-27T00:44:59.776 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-06-27T00:44:59.776 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-27T00:44:59.776 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="20.04" 2023-06-27T00:44:59.776 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-27T00:44:59.776 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-27T00:44:59.777 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-27T00:44:59.777 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-27T00:44:59.777 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=focal 2023-06-27T00:44:59.777 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=focal 2023-06-27T00:44:59.777 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-06-27T00:45:04.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:45:04.806 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:45:08.095 INFO:teuthology.dispatcher.supervisor:Running job 7317214 2023-06-27T00:45:08.096 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317214 --name yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} -- /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317214/orig.config.yaml 2023-06-27T00:45:08.100 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317214 2023-06-27T00:45:08.101 INFO:teuthology.dispatcher.supervisor:Job PID: 24059 2023-06-27T00:45:08.101 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-27T00:47:08.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:47:08.202 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:49:13.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:49:13.338 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:51:18.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:51:18.515 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:53:23.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:53:23.698 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:55:28.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:55:28.874 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:57:34.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:57:34.046 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:59:39.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:59:39.219 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T01:01:44.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T01:01:44.394 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T01:03:49.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T01:03:49.556 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T01:05:50.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T01:05:50.919 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T01:05:50.986 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-27T01:05:51.109 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-27T01:05:51.110 INFO:teuthology.nuke:Checking targets against current locks 2023-06-27T01:05:51.157 DEBUG:teuthology.nuke:shortname: smithi118 2023-06-27T01:05:51.158 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-27T01:05:51.182 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-27 00:36:43.551807', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-27T01:05:51.185 DEBUG:teuthology.nuke:shortname: smithi123 2023-06-27T01:05:51.185 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-27T01:05:51.210 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-27 00:36:43.550329', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-06-27T01:05:51.242 INFO:teuthology.orchestra.console:Power off smithi118 2023-06-27T01:05:51.243 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T01:05:51.263 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T01:05:51.285 INFO:teuthology.orchestra.console:Power off smithi123 2023-06-27T01:05:51.286 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T01:05:51.305 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T01:05:51.394 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-06-27T01:05:51.425 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-06-27T01:06:06.600 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com 2023-06-27T01:06:06.633 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com