2023-07-11T20:35:21.814 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-11T20:35:21.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:35:21.816 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:35:21.997 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fea9c62b580>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fea9bfb2d30>, signals=[15])
2023-07-11T20:35:21.999 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging
2023-07-11T20:35:21.999 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T20:35:22.000 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server
2023-07-11T20:35:22.026 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging
2023-07-11T20:35:22.026 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T20:35:22.027 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-07-11T20:35:22.028 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /host {"name": "smithi070"}
2023-07-11T20:35:22.051 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"}
2023-07-11T20:35:22.094 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-07-11T20:35:22.126 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-07-11T20:35:22.131 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-07-11T20:35:22.131 DEBUG:teuthology.provision.fog.smithi070:FOG request: PUT /host/175 {"imageID": 2}
2023-07-11T20:35:22.163 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-07-11T20:35:22.163 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 2}
2023-07-11T20:35:22.171 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of ubuntu 20.04
2023-07-11T20:35:22.171 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:35:22.206 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of ubuntu 20.04
2023-07-11T20:35:22.207 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:35:22.266 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T20:35:22.293 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T20:35:22.303 DEBUG:teuthology.provision.fog.smithi070:FOG request: POST /host/175/task {"taskTypeID": 1}
2023-07-11T20:35:22.331 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1}
2023-07-11T20:35:22.351 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:35:22.380 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:35:22.481 INFO:teuthology.orchestra.console:Power off smithi070
2023-07-11T20:35:22.482 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T20:35:22.497 INFO:teuthology.orchestra.console:Power off smithi169
2023-07-11T20:35:22.497 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T20:35:22.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:35:22.519 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:35:26.533 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:35:26.542 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:35:30.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:35:30.657 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:35:30.859 INFO:teuthology.orchestra.console:Power off for smithi070 completed
2023-07-11T20:35:30.870 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2023-07-11T20:35:30.961 INFO:teuthology.orchestra.console:Power on smithi070
2023-07-11T20:35:30.961 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T20:35:30.972 INFO:teuthology.orchestra.console:Power on smithi169
2023-07-11T20:35:30.972 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T20:35:30.982 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:35:30.993 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:35:35.004 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:35:35.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:35:35.224 INFO:teuthology.orchestra.console:Power on for smithi169 completed
2023-07-11T20:35:35.325 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2023-07-11T20:35:35.326 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:35:39.118 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:35:39.328 INFO:teuthology.orchestra.console:Power on for smithi070 completed
2023-07-11T20:35:39.429 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish
2023-07-11T20:35:39.430 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:35:50.434 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:35:54.535 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:36:05.543 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:36:09.662 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:36:20.643 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:36:24.779 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:36:35.747 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:36:39.905 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:36:50.868 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:36:55.008 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:37:05.966 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:37:10.132 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:37:21.067 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:37:25.252 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:37:36.183 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:37:40.366 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:37:51.300 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:37:55.488 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:38:06.392 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:38:10.610 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:38:21.481 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:38:25.705 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:38:36.577 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:38:40.797 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:38:51.688 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:38:55.909 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:39:06.792 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:39:10.987 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:39:21.892 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:39:26.083 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None
2023-07-11T20:39:26.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:39:36.980 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:39:44.496 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-07-11T20:39:50.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:39:52.056 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:39:53.584 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-07-11T20:39:59.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:40:02.640 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70
2023-07-11T20:40:07.134 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-11T20:40:07.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:40:08.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:40:25.712 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-11T20:40:31.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:40:34.800 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-11T20:40:40.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:40:43.856 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-11T20:40:49.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:40:52.944 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-11T20:40:58.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:41:02.032 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-11T20:41:08.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:41:08.646 WARNING:teuthology.provision.fog.smithi070:timed out
2023-07-11T20:41:14.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:41:14.857 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T20:41:14.858 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T20:41:15.364 INFO:teuthology.provision.fog.smithi070:Node is ready
2023-07-11T20:41:15.364 DEBUG:teuthology.orchestra.run.smithi070:> hostname
2023-07-11T20:41:15.370 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com
2023-07-11T20:41:15.371 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts
2023-07-11T20:41:15.377 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070
2023-07-11T20:41:15.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070
2023-07-11T20:41:15.468 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts
2023-07-11T20:41:15.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts
2023-07-11T20:41:15.541 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname
2023-07-11T20:41:15.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070
2023-07-11T20:41:15.560 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release
2023-07-11T20:41:15.565 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Ubuntu"
2023-07-11T20:41:15.566 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-11T20:41:15.566 INFO:teuthology.orchestra.run.smithi070.stdout:ID=ubuntu
2023-07-11T20:41:15.566 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE=debian
2023-07-11T20:41:15.566 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-11T20:41:15.566 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="20.04"
2023-07-11T20:41:15.566 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-11T20:41:15.566 INFO:teuthology.orchestra.run.smithi070.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-11T20:41:15.567 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-11T20:41:15.567 INFO:teuthology.orchestra.run.smithi070.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-11T20:41:15.567 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_CODENAME=focal
2023-07-11T20:41:15.567 INFO:teuthology.orchestra.run.smithi070.stdout:UBUNTU_CODENAME=focal
2023-07-11T20:41:15.567 INFO:teuthology.provision.fog.smithi070:Deploy complete!
2023-07-11T20:41:15.569 DEBUG:teuthology.parallel:result is None
2023-07-11T20:42:08.068 WARNING:teuthology.provision.fog.smithi169:timed out
2023-07-11T20:42:14.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:42:14.287 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T20:42:14.287 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T20:42:14.827 INFO:teuthology.provision.fog.smithi169:Node is ready
2023-07-11T20:42:14.828 DEBUG:teuthology.orchestra.run.smithi169:> hostname
2023-07-11T20:42:14.833 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2023-07-11T20:42:14.833 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts
2023-07-11T20:42:14.883 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2023-07-11T20:42:14.884 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-07-11T20:42:15.000 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts
2023-07-11T20:42:15.015 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts
2023-07-11T20:42:15.075 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname
2023-07-11T20:42:15.090 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-07-11T20:42:15.104 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-07-11T20:42:15.108 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu"
2023-07-11T20:42:15.108 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-11T20:42:15.109 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu
2023-07-11T20:42:15.109 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian
2023-07-11T20:42:15.109 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-11T20:42:15.109 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="20.04"
2023-07-11T20:42:15.109 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-11T20:42:15.109 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-11T20:42:15.109 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-11T20:42:15.110 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-11T20:42:15.110 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=focal
2023-07-11T20:42:15.110 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=focal
2023-07-11T20:42:15.110 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2023-07-11T20:42:15.111 DEBUG:teuthology.parallel:result is None
2023-07-11T20:42:15.403 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com
2023-07-11T20:42:15.404 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-11T20:42:15.432 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2023-07-11T20:42:15.433 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-11T20:42:15.450 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server
2023-07-11T20:42:15.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com'
2023-07-11T20:42:15.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:42:15.498 DEBUG:teuthology.orchestra.run.smithi070:> true
2023-07-11T20:42:15.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com'
2023-07-11T20:42:15.702 DEBUG:teuthology.orchestra.run.smithi070:> uname -m
2023-07-11T20:42:15.708 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64
2023-07-11T20:42:15.708 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release
2023-07-11T20:42:15.713 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Ubuntu"
2023-07-11T20:42:15.713 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-11T20:42:15.714 INFO:teuthology.orchestra.run.smithi070.stdout:ID=ubuntu
2023-07-11T20:42:15.714 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE=debian
2023-07-11T20:42:15.714 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-11T20:42:15.714 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="20.04"
2023-07-11T20:42:15.714 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-11T20:42:15.714 INFO:teuthology.orchestra.run.smithi070.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-11T20:42:15.714 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-11T20:42:15.715 INFO:teuthology.orchestra.run.smithi070.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-11T20:42:15.715 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_CODENAME=focal
2023-07-11T20:42:15.715 INFO:teuthology.orchestra.run.smithi070.stdout:UBUNTU_CODENAME=focal
2023-07-11T20:42:15.715 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server
2023-07-11T20:42:15.741 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2023-07-11T20:42:15.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-07-11T20:42:15.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T20:42:15.790 DEBUG:teuthology.orchestra.run.smithi169:> true
2023-07-11T20:42:15.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-07-11T20:42:15.909 DEBUG:teuthology.orchestra.run.smithi169:> uname -m
2023-07-11T20:42:15.914 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2023-07-11T20:42:15.915 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-07-11T20:42:15.920 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu"
2023-07-11T20:42:15.920 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-11T20:42:15.921 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu
2023-07-11T20:42:15.921 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian
2023-07-11T20:42:15.921 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-11T20:42:15.921 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="20.04"
2023-07-11T20:42:15.921 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-11T20:42:15.921 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-11T20:42:15.921 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-11T20:42:15.922 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-11T20:42:15.922 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=focal
2023-07-11T20:42:15.922 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=focal
2023-07-11T20:42:15.922 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-07-11T20:42:15.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:42:15.949 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:42:16.047 INFO:teuthology.dispatcher.supervisor:Running job 7334215
2023-07-11T20:42:16.047 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-07-11_20:34:22-rbd:mirror-wip-choffman-61707-distro-default-smithi/7334215 --name choffman-2023-07-11_20:34:22-rbd:mirror-wip-choffman-61707-distro-default-smithi --description rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_20.04} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} -- /home/teuthworker/archive/choffman-2023-07-11_20:34:22-rbd:mirror-wip-choffman-61707-distro-default-smithi/7334215/orig.config.yaml
2023-07-11T20:42:16.050 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-07-11_20:34:22-rbd:mirror-wip-choffman-61707-distro-default-smithi/7334215
2023-07-11T20:42:16.051 INFO:teuthology.dispatcher.supervisor:Job PID: 22047
2023-07-11T20:42:16.051 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-11T20:44:16.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:44:16.149 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:46:16.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:46:16.333 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:48:16.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:48:16.506 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:50:16.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:50:16.690 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:52:16.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:52:16.862 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:54:17.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:54:17.034 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:56:17.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:56:17.213 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:58:17.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T20:58:17.390 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T20:58:17.462 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-11T20:58:17.622 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-11T20:58:17.623 INFO:teuthology.nuke:Checking targets against current locks
2023-07-11T20:58:17.675 DEBUG:teuthology.nuke:shortname: smithi070
2023-07-11T20:58:17.675 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T20:58:17.701 DEBUG:teuthology.nuke:shortname: smithi169
2023-07-11T20:58:17.702 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T20:58:17.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-07-11_20:34:22-rbd:mirror-wip-choffman-61707-distro-default-smithi/7334215', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 20:35:21.030712', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-07-11T20:58:17.732 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-07-11_20:34:22-rbd:mirror-wip-choffman-61707-distro-default-smithi/7334215', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 20:35:21.032130', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-11T20:58:17.755 INFO:teuthology.orchestra.console:Power off smithi070
2023-07-11T20:58:17.756 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T20:58:17.779 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:58:17.803 INFO:teuthology.orchestra.console:Power off smithi169
2023-07-11T20:58:17.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T20:58:17.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T20:58:17.913 INFO:teuthology.orchestra.console:Power off for smithi070 completed
2023-07-11T20:58:17.947 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2023-07-11T20:58:18.080 INFO:teuthology.lock.ops:unlocked: smithi070.front.sepia.ceph.com
2023-07-11T20:58:18.093 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com