2023-09-23T16:32:21.067 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-23T16:32:21.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:32:21.215 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa77f582be0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa77f2c0ee0>, signals=[15])
2023-09-23T16:32:21.215 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging
2023-09-23T16:32:21.215 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server
2023-09-23T16:32:21.216 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2023-09-23T16:32:21.235 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging
2023-09-23T16:32:21.235 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server
2023-09-23T16:32:21.235 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2023-09-23T16:32:21.237 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"}
2023-09-23T16:32:21.259 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"}
2023-09-23T16:32:21.316 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-09-23T16:32:21.327 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-09-23T16:32:21.362 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-09-23T16:32:21.363 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 2}
2023-09-23T16:32:21.373 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-09-23T16:32:21.373 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 2}
2023-09-23T16:32:21.411 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of ubuntu 20.04
2023-09-23T16:32:21.412 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:32:21.416 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of ubuntu 20.04
2023-09-23T16:32:21.416 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:32:21.466 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"}
2023-09-23T16:32:21.469 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"}
2023-09-23T16:32:21.503 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1}
2023-09-23T16:32:21.506 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1}
2023-09-23T16:32:21.574 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:32:21.577 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:32:21.669 INFO:teuthology.orchestra.console.smithi140:Power off
2023-09-23T16:32:21.669 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-23T16:32:21.682 INFO:teuthology.orchestra.console.smithi186:Power off
2023-09-23T16:32:21.682 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-23T16:32:21.692 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off
2023-09-23T16:32:21.692 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:32:21.701 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off
2023-09-23T16:32:21.701 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:32:21.712 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-09-23T16:32:21.723 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2023-09-23T16:32:21.813 INFO:teuthology.orchestra.console.smithi140:Power off completed
2023-09-23T16:32:21.824 INFO:teuthology.orchestra.console.smithi186:Power off completed
2023-09-23T16:32:21.914 INFO:teuthology.orchestra.console.smithi140:Power on
2023-09-23T16:32:21.914 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-23T16:32:21.924 INFO:teuthology.orchestra.console.smithi186:Power on
2023-09-23T16:32:21.924 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-23T16:32:21.935 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On
2023-09-23T16:32:21.935 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:32:21.945 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On
2023-09-23T16:32:21.946 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:32:21.955 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-09-23T16:32:21.965 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2023-09-23T16:32:25.958 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:32:25.966 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T16:32:26.067 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2023-09-23T16:32:26.075 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on
2023-09-23T16:32:26.168 INFO:teuthology.orchestra.console.smithi140:Power on completed
2023-09-23T16:32:26.176 INFO:teuthology.orchestra.console.smithi186:Power on completed
2023-09-23T16:32:26.269 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish
2023-09-23T16:32:26.269 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:32:26.277 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish
2023-09-23T16:32:26.277 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:32:41.350 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:32:41.351 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:32:56.442 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:32:56.444 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:33:11.522 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:33:11.523 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:33:26.596 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:33:26.597 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:33:41.670 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:33:41.671 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:33:56.750 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:33:56.882 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:34:11.822 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:34:11.935 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:34:26.904 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:34:26.993 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:34:41.967 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:34:42.051 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:34:57.043 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:34:57.114 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:35:12.129 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:35:12.174 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:35:27.194 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:35:27.229 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:35:42.267 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:35:42.289 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:35:57.334 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:35:57.341 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:36:12.398 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-09-23T16:36:12.400 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-09-23T16:36:12.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:36:12.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:36:12.749 ERROR:teuthology.orchestra.connection:Error authenticating with smithi140.front.sepia.ceph.com: Authentication failed.
2023-09-23T16:36:12.749 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-23T16:36:12.750 DEBUG:teuthology.orchestra.run.smithi140:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-23T16:36:12.751 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-09-23T16:36:13.758 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-09-23T16:36:14.763 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-09-23T16:36:30.974 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-09-23T16:36:36.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:36:40.026 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-09-23T16:36:46.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:36:49.082 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-09-23T16:36:55.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:36:58.138 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-09-23T16:37:04.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:37:07.194 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-09-23T16:37:13.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:38:13.198 WARNING:teuthology.provision.fog.smithi186:timed out
2023-09-23T16:38:19.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:38:19.412 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-23T16:38:19.412 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-23T16:38:19.879 INFO:teuthology.provision.fog.smithi186:Node is ready
2023-09-23T16:38:19.879 DEBUG:teuthology.orchestra.run.smithi186:> hostname
2023-09-23T16:38:19.928 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com
2023-09-23T16:38:19.929 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts
2023-09-23T16:38:19.936 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186
2023-09-23T16:38:19.936 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186
2023-09-23T16:38:20.022 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts
2023-09-23T16:38:20.039 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts
2023-09-23T16:38:20.097 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname
2023-09-23T16:38:20.108 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186
2023-09-23T16:38:20.120 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release
2023-09-23T16:38:20.126 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Ubuntu"
2023-09-23T16:38:20.126 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-09-23T16:38:20.126 INFO:teuthology.orchestra.run.smithi186.stdout:ID=ubuntu
2023-09-23T16:38:20.126 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE=debian
2023-09-23T16:38:20.127 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-09-23T16:38:20.127 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="20.04"
2023-09-23T16:38:20.127 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-23T16:38:20.127 INFO:teuthology.orchestra.run.smithi186.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-23T16:38:20.127 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-23T16:38:20.127 INFO:teuthology.orchestra.run.smithi186.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-23T16:38:20.127 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_CODENAME=focal
2023-09-23T16:38:20.128 INFO:teuthology.orchestra.run.smithi186.stdout:UBUNTU_CODENAME=focal
2023-09-23T16:38:20.128 INFO:teuthology.provision.fog.smithi186:Deploy complete!
2023-09-23T16:38:20.129 DEBUG:teuthology.parallel:result is None
2023-09-23T16:38:39.486 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-09-23T16:38:39.487 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi140
2023-09-23T16:38:48.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com'
2023-09-23T16:38:48.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:38:48.687 DEBUG:teuthology.orchestra.run.smithi140:> true
2023-09-23T16:38:49.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi140.front.sepia.ceph.com'
2023-09-23T16:38:49.227 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-23T16:38:49.227 DEBUG:teuthology.orchestra.run.smithi140:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-23T16:38:49.274 INFO:teuthology.provision.fog.smithi140:Node is ready
2023-09-23T16:38:49.274 DEBUG:teuthology.orchestra.run.smithi140:> hostname
2023-09-23T16:38:49.280 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com
2023-09-23T16:38:49.281 DEBUG:teuthology.orchestra.run.smithi140:> grep smithi140.front.sepia.ceph.com /etc/hosts
2023-09-23T16:38:49.287 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140
2023-09-23T16:38:49.287 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140
2023-09-23T16:38:49.418 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hosts
2023-09-23T16:38:49.434 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/172.21.15.140/172.21.15.140/g' /etc/hosts
2023-09-23T16:38:49.450 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hostname
2023-09-23T16:38:49.465 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140
2023-09-23T16:38:49.522 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release
2023-09-23T16:38:49.529 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Ubuntu"
2023-09-23T16:38:49.529 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-09-23T16:38:49.529 INFO:teuthology.orchestra.run.smithi140.stdout:ID=ubuntu
2023-09-23T16:38:49.530 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE=debian
2023-09-23T16:38:49.530 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-09-23T16:38:49.530 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="20.04"
2023-09-23T16:38:49.530 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-23T16:38:49.530 INFO:teuthology.orchestra.run.smithi140.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-23T16:38:49.530 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-23T16:38:49.530 INFO:teuthology.orchestra.run.smithi140.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-23T16:38:49.530 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_CODENAME=focal
2023-09-23T16:38:49.530 INFO:teuthology.orchestra.run.smithi140.stdout:UBUNTU_CODENAME=focal
2023-09-23T16:38:49.531 INFO:teuthology.provision.fog.smithi140:Deploy complete!
2023-09-23T16:38:49.531 DEBUG:teuthology.parallel:result is None
2023-09-23T16:38:49.783 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com
2023-09-23T16:38:49.784 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com
2023-09-23T16:38:49.785 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server
2023-09-23T16:38:49.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com'
2023-09-23T16:38:49.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:38:49.836 DEBUG:teuthology.orchestra.run.smithi140:> true
2023-09-23T16:38:49.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi140.front.sepia.ceph.com'
2023-09-23T16:38:49.956 DEBUG:teuthology.orchestra.run.smithi140:> uname -m
2023-09-23T16:38:49.962 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64
2023-09-23T16:38:49.962 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release
2023-09-23T16:38:49.968 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Ubuntu"
2023-09-23T16:38:49.968 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-09-23T16:38:49.968 INFO:teuthology.orchestra.run.smithi140.stdout:ID=ubuntu
2023-09-23T16:38:49.969 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE=debian
2023-09-23T16:38:49.969 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-09-23T16:38:49.969 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="20.04"
2023-09-23T16:38:49.969 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-23T16:38:49.969 INFO:teuthology.orchestra.run.smithi140.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-23T16:38:49.969 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-23T16:38:49.969 INFO:teuthology.orchestra.run.smithi140.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-23T16:38:49.969 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_CODENAME=focal
2023-09-23T16:38:49.969 INFO:teuthology.orchestra.run.smithi140.stdout:UBUNTU_CODENAME=focal
2023-09-23T16:38:49.970 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2023-09-23T16:38:49.991 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server
2023-09-23T16:38:49.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com'
2023-09-23T16:38:49.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T16:38:50.039 DEBUG:teuthology.orchestra.run.smithi186:> true
2023-09-23T16:38:50.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com'
2023-09-23T16:38:50.165 DEBUG:teuthology.orchestra.run.smithi186:> uname -m
2023-09-23T16:38:50.172 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64
2023-09-23T16:38:50.172 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release
2023-09-23T16:38:50.178 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Ubuntu"
2023-09-23T16:38:50.179 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-09-23T16:38:50.179 INFO:teuthology.orchestra.run.smithi186.stdout:ID=ubuntu
2023-09-23T16:38:50.179 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE=debian
2023-09-23T16:38:50.179 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-09-23T16:38:50.179 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="20.04"
2023-09-23T16:38:50.179 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-23T16:38:50.179 INFO:teuthology.orchestra.run.smithi186.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-23T16:38:50.179 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-23T16:38:50.179 INFO:teuthology.orchestra.run.smithi186.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-23T16:38:50.179 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_CODENAME=focal
2023-09-23T16:38:50.179 INFO:teuthology.orchestra.run.smithi186.stdout:UBUNTU_CODENAME=focal
2023-09-23T16:38:50.180 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2023-09-23T16:38:50.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:38:50.303 INFO:teuthology.dispatcher.supervisor:Running job 7401745
2023-09-23T16:38:50.303 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:quincy-x-reef-distro-default-smithi/7401745 --name teuthology-2023-09-23_14:23:10-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:quincy-x-reef-distro-default-smithi/7401745/orig.config.yaml
2023-09-23T16:38:50.306 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:quincy-x-reef-distro-default-smithi/7401745
2023-09-23T16:38:50.306 INFO:teuthology.dispatcher.supervisor:Job PID: 3538200
2023-09-23T16:38:50.307 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-23T16:40:50.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:42:50.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:44:50.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:46:50.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:48:50.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:50:51.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:52:51.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:54:51.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:56:51.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T16:58:51.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:00:51.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:02:52.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:04:52.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:06:52.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:08:52.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:10:52.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:12:52.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:14:53.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:16:53.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:18:53.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:20:53.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:22:53.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:24:53.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:26:54.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:28:54.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:30:54.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:32:54.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:34:54.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:36:54.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:38:54.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:40:55.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:42:55.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:44:55.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:46:55.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:48:55.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:50:55.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:52:55.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:54:56.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:56:56.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T17:58:56.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:00:56.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:02:56.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:04:56.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:06:57.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:08:58.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:10:58.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:12:58.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T18:12:58.382 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-09-23T18:12:58.588 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-23T18:12:58.589 INFO:teuthology.nuke:Checking targets against current locks
2023-09-23T18:12:58.634 DEBUG:teuthology.nuke:shortname: smithi140
2023-09-23T18:12:58.634 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-23T18:12:58.657 DEBUG:teuthology.nuke:shortname: smithi186
2023-09-23T18:12:58.658 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-23T18:12:58.661 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:quincy-x-reef-distro-default-smithi/7401745', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 16:32:20.247515', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-09-23T18:12:58.686 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-23_14:23:10-upgrade:quincy-x-reef-distro-default-smithi/7401745', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 16:32:20.249298', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-09-23T18:12:58.713 INFO:teuthology.orchestra.console.smithi140:Power off
2023-09-23T18:12:58.714 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-23T18:12:58.738 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off
2023-09-23T18:12:58.738 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T18:12:58.754 INFO:teuthology.orchestra.console.smithi186:Power off
2023-09-23T18:12:58.754 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-23T18:12:58.763 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-09-23T18:12:58.775 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off
2023-09-23T18:12:58.776 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T18:12:58.796 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2023-09-23T18:12:58.864 INFO:teuthology.orchestra.console.smithi140:Power off completed
2023-09-23T18:12:58.897 INFO:teuthology.orchestra.console.smithi186:Power off completed
2023-09-23T18:12:59.014 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com
2023-09-23T18:12:59.040 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com