2023-10-09T04:12:59.662 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-09T04:12:59.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:12:59.807 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5ff90b2af0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5ff8df4f70>, signals=[15])
2023-10-09T04:12:59.807 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging
2023-10-09T04:12:59.807 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server
2023-10-09T04:12:59.807 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2023-10-09T04:12:59.827 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging
2023-10-09T04:12:59.828 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server
2023-10-09T04:12:59.828 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2023-10-09T04:12:59.829 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"}
2023-10-09T04:12:59.851 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /host {"name": "smithi194"}
2023-10-09T04:12:59.916 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-10-09T04:12:59.921 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-10-09T04:12:59.957 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-10-09T04:12:59.957 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 2}
2023-10-09T04:12:59.980 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-10-09T04:12:59.980 DEBUG:teuthology.provision.fog.smithi194:FOG request: PUT /host/299 {"imageID": 2}
2023-10-09T04:13:00.009 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of ubuntu 20.04
2023-10-09T04:13:00.009 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:13:00.027 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of ubuntu 20.04
2023-10-09T04:13:00.027 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:13:00.055 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"}
2023-10-09T04:13:00.082 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /tasktype {"name": "deploy"}
2023-10-09T04:13:00.094 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1}
2023-10-09T04:13:00.117 DEBUG:teuthology.provision.fog.smithi194:FOG request: POST /host/299/task {"taskTypeID": 1}
2023-10-09T04:13:00.159 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:13:00.174 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:13:00.237 INFO:teuthology.orchestra.console.smithi133:Power off
2023-10-09T04:13:00.238 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-09T04:13:00.250 INFO:teuthology.orchestra.console.smithi194:Power off
2023-10-09T04:13:00.251 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-09T04:13:00.259 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off
2023-10-09T04:13:00.260 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T04:13:00.272 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2023-10-09T04:13:00.272 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T04:13:00.280 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2023-10-09T04:13:00.293 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2023-10-09T04:13:00.393 INFO:teuthology.orchestra.console.smithi194:Power off completed
2023-10-09T04:13:00.494 INFO:teuthology.orchestra.console.smithi194:Power on
2023-10-09T04:13:00.494 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-09T04:13:00.516 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On
2023-10-09T04:13:00.516 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T04:13:00.537 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2023-10-09T04:13:04.284 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T04:13:04.392 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2023-10-09T04:13:04.538 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T04:13:04.648 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2023-10-09T04:13:04.748 INFO:teuthology.orchestra.console.smithi194:Power on completed
2023-10-09T04:13:04.849 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish
2023-10-09T04:13:04.849 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:13:08.394 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T04:13:08.552 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2023-10-09T04:13:08.698 INFO:teuthology.orchestra.console.smithi133:Power off completed
2023-10-09T04:13:08.916 INFO:teuthology.orchestra.console.smithi133:Power on
2023-10-09T04:13:08.977 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-09T04:13:09.001 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On
2023-10-09T04:13:09.128 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T04:13:09.151 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2023-10-09T04:13:13.286 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T04:13:14.085 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2023-10-09T04:13:14.702 INFO:teuthology.orchestra.console.smithi133:Power on completed
2023-10-09T04:13:15.337 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish
2023-10-09T04:13:15.370 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:13:19.914 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:13:30.432 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:13:34.970 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:13:45.498 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:13:50.022 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:14:00.560 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:14:05.078 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:14:15.614 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:14:20.133 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:14:30.678 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:14:35.190 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:14:45.742 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:14:50.246 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:15:00.802 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:15:05.302 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:15:15.866 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:15:20.370 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:15:30.935 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:15:35.426 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:15:45.994 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:15:50.482 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:16:01.059 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:16:05.535 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:16:16.116 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:16:20.594 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:16:31.178 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:16:35.657 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None
2023-10-09T04:16:35.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T04:16:35.869 ERROR:teuthology.orchestra.connection:Error authenticating with smithi194.front.sepia.ceph.com: Authentication failed.
2023-10-09T04:16:35.870 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-09T04:16:35.870 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-09T04:16:35.871 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-10-09T04:16:46.232 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:17:01.289 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-10-09T04:17:01.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T04:17:19.742 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-10-09T04:17:25.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T04:17:28.794 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-10-09T04:17:34.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T04:17:37.854 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-10-09T04:17:43.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T04:17:46.906 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-10-09T04:17:52.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T04:18:25.197 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-09T04:18:25.198 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-09T04:18:46.580 INFO:teuthology.provision.fog.smithi133:Node is ready
2023-10-09T04:18:46.580 DEBUG:teuthology.orchestra.run.smithi133:> hostname
2023-10-09T04:18:46.587 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com
2023-10-09T04:18:46.588 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts
2023-10-09T04:18:46.595 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133
2023-10-09T04:18:46.595 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133
2023-10-09T04:18:46.655 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts
2023-10-09T04:18:46.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts
2023-10-09T04:18:46.680 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname
2023-10-09T04:18:46.738 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133
2023-10-09T04:18:46.747 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release
2023-10-09T04:18:46.752 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu"
2023-10-09T04:18:46.752 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-10-09T04:18:46.752 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu
2023-10-09T04:18:46.752 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian
2023-10-09T04:18:46.752 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-10-09T04:18:46.752 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04"
2023-10-09T04:18:46.752 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-09T04:18:46.752 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-09T04:18:46.752 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-09T04:18:46.753 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-09T04:18:46.753 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal
2023-10-09T04:18:46.753 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal
2023-10-09T04:18:46.753 INFO:teuthology.provision.fog.smithi133:Deploy complete!
2023-10-09T04:18:46.754 DEBUG:teuthology.parallel:result is None
2023-10-09T04:18:55.227 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-10-09T04:18:55.227 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi194
2023-10-09T04:19:04.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com'
2023-10-09T04:19:04.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T04:19:04.442 DEBUG:teuthology.orchestra.run.smithi194:> true
2023-10-09T04:19:04.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com'
2023-10-09T04:19:04.917 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-09T04:19:04.917 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-09T04:19:04.968 INFO:teuthology.provision.fog.smithi194:Node is ready
2023-10-09T04:19:04.968 DEBUG:teuthology.orchestra.run.smithi194:> hostname
2023-10-09T04:19:04.974 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com
2023-10-09T04:19:04.975 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts
2023-10-09T04:19:04.981 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194
2023-10-09T04:19:04.982 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2023-10-09T04:19:05.096 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts
2023-10-09T04:19:05.112 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts
2023-10-09T04:19:05.129 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname
2023-10-09T04:19:05.144 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2023-10-09T04:19:05.158 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2023-10-09T04:19:05.208 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu"
2023-10-09T04:19:05.208 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-10-09T04:19:05.209 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu
2023-10-09T04:19:05.209 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian
2023-10-09T04:19:05.209 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-10-09T04:19:05.209 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="20.04"
2023-10-09T04:19:05.209 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-09T04:19:05.209 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-09T04:19:05.209 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-09T04:19:05.209 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-09T04:19:05.209 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=focal
2023-10-09T04:19:05.209 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=focal
2023-10-09T04:19:05.209 INFO:teuthology.provision.fog.smithi194:Deploy complete!
2023-10-09T04:19:05.210 DEBUG:teuthology.parallel:result is None
2023-10-09T04:19:05.448 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com
2023-10-09T04:19:05.448 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-09T04:19:05.469 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com
2023-10-09T04:19:05.469 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-09T04:19:05.520 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server
2023-10-09T04:19:05.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com'
2023-10-09T04:19:05.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T04:19:05.568 DEBUG:teuthology.orchestra.run.smithi133:> true
2023-10-09T04:19:05.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com'
2023-10-09T04:19:05.692 DEBUG:teuthology.orchestra.run.smithi133:> uname -m
2023-10-09T04:19:05.698 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64
2023-10-09T04:19:05.698 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release
2023-10-09T04:19:05.704 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu"
2023-10-09T04:19:05.704 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-10-09T04:19:05.704 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu
2023-10-09T04:19:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian
2023-10-09T04:19:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-10-09T04:19:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04"
2023-10-09T04:19:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-09T04:19:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-09T04:19:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-09T04:19:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-09T04:19:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal
2023-10-09T04:19:05.705 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal
2023-10-09T04:19:05.706 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2023-10-09T04:19:05.728 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server
2023-10-09T04:19:05.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com'
2023-10-09T04:19:05.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-09T04:19:05.775 DEBUG:teuthology.orchestra.run.smithi194:> true
2023-10-09T04:19:05.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com'
2023-10-09T04:19:05.900 DEBUG:teuthology.orchestra.run.smithi194:> uname -m
2023-10-09T04:19:05.949 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64
2023-10-09T04:19:05.949 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2023-10-09T04:19:05.955 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu"
2023-10-09T04:19:05.956 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-10-09T04:19:05.956 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu
2023-10-09T04:19:05.956 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian
2023-10-09T04:19:05.956 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-10-09T04:19:05.956 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="20.04"
2023-10-09T04:19:05.956 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-09T04:19:05.956 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-09T04:19:05.956 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-09T04:19:05.956 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-09T04:19:05.956 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=focal
2023-10-09T04:19:05.956 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=focal
2023-10-09T04:19:05.957 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2023-10-09T04:19:05.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:19:06.064 INFO:teuthology.dispatcher.supervisor:Running job 7417477
2023-10-09T04:19:06.064 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7417477 --name teuthology-2023-10-07_14:23:11-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7417477/orig.config.yaml
2023-10-09T04:19:06.067 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7417477
2023-10-09T04:19:06.067 INFO:teuthology.dispatcher.supervisor:Job PID: 728032
2023-10-09T04:19:06.068 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-09T04:21:06.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:23:06.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:25:06.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:27:06.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:29:06.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:31:06.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:33:07.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:35:07.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:37:07.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:39:07.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:41:07.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:43:07.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:45:08.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:47:08.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:49:08.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:51:08.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:53:08.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:55:08.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:57:08.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T04:59:09.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:01:09.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:03:09.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:05:09.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:07:09.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:09:09.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:11:10.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:13:10.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:15:10.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:17:10.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:19:10.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:21:10.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:23:11.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:25:11.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:27:11.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:29:11.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:31:11.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:33:11.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:35:12.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:37:12.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:39:12.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:41:12.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:43:12.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:45:12.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:47:13.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:49:13.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:51:13.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:53:13.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:55:13.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:57:13.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T05:59:14.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T06:01:14.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T06:03:14.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T06:05:14.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-09T06:05:14.690 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-10-09T06:05:14.900 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-09T06:05:14.901 INFO:teuthology.nuke:Checking targets against current locks
2023-10-09T06:05:14.950 DEBUG:teuthology.nuke:shortname: smithi133
2023-10-09T06:05:14.950 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-09T06:05:14.966 DEBUG:teuthology.nuke:shortname: smithi194
2023-10-09T06:05:14.967 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-09T06:05:14.971 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7417477', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 04:12:58.831775', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-10-09T06:05:14.985 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7417477', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 04:12:58.830015', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-10-09T06:05:15.018 INFO:teuthology.orchestra.console.smithi133:Power off
2023-10-09T06:05:15.018 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-09T06:05:15.031 INFO:teuthology.orchestra.console.smithi194:Power off
2023-10-09T06:05:15.032 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-09T06:05:15.040 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off
2023-10-09T06:05:15.040 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T06:05:15.051 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2023-10-09T06:05:15.051 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-09T06:05:15.060 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2023-10-09T06:05:15.072 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2023-10-09T06:05:15.161 INFO:teuthology.orchestra.console.smithi133:Power off completed
2023-10-09T06:05:15.173 INFO:teuthology.orchestra.console.smithi194:Power off completed
2023-10-09T06:05:15.321 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com
2023-10-09T06:05:15.329 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com