2023-06-04T02:46:49.318 INFO:root:teuthology version: 0.0.1.dev116+g62814ab 2023-06-04T02:46:49.536 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-06-04T02:46:49.538 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-06-04T02:46:49.538 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-06-04T02:46:49.568 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-06-04T02:46:49.569 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-06-04T02:46:49.569 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-06-04T02:46:49.593 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-06-04T02:46:49.593 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-06-04T02:46:49.594 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-06-04T02:46:49.739 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of ubuntu 20.04 2023-06-04T02:46:49.752 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of ubuntu 20.04 2023-06-04T02:46:49.782 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of ubuntu 20.04 2023-06-04T02:46:50.021 INFO:teuthology.orchestra.console:Power off smithi167 2023-06-04T02:46:50.037 INFO:teuthology.orchestra.console:Power off smithi153 2023-06-04T02:46:50.094 INFO:teuthology.orchestra.console:Power off smithi172 2023-06-04T02:46:58.408 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2023-06-04T02:46:58.428 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2023-06-04T02:46:58.510 INFO:teuthology.orchestra.console:Power on smithi167 2023-06-04T02:46:58.529 INFO:teuthology.orchestra.console:Power on smithi153 2023-06-04T02:47:02.580 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-06-04T02:47:02.681 INFO:teuthology.orchestra.console:Power on smithi172 2023-06-04T02:47:02.813 INFO:teuthology.orchestra.console:Power on for smithi167 completed 2023-06-04T02:47:02.914 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-06-04T02:47:06.941 INFO:teuthology.orchestra.console:Power on for smithi172 completed 2023-06-04T02:47:07.000 INFO:teuthology.orchestra.console:Power on for smithi153 completed 2023-06-04T02:47:07.043 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-06-04T02:47:07.101 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-06-04T02:50:49.347 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: Authentication failed. 2023-06-04T02:50:56.336 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-04T02:50:56.337 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-04T02:51:05.392 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-04T02:51:05.393 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-04T02:51:14.448 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-04T02:51:14.449 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-04T02:51:23.504 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-04T02:51:23.505 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-04T02:51:32.564 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-04T02:51:32.565 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-04T02:51:41.620 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-04T02:51:41.621 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-04T02:51:50.352 WARNING:teuthology.provision.fog:timed out 2023-06-04T02:51:50.672 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-04T02:51:50.673 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-04T02:52:28.847 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-04T02:52:50.343 INFO:teuthology.provision.fog.smithi153:Node is ready 2023-06-04T02:52:50.354 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2023-06-04T02:52:50.361 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2023-06-04T02:52:50.582 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-06-04T02:52:50.582 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-04T02:52:50.582 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-06-04T02:52:50.582 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-06-04T02:52:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-04T02:52:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="20.04" 2023-06-04T02:52:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-04T02:52:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-04T02:52:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-04T02:52:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-04T02:52:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=focal 2023-06-04T02:52:50.583 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=focal 2023-06-04T02:52:50.584 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2023-06-04T02:52:56.356 WARNING:teuthology.provision.fog:timed out 2023-06-04T02:52:56.677 WARNING:teuthology.provision.fog:timed out 2023-06-04T02:53:02.571 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-04T02:53:02.886 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-04T02:53:03.074 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-06-04T02:53:03.081 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-06-04T02:53:03.089 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-06-04T02:53:03.263 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-06-04T02:53:03.264 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-04T02:53:03.264 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-06-04T02:53:03.264 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-06-04T02:53:03.265 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-04T02:53:03.265 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2023-06-04T02:53:03.265 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-04T02:53:03.265 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-04T02:53:03.266 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-04T02:53:03.266 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-04T02:53:03.266 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2023-06-04T02:53:03.267 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2023-06-04T02:53:03.267 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-06-04T02:53:03.380 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-06-04T02:53:03.386 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2023-06-04T02:53:03.393 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2023-06-04T02:53:03.618 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Ubuntu" 2023-06-04T02:53:03.619 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-04T02:53:03.619 INFO:teuthology.orchestra.run.smithi172.stdout:ID=ubuntu 2023-06-04T02:53:03.619 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE=debian 2023-06-04T02:53:03.619 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-04T02:53:03.619 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="20.04" 2023-06-04T02:53:03.619 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-04T02:53:03.620 INFO:teuthology.orchestra.run.smithi172.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-04T02:53:03.620 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-04T02:53:03.620 INFO:teuthology.orchestra.run.smithi172.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-04T02:53:03.620 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_CODENAME=focal 2023-06-04T02:53:03.621 INFO:teuthology.orchestra.run.smithi172.stdout:UBUNTU_CODENAME=focal 2023-06-04T02:53:03.621 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-06-04T02:53:03.997 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2023-06-04T02:53:03.998 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-04T02:53:04.019 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-06-04T02:53:04.020 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-06-04T02:53:04.020 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-04T02:53:04.046 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2023-06-04T02:53:04.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-06-04T02:53:04.311 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-06-04T02:53:04.318 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-06-04T02:53:04.318 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-04T02:53:04.319 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-06-04T02:53:04.319 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-06-04T02:53:04.319 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-04T02:53:04.319 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="20.04" 2023-06-04T02:53:04.320 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-04T02:53:04.320 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-04T02:53:04.320 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-04T02:53:04.320 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-04T02:53:04.320 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=focal 2023-06-04T02:53:04.320 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=focal 2023-06-04T02:53:04.321 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-06-04T02:53:04.346 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-06-04T02:53:04.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-06-04T02:53:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-06-04T02:53:04.566 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-06-04T02:53:04.567 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-04T02:53:04.567 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-06-04T02:53:04.567 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-06-04T02:53:04.567 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-04T02:53:04.568 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2023-06-04T02:53:04.568 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-04T02:53:04.568 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-04T02:53:04.568 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-04T02:53:04.569 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-04T02:53:04.569 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2023-06-04T02:53:04.569 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2023-06-04T02:53:04.569 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-06-04T02:53:04.596 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-06-04T02:53:04.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-06-04T02:53:04.770 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-06-04T02:53:04.819 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Ubuntu" 2023-06-04T02:53:04.819 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-04T02:53:04.819 INFO:teuthology.orchestra.run.smithi172.stdout:ID=ubuntu 2023-06-04T02:53:04.819 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE=debian 2023-06-04T02:53:04.820 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-04T02:53:04.820 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="20.04" 2023-06-04T02:53:04.820 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-04T02:53:04.820 INFO:teuthology.orchestra.run.smithi172.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-04T02:53:04.820 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-04T02:53:04.820 INFO:teuthology.orchestra.run.smithi172.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-04T02:53:04.820 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_CODENAME=focal 2023-06-04T02:53:04.821 INFO:teuthology.orchestra.run.smithi172.stdout:UBUNTU_CODENAME=focal 2023-06-04T02:53:04.821 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-06-04T02:53:04.963 INFO:teuthology.dispatcher.supervisor:Running job 7295924 2023-06-04T02:53:04.964 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-06-04_01:35:01-upgrade:quincy-p2p-quincy-distro-default-smithi/7295924 --name teuthology-2023-06-04_01:35:01-upgrade:quincy-p2p-quincy-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/teuthology-2023-06-04_01:35:01-upgrade:quincy-p2p-quincy-distro-default-smithi/7295924/orig.config.yaml 2023-06-04T02:53:04.969 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-06-04_01:35:01-upgrade:quincy-p2p-quincy-distro-default-smithi/7295924 2023-06-04T02:53:04.970 INFO:teuthology.dispatcher.supervisor:Job PID: 17792 2023-06-04T02:53:04.971 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-04T06:23:13.437 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-04T06:23:13.721 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-04T06:23:13.721 INFO:teuthology.nuke:Checking targets against current locks 2023-06-04T06:23:13.773 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-04T06:23:13.802 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-04T06:23:13.825 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-04T06:23:13.857 INFO:teuthology.orchestra.console:Power off smithi153 2023-06-04T06:23:13.903 INFO:teuthology.orchestra.console:Power off smithi167 2023-06-04T06:23:13.940 INFO:teuthology.orchestra.console:Power off smithi172 2023-06-04T06:23:14.013 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2023-06-04T06:23:14.052 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2023-06-04T06:23:14.088 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-06-04T06:23:14.166 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2023-06-04T06:23:14.198 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com 2023-06-04T06:23:14.242 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com