2022-09-02T03:31:01.609 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-09-02T03:31:01.777 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging
2022-09-02T03:31:01.780 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server
2022-09-02T03:31:01.781 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2022-09-02T03:31:01.819 INFO:teuthology.lock.ops:Node 'smithi045.front.sepia.ceph.com' reimaging is complete
2022-09-02T03:31:01.820 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2022-09-02T03:31:01.820 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2022-09-02T03:31:01.821 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2022-09-02T03:31:01.863 INFO:teuthology.lock.ops:Node 'smithi062.front.sepia.ceph.com' reimaging is complete
2022-09-02T03:31:02.052 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of ubuntu 20.04
2022-09-02T03:31:02.091 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of ubuntu 20.04
2022-09-02T03:31:02.420 INFO:teuthology.orchestra.console:Power off smithi045
2022-09-02T03:31:02.466 INFO:teuthology.orchestra.console:Power off smithi062
2022-09-02T03:31:10.802 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2022-09-02T03:31:10.835 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2022-09-02T03:31:10.904 INFO:teuthology.orchestra.console:Power on smithi045
2022-09-02T03:31:10.937 INFO:teuthology.orchestra.console:Power on smithi062
2022-09-02T03:31:19.277 INFO:teuthology.orchestra.console:Power on for smithi045 completed
2022-09-02T03:31:19.302 INFO:teuthology.orchestra.console:Power on for smithi062 completed
2022-09-02T03:31:19.379 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish
2022-09-02T03:31:19.404 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2022-09-02T03:35:48.367 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-02T03:35:48.903 INFO:teuthology.provision.fog.smithi045:Node is ready
2022-09-02T03:35:48.911 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com
2022-09-02T03:35:48.963 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045
2022-09-02T03:35:49.138 INFO:teuthology.provision.fog.smithi045:Deploy complete!
2022-09-02T03:36:27.174 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-02T03:36:27.729 INFO:teuthology.provision.fog.smithi062:Node is ready
2022-09-02T03:36:27.736 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2022-09-02T03:36:27.785 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2022-09-02T03:36:27.977 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2022-09-02T03:36:28.266 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com
2022-09-02T03:36:28.267 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-02T03:36:28.289 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2022-09-02T03:36:28.289 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-02T03:36:28.311 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server
2022-09-02T03:36:28.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2022-09-02T03:36:28.631 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64
2022-09-02T03:36:28.636 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Ubuntu"
2022-09-02T03:36:28.637 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="20.04.5 LTS (Focal Fossa)"
2022-09-02T03:36:28.637 INFO:teuthology.orchestra.run.smithi045.stdout:ID=ubuntu
2022-09-02T03:36:28.637 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE=debian
2022-09-02T03:36:28.637 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS"
2022-09-02T03:36:28.638 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="20.04"
2022-09-02T03:36:28.638 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.ubuntu.com/"
2022-09-02T03:36:28.638 INFO:teuthology.orchestra.run.smithi045.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-09-02T03:36:28.638 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-09-02T03:36:28.639 INFO:teuthology.orchestra.run.smithi045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-09-02T03:36:28.639 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_CODENAME=focal
2022-09-02T03:36:28.639 INFO:teuthology.orchestra.run.smithi045.stdout:UBUNTU_CODENAME=focal
2022-09-02T03:36:28.640 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2022-09-02T03:36:28.663 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2022-09-02T03:36:28.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2022-09-02T03:36:28.890 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2022-09-02T03:36:28.897 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu"
2022-09-02T03:36:28.898 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="20.04.5 LTS (Focal Fossa)"
2022-09-02T03:36:28.898 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu
2022-09-02T03:36:28.899 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian
2022-09-02T03:36:28.899 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS"
2022-09-02T03:36:28.900 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="20.04"
2022-09-02T03:36:28.900 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/"
2022-09-02T03:36:28.900 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-09-02T03:36:28.901 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-09-02T03:36:28.901 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-09-02T03:36:28.902 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=focal
2022-09-02T03:36:28.902 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=focal
2022-09-02T03:36:28.903 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2022-09-02T03:36:29.021 INFO:teuthology.dispatcher.supervisor:Running job 7005380
2022-09-02T03:36:29.022 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2022-09-01_15:25:15-rgw-wip-cbodley-testing-distro-default-smithi/7005380 --name cbodley-2022-09-01_15:25:15-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2022-09-01_15:25:15-rgw-wip-cbodley-testing-distro-default-smithi/7005380/orig.config.yaml
2022-09-02T03:36:29.027 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2022-09-01_15:25:15-rgw-wip-cbodley-testing-distro-default-smithi/7005380
2022-09-02T03:36:29.029 INFO:teuthology.dispatcher.supervisor:Job PID: 22337
2022-09-02T03:36:29.029 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-09-02T15:37:30.196 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-09-02T15:37:30.386 INFO:teuthology.kill:Killing Pids: {22337}
2022-09-02T15:37:31.877 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2022-09-02T15:37:31.879 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2022-09-02T15:37:31.879 INFO:teuthology.misc:Compressing logs...
2022-09-02T15:37:31.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2022-09-02T15:37:32.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2022-09-02T15:37:32.734 INFO:teuthology.misc:Compressing logs...
2022-09-02T15:37:32.841 INFO:teuthology.misc:Compressing logs...
2022-09-02T15:55:42.455 INFO:teuthology.kill:No teuthology processes running
2022-09-02T15:55:43.830 INFO:teuthology.kill:Nuking machines: ['smithi045', 'smithi062']
2022-09-02T15:55:44.921 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-09-02T15:55:44.922 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-09-02T15:55:44.922 INFO:teuthology.kill:2022-09-02 15:55:44,920.920 INFO:teuthology.nuke:targets:
2022-09-02T15:55:44.922 INFO:teuthology.kill:  smithi045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCe/ER+FqLWdUi/lvkLFLJ5vFd8nrDgXRuqKC/blNvSkxau0JJ2iUosy0rpERKmZ61YeclvRGrP6VvXXDUThzNCOXb+RAX+ZYr8JXku/Ju4qm74mArQC+TqGosnHUlPxPRwd8mH2iPrNV1roeATQLWG3jydWW8gWRiA7ZeFijrRZeFBFUZbQTxpmT4+CBVOF74Jv46+8k83rX/5YPTCx5cWmWKWjCyImI3kvNYqxBTQxVHLDNv89yWdJ4XGcw3KsR6vBA8hwCPrkuf4bJkikl6IQZN+0bckSxlYNxL57KS/JIvnmmzjtlI1VxcazOq+e0PZ45UYhbc/fAO/K5SNxWaZ4SRZVLmJ81wH2kWoFMq1Om/YrvcTu0vxGbkg+Zwti5y9no1BZQuNWWWneiT6HhquHZMwgiiQ7CPxSyZwNI8iJMjLmM0V9hE/LHYHClJu5s7sb61IfxV5mgTlaqipNPEPpGu+MmB6XzPsvAYucKbgmmmBkX0Gul7Vfgeek1ttVQ0=
2022-09-02T15:55:44.922 INFO:teuthology.kill:  smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC92jAQuk1MHm21d95x090ElS8/Mp2H5XiiQHi/rMddnav1+eJ+Y4Ss080Ah5TWr0v24VSzocZvuwcOjAr94nrjm1njy3n84cPFMexZu6wFXEaj9kln8Ox+ptzvCJbFAXwiuxH9IQo6/qWQQSlnZxOyD8PAjEllx6ENafa1q/9DL1AUbAV6hhLUs3ry2vknQvioDQbaM6htYseKtMt9x3nYmy+k4USv9aWqSmOBgrT5KLTd/0qE7OZhg7VpyUhxvJzSeeVvrkGlV8e6jCmCAi5xMvBk5CTMsnSFHZvrwIqUeS2iFUNldE5TyesgHsBJViC7jB5SYsmhsdSjumnylTPRaIrY59G/iPeXJxMxRPCLn71zuzm1/81TVQKDK3YePhD9+s5Kp2c8zCf8vZEy8e4zYFKUdfrD7QWVUf8r6EskaGlAXjql2hZjs6Gnb5RDppoRZpwG+SEEBVmjPil2zm2JQAiTl3/8LTAKtQJlp/g5rZf1AZs2fiSU7eceRG8juxs=
2022-09-02T15:55:44.923 INFO:teuthology.kill:2022-09-02 15:55:44,920.920 INFO:teuthology.nuke:Checking targets against current locks
2022-09-02T15:55:44.975 INFO:teuthology.kill:2022-09-02 15:55:44,975.975 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-02T15:55:44.999 INFO:teuthology.kill:2022-09-02 15:55:44,998.998 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-02T15:55:45.055 INFO:teuthology.kill:2022-09-02 15:55:45,054.054 INFO:teuthology.orchestra.console:Power off smithi045
2022-09-02T15:55:45.096 INFO:teuthology.kill:2022-09-02 15:55:45,095.095 INFO:teuthology.orchestra.console:Power off smithi062
2022-09-02T15:55:53.431 INFO:teuthology.kill:2022-09-02 15:55:53,430.430 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2022-09-02T15:55:53.578 INFO:teuthology.kill:2022-09-02 15:55:53,577.577 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com
2022-09-02T15:55:57.569 INFO:teuthology.kill:2022-09-02 15:55:57,569.569 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2022-09-02T15:55:57.718 INFO:teuthology.kill:2022-09-02 15:55:57,718.718 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com
2022-09-02T15:57:58.068 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-09-02T15:57:58.172 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi045 but it was locked by another job: /home/teuthworker/archive/dis-2022-09-02_12:19:50-rbd-wip-dis-testing-pacific-distro-default-smithi/7007924
2022-09-02T15:57:58.172 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi062 but it was locked by another job: /home/teuthworker/archive/dis-2022-09-02_12:19:50-rbd-wip-dis-testing-pacific-distro-default-smithi/7007924