2021-04-14T11:00:26.740 INFO:root:teuthology version: 1.1.0-2713a3cd
2021-04-14T11:00:27.020 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging
2021-04-14T11:00:27.021 INFO:teuthology.lock.ops:Updating [ubuntu@smithi058.front.sepia.ceph.com]: reset os type and version on server
2021-04-14T11:00:27.021 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server
2021-04-14T11:00:27.039 INFO:teuthology.lock.ops:Node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging is complete
2021-04-14T11:00:27.039 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi076.front.sepia.ceph.com' reimaging
2021-04-14T11:00:27.040 INFO:teuthology.lock.ops:Updating [ubuntu@smithi076.front.sepia.ceph.com]: reset os type and version on server
2021-04-14T11:00:27.040 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server
2021-04-14T11:00:27.067 INFO:teuthology.lock.ops:Node 'ubuntu@smithi076.front.sepia.ceph.com' reimaging is complete
2021-04-14T11:00:27.260 INFO:teuthology.provision.fog.smithi058:Scheduling deploy of ubuntu 20.04
2021-04-14T11:00:27.310 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of ubuntu 20.04
2021-04-14T11:00:27.641 INFO:teuthology.orchestra.console:Power off smithi058
2021-04-14T11:00:27.686 INFO:teuthology.orchestra.console:Power off smithi076
2021-04-14T11:00:36.024 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2021-04-14T11:00:36.066 INFO:teuthology.orchestra.console:Power off for smithi076 completed
2021-04-14T11:00:36.126 INFO:teuthology.orchestra.console:Power on smithi058
2021-04-14T11:00:36.168 INFO:teuthology.orchestra.console:Power on smithi076
2021-04-14T11:00:44.501 INFO:teuthology.orchestra.console:Power on for smithi058 completed
2021-04-14T11:00:44.602 INFO:teuthology.provision.fog.smithi058:Waiting for deploy to finish
2021-04-14T11:00:44.604 INFO:teuthology.orchestra.console:Power on for smithi076 completed
2021-04-14T11:00:44.706 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish
2021-04-14T11:05:22.240 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-14T11:05:22.722 INFO:teuthology.provision.fog.smithi058:Node is ready
2021-04-14T11:05:22.728 INFO:teuthology.orchestra.run.smithi058.stdout:smithi058.front.sepia.ceph.com
2021-04-14T11:05:22.781 INFO:teuthology.orchestra.run.smithi058.stdout:172.21.15.58 smithi058.front.sepia.ceph.com smithi058
2021-04-14T11:05:22.995 INFO:teuthology.provision.fog.smithi058:Deploy complete!
2021-04-14T11:06:12.058 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-14T11:06:12.548 INFO:teuthology.provision.fog.smithi076:Node is ready
2021-04-14T11:06:12.555 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076.front.sepia.ceph.com
2021-04-14T11:06:12.604 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076
2021-04-14T11:06:12.759 INFO:teuthology.provision.fog.smithi076:Deploy complete!
2021-04-14T11:06:12.910 INFO:teuthology.lock.ops:Checking smithi058.front.sepia.ceph.com
2021-04-14T11:06:12.911 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-14T11:06:12.926 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com
2021-04-14T11:06:12.927 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-14T11:06:12.939 INFO:teuthology.lock.ops:Updating [smithi058.front.sepia.ceph.com]: set os type and version on server
2021-04-14T11:06:12.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-14T11:06:13.239 INFO:teuthology.orchestra.run.smithi058.stdout:x86_64
2021-04-14T11:06:13.246 INFO:teuthology.orchestra.run.smithi058.stdout:NAME="Ubuntu"
2021-04-14T11:06:13.247 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-04-14T11:06:13.247 INFO:teuthology.orchestra.run.smithi058.stdout:ID=ubuntu
2021-04-14T11:06:13.248 INFO:teuthology.orchestra.run.smithi058.stdout:ID_LIKE=debian
2021-04-14T11:06:13.248 INFO:teuthology.orchestra.run.smithi058.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-04-14T11:06:13.249 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION_ID="20.04"
2021-04-14T11:06:13.249 INFO:teuthology.orchestra.run.smithi058.stdout:HOME_URL="https://www.ubuntu.com/"
2021-04-14T11:06:13.249 INFO:teuthology.orchestra.run.smithi058.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-04-14T11:06:13.250 INFO:teuthology.orchestra.run.smithi058.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-04-14T11:06:13.250 INFO:teuthology.orchestra.run.smithi058.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-04-14T11:06:13.250 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION_CODENAME=focal
2021-04-14T11:06:13.251 INFO:teuthology.orchestra.run.smithi058.stdout:UBUNTU_CODENAME=focal
2021-04-14T11:06:13.252 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server
2021-04-14T11:06:13.268 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server
2021-04-14T11:06:13.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-14T11:06:13.439 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64
2021-04-14T11:06:13.487 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Ubuntu"
2021-04-14T11:06:13.488 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-04-14T11:06:13.488 INFO:teuthology.orchestra.run.smithi076.stdout:ID=ubuntu
2021-04-14T11:06:13.488 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE=debian
2021-04-14T11:06:13.489 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-04-14T11:06:13.489 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="20.04"
2021-04-14T11:06:13.489 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.ubuntu.com/"
2021-04-14T11:06:13.491 INFO:teuthology.orchestra.run.smithi076.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-04-14T11:06:13.491 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-04-14T11:06:13.491 INFO:teuthology.orchestra.run.smithi076.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-04-14T11:06:13.492 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_CODENAME=focal
2021-04-14T11:06:13.492 INFO:teuthology.orchestra.run.smithi076.stdout:UBUNTU_CODENAME=focal
2021-04-14T11:06:13.493 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server
2021-04-14T11:06:13.626 INFO:teuthology.dispatcher.supervisor:Running job 6046623
2021-04-14T11:06:13.626 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology -v --owner scheduled_trociny@teuthology --archive /home/teuthworker/archive/trociny-2021-04-14_10:58:57-rbd-wip-mgolub-testing-distro-basic-smithi/6046623 --name trociny-2021-04-14_10:58:57-rbd-wip-mgolub-testing-distro-basic-smithi --description rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-pool/cache 5-cache-mode/rwl 6-workloads/qemu_xfstests} -- /home/teuthworker/archive/trociny-2021-04-14_10:58:57-rbd-wip-mgolub-testing-distro-basic-smithi/6046623/orig.config.yaml
2021-04-14T11:06:13.635 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/trociny-2021-04-14_10:58:57-rbd-wip-mgolub-testing-distro-basic-smithi/6046623
2021-04-14T11:06:13.638 INFO:teuthology.dispatcher.supervisor:Job PID: 8839
2021-04-14T11:06:13.639 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-04-14T19:58:58.481 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/trociny-2021-04-14_10:58:57-rbd-wip-mgolub-testing-distro-basic-smithi/jobs/ failed with status 504:
504 Gateway Time-out
504 Gateway Time-out
nginx/1.10.3 (Ubuntu)
2021-04-14T22:16:54.977 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/trociny-2021-04-14_10:58:57-rbd-wip-mgolub-testing-distro-basic-smithi/jobs/ failed with status 504:
504 Gateway Time-out
504 Gateway Time-out
nginx/1.10.3 (Ubuntu)
2021-04-14T23:08:30.932 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-04-14T23:08:31.084 INFO:teuthology.kill:Killing Pids: {8839}
2021-04-14T23:08:32.163 INFO:teuthology.kill:Nuking machines: ['smithi058', 'smithi076']
2021-04-14T23:08:33.068 INFO:teuthology.kill:2021-04-14 23:08:33,068.068 INFO:teuthology.nuke:targets:
2021-04-14T23:08:33.069 INFO:teuthology.kill: smithi058.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOXioRkWaqVpHEghwU2fovZN8G7wK8eIl61k+0AzUYHFdNUrpTQBf3LirpJskMz0Bn5eTAJGx8GqWhwVWSYqKj7T4nBmBibOUwLBtkyo9mlc6qFqpRGyvgUpnWIGQgCcgO5xNtZx2ygQVpAE3/S/ZLDwr8Pnpxj+pEZhe8iSDm1XkVeMuDjCw23l2E/XflIkOujmFJ/q1j2e+Biah5VrdqACQt2K3ECWPVq/Tug5eXjoyXfsy0kpEuXNQNAp+YSVmtUFI+1Q51ZhIeqtS9iVctcJDBPEFh4gk4mQ2GSc4Q3wwmFrLd1T/hyHA8q2DoCOh3eP28ZUnmlFwb8jUHDUELlT0c9k5rWAqXdxZoK3hndWXujiPZagWsWK7lSmPhmq+t50wNKedw59YonUR0TiDWDJ/1kP6/9+eqGqF6s44UHO41q29HjUAzy30bhBcreaqQmnkXuiiFAiQi40wfS40fFxo8Li39kIonBwSg7EqGt0tveQ8V1aG5fd7629RHBK0=
2021-04-14T23:08:33.069 INFO:teuthology.kill: smithi076.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC73i2bZ3DDMRemIXt4eAFr5HUW4KObN3Of+1rTTEEpRGgDiKYlE+1UMjMmPhRzB0GnX/BAvU7U8O/ebIMQ59B/TRQAha/Kl3dUk6vGzi79d0YtnkkI6KPNYh1IYBBFwDAncwh8LtbbEbgI7oJ7/JdGEEkRlUDfSTi2mxZdbUbIsOQU4IjrrDTNdtVLdtsjNvgrWvD5YCHynBGsrXOcaYohXVUVr403thNRoougpAq9MlvIUq5slXUtYH/O72P4R4+kI5YLzbgnMADiTMxzzxWjLypEHFI7K89fyIH58b4ONjTlBuLcOr23wLmIWdl5Bb/RwDnY1D0vNccNQT/dSujrgBbsYmDeOsHcXLYnqpxrDrHJT4/S1FpgQNfFHiThkQtvQE+aYCsRll6z/X4q0eDHaJAdiaQgaSHAHtkLyE0zd0vAUEtTJE4foBFz1R3yiLUtdS6jmfRPIJEMlv4cdBO4VlWK720SE7FwO9uOv1uDXjCNpnWUxEHzZKoJ4bpbpD8=
2021-04-14T23:08:33.070 INFO:teuthology.kill:2021-04-14 23:08:33,068.068 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-14T23:08:33.070 INFO:teuthology.kill:2021-04-14 23:08:33,070.070 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-14T23:08:33.145 INFO:teuthology.kill:2021-04-14 23:08:33,145.145 INFO:teuthology.orchestra.console:Power off smithi058
2021-04-14T23:08:33.159 INFO:teuthology.kill:2021-04-14 23:08:33,159.159 INFO:teuthology.orchestra.console:Power off smithi076
2021-04-14T23:08:41.518 INFO:teuthology.kill:2021-04-14 23:08:41,518.518 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2021-04-14T23:08:41.524 INFO:teuthology.kill:2021-04-14 23:08:41,524.524 INFO:teuthology.orchestra.console:Power off for smithi076 completed
2021-04-14T23:08:41.733 INFO:teuthology.task.internal:roles: ubuntu@smithi058.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1']
2021-04-14T23:08:41.734 INFO:teuthology.task.internal:roles: ubuntu@smithi076.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.2', 'osd.3', 'client.0']
2021-04-14T23:08:41.734 INFO:teuthology.misc:Compressing logs...
2021-04-14T23:08:41.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-14T23:09:41.798 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
teuth_config.archive_base, job_config)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
compress_logs(ctx, log_path)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/misc.py", line 1378, in compress_logs
wait=False,
File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in run
return [remote.run(**kwargs) for remote in remotes]
File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/cluster.py", line 64, in
return [remote.run(**kwargs) for remote in remotes]
File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/remote.py", line 215, in run
r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/orchestra/run.py", line 434, in run
transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-04-14T23:09:41.834 INFO:teuthology.kill:No teuthology processes running
2021-04-14T23:10:11.775 INFO:teuthology.kill:Nuking machines: ['smithi058', 'smithi076']
2021-04-14T23:10:12.669 INFO:teuthology.kill:2021-04-14 23:10:12,668.668 INFO:teuthology.nuke:targets:
2021-04-14T23:10:12.670 INFO:teuthology.kill: smithi058.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOXioRkWaqVpHEghwU2fovZN8G7wK8eIl61k+0AzUYHFdNUrpTQBf3LirpJskMz0Bn5eTAJGx8GqWhwVWSYqKj7T4nBmBibOUwLBtkyo9mlc6qFqpRGyvgUpnWIGQgCcgO5xNtZx2ygQVpAE3/S/ZLDwr8Pnpxj+pEZhe8iSDm1XkVeMuDjCw23l2E/XflIkOujmFJ/q1j2e+Biah5VrdqACQt2K3ECWPVq/Tug5eXjoyXfsy0kpEuXNQNAp+YSVmtUFI+1Q51ZhIeqtS9iVctcJDBPEFh4gk4mQ2GSc4Q3wwmFrLd1T/hyHA8q2DoCOh3eP28ZUnmlFwb8jUHDUELlT0c9k5rWAqXdxZoK3hndWXujiPZagWsWK7lSmPhmq+t50wNKedw59YonUR0TiDWDJ/1kP6/9+eqGqF6s44UHO41q29HjUAzy30bhBcreaqQmnkXuiiFAiQi40wfS40fFxo8Li39kIonBwSg7EqGt0tveQ8V1aG5fd7629RHBK0=
2021-04-14T23:10:12.670 INFO:teuthology.kill: smithi076.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC73i2bZ3DDMRemIXt4eAFr5HUW4KObN3Of+1rTTEEpRGgDiKYlE+1UMjMmPhRzB0GnX/BAvU7U8O/ebIMQ59B/TRQAha/Kl3dUk6vGzi79d0YtnkkI6KPNYh1IYBBFwDAncwh8LtbbEbgI7oJ7/JdGEEkRlUDfSTi2mxZdbUbIsOQU4IjrrDTNdtVLdtsjNvgrWvD5YCHynBGsrXOcaYohXVUVr403thNRoougpAq9MlvIUq5slXUtYH/O72P4R4+kI5YLzbgnMADiTMxzzxWjLypEHFI7K89fyIH58b4ONjTlBuLcOr23wLmIWdl5Bb/RwDnY1D0vNccNQT/dSujrgBbsYmDeOsHcXLYnqpxrDrHJT4/S1FpgQNfFHiThkQtvQE+aYCsRll6z/X4q0eDHaJAdiaQgaSHAHtkLyE0zd0vAUEtTJE4foBFz1R3yiLUtdS6jmfRPIJEMlv4cdBO4VlWK720SE7FwO9uOv1uDXjCNpnWUxEHzZKoJ4bpbpD8=
2021-04-14T23:10:12.688 INFO:teuthology.kill:2021-04-14 23:10:12,688.688 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-14T23:10:12.701 INFO:teuthology.kill:2021-04-14 23:10:12,701.701 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-14T23:10:12.804 INFO:teuthology.kill:2021-04-14 23:10:12,804.804 INFO:teuthology.orchestra.console:Power off smithi058
2021-04-14T23:10:12.817 INFO:teuthology.kill:2021-04-14 23:10:12,816.816 INFO:teuthology.orchestra.console:Power off smithi076
2021-04-14T23:10:12.942 INFO:teuthology.kill:2021-04-14 23:10:12,942.942 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2021-04-14T23:10:13.013 INFO:teuthology.kill:2021-04-14 23:10:12,953.953 INFO:teuthology.orchestra.console:Power off for smithi076 completed
2021-04-14T23:10:13.090 INFO:teuthology.kill:2021-04-14 23:10:13,090.090 INFO:teuthology.lock.ops:unlocked smithi058.front.sepia.ceph.com
2021-04-14T23:10:13.107 INFO:teuthology.kill:2021-04-14 23:10:13,107.107 INFO:teuthology.lock.ops:unlocked smithi076.front.sepia.ceph.com
2021-04-14T23:12:13.371 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15