2021-03-14T21:43:01.704 INFO:root:teuthology version: 1.1.0-b9656917 2021-03-14T21:43:01.815 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi013.front.sepia.ceph.com' reimaging 2021-03-14T21:43:01.817 INFO:teuthology.lock.ops:Updating [ubuntu@smithi013.front.sepia.ceph.com]: reset os type and version on server 2021-03-14T21:43:01.817 INFO:teuthology.lock.ops:Updating smithi013.front.sepia.ceph.com on lock server 2021-03-14T21:43:01.835 INFO:teuthology.lock.ops:Node 'ubuntu@smithi013.front.sepia.ceph.com' reimaging is complete 2021-03-14T21:43:01.835 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi201.front.sepia.ceph.com' reimaging 2021-03-14T21:43:01.836 INFO:teuthology.lock.ops:Updating [ubuntu@smithi201.front.sepia.ceph.com]: reset os type and version on server 2021-03-14T21:43:01.836 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server 2021-03-14T21:43:01.853 INFO:teuthology.lock.ops:Node 'ubuntu@smithi201.front.sepia.ceph.com' reimaging is complete 2021-03-14T21:43:02.040 INFO:teuthology.provision.fog.smithi013:Scheduling deploy of ubuntu 18.04 2021-03-14T21:43:02.060 INFO:teuthology.provision.fog.smithi201:Scheduling deploy of ubuntu 18.04 2021-03-14T21:43:02.373 INFO:teuthology.orchestra.console:Power off smithi201 2021-03-14T21:43:02.393 INFO:teuthology.orchestra.console:Power off smithi013 2021-03-14T21:43:10.781 INFO:teuthology.orchestra.console:Power off for smithi013 completed 2021-03-14T21:43:10.883 INFO:teuthology.orchestra.console:Power on smithi013 2021-03-14T21:43:14.883 INFO:teuthology.orchestra.console:Power off for smithi201 completed 2021-03-14T21:43:14.985 INFO:teuthology.orchestra.console:Power on smithi201 2021-03-14T21:43:19.244 INFO:teuthology.orchestra.console:Power on for smithi201 completed 2021-03-14T21:43:19.251 INFO:teuthology.orchestra.console:Power on for smithi013 completed 2021-03-14T21:43:19.345 INFO:teuthology.provision.fog.smithi201:Waiting for deploy to finish 2021-03-14T21:43:19.352 INFO:teuthology.provision.fog.smithi013:Waiting for deploy to finish 2021-03-14T21:47:25.249 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-03-14T21:47:31.281 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-03-14T21:47:38.315 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-03-14T21:47:44.398 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-14T21:47:44.736 INFO:teuthology.provision.fog.smithi013:Node is ready 2021-03-14T21:47:44.794 INFO:teuthology.orchestra.run.smithi013.stdout:smithi013.front.sepia.ceph.com 2021-03-14T21:47:45.084 INFO:teuthology.orchestra.run.smithi013.stdout:172.21.15.13 smithi013.front.sepia.ceph.com smithi013 2021-03-14T21:47:45.369 INFO:teuthology.provision.fog.smithi013:Deploy complete! 2021-03-14T21:48:13.501 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-14T21:48:13.851 INFO:teuthology.provision.fog.smithi201:Node is ready 2021-03-14T21:48:13.899 INFO:teuthology.orchestra.run.smithi201.stdout:smithi201.front.sepia.ceph.com 2021-03-14T21:48:13.948 INFO:teuthology.orchestra.run.smithi201.stdout:172.21.15.201 smithi201.front.sepia.ceph.com smithi201 2021-03-14T21:48:14.383 INFO:teuthology.provision.fog.smithi201:Deploy complete! 2021-03-14T21:48:14.538 INFO:teuthology.lock.ops:Checking smithi013.front.sepia.ceph.com 2021-03-14T21:48:14.539 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-14T21:48:14.556 INFO:teuthology.lock.ops:Checking smithi201.front.sepia.ceph.com 2021-03-14T21:48:14.556 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-14T21:48:14.571 INFO:teuthology.lock.ops:Updating [smithi013.front.sepia.ceph.com]: set os type and version on server 2021-03-14T21:48:14.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-14T21:48:14.947 INFO:teuthology.orchestra.run.smithi013.stdout:x86_64 2021-03-14T21:48:14.998 INFO:teuthology.orchestra.run.smithi013.stdout:NAME="Ubuntu" 2021-03-14T21:48:14.998 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-03-14T21:48:14.999 INFO:teuthology.orchestra.run.smithi013.stdout:ID=ubuntu 2021-03-14T21:48:15.000 INFO:teuthology.orchestra.run.smithi013.stdout:ID_LIKE=debian 2021-03-14T21:48:15.000 INFO:teuthology.orchestra.run.smithi013.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-03-14T21:48:15.001 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION_ID="18.04" 2021-03-14T21:48:15.001 INFO:teuthology.orchestra.run.smithi013.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-14T21:48:15.002 INFO:teuthology.orchestra.run.smithi013.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-14T21:48:15.003 INFO:teuthology.orchestra.run.smithi013.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-14T21:48:15.004 INFO:teuthology.orchestra.run.smithi013.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-14T21:48:15.006 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION_CODENAME=bionic 2021-03-14T21:48:15.007 INFO:teuthology.orchestra.run.smithi013.stdout:UBUNTU_CODENAME=bionic 2021-03-14T21:48:15.010 INFO:teuthology.lock.ops:Updating smithi013.front.sepia.ceph.com on lock server 2021-03-14T21:48:15.036 INFO:teuthology.lock.ops:Updating [smithi201.front.sepia.ceph.com]: set os type and version on server 2021-03-14T21:48:15.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-14T21:48:15.451 INFO:teuthology.orchestra.run.smithi201.stdout:x86_64 2021-03-14T21:48:15.499 INFO:teuthology.orchestra.run.smithi201.stdout:NAME="Ubuntu" 2021-03-14T21:48:15.500 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-03-14T21:48:15.500 INFO:teuthology.orchestra.run.smithi201.stdout:ID=ubuntu 2021-03-14T21:48:15.501 INFO:teuthology.orchestra.run.smithi201.stdout:ID_LIKE=debian 2021-03-14T21:48:15.501 INFO:teuthology.orchestra.run.smithi201.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-03-14T21:48:15.501 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_ID="18.04" 2021-03-14T21:48:15.503 INFO:teuthology.orchestra.run.smithi201.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-14T21:48:15.503 INFO:teuthology.orchestra.run.smithi201.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-14T21:48:15.503 INFO:teuthology.orchestra.run.smithi201.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-14T21:48:15.503 INFO:teuthology.orchestra.run.smithi201.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-14T21:48:15.504 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_CODENAME=bionic 2021-03-14T21:48:15.504 INFO:teuthology.orchestra.run.smithi201.stdout:UBUNTU_CODENAME=bionic 2021-03-14T21:48:15.505 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server 2021-03-14T21:48:15.570 INFO:teuthology.dispatcher.supervisor:Running job 5964132 2021-03-14T21:48:15.571 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-03-14_06:07:03-rbd-pacific-distro-basic-smithi/5964132 --name teuthology-2021-03-14_06:07:03-rbd-pacific-distro-basic-smithi --description rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-pool/cache 5-cache-mode/rwl 6-workloads/qemu_xfstests} -- /home/teuthworker/archive/teuthology-2021-03-14_06:07:03-rbd-pacific-distro-basic-smithi/5964132/orig.config.yaml 2021-03-14T21:48:15.574 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-03-14_06:07:03-rbd-pacific-distro-basic-smithi/5964132 2021-03-14T21:48:15.575 INFO:teuthology.dispatcher.supervisor:Job PID: 2045 2021-03-14T21:48:15.575 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-03-15T09:49:06.383 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-03-15T09:49:06.775 INFO:teuthology.kill:Killing Pids: {2045} 2021-03-15T09:49:08.769 INFO:teuthology.kill:Nuking machines: ['smithi013', 'smithi201'] 2021-03-15T09:49:09.847 INFO:teuthology.kill:2021-03-15 09:49:09,846.846 INFO:teuthology.nuke:targets: 2021-03-15T09:49:09.849 INFO:teuthology.kill: smithi013.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtD/iuuzfUnugsGiLaW3dxeMnk5xlGNo6wiPbGWmkTI4/oTFLOVoCQk0abbxrdlvPHxmxpAlwB0eCj6BVEMyRSFf42BC0XXakcralIpJkfwySoKYQewUFL5QX/elhx6M54UY49S8QcGI14DBWpzuP8EVX8Umgs9GGFb6CKzruVRYrlP17woXN5pp7/03v79GVYzpVqJExCYh9fqyqW33BWEDZkxHknwPci5ML/i3TcHvP99hi8dgwLkoQWLEtTIfThDPgHuaWSEirEHrHs9NTFMtG00QRsJiLMpuhjF+0Q1c17UrEZFusbjqyNagYiqeeUZnSb5WvFflYwRgkIvvvh 2021-03-15T09:49:09.849 INFO:teuthology.kill: smithi201.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/cCIOiLMvVzzclb3skX5Efzb55nfnEJxfI3N8iswJdUUXZYDxh2u4umg/E9xQ+ijB/4MxG2KEgeiaJTtUqvCHl7+enGu/KOYj0P/ESjTY6JoDKDZQ1+fQ7r1VT5ri30szaRIHJ4GM7OpZRPOrGZgKlKxHWRT9LET4FDjKJWbNjMe1j0XA4cXqA0WaT9v1JIWSAbiVX9M42om5ZszlEcoPbORJn4o6wkVNf8N0O5C4Und0BaF7S2/wm8stkDVnYtZHXGX2EXbwQjxnwRHAZtvhhjCCmA8zYebmivoFmE9hBcyhFEiUW2LoqZ/z9NIOA0qB6YJTSuc9EWWoAYo1d7BV 2021-03-15T09:49:09.849 INFO:teuthology.kill:2021-03-15 09:49:09,847.847 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-15T09:49:09.850 INFO:teuthology.kill:2021-03-15 09:49:09,850.850 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-15T09:49:09.931 INFO:teuthology.kill:2021-03-15 09:49:09,930.930 INFO:teuthology.orchestra.console:Power off smithi201 2021-03-15T09:49:09.948 INFO:teuthology.kill:2021-03-15 09:49:09,948.948 INFO:teuthology.orchestra.console:Power off smithi013 2021-03-15T09:49:18.320 INFO:teuthology.kill:2021-03-15 09:49:18,319.319 INFO:teuthology.orchestra.console:Power off for smithi201 completed 2021-03-15T09:49:18.327 INFO:teuthology.kill:2021-03-15 09:49:18,327.327 INFO:teuthology.orchestra.console:Power off for smithi013 completed 2021-03-15T09:49:18.624 INFO:teuthology.task.internal:roles: ubuntu@smithi013.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1'] 2021-03-15T09:49:18.625 INFO:teuthology.task.internal:roles: ubuntu@smithi201.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.2', 'osd.3', 'client.0'] 2021-03-15T09:49:18.625 INFO:teuthology.misc:Compressing logs... 2021-03-15T09:49:18.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-15T09:50:18.689 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/misc.py", line 1374, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-03-15T09:50:18.738 INFO:teuthology.kill:No teuthology processes running 2021-03-15T09:50:20.701 INFO:teuthology.kill:Nuking machines: ['smithi013', 'smithi201'] 2021-03-15T09:50:22.056 INFO:teuthology.kill:2021-03-15 09:50:22,055.055 INFO:teuthology.nuke:targets: 2021-03-15T09:50:22.057 INFO:teuthology.kill: smithi013.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtD/iuuzfUnugsGiLaW3dxeMnk5xlGNo6wiPbGWmkTI4/oTFLOVoCQk0abbxrdlvPHxmxpAlwB0eCj6BVEMyRSFf42BC0XXakcralIpJkfwySoKYQewUFL5QX/elhx6M54UY49S8QcGI14DBWpzuP8EVX8Umgs9GGFb6CKzruVRYrlP17woXN5pp7/03v79GVYzpVqJExCYh9fqyqW33BWEDZkxHknwPci5ML/i3TcHvP99hi8dgwLkoQWLEtTIfThDPgHuaWSEirEHrHs9NTFMtG00QRsJiLMpuhjF+0Q1c17UrEZFusbjqyNagYiqeeUZnSb5WvFflYwRgkIvvvh 2021-03-15T09:50:22.057 INFO:teuthology.kill: smithi201.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/cCIOiLMvVzzclb3skX5Efzb55nfnEJxfI3N8iswJdUUXZYDxh2u4umg/E9xQ+ijB/4MxG2KEgeiaJTtUqvCHl7+enGu/KOYj0P/ESjTY6JoDKDZQ1+fQ7r1VT5ri30szaRIHJ4GM7OpZRPOrGZgKlKxHWRT9LET4FDjKJWbNjMe1j0XA4cXqA0WaT9v1JIWSAbiVX9M42om5ZszlEcoPbORJn4o6wkVNf8N0O5C4Und0BaF7S2/wm8stkDVnYtZHXGX2EXbwQjxnwRHAZtvhhjCCmA8zYebmivoFmE9hBcyhFEiUW2LoqZ/z9NIOA0qB6YJTSuc9EWWoAYo1d7BV 2021-03-15T09:50:22.081 INFO:teuthology.kill:2021-03-15 09:50:22,081.081 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-15T09:50:22.084 INFO:teuthology.kill:2021-03-15 09:50:22,084.084 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-15T09:50:22.145 INFO:teuthology.kill:2021-03-15 09:50:22,145.145 INFO:teuthology.orchestra.console:Power off smithi013 2021-03-15T09:50:22.160 INFO:teuthology.kill:2021-03-15 09:50:22,160.160 INFO:teuthology.orchestra.console:Power off smithi201 2021-03-15T09:50:22.313 INFO:teuthology.kill:2021-03-15 09:50:22,313.313 INFO:teuthology.orchestra.console:Power off for smithi013 completed 2021-03-15T09:50:22.320 INFO:teuthology.kill:2021-03-15 09:50:22,320.320 INFO:teuthology.orchestra.console:Power off for smithi201 completed 2021-03-15T09:50:22.456 INFO:teuthology.kill:2021-03-15 09:50:22,455.455 INFO:teuthology.lock.ops:unlocked smithi013.front.sepia.ceph.com 2021-03-15T09:50:22.465 INFO:teuthology.kill:2021-03-15 09:50:22,464.464 INFO:teuthology.lock.ops:unlocked smithi201.front.sepia.ceph.com 2021-03-15T09:52:22.776 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-03-15T09:52:22.850 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-03-15T09:52:22.850 INFO:teuthology.nuke:Checking targets against current locks 2021-03-15T09:52:22.950 INFO:teuthology.nuke:Not nuking smithi201.front.sepia.ceph.com because description doesn't match 2021-03-15T09:52:22.951 INFO:teuthology.nuke:Not nuking smithi013.front.sepia.ceph.com because description doesn't match