2021-03-01T20:45:12.893 INFO:root:teuthology version: 1.1.0-3082387b 2021-03-01T20:45:12.995 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi195.front.sepia.ceph.com' reimaging 2021-03-01T20:45:12.996 INFO:teuthology.lock.ops:Updating [ubuntu@smithi195.front.sepia.ceph.com]: reset os type and version on server 2021-03-01T20:45:12.997 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2021-03-01T20:45:13.013 INFO:teuthology.lock.ops:Node 'ubuntu@smithi195.front.sepia.ceph.com' reimaging is complete 2021-03-01T20:45:13.014 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging 2021-03-01T20:45:13.014 INFO:teuthology.lock.ops:Updating [ubuntu@smithi196.front.sepia.ceph.com]: reset os type and version on server 2021-03-01T20:45:13.014 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2021-03-01T20:45:13.034 INFO:teuthology.lock.ops:Node 'ubuntu@smithi196.front.sepia.ceph.com' reimaging is complete 2021-03-01T20:45:13.235 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of ubuntu 18.04 2021-03-01T20:45:13.253 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of ubuntu 18.04 2021-03-01T20:45:13.634 INFO:teuthology.orchestra.console:Power off smithi195 2021-03-01T20:45:13.709 INFO:teuthology.orchestra.console:Power off smithi196 2021-03-01T20:45:26.124 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2021-03-01T20:45:26.184 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2021-03-01T20:45:26.227 INFO:teuthology.orchestra.console:Power on smithi195 2021-03-01T20:45:26.285 INFO:teuthology.orchestra.console:Power on smithi196 2021-03-01T20:45:30.539 INFO:teuthology.orchestra.console:Power on for smithi196 completed 2021-03-01T20:45:30.641 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2021-03-01T20:45:34.597 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2021-03-01T20:45:34.698 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2021-03-01T20:48:20.953 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: Authentication failed. 2021-03-01T20:49:22.045 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: Authentication timeout. 2021-03-01T20:50:29.132 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-01T20:50:29.465 INFO:teuthology.provision.fog.smithi195:Node is ready 2021-03-01T20:50:29.516 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2021-03-01T20:50:29.563 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2021-03-01T20:50:29.859 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2021-03-01T20:50:32.972 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-01T20:50:33.335 INFO:teuthology.provision.fog.smithi196:Node is ready 2021-03-01T20:50:33.388 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2021-03-01T20:50:33.437 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2021-03-01T20:50:33.772 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2021-03-01T20:50:33.923 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2021-03-01T20:50:33.924 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-01T20:50:33.944 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2021-03-01T20:50:33.944 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-01T20:50:33.969 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2021-03-01T20:50:33.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-01T20:50:34.334 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2021-03-01T20:50:34.382 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2021-03-01T20:50:34.382 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-03-01T20:50:34.383 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2021-03-01T20:50:34.383 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2021-03-01T20:50:34.383 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-03-01T20:50:34.383 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="18.04" 2021-03-01T20:50:34.384 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-01T20:50:34.384 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-01T20:50:34.384 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-01T20:50:34.384 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-01T20:50:34.384 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=bionic 2021-03-01T20:50:34.385 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=bionic 2021-03-01T20:50:34.386 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2021-03-01T20:50:34.402 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2021-03-01T20:50:34.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-01T20:50:34.778 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2021-03-01T20:50:34.824 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2021-03-01T20:50:34.825 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-03-01T20:50:34.825 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2021-03-01T20:50:34.825 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2021-03-01T20:50:34.825 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-03-01T20:50:34.826 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="18.04" 2021-03-01T20:50:34.826 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-01T20:50:34.826 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-01T20:50:34.826 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-01T20:50:34.827 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-01T20:50:34.827 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=bionic 2021-03-01T20:50:34.827 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=bionic 2021-03-01T20:50:34.827 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2021-03-01T20:50:34.896 INFO:teuthology.dispatcher.supervisor:Running job 5925029 2021-03-01T20:50:34.897 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/bin/teuthology -v --owner scheduled_jdillaman@cube-1 --archive /home/teuthworker/archive/jdillaman-2021-03-01_15:31:20-rbd-wip-jd-testing-pacific-testing-basic-smithi/5925029 --name jdillaman-2021-03-01_15:31:20-rbd-wip-jd-testing-pacific-testing-basic-smithi --description rbd/persistent-writeback-cache/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-pool/cache 5-cache-mode/rwl 6-workloads/qemu_xfstests} -- /home/teuthworker/archive/jdillaman-2021-03-01_15:31:20-rbd-wip-jd-testing-pacific-testing-basic-smithi/5925029/orig.config.yaml 2021-03-01T20:50:34.900 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/jdillaman-2021-03-01_15:31:20-rbd-wip-jd-testing-pacific-testing-basic-smithi/5925029 2021-03-01T20:50:34.901 INFO:teuthology.dispatcher.supervisor:Job PID: 21071 2021-03-01T20:50:34.901 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-03-01T20:54:00.899 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-03-02T08:50:51.539 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-03-02T08:50:51.736 INFO:teuthology.kill:Killing Pids: {21071} 2021-03-02T08:50:52.827 INFO:teuthology.kill:Nuking machines: ['smithi195', 'smithi196'] 2021-03-02T08:50:53.753 INFO:teuthology.kill:2021-03-02 08:50:53,753.753 INFO:teuthology.nuke:targets: 2021-03-02T08:50:53.754 INFO:teuthology.kill: smithi195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCr1OkSeYSppef4gBQpOkch/+sswMRfhu19EFg+Suk9O3OdrHVCd6drkTQfAh/yPOLohiR01T/INAUjKPdXF5u2WYwB6kDdGyib96KEeJbH5b2d6MGoTd2+Pmib1EATpZMQnqc8h0hfWSTFj/P/EwUmJBDKxMsunU9MlcCHIyJNTAZ0lL+4w70RwoqJ8fcoqqyKB3NfIi9jTETcLaQytcz463ZDxCzwjOwZfhW62mzuVwmASRzcpQ9iqVDz3CUjncmL9uyVwIXuJtmTUSTHGLZ+WEbTNDERrJwJmfD5Elx7L8MpOTYzcH9NZZVM2OUtRSfoPF+m9UGuElHj8fdtQf2X 2021-03-02T08:50:53.755 INFO:teuthology.kill: smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDG9POeCRLr9Rrt21KgnQw01Tv0Wzm4HzK8SMCgQgVQV07ORqcplu8o7AVqPa1ng7Lq86mZs7PTKrYXAu9xUET/IG9GAaCwGmECXBeK7ROPLHDImABIT6NuDR139T2WWu4/K4uD3t5LrzOjt+HhQziACtCtrR6uENfLk6hXDSHZhK2lUMwbH3DzvSb3Px3XBR/dQorzCcHOhI9c2IWRWBoYdrUHTvwgj9ck8WhjTuOJu8VCi1u3xtLndbaeBJY+EG/8wsmNfV9VBFLsr1eemdyEyy77x8XzGozNL/626H4S8zQAM/6IPaTIs+jlohPzGF3v9w3m872n2yPFdu9fFZrx 2021-03-02T08:50:53.755 INFO:teuthology.kill:2021-03-02 08:50:53,753.753 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-02T08:50:53.756 INFO:teuthology.kill:2021-03-02 08:50:53,756.756 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-02T08:50:53.822 INFO:teuthology.kill:2021-03-02 08:50:53,822.822 INFO:teuthology.orchestra.console:Power off smithi196 2021-03-02T08:50:53.835 INFO:teuthology.kill:2021-03-02 08:50:53,835.835 INFO:teuthology.orchestra.console:Power off smithi195 2021-03-02T08:51:02.188 INFO:teuthology.kill:2021-03-02 08:51:02,188.188 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2021-03-02T08:51:06.309 INFO:teuthology.kill:2021-03-02 08:51:06,309.309 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2021-03-02T08:51:06.544 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1'] 2021-03-02T08:51:06.545 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.2', 'osd.3', 'client.0'] 2021-03-02T08:51:06.545 INFO:teuthology.misc:Compressing logs... 2021-03-02T08:51:06.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-02T08:52:06.550 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/misc.py", line 1374, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-03-02T08:52:06.591 INFO:teuthology.kill:No teuthology processes running 2021-03-02T08:52:07.804 INFO:teuthology.kill:Nuking machines: ['smithi195', 'smithi196'] 2021-03-02T08:52:08.788 INFO:teuthology.kill:2021-03-02 08:52:08,788.788 INFO:teuthology.nuke:targets: 2021-03-02T08:52:08.789 INFO:teuthology.kill: smithi195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCr1OkSeYSppef4gBQpOkch/+sswMRfhu19EFg+Suk9O3OdrHVCd6drkTQfAh/yPOLohiR01T/INAUjKPdXF5u2WYwB6kDdGyib96KEeJbH5b2d6MGoTd2+Pmib1EATpZMQnqc8h0hfWSTFj/P/EwUmJBDKxMsunU9MlcCHIyJNTAZ0lL+4w70RwoqJ8fcoqqyKB3NfIi9jTETcLaQytcz463ZDxCzwjOwZfhW62mzuVwmASRzcpQ9iqVDz3CUjncmL9uyVwIXuJtmTUSTHGLZ+WEbTNDERrJwJmfD5Elx7L8MpOTYzcH9NZZVM2OUtRSfoPF+m9UGuElHj8fdtQf2X 2021-03-02T08:52:08.789 INFO:teuthology.kill: smithi196.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDG9POeCRLr9Rrt21KgnQw01Tv0Wzm4HzK8SMCgQgVQV07ORqcplu8o7AVqPa1ng7Lq86mZs7PTKrYXAu9xUET/IG9GAaCwGmECXBeK7ROPLHDImABIT6NuDR139T2WWu4/K4uD3t5LrzOjt+HhQziACtCtrR6uENfLk6hXDSHZhK2lUMwbH3DzvSb3Px3XBR/dQorzCcHOhI9c2IWRWBoYdrUHTvwgj9ck8WhjTuOJu8VCi1u3xtLndbaeBJY+EG/8wsmNfV9VBFLsr1eemdyEyy77x8XzGozNL/626H4S8zQAM/6IPaTIs+jlohPzGF3v9w3m872n2yPFdu9fFZrx 2021-03-02T08:52:08.811 INFO:teuthology.kill:2021-03-02 08:52:08,811.811 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-02T08:52:08.864 INFO:teuthology.kill:2021-03-02 08:52:08,814.814 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-02T08:52:08.911 INFO:teuthology.kill:2021-03-02 08:52:08,910.910 INFO:teuthology.orchestra.console:Power off smithi195 2021-03-02T08:52:08.924 INFO:teuthology.kill:2021-03-02 08:52:08,923.923 INFO:teuthology.orchestra.console:Power off smithi196 2021-03-02T08:52:09.099 INFO:teuthology.kill:2021-03-02 08:52:09,099.099 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2021-03-02T08:52:09.109 INFO:teuthology.kill:2021-03-02 08:52:09,109.109 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2021-03-02T08:52:09.245 INFO:teuthology.kill:2021-03-02 08:52:09,244.244 INFO:teuthology.lock.ops:unlocked smithi195.front.sepia.ceph.com 2021-03-02T08:52:09.248 INFO:teuthology.kill:2021-03-02 08:52:09,248.248 INFO:teuthology.lock.ops:unlocked smithi196.front.sepia.ceph.com 2021-03-02T08:54:09.436 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-03-02T08:54:09.508 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-03-02T08:54:09.509 INFO:teuthology.nuke:Checking targets against current locks 2021-03-02T08:54:09.583 INFO:teuthology.nuke:Not nuking smithi196.front.sepia.ceph.com because description doesn't match 2021-03-02T08:54:09.584 INFO:teuthology.nuke:Not nuking smithi195.front.sepia.ceph.com because description doesn't match