2021-03-04T07:39:47.550 INFO:root:teuthology version: 1.1.0-3082387b 2021-03-04T07:39:47.627 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging 2021-03-04T07:39:47.628 INFO:teuthology.lock.ops:Updating [ubuntu@smithi164.front.sepia.ceph.com]: reset os type and version on server 2021-03-04T07:39:47.628 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2021-03-04T07:39:47.646 INFO:teuthology.lock.ops:Node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging is complete 2021-03-04T07:39:47.851 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 8.2 2021-03-04T07:39:48.135 INFO:teuthology.orchestra.console:Power off smithi164 2021-03-04T07:39:56.554 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2021-03-04T07:39:56.655 INFO:teuthology.orchestra.console:Power on smithi164 2021-03-04T07:40:05.079 INFO:teuthology.orchestra.console:Power on for smithi164 completed 2021-03-04T07:40:05.181 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2021-03-04T07:42:36.202 ERROR:teuthology.orchestra.connection:Error authenticating with smithi164.front.sepia.ceph.com: Authentication failed. 2021-03-04T07:42:37.273 ERROR:teuthology.orchestra.connection:Error authenticating with smithi164.front.sepia.ceph.com: Authentication failed. 2021-03-04T07:44:50.543 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-04T07:44:50.833 INFO:teuthology.provision.fog.smithi164:Node is ready 2021-03-04T07:44:50.847 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2021-03-04T07:44:50.902 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2021-03-04T07:44:51.225 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2021-03-04T07:44:51.338 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2021-03-04T07:44:51.338 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-04T07:44:51.354 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2021-03-04T07:44:51.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-04T07:44:51.617 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2021-03-04T07:44:51.672 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Linux" 2021-03-04T07:44:51.673 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8 (Core)" 2021-03-04T07:44:51.673 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2021-03-04T07:44:51.674 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2021-03-04T07:44:51.674 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8" 2021-03-04T07:44:51.675 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2021-03-04T07:44:51.675 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-03-04T07:44:51.675 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2021-03-04T07:44:51.676 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-03-04T07:44:51.676 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.centos.org/" 2021-03-04T07:44:51.677 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-03-04T07:44:51.677 INFO:teuthology.orchestra.run.smithi164.stdout: 2021-03-04T07:44:51.678 INFO:teuthology.orchestra.run.smithi164.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-03-04T07:44:51.678 INFO:teuthology.orchestra.run.smithi164.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-03-04T07:44:51.679 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-03-04T07:44:51.679 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-03-04T07:44:51.679 INFO:teuthology.orchestra.run.smithi164.stdout: 2021-03-04T07:44:51.682 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2021-03-04T07:44:51.774 INFO:teuthology.dispatcher.supervisor:Running job 5932489 2021-03-04T07:44:51.774 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/bin/teuthology -v --owner vshankar --archive /home/teuthworker/archive/vshankar-2021-03-04_07:31:42-fs-wip-cephfs-mirror-peer-bootstrap-20210304-005930-distro-basic-smithi/5932489 --name vshankar-2021-03-04_07:31:42-fs-wip-cephfs-mirror-peer-bootstrap-20210304-005930-distro-basic-smithi --description fs/mirror/{begin cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{centos_8} tasks/mirror} -- /home/teuthworker/archive/vshankar-2021-03-04_07:31:42-fs-wip-cephfs-mirror-peer-bootstrap-20210304-005930-distro-basic-smithi/5932489/orig.config.yaml 2021-03-04T07:44:51.777 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2021-03-04_07:31:42-fs-wip-cephfs-mirror-peer-bootstrap-20210304-005930-distro-basic-smithi/5932489 2021-03-04T07:44:51.778 INFO:teuthology.dispatcher.supervisor:Job PID: 26284 2021-03-04T07:44:51.779 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-03-04T19:45:09.545 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-03-04T19:45:09.774 INFO:teuthology.kill:Killing Pids: {26284} 2021-03-04T19:45:10.997 INFO:teuthology.kill:Nuking machines: ['smithi164'] 2021-03-04T19:45:12.026 INFO:teuthology.kill:2021-03-04 19:45:12,026.026 INFO:teuthology.nuke:targets: 2021-03-04T19:45:12.027 INFO:teuthology.kill: smithi164.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCigd/96TI6+NVgPLLrf5R4OPYH/Jc9bK/bIuGnaRlsnlX6wDpNgljmMCbj2NK3Eye6jGVLAHUon6kpFYSdA/k+zgxrkIj5cB+i9bRsEKs+mz06i7/p/Nwobzz7f/evX3b9BWC3PJzEPE0i9aWyEx76+l2+C9MUkL7FuHWZ3v9xjSR/pKcINhIcIAjFKidqIMH2l/GusaEiYwLdk76Zkwupetafx4MMnvhkTsxQ06/zcGoWLfC9tR/fC+eL2dGOM/FxT/ZV+T4o5pQGupjZMe0pytv7tbiwhVW4wBF1aTWJZ0I+G7nwXXtJR4hrIPgSqUoXjkO6+i/NMAlewW9vzQhcrTbhq5axm7ms2xeLyzjmNsP7JwGFUOIw1rDjOi/Yoz9Aa4ov1PEtr21mFMcNjBUHh29qppy6TdnHkTJ+OvLgBbK5PRaiRiQxcjqo6WVIO5vemJu4ZtXZw71eYuOTsh5AVa/UOt2HvZEdMU9JCGrfuxbBhQV3wZYkDjRgyXSHURE= 2021-03-04T19:45:12.027 INFO:teuthology.kill:2021-03-04 19:45:12,026.026 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-04T19:45:12.092 INFO:teuthology.kill:2021-03-04 19:45:12,092.092 INFO:teuthology.orchestra.console:Power off smithi164 2021-03-04T19:45:24.591 INFO:teuthology.kill:2021-03-04 19:45:24,590.590 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2021-03-04T19:45:24.875 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.b', 'mds.c', 'mds.d', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1', 'client.mirror', 'client.mirror_remote'] 2021-03-04T19:45:24.876 INFO:teuthology.misc:Compressing logs... 2021-03-04T19:45:24.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-04T19:46:24.883 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/misc.py", line 1374, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-03-04T19:46:24.942 INFO:teuthology.kill:No teuthology processes running 2021-03-04T19:46:26.022 INFO:teuthology.kill:Nuking machines: ['smithi164'] 2021-03-04T19:46:27.003 INFO:teuthology.kill:2021-03-04 19:46:27,003.003 INFO:teuthology.nuke:targets: 2021-03-04T19:46:27.004 INFO:teuthology.kill: smithi164.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCigd/96TI6+NVgPLLrf5R4OPYH/Jc9bK/bIuGnaRlsnlX6wDpNgljmMCbj2NK3Eye6jGVLAHUon6kpFYSdA/k+zgxrkIj5cB+i9bRsEKs+mz06i7/p/Nwobzz7f/evX3b9BWC3PJzEPE0i9aWyEx76+l2+C9MUkL7FuHWZ3v9xjSR/pKcINhIcIAjFKidqIMH2l/GusaEiYwLdk76Zkwupetafx4MMnvhkTsxQ06/zcGoWLfC9tR/fC+eL2dGOM/FxT/ZV+T4o5pQGupjZMe0pytv7tbiwhVW4wBF1aTWJZ0I+G7nwXXtJR4hrIPgSqUoXjkO6+i/NMAlewW9vzQhcrTbhq5axm7ms2xeLyzjmNsP7JwGFUOIw1rDjOi/Yoz9Aa4ov1PEtr21mFMcNjBUHh29qppy6TdnHkTJ+OvLgBbK5PRaiRiQxcjqo6WVIO5vemJu4ZtXZw71eYuOTsh5AVa/UOt2HvZEdMU9JCGrfuxbBhQV3wZYkDjRgyXSHURE= 2021-03-04T19:46:27.025 INFO:teuthology.kill:2021-03-04 19:46:27,025.025 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-04T19:46:27.084 INFO:teuthology.kill:2021-03-04 19:46:27,084.084 INFO:teuthology.orchestra.console:Power off smithi164 2021-03-04T19:46:27.239 INFO:teuthology.kill:2021-03-04 19:46:27,238.238 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2021-03-04T19:46:27.383 INFO:teuthology.kill:2021-03-04 19:46:27,382.382 INFO:teuthology.lock.ops:unlocked smithi164.front.sepia.ceph.com 2021-03-04T19:48:27.667 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15