2022-02-19T19:09:22.373 INFO:root:teuthology version: 1.1.0-eea25212 2022-02-19T19:09:22.507 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi055.front.sepia.ceph.com' reimaging 2022-02-19T19:09:22.509 INFO:teuthology.lock.ops:Updating [ubuntu@smithi055.front.sepia.ceph.com]: reset os type and version on server 2022-02-19T19:09:22.509 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-02-19T19:09:22.528 INFO:teuthology.lock.ops:Node 'ubuntu@smithi055.front.sepia.ceph.com' reimaging is complete 2022-02-19T19:09:22.528 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi121.front.sepia.ceph.com' reimaging 2022-02-19T19:09:22.529 INFO:teuthology.lock.ops:Updating [ubuntu@smithi121.front.sepia.ceph.com]: reset os type and version on server 2022-02-19T19:09:22.529 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2022-02-19T19:09:22.547 INFO:teuthology.lock.ops:Node 'ubuntu@smithi121.front.sepia.ceph.com' reimaging is complete 2022-02-19T19:09:22.747 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 8.stream 2022-02-19T19:09:22.757 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 8.stream 2022-02-19T19:09:23.133 INFO:teuthology.orchestra.console:Power off smithi121 2022-02-19T19:09:23.148 INFO:teuthology.orchestra.console:Power off smithi055 2022-02-19T19:09:23.281 INFO:teuthology.orchestra.console:Power off for smithi121 completed 2022-02-19T19:09:23.292 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-02-19T19:09:23.383 INFO:teuthology.orchestra.console:Power on smithi121 2022-02-19T19:09:23.393 INFO:teuthology.orchestra.console:Power on smithi055 2022-02-19T19:09:27.635 INFO:teuthology.orchestra.console:Power on for smithi121 completed 2022-02-19T19:09:27.646 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2022-02-19T19:09:27.737 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2022-02-19T19:09:27.747 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2022-02-19T19:13:10.099 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-19T19:13:31.200 INFO:teuthology.provision.fog.smithi055:Node is ready 2022-02-19T19:13:31.222 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2022-02-19T19:13:31.280 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2022-02-19T19:13:31.666 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2022-02-19T19:14:08.860 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-19T19:14:09.103 INFO:teuthology.provision.fog.smithi121:Node is ready 2022-02-19T19:14:09.121 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2022-02-19T19:14:09.180 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2022-02-19T19:14:09.519 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2022-02-19T19:14:09.679 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2022-02-19T19:14:09.680 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-19T19:14:09.700 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2022-02-19T19:14:09.701 INFO:teuthology.lock.ops:New key found. Updating... 2022-02-19T19:14:09.720 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2022-02-19T19:14:09.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-02-19T19:14:09.970 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2022-02-19T19:14:10.029 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2022-02-19T19:14:10.030 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2022-02-19T19:14:10.030 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2022-02-19T19:14:10.030 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2022-02-19T19:14:10.031 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2022-02-19T19:14:10.031 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2022-02-19T19:14:10.032 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-19T19:14:10.032 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2022-02-19T19:14:10.033 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-19T19:14:10.033 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2022-02-19T19:14:10.033 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-19T19:14:10.033 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-19T19:14:10.033 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-19T19:14:10.035 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-02-19T19:14:10.056 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2022-02-19T19:14:10.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2022-02-19T19:14:10.248 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2022-02-19T19:14:10.305 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2022-02-19T19:14:10.305 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8" 2022-02-19T19:14:10.306 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2022-02-19T19:14:10.306 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2022-02-19T19:14:10.306 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8" 2022-02-19T19:14:10.306 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2022-02-19T19:14:10.307 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-19T19:14:10.307 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2022-02-19T19:14:10.307 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-19T19:14:10.307 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2022-02-19T19:14:10.307 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-19T19:14:10.308 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-19T19:14:10.308 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-19T19:14:10.309 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2022-02-19T19:14:10.422 INFO:teuthology.dispatcher.supervisor:Running job 6695627 2022-02-19T19:14:10.423 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-02-18_23:03:24-fs-wip-yuriw-quincy-2.18.22-distro-default-smithi/6695627 --name yuriw-2022-02-18_23:03:24-fs-wip-yuriw-quincy-2.18.22-distro-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} -- /home/teuthworker/archive/yuriw-2022-02-18_23:03:24-fs-wip-yuriw-quincy-2.18.22-distro-default-smithi/6695627/orig.config.yaml 2022-02-19T19:14:10.426 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-02-18_23:03:24-fs-wip-yuriw-quincy-2.18.22-distro-default-smithi/6695627 2022-02-19T19:14:10.427 INFO:teuthology.dispatcher.supervisor:Job PID: 11444 2022-02-19T19:14:10.428 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-02-20T01:44:39.183 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-02-20T01:44:39.419 INFO:teuthology.kill:Killing Pids: {11444} 2022-02-20T01:44:40.661 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2022-02-20T01:44:40.662 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2022-02-20T01:44:40.663 INFO:teuthology.misc:Compressing logs... 2022-02-20T01:44:40.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-02-20T01:44:42.507 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/dispatcher/supervisor.py", line 287, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/dispatcher/supervisor.py", line 345, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2022-02-20T01:44:42.575 INFO:teuthology.kill:No teuthology processes running 2022-02-20T01:44:43.743 INFO:teuthology.kill:Nuking machines: ['smithi055', 'smithi121'] 2022-02-20T01:44:44.750 INFO:teuthology.kill:2022-02-20 01:44:44,749.749 INFO:teuthology.nuke:targets: 2022-02-20T01:44:44.751 INFO:teuthology.kill: smithi055.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4606JbB+d+qKsKA1R2toVdx2DZXKxEgRTPy9fXAkUT3RU3l5x4UAUg/uxM9adJ0s9e9fgCJ9rmfdVTS7837wa0fnUOFwCAMobN8Pm622kDtxee1p2EJAwndz+2SPKpjhjDWU7VVjANPZ8uoiq2/6Kgsz3X7bkz1wd6RV9kXkrQ2KAT23rSYvUoeIWgI/6x7r60+JMt3RR5YgL0gLtG7vUafot4iN0ckAOSks+AC76kxVs1LYmIOXV6BlBfOvn0aDMgYehOw3w2fS1Fv9m9QagoqwU7Rwg2v4x26Ynls6ikga9UY+4rh6hTDELODzCGhANmf3bXd8oYbjZG+FbPWutuWoTM2ohBObMs2gOXFuyJapP/rYC2CiO0vpbjz3kWin+BmBk7ZafSXb2BhHuHEF57JNis5st+ez8j56U0EDxSLxqh29sdrVEqvR6Wy+cUfpVaQiS1ZehkiF16cOR0vNcUIT7mtNwkdR3TeOIRqFqHHIxIjH2k8/+3fiRNF1tkDk= 2022-02-20T01:44:44.751 INFO:teuthology.kill: smithi121.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZzJWEBLIdSZNvo0xqf4hph1QGgbmmpT4f9AfU2EibocHH8WCl26t96+9ZGp4zKhp5UlqhfEvyVWZiO8VqYY+NRqwEzLx46kGi+bE7eTMhcLLZeRSz+dBpvrSXbfR6BaQ6LVl6y6X/8QS0XS49KZojBvm0IPoom8l87HR9+LF7RCLx4KRcip2kA+TIuZNoxehoq1XWrYHncOrI+hkMRyGyt4XR7lW/1cHowH9+5e2BhS/G68FhxkBdHpg8zsK9tkz08pgqB9EMtPMFXS20q28rodRVUOZxlNGOU/BIgnChufs0+btXygX8t6rW/CKz0+Tl9PaRtutZksNw2VtKNBm0AGXjB3S7JMmFIQT0R1ZNZnakdbgGxR10UNSNbnJ228fzmQGsYNgaydFljy6WAjevbG1fiXSBt1I1aKp9BuPuiQQhHCtg5O7lG5dHU1DwekE8/rANThr+jmPqFZ2Z5JXCPTfaGsY4C5NCaZwQWpcnJxyP20hqs1QWtwXVaGoL8sE= 2022-02-20T01:44:44.777 INFO:teuthology.kill:2022-02-20 01:44:44,777.777 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-20T01:44:44.778 INFO:teuthology.kill:2022-02-20 01:44:44,778.778 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-20T01:44:44.851 INFO:teuthology.kill:2022-02-20 01:44:44,851.851 INFO:teuthology.orchestra.console:Power off smithi055 2022-02-20T01:44:44.866 INFO:teuthology.kill:2022-02-20 01:44:44,866.866 INFO:teuthology.orchestra.console:Power off smithi121 2022-02-20T01:44:57.338 INFO:teuthology.kill:2022-02-20 01:44:57,337.337 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-02-20T01:44:57.343 INFO:teuthology.kill:2022-02-20 01:44:57,343.343 INFO:teuthology.orchestra.console:Power off for smithi121 completed 2022-02-20T01:44:57.492 INFO:teuthology.kill:2022-02-20 01:44:57,491.491 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2022-02-20T01:44:57.501 INFO:teuthology.kill:2022-02-20 01:44:57,501.501 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com 2022-02-20T01:46:57.809 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-02-20T01:46:57.915 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi055 but it was locked by another job: /home/teuthworker/archive/pdonnell-2022-02-18_03:10:32-fs:workload-wip-pdonnell-testing-20220218.000925-distro-default-smithi/6693278 2022-02-20T01:46:57.915 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi121 but it was locked by another job: /home/teuthworker/archive/pdonnell-2022-02-18_03:10:32-fs:workload-wip-pdonnell-testing-20220218.000925-distro-default-smithi/6693278