2021-02-15T15:46:40.148 INFO:root:teuthology version: 1.1.0-64d5f180 2021-02-15T15:46:40.257 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging 2021-02-15T15:46:40.257 INFO:teuthology.lock.ops:Updating [ubuntu@smithi155.front.sepia.ceph.com]: reset os type and version on server 2021-02-15T15:46:40.257 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2021-02-15T15:46:40.272 INFO:teuthology.lock.ops:Node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging is complete 2021-02-15T15:46:40.272 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi180.front.sepia.ceph.com' reimaging 2021-02-15T15:46:40.272 INFO:teuthology.lock.ops:Updating [ubuntu@smithi180.front.sepia.ceph.com]: reset os type and version on server 2021-02-15T15:46:40.272 INFO:teuthology.lock.ops:Updating smithi180.front.sepia.ceph.com on lock server 2021-02-15T15:46:40.289 INFO:teuthology.lock.ops:Node 'ubuntu@smithi180.front.sepia.ceph.com' reimaging is complete 2021-02-15T15:46:40.474 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 8.2 2021-02-15T15:46:40.491 INFO:teuthology.provision.fog.smithi180:Scheduling deploy of centos 8.2 2021-02-15T15:46:40.764 INFO:teuthology.orchestra.console:Power off smithi155 2021-02-15T15:46:40.779 INFO:teuthology.orchestra.console:Power off smithi180 2021-02-15T15:46:40.915 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2021-02-15T15:46:40.925 INFO:teuthology.orchestra.console:Power off for smithi180 completed 2021-02-15T15:46:41.016 INFO:teuthology.orchestra.console:Power on smithi155 2021-02-15T15:46:41.027 INFO:teuthology.orchestra.console:Power on smithi180 2021-02-15T15:46:45.283 INFO:teuthology.orchestra.console:Power on for smithi155 completed 2021-02-15T15:46:45.290 INFO:teuthology.orchestra.console:Power on for smithi180 completed 2021-02-15T15:46:45.384 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2021-02-15T15:46:45.391 INFO:teuthology.provision.fog.smithi180:Waiting for deploy to finish 2021-02-15T15:50:39.806 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-15T15:51:00.638 INFO:teuthology.provision.fog.smithi180:Node is ready 2021-02-15T15:51:00.656 INFO:teuthology.orchestra.run.smithi180.stdout:smithi180.front.sepia.ceph.com 2021-02-15T15:51:00.712 INFO:teuthology.orchestra.run.smithi180.stdout:172.21.15.180 smithi180.front.sepia.ceph.com smithi180 2021-02-15T15:51:01.051 INFO:teuthology.provision.fog.smithi180:Deploy complete! 2021-02-15T15:51:38.383 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-15T15:51:38.702 INFO:teuthology.provision.fog.smithi155:Node is ready 2021-02-15T15:51:38.716 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2021-02-15T15:51:38.771 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2021-02-15T15:51:39.091 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2021-02-15T15:51:39.398 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2021-02-15T15:51:39.399 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-15T15:51:39.417 INFO:teuthology.lock.ops:Checking smithi180.front.sepia.ceph.com 2021-02-15T15:51:39.417 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-15T15:51:39.432 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2021-02-15T15:51:39.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-15T15:51:39.694 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2021-02-15T15:51:39.748 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Linux" 2021-02-15T15:51:39.748 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8 (Core)" 2021-02-15T15:51:39.748 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2021-02-15T15:51:39.748 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2021-02-15T15:51:39.748 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8" 2021-02-15T15:51:39.749 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2021-02-15T15:51:39.749 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-02-15T15:51:39.749 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2021-02-15T15:51:39.749 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-02-15T15:51:39.749 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.centos.org/" 2021-02-15T15:51:39.749 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-15T15:51:39.749 INFO:teuthology.orchestra.run.smithi155.stdout: 2021-02-15T15:51:39.749 INFO:teuthology.orchestra.run.smithi155.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-02-15T15:51:39.749 INFO:teuthology.orchestra.run.smithi155.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-02-15T15:51:39.749 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-15T15:51:39.749 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-02-15T15:51:39.749 INFO:teuthology.orchestra.run.smithi155.stdout: 2021-02-15T15:51:39.751 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2021-02-15T15:51:39.770 INFO:teuthology.lock.ops:Updating [smithi180.front.sepia.ceph.com]: set os type and version on server 2021-02-15T15:51:39.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-15T15:51:40.056 INFO:teuthology.orchestra.run.smithi180.stdout:x86_64 2021-02-15T15:51:40.114 INFO:teuthology.orchestra.run.smithi180.stdout:NAME="CentOS Linux" 2021-02-15T15:51:40.115 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION="8 (Core)" 2021-02-15T15:51:40.115 INFO:teuthology.orchestra.run.smithi180.stdout:ID="centos" 2021-02-15T15:51:40.115 INFO:teuthology.orchestra.run.smithi180.stdout:ID_LIKE="rhel fedora" 2021-02-15T15:51:40.115 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION_ID="8" 2021-02-15T15:51:40.115 INFO:teuthology.orchestra.run.smithi180.stdout:PLATFORM_ID="platform:el8" 2021-02-15T15:51:40.116 INFO:teuthology.orchestra.run.smithi180.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-02-15T15:51:40.116 INFO:teuthology.orchestra.run.smithi180.stdout:ANSI_COLOR="0;31" 2021-02-15T15:51:40.116 INFO:teuthology.orchestra.run.smithi180.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-02-15T15:51:40.116 INFO:teuthology.orchestra.run.smithi180.stdout:HOME_URL="https://www.centos.org/" 2021-02-15T15:51:40.116 INFO:teuthology.orchestra.run.smithi180.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-15T15:51:40.116 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-02-15T15:51:40.117 INFO:teuthology.orchestra.run.smithi180.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-02-15T15:51:40.117 INFO:teuthology.orchestra.run.smithi180.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-02-15T15:51:40.117 INFO:teuthology.orchestra.run.smithi180.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-15T15:51:40.117 INFO:teuthology.orchestra.run.smithi180.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-02-15T15:51:40.117 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-02-15T15:51:40.118 INFO:teuthology.lock.ops:Updating smithi180.front.sepia.ceph.com on lock server 2021-02-15T15:51:40.220 INFO:teuthology.dispatcher.supervisor:Running job 5884252 2021-02-15T15:51:40.220 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-02-15_15:21:14-rados-wip-sage2-testing-2021-02-10-1604-distro-basic-smithi/5884252 --name sage-2021-02-15_15:21:14-rados-wip-sage2-testing-2021-02-10-1604-distro-basic-smithi --description rados/cephadm/thrash/{0-distro/centos_latest 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} -- /home/teuthworker/archive/sage-2021-02-15_15:21:14-rados-wip-sage2-testing-2021-02-10-1604-distro-basic-smithi/5884252/orig.config.yaml 2021-02-15T15:51:40.230 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-02-15_15:21:14-rados-wip-sage2-testing-2021-02-10-1604-distro-basic-smithi/5884252 2021-02-15T15:51:40.230 INFO:teuthology.dispatcher.supervisor:Job PID: 2658 2021-02-15T15:51:40.230 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-02-16T03:52:00.309 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-02-16T03:52:00.934 INFO:teuthology.kill:Killing Pids: {2658} 2021-02-16T03:52:02.167 INFO:teuthology.kill:Nuking machines: ['smithi155', 'smithi180'] 2021-02-16T03:52:03.125 INFO:teuthology.kill:2021-02-16 03:52:03,124.124 INFO:teuthology.nuke:targets: 2021-02-16T03:52:03.125 INFO:teuthology.kill: smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbM5+Lmy1NMwFFezwiczWlhr4oFWUYUFvI8gUOQmGV6PokZq5XgqtR13zgYvQcB5YCNN9c4T034BxoW0CzFWb4Mci4tSrJeKfEYVLCvA8VZAmkhC+EdFN8RdzqI+4cUE+bmnpWPkM36E6MAnKHgyX+l1JJ0xzqDQcgtAYBz3//Fm2McsTansE72e1DHTrAac2MNLyWQy3IegdYRg/sYF/v2psZWaCx2c2rZavOc8LsqYTcPR877VlNZnncv9UtJG+xkT6UO99HAYj0gi+nSvSpiJcCDsWAuxG03DqKICOlC6fUhn5NSvd9QXxCrmvYKQ/SN6dHxqbAufdlN2e49bHUGJ2x4roezIO98x/gcOnLQmp5wSGPDBZfRqfwt/UaDzF5aqPdPEq3SL0128twIE2P8b/tO3memd6CS9DcCHIyQzlpQnmwEkM01M7NZ5jYnl7nbT5WXEbSSqWJ/0+KPi0nW0soqU/qgsOM7yOXpAbCUO7Znh/UBYtLklGhyGiFE7c= 2021-02-16T03:52:03.125 INFO:teuthology.kill: smithi180.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaddr2khwHC29u9A2zON+XqD/ByFpirjcy6/82ueFplmTVi/85uWvLeWW/hP21kULLcaSyAEkbSmLdhZOf9He4mzIttnJ/rGjeahz4gUH1XJGMxRfs3K7+2UtQEmvnbRYuMemV5h35J+YW2ZCcLRW6hBJsN5iekdKLHuMkk8flESuQrgicgqgzKPmBL9JG7kS4vmYOxYBdbpkTooUugcfP8dt8nBFeDitslGW/6vm5b2qga4pi1sZmpRo6nlOe8kP4I87WrSZRwhibw5WwzY2vBRSCw/kt4Pn2tBt4r1KagN78wpvFNOzmyYoY6yaMSVo7qyAjrMzHHbZt09QEYWBFw+knUxVZZ8FdyUtUVe6WCjmZGmfXrm2mOy6EKYYZjHXrOCL4hlPd+c86SWqMd4euUPcONOVThxNbuw9xVSYfYcrPl3FMTCjuUPz46DgdnbtzxFxtrUC+d9vd4DU78/zMTKLo1DP35rLAhhszpmzypBMeAlmOEUqR4RfQDZwBRUU= 2021-02-16T03:52:03.125 INFO:teuthology.kill:2021-02-16 03:52:03,125.125 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-16T03:52:03.132 INFO:teuthology.kill:2021-02-16 03:52:03,131.131 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-16T03:52:03.189 INFO:teuthology.kill:2021-02-16 03:52:03,189.189 INFO:teuthology.orchestra.console:Power off smithi155 2021-02-16T03:52:03.202 INFO:teuthology.kill:2021-02-16 03:52:03,202.202 INFO:teuthology.orchestra.console:Power off smithi180 2021-02-16T03:52:11.558 INFO:teuthology.kill:2021-02-16 03:52:11,558.558 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2021-02-16T03:52:11.564 INFO:teuthology.kill:2021-02-16 03:52:11,564.564 INFO:teuthology.orchestra.console:Power off for smithi180 completed 2021-02-16T03:52:12.023 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.realm.zone.a', 'node-exporter.a', 'alertmanager.a'] 2021-02-16T03:52:12.024 INFO:teuthology.task.internal:roles: ubuntu@smithi180.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2021-02-16T03:52:12.027 INFO:teuthology.misc:Compressing logs... 2021-02-16T03:52:12.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-16T03:53:12.138 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/misc.py", line 1372, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-02-16T03:53:12.264 INFO:teuthology.kill:No teuthology processes running 2021-02-16T03:53:13.928 INFO:teuthology.kill:Nuking machines: ['smithi155', 'smithi180'] 2021-02-16T03:53:15.116 INFO:teuthology.kill:2021-02-16 03:53:15,115.115 INFO:teuthology.nuke:targets: 2021-02-16T03:53:15.116 INFO:teuthology.kill: smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbM5+Lmy1NMwFFezwiczWlhr4oFWUYUFvI8gUOQmGV6PokZq5XgqtR13zgYvQcB5YCNN9c4T034BxoW0CzFWb4Mci4tSrJeKfEYVLCvA8VZAmkhC+EdFN8RdzqI+4cUE+bmnpWPkM36E6MAnKHgyX+l1JJ0xzqDQcgtAYBz3//Fm2McsTansE72e1DHTrAac2MNLyWQy3IegdYRg/sYF/v2psZWaCx2c2rZavOc8LsqYTcPR877VlNZnncv9UtJG+xkT6UO99HAYj0gi+nSvSpiJcCDsWAuxG03DqKICOlC6fUhn5NSvd9QXxCrmvYKQ/SN6dHxqbAufdlN2e49bHUGJ2x4roezIO98x/gcOnLQmp5wSGPDBZfRqfwt/UaDzF5aqPdPEq3SL0128twIE2P8b/tO3memd6CS9DcCHIyQzlpQnmwEkM01M7NZ5jYnl7nbT5WXEbSSqWJ/0+KPi0nW0soqU/qgsOM7yOXpAbCUO7Znh/UBYtLklGhyGiFE7c= 2021-02-16T03:53:15.116 INFO:teuthology.kill: smithi180.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaddr2khwHC29u9A2zON+XqD/ByFpirjcy6/82ueFplmTVi/85uWvLeWW/hP21kULLcaSyAEkbSmLdhZOf9He4mzIttnJ/rGjeahz4gUH1XJGMxRfs3K7+2UtQEmvnbRYuMemV5h35J+YW2ZCcLRW6hBJsN5iekdKLHuMkk8flESuQrgicgqgzKPmBL9JG7kS4vmYOxYBdbpkTooUugcfP8dt8nBFeDitslGW/6vm5b2qga4pi1sZmpRo6nlOe8kP4I87WrSZRwhibw5WwzY2vBRSCw/kt4Pn2tBt4r1KagN78wpvFNOzmyYoY6yaMSVo7qyAjrMzHHbZt09QEYWBFw+knUxVZZ8FdyUtUVe6WCjmZGmfXrm2mOy6EKYYZjHXrOCL4hlPd+c86SWqMd4euUPcONOVThxNbuw9xVSYfYcrPl3FMTCjuUPz46DgdnbtzxFxtrUC+d9vd4DU78/zMTKLo1DP35rLAhhszpmzypBMeAlmOEUqR4RfQDZwBRUU= 2021-02-16T03:53:15.145 INFO:teuthology.kill:2021-02-16 03:53:15,144.144 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-16T03:53:15.148 INFO:teuthology.kill:2021-02-16 03:53:15,147.147 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-16T03:53:15.206 INFO:teuthology.kill:2021-02-16 03:53:15,206.206 INFO:teuthology.orchestra.console:Power off smithi155 2021-02-16T03:53:15.226 INFO:teuthology.kill:2021-02-16 03:53:15,225.225 INFO:teuthology.orchestra.console:Power off smithi180 2021-02-16T03:53:15.446 INFO:teuthology.kill:2021-02-16 03:53:15,446.446 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2021-02-16T03:53:15.492 INFO:teuthology.kill:2021-02-16 03:53:15,492.492 INFO:teuthology.orchestra.console:Power off for smithi180 completed 2021-02-16T03:53:15.601 INFO:teuthology.kill:2021-02-16 03:53:15,600.600 INFO:teuthology.lock.ops:unlocked smithi155.front.sepia.ceph.com 2021-02-16T03:53:15.641 INFO:teuthology.kill:2021-02-16 03:53:15,640.640 INFO:teuthology.lock.ops:unlocked smithi180.front.sepia.ceph.com 2021-02-16T03:55:15.879 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-02-16T03:55:15.971 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-02-16T03:55:15.973 INFO:teuthology.nuke:Checking targets against current locks 2021-02-16T03:55:16.212 INFO:teuthology.nuke:Not nuking smithi155.front.sepia.ceph.com because description doesn't match 2021-02-16T03:55:16.213 INFO:teuthology.nuke:Not nuking smithi180.front.sepia.ceph.com because description doesn't match