2021-02-27T13:11:47.781 INFO:root:teuthology version: 1.1.0-9a6b849c 2021-02-27T13:11:47.996 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging 2021-02-27T13:11:47.997 INFO:teuthology.lock.ops:Updating [ubuntu@smithi017.front.sepia.ceph.com]: reset os type and version on server 2021-02-27T13:11:47.997 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2021-02-27T13:11:48.012 INFO:teuthology.lock.ops:Node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging is complete 2021-02-27T13:11:48.013 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi028.front.sepia.ceph.com' reimaging 2021-02-27T13:11:48.013 INFO:teuthology.lock.ops:Updating [ubuntu@smithi028.front.sepia.ceph.com]: reset os type and version on server 2021-02-27T13:11:48.013 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2021-02-27T13:11:48.029 INFO:teuthology.lock.ops:Node 'ubuntu@smithi028.front.sepia.ceph.com' reimaging is complete 2021-02-27T13:11:48.029 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging 2021-02-27T13:11:48.030 INFO:teuthology.lock.ops:Updating [ubuntu@smithi081.front.sepia.ceph.com]: reset os type and version on server 2021-02-27T13:11:48.030 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2021-02-27T13:11:48.046 INFO:teuthology.lock.ops:Node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging is complete 2021-02-27T13:11:48.047 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi094.front.sepia.ceph.com' reimaging 2021-02-27T13:11:48.047 INFO:teuthology.lock.ops:Updating [ubuntu@smithi094.front.sepia.ceph.com]: reset os type and version on server 2021-02-27T13:11:48.048 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2021-02-27T13:11:48.065 INFO:teuthology.lock.ops:Node 'ubuntu@smithi094.front.sepia.ceph.com' reimaging is complete 2021-02-27T13:11:48.065 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi139.front.sepia.ceph.com' reimaging 2021-02-27T13:11:48.066 INFO:teuthology.lock.ops:Updating [ubuntu@smithi139.front.sepia.ceph.com]: reset os type and version on server 2021-02-27T13:11:48.066 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2021-02-27T13:11:48.082 INFO:teuthology.lock.ops:Node 'ubuntu@smithi139.front.sepia.ceph.com' reimaging is complete 2021-02-27T13:11:48.298 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 7.8 2021-02-27T13:11:48.304 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of centos 7.8 2021-02-27T13:11:48.343 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 7.8 2021-02-27T13:11:48.358 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of centos 7.8 2021-02-27T13:11:48.373 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of centos 7.8 2021-02-27T13:11:48.764 INFO:teuthology.orchestra.console:Power off smithi017 2021-02-27T13:11:48.797 INFO:teuthology.orchestra.console:Power off smithi028 2021-02-27T13:11:48.812 INFO:teuthology.orchestra.console:Power off smithi094 2021-02-27T13:11:48.877 INFO:teuthology.orchestra.console:Power off smithi081 2021-02-27T13:11:48.907 INFO:teuthology.orchestra.console:Power off smithi139 2021-02-27T13:11:49.041 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2021-02-27T13:11:49.142 INFO:teuthology.orchestra.console:Power on smithi081 2021-02-27T13:11:57.249 INFO:teuthology.orchestra.console:Power off for smithi028 completed 2021-02-27T13:11:57.266 INFO:teuthology.orchestra.console:Power off for smithi094 completed 2021-02-27T13:11:57.352 INFO:teuthology.orchestra.console:Power on smithi028 2021-02-27T13:11:57.374 INFO:teuthology.orchestra.console:Power on smithi094 2021-02-27T13:11:57.531 INFO:teuthology.orchestra.console:Power on for smithi081 completed 2021-02-27T13:11:57.633 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2021-02-27T13:12:01.335 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2021-02-27T13:12:01.391 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2021-02-27T13:12:01.437 INFO:teuthology.orchestra.console:Power on smithi017 2021-02-27T13:12:01.492 INFO:teuthology.orchestra.console:Power on smithi139 2021-02-27T13:12:05.701 INFO:teuthology.orchestra.console:Power on for smithi017 completed 2021-02-27T13:12:05.750 INFO:teuthology.orchestra.console:Power on for smithi139 completed 2021-02-27T13:12:05.773 INFO:teuthology.orchestra.console:Power on for smithi028 completed 2021-02-27T13:12:05.803 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2021-02-27T13:12:05.839 INFO:teuthology.orchestra.console:Power on for smithi094 completed 2021-02-27T13:12:05.851 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2021-02-27T13:12:05.874 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish 2021-02-27T13:12:05.940 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish 2021-02-27T13:16:11.410 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-27T13:16:13.842 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-27T13:16:14.418 INFO:teuthology.provision.fog.smithi028:Node is ready 2021-02-27T13:16:14.508 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com 2021-02-27T13:16:14.583 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028 2021-02-27T13:16:15.129 INFO:teuthology.provision.fog.smithi028:Deploy complete! 2021-02-27T13:16:22.805 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-27T13:16:23.383 INFO:teuthology.provision.fog.smithi017:Node is ready 2021-02-27T13:16:23.485 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2021-02-27T13:16:23.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2021-02-27T13:16:24.201 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2021-02-27T13:16:27.017 INFO:teuthology.provision.fog.smithi139:Node is ready 2021-02-27T13:16:27.140 INFO:teuthology.orchestra.run.smithi139.stdout:smithi061 2021-02-27T13:16:30.834 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-27T13:16:31.004 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2021-02-27T13:16:31.433 INFO:teuthology.provision.fog.smithi081:Node is ready 2021-02-27T13:16:31.539 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 2021-02-27T13:16:31.623 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2021-02-27T13:16:32.083 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2021-02-27T13:16:38.174 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-27T13:16:38.715 INFO:teuthology.provision.fog.smithi094:Node is ready 2021-02-27T13:16:38.792 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094 2021-02-27T13:16:38.853 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094 2021-02-27T13:16:39.388 INFO:teuthology.provision.fog.smithi094:Deploy complete! 2021-02-27T13:16:39.717 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2021-02-27T13:16:39.722 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-27T13:16:39.738 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com 2021-02-27T13:16:39.739 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-27T13:16:39.752 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2021-02-27T13:16:39.753 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-27T13:16:39.766 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com 2021-02-27T13:16:39.767 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-27T13:16:39.780 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2021-02-27T13:16:39.781 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-27T13:16:39.797 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2021-02-27T13:16:39.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-27T13:16:40.390 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2021-02-27T13:16:40.475 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Linux" 2021-02-27T13:16:40.475 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="7 (Core)" 2021-02-27T13:16:40.476 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2021-02-27T13:16:40.476 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2021-02-27T13:16:40.476 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="7" 2021-02-27T13:16:40.476 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2021-02-27T13:16:40.477 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2021-02-27T13:16:40.477 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2021-02-27T13:16:40.477 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.centos.org/" 2021-02-27T13:16:40.477 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-27T13:16:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: 2021-02-27T13:16:40.478 INFO:teuthology.orchestra.run.smithi017.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2021-02-27T13:16:40.479 INFO:teuthology.orchestra.run.smithi017.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2021-02-27T13:16:40.479 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-27T13:16:40.479 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2021-02-27T13:16:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: 2021-02-27T13:16:40.481 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2021-02-27T13:16:40.496 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server 2021-02-27T13:16:40.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-27T13:16:41.076 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2021-02-27T13:16:41.146 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Linux" 2021-02-27T13:16:41.146 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="7 (Core)" 2021-02-27T13:16:41.147 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2021-02-27T13:16:41.147 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2021-02-27T13:16:41.148 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="7" 2021-02-27T13:16:41.148 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2021-02-27T13:16:41.148 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2021-02-27T13:16:41.149 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2021-02-27T13:16:41.149 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://www.centos.org/" 2021-02-27T13:16:41.149 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-27T13:16:41.150 INFO:teuthology.orchestra.run.smithi028.stdout: 2021-02-27T13:16:41.150 INFO:teuthology.orchestra.run.smithi028.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2021-02-27T13:16:41.151 INFO:teuthology.orchestra.run.smithi028.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2021-02-27T13:16:41.151 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-27T13:16:41.151 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2021-02-27T13:16:41.152 INFO:teuthology.orchestra.run.smithi028.stdout: 2021-02-27T13:16:41.153 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2021-02-27T13:16:41.171 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2021-02-27T13:16:41.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-27T13:16:41.727 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2021-02-27T13:16:41.786 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Linux" 2021-02-27T13:16:41.786 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="7 (Core)" 2021-02-27T13:16:41.786 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2021-02-27T13:16:41.787 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2021-02-27T13:16:41.787 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="7" 2021-02-27T13:16:41.787 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2021-02-27T13:16:41.787 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2021-02-27T13:16:41.788 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2021-02-27T13:16:41.788 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.centos.org/" 2021-02-27T13:16:41.788 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-27T13:16:41.788 INFO:teuthology.orchestra.run.smithi081.stdout: 2021-02-27T13:16:41.788 INFO:teuthology.orchestra.run.smithi081.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2021-02-27T13:16:41.789 INFO:teuthology.orchestra.run.smithi081.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2021-02-27T13:16:41.789 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-27T13:16:41.789 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2021-02-27T13:16:41.789 INFO:teuthology.orchestra.run.smithi081.stdout: 2021-02-27T13:16:41.790 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2021-02-27T13:16:41.828 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server 2021-02-27T13:16:41.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-27T13:16:42.388 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2021-02-27T13:16:42.455 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Linux" 2021-02-27T13:16:42.456 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="7 (Core)" 2021-02-27T13:16:42.456 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2021-02-27T13:16:42.457 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2021-02-27T13:16:42.457 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="7" 2021-02-27T13:16:42.458 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2021-02-27T13:16:42.458 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2021-02-27T13:16:42.458 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2021-02-27T13:16:42.459 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.centos.org/" 2021-02-27T13:16:42.459 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-27T13:16:42.459 INFO:teuthology.orchestra.run.smithi094.stdout: 2021-02-27T13:16:42.459 INFO:teuthology.orchestra.run.smithi094.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2021-02-27T13:16:42.460 INFO:teuthology.orchestra.run.smithi094.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2021-02-27T13:16:42.460 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-27T13:16:42.461 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2021-02-27T13:16:42.461 INFO:teuthology.orchestra.run.smithi094.stdout: 2021-02-27T13:16:42.462 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2021-02-27T13:16:42.480 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2021-02-27T13:16:42.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-27T13:16:43.079 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2021-02-27T13:16:43.143 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Linux" 2021-02-27T13:16:43.143 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="7 (Core)" 2021-02-27T13:16:43.143 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2021-02-27T13:16:43.144 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2021-02-27T13:16:43.144 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="7" 2021-02-27T13:16:43.144 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2021-02-27T13:16:43.144 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2021-02-27T13:16:43.145 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2021-02-27T13:16:43.145 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.centos.org/" 2021-02-27T13:16:43.145 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-27T13:16:43.145 INFO:teuthology.orchestra.run.smithi139.stdout: 2021-02-27T13:16:43.145 INFO:teuthology.orchestra.run.smithi139.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2021-02-27T13:16:43.146 INFO:teuthology.orchestra.run.smithi139.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2021-02-27T13:16:43.146 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-27T13:16:43.146 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2021-02-27T13:16:43.146 INFO:teuthology.orchestra.run.smithi139.stdout: 2021-02-27T13:16:43.147 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2021-02-27T13:16:43.267 INFO:teuthology.dispatcher.supervisor:Running job 5916582 2021-02-27T13:16:43.268 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi/5916582 --name yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi --description upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-nautilus 6.1-msgr2 7-final-workload/{rbd-python rgw-swift-ragweed_check snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/centos_latest thrashosds-health} -- /home/teuthworker/archive/yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi/5916582/orig.config.yaml 2021-02-27T13:16:43.273 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-02-26_18:23:02-upgrade:mimic-x-wip-yuri2-testing-2021-02-26-0845-nautilus-distro-basic-smithi/5916582 2021-02-27T13:16:43.274 INFO:teuthology.dispatcher.supervisor:Job PID: 31501 2021-02-27T13:16:43.275 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-02-28T01:16:59.685 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-02-28T01:16:59.931 INFO:teuthology.kill:Killing Pids: {31501} 2021-02-28T01:17:00.927 INFO:teuthology.kill:Nuking machines: ['smithi017', 'smithi028', 'smithi081', 'smithi094', 'smithi139'] 2021-02-28T01:17:01.794 INFO:teuthology.kill:2021-02-28 01:17:01,793.793 INFO:teuthology.nuke:targets: 2021-02-28T01:17:01.795 INFO:teuthology.kill: smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC7cf5KtjwAc5JubhpHnbKe9CocWK2jPw+o1SDxwlkoiIxReZ2sHkQXdiQ4s531j+Xs5dRdaa5NxtQE8H3qDdGyk8m9uQYpKnxjoYpbMksynorJ6VYR2756NKmDhVoXlOnO2Z8L48YG1prgxAScUismLgs/qagwwghuhdB5XgYTKvmkJ45wbm4Twby92GXZ6Fr6rkwbJYtJEwY5O4ITuVZEDFhTpc7Pl/vWDHTxPB2kfGNQkNjGRAd4s46BzDvDa9z84ANpPf70zlzS2iOjxG4/fIqfclhub5MJgvmu5G+oW1P9KtvhlDmQYNVOWsCMslqIvP2kQow6jnmmTUql08tJ 2021-02-28T01:17:01.795 INFO:teuthology.kill: smithi028.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVdP9fhNhDkauXdsqZT3AH9vJlncX4cLjcg+elrxgryx8XF2YtliWu6e0TU/kp/p4naTI5NtLEMJvRdnGiQEMazHdasRfbXAIfU+nTrtBSmnA345clz15SpSr6C2g2HFNs2FhW+o1Y5juax6yUfrGSo3L5wZLptDc6PFFmccTHOGuSaaBDSMx1yer9LbXbneOsxvkRvLCQSXDMoBz6J7aF8BVjVuZ5ZOwAMBnET1NK4ysgCfoFjCDziaXPIMMOIk9JmhCAJiK9x7V1E6RXI0qS3m3rB5U5ezAUo9SsHnXwFA+rRtBLJV9sWFdQkoS7ucjJFyWxVtsdLPNHL3MVRW49 2021-02-28T01:17:01.796 INFO:teuthology.kill: smithi081.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhspzjYlR7fZBNAjR56NL32MlJPtQkC6MytKgYybSAWsde3Wow2EpJtyGXBFqTrCKL6P8JEKhzIOSlU7gKm/h6QUtq8iUVxgOZnMgT3Lnj8YOLLtWJkkNKPtczjHGfHbz5k3hp0m5vQM3KWTLhyEfqQJuLBOEk7FunnizDsbnmNXJKmyl0sUWFMuU2ZTJ3NZUjAUcQ3hNNXqWNoLcN7hPMtOxwmNcytai13oQfOLSjQv7CspGEjxUYc+hBNZDmScsDR1DsbIKkzwni5MobZQw43lZCVykPCxDxRy0zdL9uslQQng/mk0J8Gq1YRaANs+txrRv5FUjW15WRvqBkSVB 2021-02-28T01:17:01.796 INFO:teuthology.kill: smithi094.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCu93BnSFC+1YEVKkCL4XBoY+1tOvoUA3Q7EeYRDe01Ius7HEf9dkwxUGuRxDIXursbiDei+QomHLFaKIhez1pBFeHL1um/XQHyVQI9At9LCmwFYrglSqgATLNiK/bibRzXed/H0vQCBQUJfsIsveI4SN1/LeNdLv7/vKEDxii94dyGEjdfo4h8uhaWvtGHuFz/oLPQxzAXNkViXTI+h84AwAfgIXYf2Ddt3p3qZn7/Cq2OXr1hfe1FDPXuOzRGfQLgkve3E1HxZG+pgF0n1kWelma6zqK8jQrfIUYm482UIzupsyZvZJkPFgWA5igmXENfF/SPpzItJCgLBCl+v97J 2021-02-28T01:17:01.797 INFO:teuthology.kill: smithi139.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC70Yn8KpG41qGJj/H/2+icbKC0eydN3ag0J9onuSsPtHboheRfjV9xhTkqF/BgsKfXwlKechCOnU+dgJHgL9K/na9COa/kfDdcgKORMMCbsZgdHPzBHhY5hG5c8TvJm56lyHnK8Z571lFcdmlqUe0uO/Gle6nQ3vbKyAVfywNT0cIXMtbxxt+Gqlj7g98Qk5IpCWnXFaBemT23TzFNhPMvh89KH83nv1YRYqZ3KAYf61RBb4Om9CC18OvXHY31KzD5ZysQ/vmK2AYvsuoLnfH/nnW7FF1bTY/ZHxq+44eDEw3lVaYT03WM5hh520RkzdcjMixG9NMJTRUrbvaI3zQb 2021-02-28T01:17:01.797 INFO:teuthology.kill:2021-02-28 01:17:01,794.794 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-28T01:17:01.800 INFO:teuthology.kill:2021-02-28 01:17:01,800.800 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-28T01:17:01.802 INFO:teuthology.kill:2021-02-28 01:17:01,802.802 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-28T01:17:01.804 INFO:teuthology.kill:2021-02-28 01:17:01,804.804 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-28T01:17:01.806 INFO:teuthology.kill:2021-02-28 01:17:01,806.806 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-28T01:17:01.889 INFO:teuthology.kill:2021-02-28 01:17:01,889.889 INFO:teuthology.orchestra.console:Power off smithi081 2021-02-28T01:17:01.903 INFO:teuthology.kill:2021-02-28 01:17:01,903.903 INFO:teuthology.orchestra.console:Power off smithi094 2021-02-28T01:17:01.916 INFO:teuthology.kill:2021-02-28 01:17:01,916.916 INFO:teuthology.orchestra.console:Power off smithi028 2021-02-28T01:17:01.931 INFO:teuthology.kill:2021-02-28 01:17:01,930.930 INFO:teuthology.orchestra.console:Power off smithi139 2021-02-28T01:17:01.944 INFO:teuthology.kill:2021-02-28 01:17:01,943.943 INFO:teuthology.orchestra.console:Power off smithi017 2021-02-28T01:17:10.321 INFO:teuthology.kill:2021-02-28 01:17:10,321.321 INFO:teuthology.orchestra.console:Power off for smithi028 completed 2021-02-28T01:17:10.328 INFO:teuthology.kill:2021-02-28 01:17:10,328.328 INFO:teuthology.orchestra.console:Power off for smithi094 completed 2021-02-28T01:17:10.335 INFO:teuthology.kill:2021-02-28 01:17:10,334.334 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2021-02-28T01:17:14.458 INFO:teuthology.kill:2021-02-28 01:17:14,457.457 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2021-02-28T01:17:14.464 INFO:teuthology.kill:2021-02-28 01:17:14,464.464 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2021-02-28T01:17:14.734 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-02-28T01:17:14.736 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['mon.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-02-28T01:17:14.736 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.c'] 2021-02-28T01:17:14.737 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11'] 2021-02-28T01:17:14.737 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['client.0'] 2021-02-28T01:17:14.737 INFO:teuthology.misc:Compressing logs... 2021-02-28T01:17:14.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-28T01:18:14.742 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/misc.py", line 1374, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-02-28T01:18:14.903 INFO:teuthology.kill:No teuthology processes running 2021-02-28T01:18:15.860 INFO:teuthology.kill:Nuking machines: ['smithi017', 'smithi028', 'smithi081', 'smithi094', 'smithi139'] 2021-02-28T01:18:16.693 INFO:teuthology.kill:2021-02-28 01:18:16,692.692 INFO:teuthology.nuke:targets: 2021-02-28T01:18:16.693 INFO:teuthology.kill: smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC7cf5KtjwAc5JubhpHnbKe9CocWK2jPw+o1SDxwlkoiIxReZ2sHkQXdiQ4s531j+Xs5dRdaa5NxtQE8H3qDdGyk8m9uQYpKnxjoYpbMksynorJ6VYR2756NKmDhVoXlOnO2Z8L48YG1prgxAScUismLgs/qagwwghuhdB5XgYTKvmkJ45wbm4Twby92GXZ6Fr6rkwbJYtJEwY5O4ITuVZEDFhTpc7Pl/vWDHTxPB2kfGNQkNjGRAd4s46BzDvDa9z84ANpPf70zlzS2iOjxG4/fIqfclhub5MJgvmu5G+oW1P9KtvhlDmQYNVOWsCMslqIvP2kQow6jnmmTUql08tJ 2021-02-28T01:18:16.694 INFO:teuthology.kill: smithi028.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVdP9fhNhDkauXdsqZT3AH9vJlncX4cLjcg+elrxgryx8XF2YtliWu6e0TU/kp/p4naTI5NtLEMJvRdnGiQEMazHdasRfbXAIfU+nTrtBSmnA345clz15SpSr6C2g2HFNs2FhW+o1Y5juax6yUfrGSo3L5wZLptDc6PFFmccTHOGuSaaBDSMx1yer9LbXbneOsxvkRvLCQSXDMoBz6J7aF8BVjVuZ5ZOwAMBnET1NK4ysgCfoFjCDziaXPIMMOIk9JmhCAJiK9x7V1E6RXI0qS3m3rB5U5ezAUo9SsHnXwFA+rRtBLJV9sWFdQkoS7ucjJFyWxVtsdLPNHL3MVRW49 2021-02-28T01:18:16.694 INFO:teuthology.kill: smithi081.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhspzjYlR7fZBNAjR56NL32MlJPtQkC6MytKgYybSAWsde3Wow2EpJtyGXBFqTrCKL6P8JEKhzIOSlU7gKm/h6QUtq8iUVxgOZnMgT3Lnj8YOLLtWJkkNKPtczjHGfHbz5k3hp0m5vQM3KWTLhyEfqQJuLBOEk7FunnizDsbnmNXJKmyl0sUWFMuU2ZTJ3NZUjAUcQ3hNNXqWNoLcN7hPMtOxwmNcytai13oQfOLSjQv7CspGEjxUYc+hBNZDmScsDR1DsbIKkzwni5MobZQw43lZCVykPCxDxRy0zdL9uslQQng/mk0J8Gq1YRaANs+txrRv5FUjW15WRvqBkSVB 2021-02-28T01:18:16.694 INFO:teuthology.kill: smithi094.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCu93BnSFC+1YEVKkCL4XBoY+1tOvoUA3Q7EeYRDe01Ius7HEf9dkwxUGuRxDIXursbiDei+QomHLFaKIhez1pBFeHL1um/XQHyVQI9At9LCmwFYrglSqgATLNiK/bibRzXed/H0vQCBQUJfsIsveI4SN1/LeNdLv7/vKEDxii94dyGEjdfo4h8uhaWvtGHuFz/oLPQxzAXNkViXTI+h84AwAfgIXYf2Ddt3p3qZn7/Cq2OXr1hfe1FDPXuOzRGfQLgkve3E1HxZG+pgF0n1kWelma6zqK8jQrfIUYm482UIzupsyZvZJkPFgWA5igmXENfF/SPpzItJCgLBCl+v97J 2021-02-28T01:18:16.694 INFO:teuthology.kill: smithi139.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC70Yn8KpG41qGJj/H/2+icbKC0eydN3ag0J9onuSsPtHboheRfjV9xhTkqF/BgsKfXwlKechCOnU+dgJHgL9K/na9COa/kfDdcgKORMMCbsZgdHPzBHhY5hG5c8TvJm56lyHnK8Z571lFcdmlqUe0uO/Gle6nQ3vbKyAVfywNT0cIXMtbxxt+Gqlj7g98Qk5IpCWnXFaBemT23TzFNhPMvh89KH83nv1YRYqZ3KAYf61RBb4Om9CC18OvXHY31KzD5ZysQ/vmK2AYvsuoLnfH/nnW7FF1bTY/ZHxq+44eDEw3lVaYT03WM5hh520RkzdcjMixG9NMJTRUrbvaI3zQb 2021-02-28T01:18:16.720 INFO:teuthology.kill:2021-02-28 01:18:16,720.720 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-28T01:18:16.723 INFO:teuthology.kill:2021-02-28 01:18:16,723.723 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-28T01:18:16.726 INFO:teuthology.kill:2021-02-28 01:18:16,725.725 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-28T01:18:16.729 INFO:teuthology.kill:2021-02-28 01:18:16,729.729 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-28T01:18:16.732 INFO:teuthology.kill:2021-02-28 01:18:16,732.732 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-28T01:18:16.790 INFO:teuthology.kill:2021-02-28 01:18:16,789.789 INFO:teuthology.orchestra.console:Power off smithi017 2021-02-28T01:18:16.805 INFO:teuthology.kill:2021-02-28 01:18:16,805.805 INFO:teuthology.orchestra.console:Power off smithi028 2021-02-28T01:18:16.819 INFO:teuthology.kill:2021-02-28 01:18:16,819.819 INFO:teuthology.orchestra.console:Power off smithi139 2021-02-28T01:18:16.832 INFO:teuthology.kill:2021-02-28 01:18:16,832.832 INFO:teuthology.orchestra.console:Power off smithi094 2021-02-28T01:18:16.845 INFO:teuthology.kill:2021-02-28 01:18:16,844.844 INFO:teuthology.orchestra.console:Power off smithi081 2021-02-28T01:18:16.980 INFO:teuthology.kill:2021-02-28 01:18:16,979.979 INFO:teuthology.orchestra.console:Power off for smithi028 completed 2021-02-28T01:18:16.988 INFO:teuthology.kill:2021-02-28 01:18:16,988.988 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2021-02-28T01:18:16.990 INFO:teuthology.kill:2021-02-28 01:18:16,989.989 INFO:teuthology.orchestra.console:Power off for smithi094 completed 2021-02-28T01:18:16.995 INFO:teuthology.kill:2021-02-28 01:18:16,995.995 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2021-02-28T01:18:17.001 INFO:teuthology.kill:2021-02-28 01:18:17,000.000 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2021-02-28T01:18:17.130 INFO:teuthology.kill:2021-02-28 01:18:17,130.130 INFO:teuthology.lock.ops:unlocked smithi028.front.sepia.ceph.com 2021-02-28T01:18:17.140 INFO:teuthology.kill:2021-02-28 01:18:17,140.140 INFO:teuthology.lock.ops:unlocked smithi094.front.sepia.ceph.com 2021-02-28T01:18:17.143 INFO:teuthology.kill:2021-02-28 01:18:17,142.142 INFO:teuthology.lock.ops:unlocked smithi017.front.sepia.ceph.com 2021-02-28T01:18:17.147 INFO:teuthology.kill:2021-02-28 01:18:17,147.147 INFO:teuthology.lock.ops:unlocked smithi081.front.sepia.ceph.com 2021-02-28T01:18:17.148 INFO:teuthology.kill:2021-02-28 01:18:17,147.147 INFO:teuthology.lock.ops:unlocked smithi139.front.sepia.ceph.com 2021-02-28T01:20:17.354 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-02-28T01:20:17.551 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-02-28T01:20:17.552 INFO:teuthology.nuke:Checking targets against current locks 2021-02-28T01:20:17.627 INFO:teuthology.nuke:Not nuking smithi094.front.sepia.ceph.com because description doesn't match 2021-02-28T01:20:17.628 INFO:teuthology.nuke:Not nuking smithi028.front.sepia.ceph.com because description doesn't match 2021-02-28T01:20:17.628 INFO:teuthology.nuke:Not nuking smithi139.front.sepia.ceph.com because description doesn't match 2021-02-28T01:20:17.628 INFO:teuthology.nuke:Not nuking smithi081.front.sepia.ceph.com because description doesn't match 2021-02-28T01:20:17.628 INFO:teuthology.nuke:Not nuking smithi017.front.sepia.ceph.com because description doesn't match