2021-03-08T11:37:50.894 INFO:root:teuthology version: 1.1.0-3082387b 2021-03-08T11:37:51.075 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi016.front.sepia.ceph.com' reimaging 2021-03-08T11:37:51.076 INFO:teuthology.lock.ops:Updating [ubuntu@smithi016.front.sepia.ceph.com]: reset os type and version on server 2021-03-08T11:37:51.076 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2021-03-08T11:37:51.246 INFO:teuthology.lock.ops:Node 'ubuntu@smithi016.front.sepia.ceph.com' reimaging is complete 2021-03-08T11:37:51.247 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi041.front.sepia.ceph.com' reimaging 2021-03-08T11:37:51.247 INFO:teuthology.lock.ops:Updating [ubuntu@smithi041.front.sepia.ceph.com]: reset os type and version on server 2021-03-08T11:37:51.247 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server 2021-03-08T11:37:51.360 INFO:teuthology.lock.ops:Node 'ubuntu@smithi041.front.sepia.ceph.com' reimaging is complete 2021-03-08T11:37:51.360 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi076.front.sepia.ceph.com' reimaging 2021-03-08T11:37:51.361 INFO:teuthology.lock.ops:Updating [ubuntu@smithi076.front.sepia.ceph.com]: reset os type and version on server 2021-03-08T11:37:51.361 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2021-03-08T11:37:51.377 INFO:teuthology.lock.ops:Node 'ubuntu@smithi076.front.sepia.ceph.com' reimaging is complete 2021-03-08T11:37:51.378 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi129.front.sepia.ceph.com' reimaging 2021-03-08T11:37:51.378 INFO:teuthology.lock.ops:Updating [ubuntu@smithi129.front.sepia.ceph.com]: reset os type and version on server 2021-03-08T11:37:51.378 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2021-03-08T11:37:51.392 INFO:teuthology.lock.ops:Node 'ubuntu@smithi129.front.sepia.ceph.com' reimaging is complete 2021-03-08T11:37:51.393 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi146.front.sepia.ceph.com' reimaging 2021-03-08T11:37:51.393 INFO:teuthology.lock.ops:Updating [ubuntu@smithi146.front.sepia.ceph.com]: reset os type and version on server 2021-03-08T11:37:51.393 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2021-03-08T11:37:51.409 INFO:teuthology.lock.ops:Node 'ubuntu@smithi146.front.sepia.ceph.com' reimaging is complete 2021-03-08T11:37:51.511 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of rhel 7.9 2021-03-08T11:37:51.558 INFO:teuthology.provision.fog.smithi041:Scheduling deploy of rhel 7.9 2021-03-08T11:37:51.592 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of rhel 7.9 2021-03-08T11:37:51.612 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of rhel 7.9 2021-03-08T11:37:51.692 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of rhel 7.9 2021-03-08T11:37:51.935 INFO:teuthology.orchestra.console:Power off smithi016 2021-03-08T11:37:52.070 INFO:teuthology.orchestra.console:Power off smithi041 2021-03-08T11:37:52.084 INFO:teuthology.orchestra.console:Power off smithi076 2021-03-08T11:37:52.097 INFO:teuthology.orchestra.console:Power off smithi129 2021-03-08T11:37:52.152 INFO:teuthology.orchestra.console:Power off smithi146 2021-03-08T11:38:00.307 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2021-03-08T11:38:00.408 INFO:teuthology.orchestra.console:Power on smithi016 2021-03-08T11:38:00.452 INFO:teuthology.orchestra.console:Power off for smithi041 completed 2021-03-08T11:38:00.517 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2021-03-08T11:38:00.554 INFO:teuthology.orchestra.console:Power on smithi041 2021-03-08T11:38:00.618 INFO:teuthology.orchestra.console:Power on smithi146 2021-03-08T11:38:04.571 INFO:teuthology.orchestra.console:Power off for smithi076 completed 2021-03-08T11:38:04.577 INFO:teuthology.orchestra.console:Power off for smithi129 completed 2021-03-08T11:38:04.673 INFO:teuthology.orchestra.console:Power on smithi076 2021-03-08T11:38:04.685 INFO:teuthology.orchestra.console:Power on smithi129 2021-03-08T11:38:04.870 INFO:teuthology.orchestra.console:Power on for smithi146 completed 2021-03-08T11:38:04.972 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2021-03-08T11:38:08.769 INFO:teuthology.orchestra.console:Power on for smithi016 completed 2021-03-08T11:38:08.872 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2021-03-08T11:38:08.917 INFO:teuthology.orchestra.console:Power on for smithi041 completed 2021-03-08T11:38:08.985 INFO:teuthology.orchestra.console:Power on for smithi076 completed 2021-03-08T11:38:09.018 INFO:teuthology.provision.fog.smithi041:Waiting for deploy to finish 2021-03-08T11:38:09.086 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish 2021-03-08T11:38:13.122 INFO:teuthology.orchestra.console:Power on for smithi129 completed 2021-03-08T11:38:13.223 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2021-03-08T11:42:31.666 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-08T11:42:31.705 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-08T11:42:31.892 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-08T11:42:32.122 INFO:teuthology.provision.fog.smithi016:Node is ready 2021-03-08T11:42:32.172 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2021-03-08T11:42:32.214 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2021-03-08T11:42:32.307 INFO:teuthology.provision.fog.smithi041:Node is ready 2021-03-08T11:42:32.349 INFO:teuthology.orchestra.run.smithi041.stdout:smithi041.front.sepia.ceph.com 2021-03-08T11:42:32.434 INFO:teuthology.orchestra.run.smithi041.stdout:172.21.15.41 smithi041.front.sepia.ceph.com smithi041 2021-03-08T11:42:32.567 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2021-03-08T11:42:32.796 INFO:teuthology.provision.fog.smithi041:Deploy complete! 2021-03-08T11:42:47.162 INFO:teuthology.provision.fog.smithi129:Node is ready 2021-03-08T11:42:47.224 INFO:teuthology.orchestra.run.smithi129.stdout:smithi121 2021-03-08T11:42:47.265 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2021-03-08T11:42:47.639 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2021-03-08T11:43:16.156 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-08T11:43:16.581 INFO:teuthology.provision.fog.smithi146:Node is ready 2021-03-08T11:43:16.634 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146 2021-03-08T11:43:16.674 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2021-03-08T11:43:17.023 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2021-03-08T11:43:38.470 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-08T11:43:38.888 INFO:teuthology.provision.fog.smithi076:Node is ready 2021-03-08T11:43:38.941 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076 2021-03-08T11:43:38.981 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2021-03-08T11:43:39.319 INFO:teuthology.provision.fog.smithi076:Deploy complete! 2021-03-08T11:43:39.539 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2021-03-08T11:43:39.540 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-08T11:43:39.557 INFO:teuthology.lock.ops:Checking smithi041.front.sepia.ceph.com 2021-03-08T11:43:39.558 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-08T11:43:39.571 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com 2021-03-08T11:43:39.571 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-08T11:43:39.586 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2021-03-08T11:43:39.586 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-08T11:43:39.601 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2021-03-08T11:43:39.601 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-08T11:43:39.617 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2021-03-08T11:43:39.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-08T11:43:39.991 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2021-03-08T11:43:40.072 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux Server" 2021-03-08T11:43:40.072 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="7.9 (Maipo)" 2021-03-08T11:43:40.072 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2021-03-08T11:43:40.073 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2021-03-08T11:43:40.073 INFO:teuthology.orchestra.run.smithi016.stdout:VARIANT="Server" 2021-03-08T11:43:40.073 INFO:teuthology.orchestra.run.smithi016.stdout:VARIANT_ID="server" 2021-03-08T11:43:40.073 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="7.9" 2021-03-08T11:43:40.074 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Employee SKU" 2021-03-08T11:43:40.074 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2021-03-08T11:43:40.074 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server" 2021-03-08T11:43:40.074 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2021-03-08T11:43:40.074 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-03-08T11:43:40.075 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-03-08T11:43:40.075 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2021-03-08T11:43:40.075 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.9 2021-03-08T11:43:40.075 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-03-08T11:43:40.076 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.9" 2021-03-08T11:43:40.077 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2021-03-08T11:43:40.093 INFO:teuthology.lock.ops:Updating [smithi041.front.sepia.ceph.com]: set os type and version on server 2021-03-08T11:43:40.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-08T11:43:40.467 INFO:teuthology.orchestra.run.smithi041.stdout:x86_64 2021-03-08T11:43:40.548 INFO:teuthology.orchestra.run.smithi041.stdout:NAME="Red Hat Enterprise Linux Server" 2021-03-08T11:43:40.549 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION="7.9 (Maipo)" 2021-03-08T11:43:40.549 INFO:teuthology.orchestra.run.smithi041.stdout:ID="rhel" 2021-03-08T11:43:40.549 INFO:teuthology.orchestra.run.smithi041.stdout:ID_LIKE="fedora" 2021-03-08T11:43:40.550 INFO:teuthology.orchestra.run.smithi041.stdout:VARIANT="Server" 2021-03-08T11:43:40.550 INFO:teuthology.orchestra.run.smithi041.stdout:VARIANT_ID="server" 2021-03-08T11:43:40.550 INFO:teuthology.orchestra.run.smithi041.stdout:VERSION_ID="7.9" 2021-03-08T11:43:40.551 INFO:teuthology.orchestra.run.smithi041.stdout:PRETTY_NAME="Employee SKU" 2021-03-08T11:43:40.551 INFO:teuthology.orchestra.run.smithi041.stdout:ANSI_COLOR="0;31" 2021-03-08T11:43:40.551 INFO:teuthology.orchestra.run.smithi041.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server" 2021-03-08T11:43:40.551 INFO:teuthology.orchestra.run.smithi041.stdout:HOME_URL="https://www.redhat.com/" 2021-03-08T11:43:40.551 INFO:teuthology.orchestra.run.smithi041.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-03-08T11:43:40.552 INFO:teuthology.orchestra.run.smithi041.stdout: 2021-03-08T11:43:40.552 INFO:teuthology.orchestra.run.smithi041.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2021-03-08T11:43:40.552 INFO:teuthology.orchestra.run.smithi041.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.9 2021-03-08T11:43:40.552 INFO:teuthology.orchestra.run.smithi041.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-03-08T11:43:40.553 INFO:teuthology.orchestra.run.smithi041.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.9" 2021-03-08T11:43:40.553 INFO:teuthology.lock.ops:Updating smithi041.front.sepia.ceph.com on lock server 2021-03-08T11:43:40.570 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server 2021-03-08T11:43:40.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-08T11:43:40.938 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2021-03-08T11:43:41.017 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Red Hat Enterprise Linux Server" 2021-03-08T11:43:41.018 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="7.9 (Maipo)" 2021-03-08T11:43:41.018 INFO:teuthology.orchestra.run.smithi076.stdout:ID="rhel" 2021-03-08T11:43:41.018 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="fedora" 2021-03-08T11:43:41.018 INFO:teuthology.orchestra.run.smithi076.stdout:VARIANT="Server" 2021-03-08T11:43:41.019 INFO:teuthology.orchestra.run.smithi076.stdout:VARIANT_ID="server" 2021-03-08T11:43:41.019 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="7.9" 2021-03-08T11:43:41.019 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Employee SKU" 2021-03-08T11:43:41.019 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2021-03-08T11:43:41.020 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server" 2021-03-08T11:43:41.020 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.redhat.com/" 2021-03-08T11:43:41.020 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-03-08T11:43:41.020 INFO:teuthology.orchestra.run.smithi076.stdout: 2021-03-08T11:43:41.021 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2021-03-08T11:43:41.021 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.9 2021-03-08T11:43:41.021 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-03-08T11:43:41.021 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.9" 2021-03-08T11:43:41.022 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2021-03-08T11:43:41.037 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2021-03-08T11:43:41.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-08T11:43:41.422 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2021-03-08T11:43:41.501 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Red Hat Enterprise Linux Server" 2021-03-08T11:43:41.501 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="7.9 (Maipo)" 2021-03-08T11:43:41.501 INFO:teuthology.orchestra.run.smithi129.stdout:ID="rhel" 2021-03-08T11:43:41.501 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="fedora" 2021-03-08T11:43:41.502 INFO:teuthology.orchestra.run.smithi129.stdout:VARIANT="Server" 2021-03-08T11:43:41.502 INFO:teuthology.orchestra.run.smithi129.stdout:VARIANT_ID="server" 2021-03-08T11:43:41.502 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="7.9" 2021-03-08T11:43:41.502 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Employee SKU" 2021-03-08T11:43:41.503 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2021-03-08T11:43:41.503 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server" 2021-03-08T11:43:41.503 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.redhat.com/" 2021-03-08T11:43:41.503 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-03-08T11:43:41.504 INFO:teuthology.orchestra.run.smithi129.stdout: 2021-03-08T11:43:41.504 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2021-03-08T11:43:41.504 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.9 2021-03-08T11:43:41.504 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-03-08T11:43:41.504 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.9" 2021-03-08T11:43:41.505 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2021-03-08T11:43:41.521 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2021-03-08T11:43:41.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-08T11:43:41.902 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2021-03-08T11:43:41.980 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Red Hat Enterprise Linux Server" 2021-03-08T11:43:41.981 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="7.9 (Maipo)" 2021-03-08T11:43:41.981 INFO:teuthology.orchestra.run.smithi146.stdout:ID="rhel" 2021-03-08T11:43:41.981 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="fedora" 2021-03-08T11:43:41.982 INFO:teuthology.orchestra.run.smithi146.stdout:VARIANT="Server" 2021-03-08T11:43:41.982 INFO:teuthology.orchestra.run.smithi146.stdout:VARIANT_ID="server" 2021-03-08T11:43:41.982 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="7.9" 2021-03-08T11:43:41.982 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Employee SKU" 2021-03-08T11:43:41.983 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2021-03-08T11:43:41.983 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server" 2021-03-08T11:43:41.983 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.redhat.com/" 2021-03-08T11:43:41.983 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-03-08T11:43:41.983 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-03-08T11:43:41.984 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2021-03-08T11:43:41.984 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.9 2021-03-08T11:43:41.984 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-03-08T11:43:41.985 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.9" 2021-03-08T11:43:41.985 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2021-03-08T11:43:42.100 INFO:teuthology.dispatcher.supervisor:Running job 5931773 2021-03-08T11:43:42.101 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-03-04_02:30:04-upgrade:mimic-x-nautilus-distro-basic-smithi/5931773 --name teuthology-2021-03-04_02:30:04-upgrade:mimic-x-nautilus-distro-basic-smithi --description upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-nautilus 6.1-msgr2 7-final-workload/{rbd-python rgw-swift-ragweed_check snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/rhel_7 thrashosds-health} -- /home/teuthworker/archive/teuthology-2021-03-04_02:30:04-upgrade:mimic-x-nautilus-distro-basic-smithi/5931773/orig.config.yaml 2021-03-08T11:43:42.105 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-03-04_02:30:04-upgrade:mimic-x-nautilus-distro-basic-smithi/5931773 2021-03-08T11:43:42.106 INFO:teuthology.dispatcher.supervisor:Job PID: 14012 2021-03-08T11:43:42.107 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-03-08T23:44:31.918 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-03-08T23:44:32.254 INFO:teuthology.kill:Killing Pids: {14012} 2021-03-08T23:44:33.451 INFO:teuthology.kill:Nuking machines: ['smithi016', 'smithi041', 'smithi076', 'smithi129', 'smithi146'] 2021-03-08T23:44:34.384 INFO:teuthology.kill:2021-03-08 23:44:34,384.384 INFO:teuthology.nuke:targets: 2021-03-08T23:44:34.385 INFO:teuthology.kill: smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGOzPvtqRyWPHWIX7UHXGkxjpD+n2wrfpyklSYA5rAXY0qzn4Z62Q5+A4NCGQOS2rSRw5CyLHWGUS84HCxyo7Be+fkJsXkWp9V/Z5QvHGr7vDCCAsq5xUaDET1egbdLW+iN7pHah1FaH1AD3H459S548j5T00WFrkwIPS1B/VrLTIVsTXXOmeUuyXWJVBe+6abzI2pHejFumWA/AbSLuqDXPKb4mBPHAhTwExWOnoEuWICbHPr8ly9WQ32y/8tNfEGM6DMwjmiWWmOUXRVDZB6jxAWGR6dbic3zWLrVa+PqjFqsASpxrINhJvl35z2j82DkS2JiEEmf0/Yobt8XPX7 2021-03-08T23:44:34.385 INFO:teuthology.kill: smithi041.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpi91mOsbAvfgNcSPd30Czb6ksPumwvpufdFZSSJhxjhZHREQFYaaIvxvq185KXphKRvku3gQ1d63Kx8NfI3owYZ5eAy+osqAUgE+YB/9yPgP5zzVRrgSxjwPqJzX63+pcNBfDx+Do6JRPlmJkG+b9MB4sqvAnBs6U53rPmf+Nmd1bGCyVpJUXhCieghISSzLCwYDKicAHOkN1doi1M8I4VTHyo4putbCQzgGQxxK2UyEDHLlaUHgVKh8BjmZNgehJu+dhFU10vq1DARXgROGFnTbWQlhDzo5qDFnchTycbfpcfG577LtfGYqepE0KPv7Q+FWCZMhTA6Z3bynMMMA3 2021-03-08T23:44:34.386 INFO:teuthology.kill: smithi076.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDWItRkugantuc8ZRveB2ae3Rr4ftd/xEcxaB6y6MZgSMWx9PY+S9TwvdsttO4yPgA+fkwvUhD2VymbwL6p2jFMVlDu74hPcbRGzfXK/cBv7V1bFSNxDoj0kYq4n+Yem5REPZ4o6EAqj+d1VFEY5cuhJpu0Hu7RYmHoizcnBo/H99jm5V69tIzoaDHstQheWMi+9ZTjLxDFv5gMDQND+4rJQlJLZoN+BHshOlRqO4smqcPlVZPo8EuPTkTYJDLZDudNJ/W8bLj1qg331Fb7rKVT48VSulwPb1cCBCgDeOYT2qcyGfAO1AI6a2pntHp1FPlHSgRGzIJ0BarCV9EwDswT 2021-03-08T23:44:34.386 INFO:teuthology.kill: smithi129.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaVnnWD7rvJLxiDaoZkOX173m7Tiq4mtyjj6gbgjTpUP8U3NzOzlkoaeBvzQVkBuomACkZX83kO1YC468mycz6dsW72SeC1A+YgM0puGKWgnto7p/TDcWkubYtVDC/BJA/B1d3QowFTSuhci4nlqSld/gtvPNSzInEcp0015qZZHX+HMdigwIkQyEWucjaGzqUBter/cl/XS8zZF8xAuRfjJ0Ik6y4raGJY96sIW+N2qQN35QlMX33Gk1lbCW+xZjYUDsmDDJv6DmiXczUBHG7glj92xQAQYwX/ivtu/rggrv2rqmnChRRL/IuWonkrl3poObVgIXVWBmUrX6nC46F 2021-03-08T23:44:34.386 INFO:teuthology.kill: smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCbWs+f35wkdVdQDe9euFsbar2ORoL5Fr/YAXudXOUS6J1JTzlddOmlKfCgFhr3RteGOwE+/YrhlZR8way8ZEftVD4X3c9IT5yR3JekQ3oLsFm7WDnP/iOLy6Q3p2j+yHAPpA5/ljWY75139ABWowZep0TgqegE7+JKM0IQw09FkHfbHS0lV7NdYOzHIL4HrsoSGh4aMpeS2bWUrBY3XLxwFIcExJxhnejaINcLg7wC6tP16w+4kIc79TPpi5GaPsEMXmQOCD0hjhrR5nVRCfBpKYrdIjqL2ZkVIgZRv0W/RKv5DLfGaJtOXDNb1RYvhAii6ehaIPIYtdz6zC8O04T1 2021-03-08T23:44:34.387 INFO:teuthology.kill:2021-03-08 23:44:34,384.384 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-08T23:44:34.388 INFO:teuthology.kill:2021-03-08 23:44:34,387.387 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-08T23:44:34.388 INFO:teuthology.kill:2021-03-08 23:44:34,388.388 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-08T23:44:34.389 INFO:teuthology.kill:2021-03-08 23:44:34,389.389 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-08T23:44:34.390 INFO:teuthology.kill:2021-03-08 23:44:34,390.390 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-08T23:44:34.465 INFO:teuthology.kill:2021-03-08 23:44:34,465.465 INFO:teuthology.orchestra.console:Power off smithi016 2021-03-08T23:44:34.481 INFO:teuthology.kill:2021-03-08 23:44:34,481.481 INFO:teuthology.orchestra.console:Power off smithi129 2021-03-08T23:44:34.492 INFO:teuthology.kill:2021-03-08 23:44:34,492.492 INFO:teuthology.orchestra.console:Power off smithi041 2021-03-08T23:44:34.503 INFO:teuthology.kill:2021-03-08 23:44:34,502.502 INFO:teuthology.orchestra.console:Power off smithi146 2021-03-08T23:44:34.512 INFO:teuthology.kill:2021-03-08 23:44:34,512.512 INFO:teuthology.orchestra.console:Power off smithi076 2021-03-08T23:44:42.885 INFO:teuthology.kill:2021-03-08 23:44:42,884.884 INFO:teuthology.orchestra.console:Power off for smithi129 completed 2021-03-08T23:44:42.900 INFO:teuthology.kill:2021-03-08 23:44:42,899.899 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2021-03-08T23:44:42.910 INFO:teuthology.kill:2021-03-08 23:44:42,910.910 INFO:teuthology.orchestra.console:Power off for smithi076 completed 2021-03-08T23:44:42.914 INFO:teuthology.kill:2021-03-08 23:44:42,914.914 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2021-03-08T23:44:47.001 INFO:teuthology.kill:2021-03-08 23:44:47,001.001 INFO:teuthology.orchestra.console:Power off for smithi041 completed 2021-03-08T23:44:47.271 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-03-08T23:44:47.271 INFO:teuthology.task.internal:roles: ubuntu@smithi041.front.sepia.ceph.com - ['mon.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-03-08T23:44:47.272 INFO:teuthology.task.internal:roles: ubuntu@smithi076.front.sepia.ceph.com - ['mon.c'] 2021-03-08T23:44:47.272 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11'] 2021-03-08T23:44:47.272 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['client.0'] 2021-03-08T23:44:47.273 INFO:teuthology.misc:Compressing logs... 2021-03-08T23:44:47.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-08T23:45:47.335 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/misc.py", line 1374, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_3082387bba74fcd24c9700593d10418152d53c97/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-03-08T23:45:47.453 INFO:teuthology.kill:No teuthology processes running 2021-03-08T23:45:48.582 INFO:teuthology.kill:Nuking machines: ['smithi016', 'smithi041', 'smithi076', 'smithi129', 'smithi146'] 2021-03-08T23:45:49.542 INFO:teuthology.kill:2021-03-08 23:45:49,542.542 INFO:teuthology.nuke:targets: 2021-03-08T23:45:49.543 INFO:teuthology.kill: smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGOzPvtqRyWPHWIX7UHXGkxjpD+n2wrfpyklSYA5rAXY0qzn4Z62Q5+A4NCGQOS2rSRw5CyLHWGUS84HCxyo7Be+fkJsXkWp9V/Z5QvHGr7vDCCAsq5xUaDET1egbdLW+iN7pHah1FaH1AD3H459S548j5T00WFrkwIPS1B/VrLTIVsTXXOmeUuyXWJVBe+6abzI2pHejFumWA/AbSLuqDXPKb4mBPHAhTwExWOnoEuWICbHPr8ly9WQ32y/8tNfEGM6DMwjmiWWmOUXRVDZB6jxAWGR6dbic3zWLrVa+PqjFqsASpxrINhJvl35z2j82DkS2JiEEmf0/Yobt8XPX7 2021-03-08T23:45:49.543 INFO:teuthology.kill: smithi041.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpi91mOsbAvfgNcSPd30Czb6ksPumwvpufdFZSSJhxjhZHREQFYaaIvxvq185KXphKRvku3gQ1d63Kx8NfI3owYZ5eAy+osqAUgE+YB/9yPgP5zzVRrgSxjwPqJzX63+pcNBfDx+Do6JRPlmJkG+b9MB4sqvAnBs6U53rPmf+Nmd1bGCyVpJUXhCieghISSzLCwYDKicAHOkN1doi1M8I4VTHyo4putbCQzgGQxxK2UyEDHLlaUHgVKh8BjmZNgehJu+dhFU10vq1DARXgROGFnTbWQlhDzo5qDFnchTycbfpcfG577LtfGYqepE0KPv7Q+FWCZMhTA6Z3bynMMMA3 2021-03-08T23:45:49.544 INFO:teuthology.kill: smithi076.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDWItRkugantuc8ZRveB2ae3Rr4ftd/xEcxaB6y6MZgSMWx9PY+S9TwvdsttO4yPgA+fkwvUhD2VymbwL6p2jFMVlDu74hPcbRGzfXK/cBv7V1bFSNxDoj0kYq4n+Yem5REPZ4o6EAqj+d1VFEY5cuhJpu0Hu7RYmHoizcnBo/H99jm5V69tIzoaDHstQheWMi+9ZTjLxDFv5gMDQND+4rJQlJLZoN+BHshOlRqO4smqcPlVZPo8EuPTkTYJDLZDudNJ/W8bLj1qg331Fb7rKVT48VSulwPb1cCBCgDeOYT2qcyGfAO1AI6a2pntHp1FPlHSgRGzIJ0BarCV9EwDswT 2021-03-08T23:45:49.544 INFO:teuthology.kill: smithi129.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaVnnWD7rvJLxiDaoZkOX173m7Tiq4mtyjj6gbgjTpUP8U3NzOzlkoaeBvzQVkBuomACkZX83kO1YC468mycz6dsW72SeC1A+YgM0puGKWgnto7p/TDcWkubYtVDC/BJA/B1d3QowFTSuhci4nlqSld/gtvPNSzInEcp0015qZZHX+HMdigwIkQyEWucjaGzqUBter/cl/XS8zZF8xAuRfjJ0Ik6y4raGJY96sIW+N2qQN35QlMX33Gk1lbCW+xZjYUDsmDDJv6DmiXczUBHG7glj92xQAQYwX/ivtu/rggrv2rqmnChRRL/IuWonkrl3poObVgIXVWBmUrX6nC46F 2021-03-08T23:45:49.544 INFO:teuthology.kill: smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCbWs+f35wkdVdQDe9euFsbar2ORoL5Fr/YAXudXOUS6J1JTzlddOmlKfCgFhr3RteGOwE+/YrhlZR8way8ZEftVD4X3c9IT5yR3JekQ3oLsFm7WDnP/iOLy6Q3p2j+yHAPpA5/ljWY75139ABWowZep0TgqegE7+JKM0IQw09FkHfbHS0lV7NdYOzHIL4HrsoSGh4aMpeS2bWUrBY3XLxwFIcExJxhnejaINcLg7wC6tP16w+4kIc79TPpi5GaPsEMXmQOCD0hjhrR5nVRCfBpKYrdIjqL2ZkVIgZRv0W/RKv5DLfGaJtOXDNb1RYvhAii6ehaIPIYtdz6zC8O04T1 2021-03-08T23:45:49.571 INFO:teuthology.kill:2021-03-08 23:45:49,571.571 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-08T23:45:49.576 INFO:teuthology.kill:2021-03-08 23:45:49,576.576 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-08T23:45:49.577 INFO:teuthology.kill:2021-03-08 23:45:49,577.577 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-08T23:45:49.578 INFO:teuthology.kill:2021-03-08 23:45:49,578.578 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-08T23:45:49.579 INFO:teuthology.kill:2021-03-08 23:45:49,579.579 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-08T23:45:49.634 INFO:teuthology.kill:2021-03-08 23:45:49,633.633 INFO:teuthology.orchestra.console:Power off smithi146 2021-03-08T23:45:49.649 INFO:teuthology.kill:2021-03-08 23:45:49,649.649 INFO:teuthology.orchestra.console:Power off smithi076 2021-03-08T23:45:49.661 INFO:teuthology.kill:2021-03-08 23:45:49,660.660 INFO:teuthology.orchestra.console:Power off smithi129 2021-03-08T23:45:49.709 INFO:teuthology.kill:2021-03-08 23:45:49,708.708 INFO:teuthology.orchestra.console:Power off smithi016 2021-03-08T23:45:49.727 INFO:teuthology.kill:2021-03-08 23:45:49,726.726 INFO:teuthology.orchestra.console:Power off smithi041 2021-03-08T23:45:49.800 INFO:teuthology.kill:2021-03-08 23:45:49,800.800 INFO:teuthology.orchestra.console:Power off for smithi076 completed 2021-03-08T23:45:49.835 INFO:teuthology.kill:2021-03-08 23:45:49,834.834 INFO:teuthology.orchestra.console:Power off for smithi129 completed 2021-03-08T23:45:49.835 INFO:teuthology.kill:2021-03-08 23:45:49,835.835 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2021-03-08T23:45:49.857 INFO:teuthology.kill:2021-03-08 23:45:49,857.857 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2021-03-08T23:45:49.871 INFO:teuthology.kill:2021-03-08 23:45:49,871.871 INFO:teuthology.orchestra.console:Power off for smithi041 completed 2021-03-08T23:45:49.941 INFO:teuthology.kill:2021-03-08 23:45:49,941.941 INFO:teuthology.lock.ops:unlocked smithi076.front.sepia.ceph.com 2021-03-08T23:45:49.979 INFO:teuthology.kill:2021-03-08 23:45:49,979.979 INFO:teuthology.lock.ops:unlocked smithi129.front.sepia.ceph.com 2021-03-08T23:45:49.983 INFO:teuthology.kill:2021-03-08 23:45:49,983.983 INFO:teuthology.lock.ops:unlocked smithi146.front.sepia.ceph.com 2021-03-08T23:45:49.997 INFO:teuthology.kill:2021-03-08 23:45:49,997.997 INFO:teuthology.lock.ops:unlocked smithi016.front.sepia.ceph.com 2021-03-08T23:45:50.011 INFO:teuthology.kill:2021-03-08 23:45:50,010.010 INFO:teuthology.lock.ops:unlocked smithi041.front.sepia.ceph.com 2021-03-08T23:47:50.323 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-03-08T23:47:50.531 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-03-08T23:47:50.531 INFO:teuthology.nuke:Checking targets against current locks 2021-03-08T23:47:50.614 INFO:teuthology.nuke:Not nuking smithi146.front.sepia.ceph.com because description doesn't match 2021-03-08T23:47:50.615 INFO:teuthology.nuke:Not nuking smithi076.front.sepia.ceph.com because description doesn't match 2021-03-08T23:47:50.615 INFO:teuthology.nuke:Not nuking smithi041.front.sepia.ceph.com because description doesn't match 2021-03-08T23:47:50.615 INFO:teuthology.nuke:Not nuking smithi129.front.sepia.ceph.com because description doesn't match 2021-03-08T23:47:50.615 INFO:teuthology.nuke:Not nuking smithi016.front.sepia.ceph.com because description doesn't match