2021-02-09T02:44:35.087 INFO:root:teuthology version: 1.1.0-17c09965 2021-02-09T02:44:35.255 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging 2021-02-09T02:44:35.256 INFO:teuthology.lock.ops:Updating [ubuntu@smithi082.front.sepia.ceph.com]: reset os type and version on server 2021-02-09T02:44:35.256 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2021-02-09T02:44:35.269 INFO:teuthology.lock.ops:Node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging is complete 2021-02-09T02:44:35.270 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi086.front.sepia.ceph.com' reimaging 2021-02-09T02:44:35.270 INFO:teuthology.lock.ops:Updating [ubuntu@smithi086.front.sepia.ceph.com]: reset os type and version on server 2021-02-09T02:44:35.270 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2021-02-09T02:44:35.283 INFO:teuthology.lock.ops:Node 'ubuntu@smithi086.front.sepia.ceph.com' reimaging is complete 2021-02-09T02:44:35.283 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi138.front.sepia.ceph.com' reimaging 2021-02-09T02:44:35.283 INFO:teuthology.lock.ops:Updating [ubuntu@smithi138.front.sepia.ceph.com]: reset os type and version on server 2021-02-09T02:44:35.283 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2021-02-09T02:44:35.295 INFO:teuthology.lock.ops:Node 'ubuntu@smithi138.front.sepia.ceph.com' reimaging is complete 2021-02-09T02:44:35.296 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi172.front.sepia.ceph.com' reimaging 2021-02-09T02:44:35.296 INFO:teuthology.lock.ops:Updating [ubuntu@smithi172.front.sepia.ceph.com]: reset os type and version on server 2021-02-09T02:44:35.296 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2021-02-09T02:44:35.309 INFO:teuthology.lock.ops:Node 'ubuntu@smithi172.front.sepia.ceph.com' reimaging is complete 2021-02-09T02:44:35.309 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging 2021-02-09T02:44:35.309 INFO:teuthology.lock.ops:Updating [ubuntu@smithi190.front.sepia.ceph.com]: reset os type and version on server 2021-02-09T02:44:35.309 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2021-02-09T02:44:35.321 INFO:teuthology.lock.ops:Node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging is complete 2021-02-09T02:44:35.495 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of rhel 7.9 2021-02-09T02:44:35.506 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of rhel 7.9 2021-02-09T02:44:35.516 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 7.9 2021-02-09T02:44:35.519 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 7.9 2021-02-09T02:44:35.560 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of rhel 7.9 2021-02-09T02:44:35.920 INFO:teuthology.orchestra.console:Power off smithi086 2021-02-09T02:44:35.939 INFO:teuthology.orchestra.console:Power off smithi172 2021-02-09T02:44:35.990 INFO:teuthology.orchestra.console:Power off smithi190 2021-02-09T02:44:36.004 INFO:teuthology.orchestra.console:Power off smithi138 2021-02-09T02:44:36.018 INFO:teuthology.orchestra.console:Power off smithi082 2021-02-09T02:44:44.364 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2021-02-09T02:44:44.378 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2021-02-09T02:44:44.384 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2021-02-09T02:44:44.464 INFO:teuthology.orchestra.console:Power on smithi086 2021-02-09T02:44:44.480 INFO:teuthology.orchestra.console:Power on smithi138 2021-02-09T02:44:44.486 INFO:teuthology.orchestra.console:Power on smithi082 2021-02-09T02:44:48.469 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2021-02-09T02:44:48.900 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2021-02-09T02:44:49.000 INFO:teuthology.orchestra.console:Power on smithi172 2021-02-09T02:44:49.009 INFO:teuthology.orchestra.console:Power on smithi190 2021-02-09T02:44:49.120 INFO:teuthology.orchestra.console:Power on for smithi086 completed 2021-02-09T02:44:49.121 INFO:teuthology.orchestra.console:Power on for smithi138 completed 2021-02-09T02:44:49.125 INFO:teuthology.orchestra.console:Power on for smithi082 completed 2021-02-09T02:44:49.222 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2021-02-09T02:44:49.225 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2021-02-09T02:44:49.227 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2021-02-09T02:44:57.388 INFO:teuthology.orchestra.console:Power on for smithi172 completed 2021-02-09T02:44:57.406 INFO:teuthology.orchestra.console:Power on for smithi190 completed 2021-02-09T02:44:57.489 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2021-02-09T02:44:57.507 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2021-02-09T02:49:10.642 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-09T02:49:16.577 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-09T02:49:31.359 INFO:teuthology.provision.fog.smithi082:Node is ready 2021-02-09T02:49:31.420 INFO:teuthology.orchestra.run.smithi082.stdout:smithi121 2021-02-09T02:49:31.461 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2021-02-09T02:49:31.818 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2021-02-09T02:49:37.234 INFO:teuthology.provision.fog.smithi086:Node is ready 2021-02-09T02:49:37.310 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086 2021-02-09T02:49:37.364 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2021-02-09T02:49:37.686 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2021-02-09T02:49:44.312 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-09T02:49:44.779 INFO:teuthology.provision.fog.smithi190:Node is ready 2021-02-09T02:49:44.827 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190 2021-02-09T02:49:44.867 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2021-02-09T02:49:45.109 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-09T02:49:45.212 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2021-02-09T02:49:45.574 INFO:teuthology.provision.fog.smithi138:Node is ready 2021-02-09T02:49:45.616 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138 2021-02-09T02:49:45.695 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2021-02-09T02:49:46.036 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2021-02-09T02:49:59.455 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-09T02:49:59.879 INFO:teuthology.provision.fog.smithi172:Node is ready 2021-02-09T02:49:59.922 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2021-02-09T02:50:00.007 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2021-02-09T02:50:00.342 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2021-02-09T02:50:00.617 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2021-02-09T02:50:00.618 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-09T02:50:00.635 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2021-02-09T02:50:00.635 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-09T02:50:00.651 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2021-02-09T02:50:00.651 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-09T02:50:00.667 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2021-02-09T02:50:00.668 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-09T02:50:00.682 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2021-02-09T02:50:00.682 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-09T02:50:00.701 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2021-02-09T02:50:00.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T02:50:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2021-02-09T02:50:01.166 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux Server" 2021-02-09T02:50:01.166 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="7.9 (Maipo)" 2021-02-09T02:50:01.166 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel" 2021-02-09T02:50:01.167 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora" 2021-02-09T02:50:01.167 INFO:teuthology.orchestra.run.smithi082.stdout:VARIANT="Server" 2021-02-09T02:50:01.167 INFO:teuthology.orchestra.run.smithi082.stdout:VARIANT_ID="server" 2021-02-09T02:50:01.167 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="7.9" 2021-02-09T02:50:01.167 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Employee SKU" 2021-02-09T02:50:01.168 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2021-02-09T02:50:01.168 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server" 2021-02-09T02:50:01.168 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/" 2021-02-09T02:50:01.168 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-02-09T02:50:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: 2021-02-09T02:50:01.168 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2021-02-09T02:50:01.169 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.9 2021-02-09T02:50:01.169 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-02-09T02:50:01.169 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.9" 2021-02-09T02:50:01.170 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2021-02-09T02:50:01.184 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2021-02-09T02:50:01.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T02:50:01.570 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2021-02-09T02:50:01.650 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux Server" 2021-02-09T02:50:01.650 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="7.9 (Maipo)" 2021-02-09T02:50:01.650 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2021-02-09T02:50:01.650 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2021-02-09T02:50:01.650 INFO:teuthology.orchestra.run.smithi086.stdout:VARIANT="Server" 2021-02-09T02:50:01.650 INFO:teuthology.orchestra.run.smithi086.stdout:VARIANT_ID="server" 2021-02-09T02:50:01.650 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="7.9" 2021-02-09T02:50:01.651 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Employee SKU" 2021-02-09T02:50:01.651 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2021-02-09T02:50:01.651 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server" 2021-02-09T02:50:01.651 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2021-02-09T02:50:01.651 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-02-09T02:50:01.651 INFO:teuthology.orchestra.run.smithi086.stdout: 2021-02-09T02:50:01.651 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2021-02-09T02:50:01.651 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.9 2021-02-09T02:50:01.651 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-02-09T02:50:01.651 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.9" 2021-02-09T02:50:01.652 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2021-02-09T02:50:01.668 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2021-02-09T02:50:01.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T02:50:02.040 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2021-02-09T02:50:02.120 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux Server" 2021-02-09T02:50:02.121 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="7.9 (Maipo)" 2021-02-09T02:50:02.121 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2021-02-09T02:50:02.121 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2021-02-09T02:50:02.121 INFO:teuthology.orchestra.run.smithi138.stdout:VARIANT="Server" 2021-02-09T02:50:02.121 INFO:teuthology.orchestra.run.smithi138.stdout:VARIANT_ID="server" 2021-02-09T02:50:02.121 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="7.9" 2021-02-09T02:50:02.121 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Employee SKU" 2021-02-09T02:50:02.121 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2021-02-09T02:50:02.121 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server" 2021-02-09T02:50:02.121 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2021-02-09T02:50:02.121 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-02-09T02:50:02.122 INFO:teuthology.orchestra.run.smithi138.stdout: 2021-02-09T02:50:02.122 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2021-02-09T02:50:02.122 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.9 2021-02-09T02:50:02.122 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-02-09T02:50:02.122 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.9" 2021-02-09T02:50:02.122 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2021-02-09T02:50:02.141 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2021-02-09T02:50:02.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T02:50:02.540 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2021-02-09T02:50:02.625 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux Server" 2021-02-09T02:50:02.625 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="7.9 (Maipo)" 2021-02-09T02:50:02.625 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2021-02-09T02:50:02.625 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2021-02-09T02:50:02.626 INFO:teuthology.orchestra.run.smithi172.stdout:VARIANT="Server" 2021-02-09T02:50:02.626 INFO:teuthology.orchestra.run.smithi172.stdout:VARIANT_ID="server" 2021-02-09T02:50:02.626 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="7.9" 2021-02-09T02:50:02.626 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Employee SKU" 2021-02-09T02:50:02.626 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2021-02-09T02:50:02.626 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server" 2021-02-09T02:50:02.626 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2021-02-09T02:50:02.626 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-02-09T02:50:02.626 INFO:teuthology.orchestra.run.smithi172.stdout: 2021-02-09T02:50:02.626 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2021-02-09T02:50:02.626 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.9 2021-02-09T02:50:02.626 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-02-09T02:50:02.627 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.9" 2021-02-09T02:50:02.627 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2021-02-09T02:50:02.645 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2021-02-09T02:50:02.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T02:50:03.042 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2021-02-09T02:50:03.124 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux Server" 2021-02-09T02:50:03.124 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="7.9 (Maipo)" 2021-02-09T02:50:03.124 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout:VARIANT="Server" 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout:VARIANT_ID="server" 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="7.9" 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Employee SKU" 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server" 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout: 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=7.9 2021-02-09T02:50:03.125 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-02-09T02:50:03.126 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7.9" 2021-02-09T02:50:03.126 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2021-02-09T02:50:03.243 INFO:teuthology.dispatcher.supervisor:Running job 5869847 2021-02-09T02:50:03.243 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-02-09_02:30:03-upgrade:mimic-x-nautilus-distro-basic-smithi/5869847 --name teuthology-2021-02-09_02:30:03-upgrade:mimic-x-nautilus-distro-basic-smithi --description upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-nautilus 6.1-msgr2 7-final-workload/{rbd-python rgw-swift-ragweed_check snaps-many-objects} objectstore/filestore-xfs supported-all-distro/rhel_7 thrashosds-health} -- /home/teuthworker/archive/teuthology-2021-02-09_02:30:03-upgrade:mimic-x-nautilus-distro-basic-smithi/5869847/orig.config.yaml 2021-02-09T02:50:03.251 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-02-09_02:30:03-upgrade:mimic-x-nautilus-distro-basic-smithi/5869847 2021-02-09T02:50:03.252 INFO:teuthology.dispatcher.supervisor:Job PID: 19537 2021-02-09T02:50:03.253 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-02-09T14:50:18.968 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-02-09T14:50:19.128 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-02-09T14:50:19.128 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-02-09T14:50:19.129 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.c'] 2021-02-09T14:50:19.129 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11'] 2021-02-09T14:50:19.130 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['client.0'] 2021-02-09T14:50:19.130 INFO:teuthology.misc:Compressing logs... 2021-02-09T14:50:19.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T14:50:20.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T14:50:20.183 INFO:teuthology.orchestra.run.smithi082.stderr: 2021-02-09T14:50:20.183 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/kern.log.gz: No space left on device 2021-02-09T14:50:21.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T14:50:22.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T14:50:22.234 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-02-09T14:50:22.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-09T14:50:23.004 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/dispatcher/supervisor.py", line 220, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/dispatcher/supervisor.py", line 274, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/misc.py", line 1372, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi082 with status 123: 'sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip --' 2021-02-09T14:50:23.169 INFO:teuthology.kill:Killing Pids: {19537} 2021-02-09T14:50:24.524 INFO:teuthology.kill:Nuking machines: ['smithi082', 'smithi086', 'smithi138', 'smithi172', 'smithi190'] 2021-02-09T14:50:25.361 INFO:teuthology.kill:2021-02-09 14:50:25,361.361 INFO:teuthology.nuke:targets: 2021-02-09T14:50:25.362 INFO:teuthology.kill: smithi082.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDp+FAmv2k4CGzqoQYk+s4pv0jhZAsmufk+gODbL/5q0Mwnf3UFzjXuyA+d7FREvCop9Yf3Vi7QVlikOtt8zLTJRzbUmVW87jRW5pxc01BJXXRbCEbxx7qU/TAhnrJyPWqC3O1IKpaD25j8sNfttwNKXPRIw7YGDwhgnNqR68SQ1qS1wK9PwD1yV3XZ954XrryI62fDvmnfK8c5x1ykoE+IUo/O5HArJm+VoV999NWuyFsR1KoDEniuAXCT47SJeO0UIp2NtIVLnf6M6L6nuKHn4i7p/uyTk5AYWC7T+4/r1H4QVrfynoYMHee3yCbRqMQPmYMaF5MsVUzO0jiFjuch 2021-02-09T14:50:25.362 INFO:teuthology.kill: smithi086.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJXIyiqn4yX6NLtA/aGm4BnvbcZ0+ZE/XTFEK/EB2i4DZL+MOlCFiHoX7zfNBaUH+nUUv61IEhPu/xQjL/+JYEGufstsgCVGX7SP9AZ2ALiBnfi1mfcIrMiXUXvhl1eQ7p+Uszveqr0XT7+F82rPcn8M4EW/NeDyV7MQdvmytANCLzBiEqwNfC69bFIjb4h3sa8qac3LoSc9+PLzUiHkW1ITHlUuSe+rwMH0DCqwC7wRRrbpRGkfno0rQZaMLRrtSAAxdnIQImymk2s3FHsqO7fR8KJJ5wifV1POKcUD/RJ911Kh//nZD8uR8W58JeJQVSulZYPXAiVcIs8GPqhk5f 2021-02-09T14:50:25.362 INFO:teuthology.kill: smithi138.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2Do7BVjd0AJo02Ai1WZ2BaZnylER9ypicSTBOe0ojSkuz3Rz3eyTVGLzfxmM09IvQgJkYje+YypX54q2GX2eao9iqnnIFlp8zIGNAsIeI6jStRFS4VBYmAaaEX5s6RznlHUExRx40ZvFhK66m6t23ZcyG541NU0osIdNn+CowhRswF0wnLGv7sqmH4BqQvWGmOShV0wibHW4ccxzuTlSqUaXvbVuITRakQwXi5f9Dgaf2Xe3xH+DxTcbHlRUHdoIf55X7w/k87JSSBFWYd9oWNH5XhM60ubeWp2ahPBAgtxfUdeyEKG//x5JPcrooZ2gBvqW/XPCNnudG4H57pMKB 2021-02-09T14:50:25.362 INFO:teuthology.kill: smithi172.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2fbqN1hKfS78aDp7Tx3/D0cd9Nc0rhLbBbnPRTY+l5Yw9Ua/cxd5hx/sO1zsf9QJ3NpKP/NXZ2R4ow/19IIPkoXzVjKyDLmrsJMIRHuRPnHGZCWU8h2Mgu24JQLmFw344JzXgQIISDINlFCsSoGpjJF4vnNPLIBFoM51ZUUOL265RzL/vE0XnpVN2jU+eB4aO9Qx15umg82ABW820ko59nyLEv4C111RHJ7Pg84+VHpLeghEyZcYr+5Pl/3No3s+ZHHQFNN5lcGTJiF99alDpbalAzHPiG9rGh9Xpp409Wbv72izRLosGBdwCnUppnQ224lHL+S7rCIFzUpL7dt+N 2021-02-09T14:50:25.362 INFO:teuthology.kill: smithi190.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCqjuXqhNWmoLVfOaVqHysdXsWJPfugtFzJKTConCePJyLef45OTwFF0q1B29G0wM7X1Mitu1JnpMxGQyT2i0vxDBLvjEugeGWEAM5OfXTKd2gBAnqzr7YBNk0toL9Cpv04tt30E1/11mPHTVlhcAY2Sxb728MrICU25nNS9jL9D4FrTqpCuwPxjommuBrxgk3NY7NPp1Hdowa9MusoqDviQYnyAIvwcHlKA6SG4LD0f9qlKZCj7NEFt0JkRicbrdiSGZ5eGLESdBQncFhENOfuN1WMwQF/kOEXNxj0Okkzvj0PfnXXr537g4ZNq/Y2lCHOY8Uxo7cLpofOi/ft+eqX 2021-02-09T14:50:25.390 INFO:teuthology.kill:2021-02-09 14:50:25,390.390 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-09T14:50:25.393 INFO:teuthology.kill:2021-02-09 14:50:25,392.392 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-09T14:50:25.395 INFO:teuthology.kill:2021-02-09 14:50:25,395.395 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-09T14:50:25.399 INFO:teuthology.kill:2021-02-09 14:50:25,399.399 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-09T14:50:25.402 INFO:teuthology.kill:2021-02-09 14:50:25,402.402 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-09T14:50:25.468 INFO:teuthology.kill:2021-02-09 14:50:25,468.468 INFO:teuthology.orchestra.console:Power off smithi190 2021-02-09T14:50:25.481 INFO:teuthology.kill:2021-02-09 14:50:25,481.481 INFO:teuthology.orchestra.console:Power off smithi138 2021-02-09T14:50:25.493 INFO:teuthology.kill:2021-02-09 14:50:25,492.492 INFO:teuthology.orchestra.console:Power off smithi172 2021-02-09T14:50:25.505 INFO:teuthology.kill:2021-02-09 14:50:25,505.505 INFO:teuthology.orchestra.console:Power off smithi086 2021-02-09T14:50:25.522 INFO:teuthology.kill:2021-02-09 14:50:25,522.522 INFO:teuthology.orchestra.console:Power off smithi082 2021-02-09T14:50:33.901 INFO:teuthology.kill:2021-02-09 14:50:33,901.901 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2021-02-09T14:50:33.910 INFO:teuthology.kill:2021-02-09 14:50:33,910.910 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2021-02-09T14:50:33.917 INFO:teuthology.kill:2021-02-09 14:50:33,917.917 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2021-02-09T14:50:33.930 INFO:teuthology.kill:2021-02-09 14:50:33,930.930 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2021-02-09T14:50:34.046 INFO:teuthology.kill:2021-02-09 14:50:34,045.045 INFO:teuthology.lock.ops:unlocked smithi172.front.sepia.ceph.com 2021-02-09T14:50:34.065 INFO:teuthology.kill:2021-02-09 14:50:34,065.065 INFO:teuthology.lock.ops:unlocked smithi086.front.sepia.ceph.com 2021-02-09T14:50:34.066 INFO:teuthology.kill:2021-02-09 14:50:34,066.066 INFO:teuthology.lock.ops:unlocked smithi190.front.sepia.ceph.com 2021-02-09T14:50:34.085 INFO:teuthology.kill:2021-02-09 14:50:34,084.084 INFO:teuthology.lock.ops:unlocked smithi082.front.sepia.ceph.com 2021-02-09T14:50:38.004 INFO:teuthology.kill:2021-02-09 14:50:38,004.004 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2021-02-09T14:50:38.145 INFO:teuthology.kill:2021-02-09 14:50:38,144.144 INFO:teuthology.lock.ops:unlocked smithi138.front.sepia.ceph.com 2021-02-09T14:52:38.331 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-02-09T14:52:38.635 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-02-09T14:52:38.635 INFO:teuthology.nuke:Checking targets against current locks 2021-02-09T14:52:38.778 INFO:teuthology.nuke:Not nuking smithi082.front.sepia.ceph.com because description doesn't match 2021-02-09T14:52:38.779 INFO:teuthology.nuke:Not nuking smithi190.front.sepia.ceph.com because description doesn't match 2021-02-09T14:52:38.779 INFO:teuthology.nuke:Not nuking smithi172.front.sepia.ceph.com because description doesn't match 2021-02-09T14:52:38.779 INFO:teuthology.nuke:Not nuking smithi138.front.sepia.ceph.com because description doesn't match 2021-02-09T14:52:38.779 INFO:teuthology.nuke:Not nuking smithi086.front.sepia.ceph.com because description doesn't match