2021-11-03T12:24:27.517 INFO:root:teuthology version: 1.1.0-c56135d1
2021-11-03T12:24:27.641 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi057.front.sepia.ceph.com' reimaging
2021-11-03T12:24:27.642 INFO:teuthology.lock.ops:Updating [ubuntu@smithi057.front.sepia.ceph.com]: reset os type and version on server
2021-11-03T12:24:27.642 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2021-11-03T12:24:27.669 INFO:teuthology.lock.ops:Node 'ubuntu@smithi057.front.sepia.ceph.com' reimaging is complete
2021-11-03T12:24:27.669 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging
2021-11-03T12:24:27.670 INFO:teuthology.lock.ops:Updating [ubuntu@smithi164.front.sepia.ceph.com]: reset os type and version on server
2021-11-03T12:24:27.670 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2021-11-03T12:24:27.696 INFO:teuthology.lock.ops:Node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging is complete
2021-11-03T12:24:27.877 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of centos 8.3
2021-11-03T12:24:27.910 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 8.3
2021-11-03T12:24:28.245 INFO:teuthology.orchestra.console:Power off smithi057
2021-11-03T12:24:28.263 INFO:teuthology.orchestra.console:Power off smithi164
2021-11-03T12:24:36.617 INFO:teuthology.orchestra.console:Power off for smithi057 completed
2021-11-03T12:24:36.623 INFO:teuthology.orchestra.console:Power off for smithi164 completed
2021-11-03T12:24:36.719 INFO:teuthology.orchestra.console:Power on smithi057
2021-11-03T12:24:36.727 INFO:teuthology.orchestra.console:Power on smithi164
2021-11-03T12:24:45.094 INFO:teuthology.orchestra.console:Power on for smithi164 completed
2021-11-03T12:24:45.131 INFO:teuthology.orchestra.console:Power on for smithi057 completed
2021-11-03T12:24:45.195 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish
2021-11-03T12:24:45.232 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish
2021-11-03T12:29:12.037 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-03T12:29:32.163 INFO:teuthology.provision.fog.smithi164:Node is ready
2021-11-03T12:29:32.183 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com
2021-11-03T12:29:32.241 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164
2021-11-03T12:29:32.606 INFO:teuthology.provision.fog.smithi164:Deploy complete!
2021-11-03T12:29:34.675 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-03T12:29:34.947 INFO:teuthology.provision.fog.smithi057:Node is ready
2021-11-03T12:29:34.963 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com
2021-11-03T12:29:35.019 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057
2021-11-03T12:29:35.364 INFO:teuthology.provision.fog.smithi057:Deploy complete!
2021-11-03T12:29:35.516 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com
2021-11-03T12:29:35.517 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-03T12:29:35.537 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com
2021-11-03T12:29:35.537 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-03T12:29:35.557 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server
2021-11-03T12:29:35.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2021-11-03T12:29:35.764 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64
2021-11-03T12:29:35.820 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Linux"
2021-11-03T12:29:35.820 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8"
2021-11-03T12:29:35.821 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos"
2021-11-03T12:29:35.821 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora"
2021-11-03T12:29:35.821 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8"
2021-11-03T12:29:35.821 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8"
2021-11-03T12:29:35.822 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-03T12:29:35.822 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2021-11-03T12:29:35.822 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-03T12:29:35.822 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/"
2021-11-03T12:29:35.823 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-03T12:29:35.823 INFO:teuthology.orchestra.run.smithi057.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-03T12:29:35.823 INFO:teuthology.orchestra.run.smithi057.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-03T12:29:35.824 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2021-11-03T12:29:35.843 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server
2021-11-03T12:29:35.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2021-11-03T12:29:36.112 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64
2021-11-03T12:29:36.167 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Linux"
2021-11-03T12:29:36.167 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8"
2021-11-03T12:29:36.167 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos"
2021-11-03T12:29:36.168 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora"
2021-11-03T12:29:36.168 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8"
2021-11-03T12:29:36.168 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8"
2021-11-03T12:29:36.168 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-03T12:29:36.169 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2021-11-03T12:29:36.169 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-03T12:29:36.169 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/"
2021-11-03T12:29:36.169 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-03T12:29:36.169 INFO:teuthology.orchestra.run.smithi164.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-03T12:29:36.170 INFO:teuthology.orchestra.run.smithi164.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-03T12:29:36.170 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2021-11-03T12:29:36.262 INFO:teuthology.dispatcher.supervisor:Running job 6481201
2021-11-03T12:29:36.262 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_swagner@teuthology --archive /home/teuthworker/archive/swagner-2021-11-03_11:47:26-orch:cephadm-wip-swagner-testing-2021-11-03-0958-distro-basic-smithi/6481201 --name swagner-2021-11-03_11:47:26-orch:cephadm-wip-swagner-testing-2021-11-03-0958-distro-basic-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/swagner-2021-11-03_11:47:26-orch:cephadm-wip-swagner-testing-2021-11-03-0958-distro-basic-smithi/6481201/orig.config.yaml
2021-11-03T12:29:36.265 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/swagner-2021-11-03_11:47:26-orch:cephadm-wip-swagner-testing-2021-11-03-0958-distro-basic-smithi/6481201
2021-11-03T12:29:36.266 INFO:teuthology.dispatcher.supervisor:Job PID: 9083
2021-11-03T12:29:36.267 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-04T00:30:30.235 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-04T00:30:30.444 INFO:teuthology.kill:Killing Pids: {9083}
2021-11-04T00:30:31.583 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-11-04T00:30:31.584 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-11-04T00:30:31.584 INFO:teuthology.misc:Compressing logs...
2021-11-04T00:30:31.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2021-11-04T00:30:31.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2021-11-04T00:30:32.096 INFO:teuthology.misc:Compressing logs...
2021-11-04T00:30:32.445 INFO:teuthology.misc:Compressing logs...
2021-11-04T00:30:48.100 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/6fde06ce-3ca3-11ec-8c28-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-04T00:31:08.896 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/6fde06ce-3ca3-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi057.tgrvzk.log: file size changed while zipping
2021-11-04T00:31:32.211 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/6fde06ce-3ca3-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi164.jpjiqe.log: file size changed while zipping
2021-11-04T00:31:34.223 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/6fde06ce-3ca3-11ec-8c28-001a4aab830c/ceph-mon.smithi057.log: file size changed while zipping
2021-11-04T00:31:37.580 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/6fde06ce-3ca3-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi057.xirpau.log: file size changed while zipping
2021-11-04T00:31:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/6fde06ce-3ca3-11ec-8c28-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-04T00:31:54.694 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/6fde06ce-3ca3-11ec-8c28-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-04T00:32:05.071 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/6fde06ce-3ca3-11ec-8c28-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-04T00:32:09.768 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/6fde06ce-3ca3-11ec-8c28-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-04T00:32:12.340 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/6fde06ce-3ca3-11ec-8c28-001a4aab830c/ceph-mon.smithi164.log: file size changed while zipping
2021-11-04T00:32:27.912 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/6fde06ce-3ca3-11ec-8c28-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-04T00:32:40.240 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/6fde06ce-3ca3-11ec-8c28-001a4aab830c/ceph-mgr.smithi057.qreqyy.log: file size changed while zipping
2021-11-04T00:33:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:tar: .: file changed as we read it
2021-11-04T00:33:27.313 INFO:teuthology.kill:No teuthology processes running
2021-11-04T00:33:28.437 INFO:teuthology.kill:Nuking machines: ['smithi057', 'smithi164']
2021-11-04T00:33:29.465 INFO:teuthology.kill:2021-11-04 00:33:29,465.465 INFO:teuthology.nuke:targets:
2021-11-04T00:33:29.466 INFO:teuthology.kill:  smithi057.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD1TrvL5CzBOoUYGx5qqSBk87L1On+3F0dpfbkFyqopEAOtYNBjHCv2OCYzr4YoinJAmGMYYc2XykxQuHgcN3huRzSemMHpUAvYuFKxmx8driqanFLg3vleIrfsIDk09uxtKMbBBfwBqXp6xvLsupLPJ2TFBfF7hrb1JbHX8J8Y/0I5XcJXQa/FX+bI/Dej8sY53G/aBvMA1EuqrRym85U6HY8L3VD3PMN+A6sC3vY+j4UPhmiysCVOVf+bBg3uLyJAUg7dwXyi5Ohb4NV6uxmdJQS43Q/8Ai23RWpp7UMK5tz0L7P3NbfjcfBKZCZx3JCf16MFSp0Wn+BfqWZTSDoTaxd8WcZTdT3i4hRy8xs/cplfL1Z/phqwQeZERZVMywmalkjs4dUcUQWsqISs5IKb7zew8cNC1tDVVaCUh2BdYkDCzPbOUEE4nKdfVtlf567giuv6Q8o1fvIOYYPI+R0mSjZ03q1nxhUXCrPlSf2v95XZ3RyEkP6Py/zvmdti0qs=
2021-11-04T00:33:29.466 INFO:teuthology.kill:  smithi164.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDT+80Ok5DIDWLjAG+OOe+vISoSKTUinGTnWC+CNU9cggSMIdgcgpHknw7TG6Aucz97EwD/hE4RJQpjRyY+RcDI0jBGc+BgoR2o36sFYOljkX54cdy095yneEOQoyPivgxjUIQzB//SkZDNJ0sAnlmiOdpBtkCpJzKn2b9c7iGzjbKe+z8w4Ig4uwtxL2baYXv6rLm4I88Srr/MLrqrZB3Cr3W8bhgGFnLZ95gbDTWzedjsSt0IGfOJ763fAimY/5EPwGqjSp924xHT/bnIwqpqpmqViJdGv7ewmuokrcNgoxR3d4RHGieFDYLY6YcSPUUAlNRiCQufTdPPMDZQTpp9KWOuLTrXZt6f0TcDOyBjyHUsBOMeDRcnINtyuViIZgFEtGdrJdJbXZUBdiy1KmDSnC32j9FTMTV93/zbilQfdkHujIo9APnzyUzRdQ7FBAur9f7qT2YqZkLQ5PTHYhVdTd317ZGaUFtWz3QPaHMXbF4K7haNlXjW6TqRUSdFR7k=
2021-11-04T00:33:29.495 INFO:teuthology.kill:2021-11-04 00:33:29,495.495 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-04T00:33:29.500 INFO:teuthology.kill:2021-11-04 00:33:29,499.499 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-04T00:33:29.580 INFO:teuthology.kill:2021-11-04 00:33:29,579.579 INFO:teuthology.orchestra.console:Power off smithi057
2021-11-04T00:33:29.593 INFO:teuthology.kill:2021-11-04 00:33:29,593.593 INFO:teuthology.orchestra.console:Power off smithi164
2021-11-04T00:33:37.956 INFO:teuthology.kill:2021-11-04 00:33:37,955.955 INFO:teuthology.orchestra.console:Power off for smithi164 completed
2021-11-04T00:33:38.112 INFO:teuthology.kill:2021-11-04 00:33:38,112.112 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com
2021-11-04T00:33:42.062 INFO:teuthology.kill:2021-11-04 00:33:42,061.061 INFO:teuthology.orchestra.console:Power off for smithi057 completed
2021-11-04T00:33:42.214 INFO:teuthology.kill:2021-11-04 00:33:42,214.214 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com
2021-11-04T00:35:42.529 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-04T00:35:42.663 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi164 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-03_20:04:59-rados-wip-yuri4-testing-2021-11-03-1142-pacific-distro-basic-smithi/6483147