2021-11-06T23:43:25.057 INFO:root:teuthology version: 1.1.0-27954452
2021-11-06T23:43:25.182 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi152.front.sepia.ceph.com' reimaging
2021-11-06T23:43:25.183 INFO:teuthology.lock.ops:Updating [ubuntu@smithi152.front.sepia.ceph.com]: reset os type and version on server
2021-11-06T23:43:25.184 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2021-11-06T23:43:25.203 INFO:teuthology.lock.ops:Node 'ubuntu@smithi152.front.sepia.ceph.com' reimaging is complete
2021-11-06T23:43:25.204 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging
2021-11-06T23:43:25.204 INFO:teuthology.lock.ops:Updating [ubuntu@smithi197.front.sepia.ceph.com]: reset os type and version on server
2021-11-06T23:43:25.204 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2021-11-06T23:43:25.223 INFO:teuthology.lock.ops:Node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging is complete
2021-11-06T23:43:25.410 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.3
2021-11-06T23:43:25.431 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of centos 8.3
2021-11-06T23:43:25.723 INFO:teuthology.orchestra.console:Power off smithi152
2021-11-06T23:43:25.739 INFO:teuthology.orchestra.console:Power off smithi197
2021-11-06T23:43:38.209 INFO:teuthology.orchestra.console:Power off for smithi152 completed
2021-11-06T23:43:38.218 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2021-11-06T23:43:38.311 INFO:teuthology.orchestra.console:Power on smithi152
2021-11-06T23:43:38.320 INFO:teuthology.orchestra.console:Power on smithi197
2021-11-06T23:43:42.566 INFO:teuthology.orchestra.console:Power on for smithi152 completed
2021-11-06T23:43:42.667 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish
2021-11-06T23:43:46.693 INFO:teuthology.orchestra.console:Power on for smithi197 completed
2021-11-06T23:43:46.795 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish
2021-11-06T23:48:36.208 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-06T23:48:36.515 INFO:teuthology.provision.fog.smithi197:Node is ready
2021-11-06T23:48:36.531 INFO:teuthology.orchestra.run.smithi197.stdout:smithi197.front.sepia.ceph.com
2021-11-06T23:48:36.588 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197
2021-11-06T23:48:36.915 INFO:teuthology.provision.fog.smithi197:Deploy complete!
2021-11-06T23:48:47.164 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-06T23:48:47.470 INFO:teuthology.provision.fog.smithi152:Node is ready
2021-11-06T23:48:47.485 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com
2021-11-06T23:48:47.541 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152
2021-11-06T23:48:47.874 INFO:teuthology.provision.fog.smithi152:Deploy complete!
2021-11-06T23:48:48.060 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com
2021-11-06T23:48:48.061 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-06T23:48:48.080 INFO:teuthology.lock.ops:Checking smithi197.front.sepia.ceph.com
2021-11-06T23:48:48.080 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-06T23:48:48.099 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server
2021-11-06T23:48:48.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2021-11-06T23:48:48.299 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64
2021-11-06T23:48:48.353 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Linux"
2021-11-06T23:48:48.353 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8"
2021-11-06T23:48:48.354 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos"
2021-11-06T23:48:48.354 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora"
2021-11-06T23:48:48.354 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8"
2021-11-06T23:48:48.354 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2021-11-06T23:48:48.355 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-06T23:48:48.355 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2021-11-06T23:48:48.355 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-06T23:48:48.356 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/"
2021-11-06T23:48:48.356 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-06T23:48:48.356 INFO:teuthology.orchestra.run.smithi152.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-06T23:48:48.356 INFO:teuthology.orchestra.run.smithi152.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-06T23:48:48.358 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2021-11-06T23:48:48.387 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: set os type and version on server
2021-11-06T23:48:48.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2021-11-06T23:48:48.650 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64
2021-11-06T23:48:48.706 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="CentOS Linux"
2021-11-06T23:48:48.706 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8"
2021-11-06T23:48:48.706 INFO:teuthology.orchestra.run.smithi197.stdout:ID="centos"
2021-11-06T23:48:48.707 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="rhel fedora"
2021-11-06T23:48:48.707 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8"
2021-11-06T23:48:48.707 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8"
2021-11-06T23:48:48.707 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-06T23:48:48.708 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31"
2021-11-06T23:48:48.708 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-06T23:48:48.708 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://centos.org/"
2021-11-06T23:48:48.708 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-06T23:48:48.708 INFO:teuthology.orchestra.run.smithi197.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-06T23:48:48.709 INFO:teuthology.orchestra.run.smithi197.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-06T23:48:48.709 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2021-11-06T23:48:48.811 INFO:teuthology.dispatcher.supervisor:Running job 6488848
2021-11-06T23:48:48.812 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-11-06_17:09:50-upgrade-wip-yuri-testing-master-11.5.21-distro-basic-smithi/6488848 --name yuriw-2021-11-06_17:09:50-upgrade-wip-yuri-testing-master-11.5.21-distro-basic-smithi --description upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2021-11-06_17:09:50-upgrade-wip-yuri-testing-master-11.5.21-distro-basic-smithi/6488848/orig.config.yaml
2021-11-06T23:48:48.815 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-11-06_17:09:50-upgrade-wip-yuri-testing-master-11.5.21-distro-basic-smithi/6488848
2021-11-06T23:48:48.816 INFO:teuthology.dispatcher.supervisor:Job PID: 29505
2021-11-06T23:48:48.816 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-07T11:49:43.290 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-07T11:49:43.525 INFO:teuthology.kill:Killing Pids: {29505}
2021-11-07T11:49:44.641 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-11-07T11:49:44.642 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-11-07T11:49:44.642 INFO:teuthology.misc:Compressing logs...
2021-11-07T11:49:44.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2021-11-07T11:49:44.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2021-11-07T11:49:45.154 INFO:teuthology.misc:Compressing logs...
2021-11-07T11:49:45.437 INFO:teuthology.misc:Compressing logs...
2021-11-07T11:49:59.647 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/bf05bcb2-3f5d-11ec-8c28-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-07T11:50:05.965 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/bf05bcb2-3f5d-11ec-8c28-001a4aab830c/ceph-mon.smithi197.log: file size changed while zipping
2021-11-07T11:50:05.999 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/bf05bcb2-3f5d-11ec-8c28-001a4aab830c/ceph-mon.smithi152.log: file size changed while zipping
2021-11-07T11:50:14.693 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/bf05bcb2-3f5d-11ec-8c28-001a4aab830c/ceph-mgr.smithi152.ykqjhf.log: file size changed while zipping
2021-11-07T11:50:23.540 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/bf05bcb2-3f5d-11ec-8c28-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-07T11:50:36.847 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /var/log/ceph/bf05bcb2-3f5d-11ec-8c28-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-07T11:50:52.273 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/bf05bcb2-3f5d-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi152.onyryl.log: file size changed while zipping
2021-11-07T11:51:07.012 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/bf05bcb2-3f5d-11ec-8c28-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-07T11:51:19.974 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/bf05bcb2-3f5d-11ec-8c28-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-07T11:51:35.352 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/bf05bcb2-3f5d-11ec-8c28-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-07T11:51:46.026 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/bf05bcb2-3f5d-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi152.volckt.log: file size changed while zipping
2021-11-07T11:52:22.716 INFO:teuthology.kill:No teuthology processes running
2021-11-07T11:52:23.800 INFO:teuthology.kill:Nuking machines: ['smithi152', 'smithi197']
2021-11-07T11:52:24.724 INFO:teuthology.kill:2021-11-07 11:52:24,724.724 INFO:teuthology.nuke:targets:
2021-11-07T11:52:24.725 INFO:teuthology.kill:  smithi152.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOPCGY8nsooUu2Bygwb5WyV1hE93+866+qbva3fXmwEOtwQzQbcyKGjVtIxaRZFYT80jzKRwnpPgXmr2EfyZM7DZefNJU9JCdZ3X4S0qEOyJsaU+dbrFJYUHF1IrViR4rXmdHuWYNqmgrb6mIr8vAkvk4Ff8CcasyBqZRWD0b82TN4xH4osG5kqCaNrGEO2ti5Jyj+PBimmWMO3LpYEnBGMsN/DTjG33HNPMSjH0iCGS6/BzS+CvOgi5u7+m930blBl6xX4xo6Ri+UQ+PEx46/KPV7Zuk7OMH94WhMSg+jKggX19A9NyNXe5W+JycYnj2uMm0phXR4X2MWpZZggu7Yxf06otojkH06kwGy/e17cmSwEtEn9MVCj1M4ApV0l3DxriesieGNwdSc3N/Kt7gWwh1kErYNXAH3xvawGGKs0FOZvHMtITtLk8owprI7DHiWuqmZDaT7otOjNlsj36ZzfBkptyKq3kzJY2xroZz/ivjtHj7XKdMnMwEspmJYAAM=
2021-11-07T11:52:24.725 INFO:teuthology.kill:  smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDI8du4u1ysStb87DtXRrNZkwNNaLySGYEqf8m39JWO5dr7iKYgm638M+uuELVAqv5yqXQsoFdpINe2wAfX1kvhiS/IL8wBXZ1KG00pWl97wN/HWup1SPemxcD+oijMrW30Hv3WsFi0w/BFaLKIVdfNDUksZ3EuARMfXL4Nt6zVbq4OKR/zSK66jrDj/jcLMKuF4DdHxxQ8IJpaOHy1A/aD6oqquy3TsfOs8KiLA/6awj7/VCw6DXCaZF4wXJb6KkmesP0LDFI88jOUyG8AVV2yT/xpyJfgQrv3qvRMHvk2d9Xd3f374BvjRTm+Tpea3msmb0lWsRiOL92nlTpuWOl3J+xJ1kep/5GM2uC1GpHQhd3T8WLYzwYDotGEnkiWy1I74+ILlT/MmXSb/g6Q+cMtDvD762QksUBWq32td9N1xVoF9Bet3T1Hyf+Rem2n8M8VFMp0SfhI63/P0mQI4dCusN8E+RT0TAvFDAjz2pCSFz/qMK49V6pMy7lgTYb/xPE=
2021-11-07T11:52:24.753 INFO:teuthology.kill:2021-11-07 11:52:24,753.753 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-07T11:52:24.757 INFO:teuthology.kill:2021-11-07 11:52:24,757.757 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-07T11:52:24.832 INFO:teuthology.kill:2021-11-07 11:52:24,832.832 INFO:teuthology.orchestra.console:Power off smithi152
2021-11-07T11:52:24.844 INFO:teuthology.kill:2021-11-07 11:52:24,844.844 INFO:teuthology.orchestra.console:Power off smithi197
2021-11-07T11:52:33.195 INFO:teuthology.kill:2021-11-07 11:52:33,195.195 INFO:teuthology.orchestra.console:Power off for smithi152 completed
2021-11-07T11:52:33.364 INFO:teuthology.kill:2021-11-07 11:52:33,363.363 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com
2021-11-07T11:52:37.319 INFO:teuthology.kill:2021-11-07 11:52:37,319.319 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2021-11-07T11:52:37.464 INFO:teuthology.kill:2021-11-07 11:52:37,463.463 INFO:teuthology.lock.ops:unlocked: smithi197.front.sepia.ceph.com
2021-11-07T11:54:37.776 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-07T11:54:37.890 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi152 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-05_18:36:21-rados-wip-yuri2-testing-2021-11-05-0903-pacific-distro-basic-smithi/6487279
2021-11-07T11:54:37.890 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi197 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-05_18:36:21-rados-wip-yuri2-testing-2021-11-05-0903-pacific-distro-basic-smithi/6487278