2021-11-02T17:16:09.976 INFO:root:teuthology version: 1.1.0-c56135d1
2021-11-02T17:16:10.107 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging
2021-11-02T17:16:10.108 INFO:teuthology.lock.ops:Updating [ubuntu@smithi060.front.sepia.ceph.com]: reset os type and version on server
2021-11-02T17:16:10.108 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2021-11-02T17:16:10.128 INFO:teuthology.lock.ops:Node 'ubuntu@smithi060.front.sepia.ceph.com' reimaging is complete
2021-11-02T17:16:10.129 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi087.front.sepia.ceph.com' reimaging
2021-11-02T17:16:10.129 INFO:teuthology.lock.ops:Updating [ubuntu@smithi087.front.sepia.ceph.com]: reset os type and version on server
2021-11-02T17:16:10.130 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2021-11-02T17:16:10.149 INFO:teuthology.lock.ops:Node 'ubuntu@smithi087.front.sepia.ceph.com' reimaging is complete
2021-11-02T17:16:10.351 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of centos 8.3
2021-11-02T17:16:10.360 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of centos 8.3
2021-11-02T17:16:10.686 INFO:teuthology.orchestra.console:Power off smithi060
2021-11-02T17:16:10.729 INFO:teuthology.orchestra.console:Power off smithi087
2021-11-02T17:16:10.873 INFO:teuthology.orchestra.console:Power off for smithi087 completed
2021-11-02T17:16:10.974 INFO:teuthology.orchestra.console:Power on smithi087
2021-11-02T17:16:19.424 INFO:teuthology.orchestra.console:Power on for smithi087 completed
2021-11-02T17:16:19.525 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish
2021-11-02T17:16:23.176 INFO:teuthology.orchestra.console:Power off for smithi060 completed
2021-11-02T17:16:23.277 INFO:teuthology.orchestra.console:Power on smithi060
2021-11-02T17:16:27.531 INFO:teuthology.orchestra.console:Power on for smithi060 completed
2021-11-02T17:16:27.632 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish
2021-11-02T17:21:09.087 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-02T17:21:09.363 INFO:teuthology.provision.fog.smithi087:Node is ready
2021-11-02T17:21:09.380 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com
2021-11-02T17:21:09.436 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087
2021-11-02T17:21:09.751 INFO:teuthology.provision.fog.smithi087:Deploy complete!
2021-11-02T17:21:32.175 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-02T17:21:32.532 INFO:teuthology.provision.fog.smithi060:Node is ready
2021-11-02T17:21:32.548 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com
2021-11-02T17:21:32.605 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060
2021-11-02T17:21:32.922 INFO:teuthology.provision.fog.smithi060:Deploy complete!
2021-11-02T17:21:33.110 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com
2021-11-02T17:21:33.111 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-02T17:21:33.130 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com
2021-11-02T17:21:33.130 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-02T17:21:33.148 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server
2021-11-02T17:21:33.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com'
2021-11-02T17:21:33.422 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64
2021-11-02T17:21:33.478 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Linux"
2021-11-02T17:21:33.478 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8"
2021-11-02T17:21:33.478 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos"
2021-11-02T17:21:33.479 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora"
2021-11-02T17:21:33.479 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8"
2021-11-02T17:21:33.479 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8"
2021-11-02T17:21:33.479 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-02T17:21:33.480 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31"
2021-11-02T17:21:33.480 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-02T17:21:33.480 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/"
2021-11-02T17:21:33.480 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-02T17:21:33.481 INFO:teuthology.orchestra.run.smithi060.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-02T17:21:33.481 INFO:teuthology.orchestra.run.smithi060.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-02T17:21:33.482 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2021-11-02T17:21:33.499 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server
2021-11-02T17:21:33.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com'
2021-11-02T17:21:33.766 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64
2021-11-02T17:21:33.821 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Linux"
2021-11-02T17:21:33.821 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8"
2021-11-02T17:21:33.821 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos"
2021-11-02T17:21:33.822 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora"
2021-11-02T17:21:33.822 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8"
2021-11-02T17:21:33.822 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8"
2021-11-02T17:21:33.822 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-02T17:21:33.823 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31"
2021-11-02T17:21:33.823 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-02T17:21:33.823 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/"
2021-11-02T17:21:33.823 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-02T17:21:33.824 INFO:teuthology.orchestra.run.smithi087.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-02T17:21:33.824 INFO:teuthology.orchestra.run.smithi087.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-02T17:21:33.824 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server
2021-11-02T17:21:33.918 INFO:teuthology.dispatcher.supervisor:Running job 6477802
2021-11-02T17:21:33.919 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_swagner@teuthology --archive /home/teuthworker/archive/swagner-2021-11-02_13:16:45-orch:cephadm-wip-swagner-testing-2021-11-02-1007-distro-basic-smithi/6477802 --name swagner-2021-11-02_13:16:45-orch:cephadm-wip-swagner-testing-2021-11-02-1007-distro-basic-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/swagner-2021-11-02_13:16:45-orch:cephadm-wip-swagner-testing-2021-11-02-1007-distro-basic-smithi/6477802/orig.config.yaml
2021-11-02T17:21:33.922 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/swagner-2021-11-02_13:16:45-orch:cephadm-wip-swagner-testing-2021-11-02-1007-distro-basic-smithi/6477802
2021-11-02T17:21:33.923 INFO:teuthology.dispatcher.supervisor:Job PID: 19711
2021-11-02T17:21:33.923 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-03T05:22:28.731 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-03T05:22:28.952 INFO:teuthology.kill:Killing Pids: {19711}
2021-11-03T05:22:30.183 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-11-03T05:22:30.184 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-11-03T05:22:30.185 INFO:teuthology.misc:Compressing logs...
2021-11-03T05:22:30.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com'
2021-11-03T05:22:30.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com'
2021-11-03T05:22:30.714 INFO:teuthology.misc:Compressing logs...
2021-11-03T05:22:30.983 INFO:teuthology.misc:Compressing logs...
2021-11-03T05:22:34.324 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/3bd3a154-3c03-11ec-8c28-001a4aab830c/ceph-mon.smithi060.log: file size changed while zipping
2021-11-03T05:22:34.324 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/3bd3a154-3c03-11ec-8c28-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-03T05:22:34.626 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/3bd3a154-3c03-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi060.bqaboe.log: file size changed while zipping
2021-11-03T05:22:35.998 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/3bd3a154-3c03-11ec-8c28-001a4aab830c/ceph-mgr.smithi060.qzyity.log: file size changed while zipping
2021-11-03T05:22:37.782 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/3bd3a154-3c03-11ec-8c28-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-03T05:22:37.992 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/3bd3a154-3c03-11ec-8c28-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-03T05:22:39.348 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/3bd3a154-3c03-11ec-8c28-001a4aab830c/ceph-mon.smithi087.log: file size changed while zipping
2021-11-03T05:22:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/3bd3a154-3c03-11ec-8c28-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-03T05:22:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/3bd3a154-3c03-11ec-8c28-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-03T05:23:24.036 INFO:teuthology.kill:No teuthology processes running
2021-11-03T05:23:25.285 INFO:teuthology.kill:Nuking machines: ['smithi060', 'smithi087']
2021-11-03T05:23:26.248 INFO:teuthology.kill:2021-11-03 05:23:26,247.247 INFO:teuthology.nuke:targets:
2021-11-03T05:23:26.249 INFO:teuthology.kill:  smithi060.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdOJ32jCyLyO6PQ1XoJWSMFAtCA+Ot2EMIaPXr5UIC0NrkcvIH3+/ry7JveJwnSXGaWag4xESudnFmSapb8FJ03DV5n0q5cyzkBPGrmFPhBgs+YNDd3L7OEvGoDPIh2ejkM8P7gjClTMm/qeC4WrDEiB/ccHsTbvFX53IWfyYGC1EckbhFJ3zO09kLetdaOJtpbLxHHkj55CFVgOwdRfhdnT1OS2tXYb+XR0w3nvLkOfabIffWNOQ3GVCmIlbNxt2Nfm2SWwWyPmksinkgyeHAuSbGiZLmXsIDnt6z1DECD1zR5Zwk/K3gx3e4U+5dhLlG0W74zKFSO1bo5jd1W6YcFYvAUYZRhzwTs1VOoJWXeUb2IKuesZCvwx3wQ+PCzj10ECsoke4e6MEZ92VNxa22fC0MrsYANHEMjNNNCfga42YhgulbPNw64uyqf0hS9yNdxMIk2ntOHi5cm9+L181mVIV8GcMiT4Ga53LKfNmh8k71uOmotO5GhhplSeOb2Nk=
2021-11-03T05:23:26.249 INFO:teuthology.kill:  smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5xKxoMuWc8X7MicGt0JgpekA/2PQ61yZ1T8/IhDj5rZym7CMC+ObpemmkAuuDtLlWBmXc/i86uFeZLTimT524ec+huL36Fg7nHejW88D0wUh2aKVZissuKnfKZh3V7E8tZU2vNzie7xyTenzFqcZKBykwS6WOabS1XYMD52IM7JYm0It5K/Y8lVRUt5JSZ59BR7t47PpDPcsx1OhRzTjzlCmUVKbbmV28tUnLfEBQyfhw0hipOT13OaaPLKdFcnfZbkR/Z8AlLTYRpaXAjE8JHMSbBcUPjNuKKDq1Jy28zd93bHurYaHZy6S366JKev09SiVgJsZZYSuPNWoMb4SD7+BSKnpBCT/imnCaMDtbJxcPfUsFzdw5bz8R+DaePy0y8Db+9lXq920R9dIXax2pjLrwfwEzkrmPLK9gGp+ifHPfzzSywUuMxGASG+4xwZsdtRFAOiYgFGS52rdv9rAatuSUoewE3gDcjZiP94rAwr78+VsEhdQSDQuoOE4YoS8=
2021-11-03T05:23:26.276 INFO:teuthology.kill:2021-11-03 05:23:26,276.276 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-03T05:23:26.282 INFO:teuthology.kill:2021-11-03 05:23:26,282.282 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-03T05:23:26.362 INFO:teuthology.kill:2021-11-03 05:23:26,362.362 INFO:teuthology.orchestra.console:Power off smithi060
2021-11-03T05:23:26.376 INFO:teuthology.kill:2021-11-03 05:23:26,376.376 INFO:teuthology.orchestra.console:Power off smithi087
2021-11-03T05:23:34.735 INFO:teuthology.kill:2021-11-03 05:23:34,735.735 INFO:teuthology.orchestra.console:Power off for smithi060 completed
2021-11-03T05:23:34.740 INFO:teuthology.kill:2021-11-03 05:23:34,739.739 INFO:teuthology.orchestra.console:Power off for smithi087 completed
2021-11-03T05:23:34.897 INFO:teuthology.kill:2021-11-03 05:23:34,896.896 INFO:teuthology.lock.ops:unlocked: smithi087.front.sepia.ceph.com
2021-11-03T05:23:34.913 INFO:teuthology.kill:2021-11-03 05:23:34,912.912 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com
2021-11-03T05:25:35.265 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-03T05:25:35.390 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi060 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-02_19:46:34-fs-wip-yuri8-testing-2021-11-02-1009-pacific-distro-basic-smithi/6478984
2021-11-03T05:25:35.390 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi087 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-02_19:46:34-fs-wip-yuri8-testing-2021-11-02-1009-pacific-distro-basic-smithi/6478984