2021-11-03T12:07:29.020 INFO:root:teuthology version: 1.1.0-c56135d1
2021-11-03T12:07:29.156 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi033.front.sepia.ceph.com' reimaging
2021-11-03T12:07:29.157 INFO:teuthology.lock.ops:Updating [ubuntu@smithi033.front.sepia.ceph.com]: reset os type and version on server
2021-11-03T12:07:29.157 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2021-11-03T12:07:29.176 INFO:teuthology.lock.ops:Node 'ubuntu@smithi033.front.sepia.ceph.com' reimaging is complete
2021-11-03T12:07:29.177 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi045.front.sepia.ceph.com' reimaging
2021-11-03T12:07:29.177 INFO:teuthology.lock.ops:Updating [ubuntu@smithi045.front.sepia.ceph.com]: reset os type and version on server
2021-11-03T12:07:29.178 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2021-11-03T12:07:29.210 INFO:teuthology.lock.ops:Node 'ubuntu@smithi045.front.sepia.ceph.com' reimaging is complete
2021-11-03T12:07:29.435 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 8.3
2021-11-03T12:07:29.455 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 8.3
2021-11-03T12:07:29.817 INFO:teuthology.orchestra.console:Power off smithi045
2021-11-03T12:07:29.835 INFO:teuthology.orchestra.console:Power off smithi033
2021-11-03T12:07:29.976 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2021-11-03T12:07:29.987 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2021-11-03T12:07:30.079 INFO:teuthology.orchestra.console:Power on smithi045
2021-11-03T12:07:30.089 INFO:teuthology.orchestra.console:Power on smithi033
2021-11-03T12:07:34.357 INFO:teuthology.orchestra.console:Power on for smithi033 completed
2021-11-03T12:07:34.459 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish
2021-11-03T12:07:38.461 INFO:teuthology.orchestra.console:Power on for smithi045 completed
2021-11-03T12:07:38.563 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish
2021-11-03T12:12:12.916 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-03T12:12:13.208 INFO:teuthology.provision.fog.smithi045:Node is ready
2021-11-03T12:12:13.224 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com
2021-11-03T12:12:13.279 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045
2021-11-03T12:12:13.618 INFO:teuthology.provision.fog.smithi045:Deploy complete!
2021-11-03T12:12:54.151 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-03T12:12:54.418 INFO:teuthology.provision.fog.smithi033:Node is ready
2021-11-03T12:12:54.434 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com
2021-11-03T12:12:54.492 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033
2021-11-03T12:12:54.838 INFO:teuthology.provision.fog.smithi033:Deploy complete!
2021-11-03T12:12:55.031 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com
2021-11-03T12:12:55.032 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-03T12:12:55.053 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com
2021-11-03T12:12:55.053 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-03T12:12:55.072 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server
2021-11-03T12:12:55.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com'
2021-11-03T12:12:55.293 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64
2021-11-03T12:12:55.351 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Linux"
2021-11-03T12:12:55.351 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8"
2021-11-03T12:12:55.351 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos"
2021-11-03T12:12:55.352 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora"
2021-11-03T12:12:55.352 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8"
2021-11-03T12:12:55.352 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2021-11-03T12:12:55.352 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-03T12:12:55.352 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2021-11-03T12:12:55.353 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-03T12:12:55.353 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/"
2021-11-03T12:12:55.353 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-03T12:12:55.353 INFO:teuthology.orchestra.run.smithi033.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-03T12:12:55.353 INFO:teuthology.orchestra.run.smithi033.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-03T12:12:55.355 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2021-11-03T12:12:55.373 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server
2021-11-03T12:12:55.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2021-11-03T12:12:55.646 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64
2021-11-03T12:12:55.701 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Linux"
2021-11-03T12:12:55.701 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8"
2021-11-03T12:12:55.702 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos"
2021-11-03T12:12:55.702 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora"
2021-11-03T12:12:55.703 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8"
2021-11-03T12:12:55.703 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8"
2021-11-03T12:12:55.703 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Linux 8"
2021-11-03T12:12:55.703 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2021-11-03T12:12:55.704 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-03T12:12:55.704 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/"
2021-11-03T12:12:55.704 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-11-03T12:12:55.704 INFO:teuthology.orchestra.run.smithi045.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-11-03T12:12:55.704 INFO:teuthology.orchestra.run.smithi045.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-11-03T12:12:55.705 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2021-11-03T12:12:55.811 INFO:teuthology.dispatcher.supervisor:Running job 6481181
2021-11-03T12:12:55.812 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_swagner@teuthology --archive /home/teuthworker/archive/swagner-2021-11-03_11:47:26-orch:cephadm-wip-swagner-testing-2021-11-03-0958-distro-basic-smithi/6481181 --name swagner-2021-11-03_11:47:26-orch:cephadm-wip-swagner-testing-2021-11-03-0958-distro-basic-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/swagner-2021-11-03_11:47:26-orch:cephadm-wip-swagner-testing-2021-11-03-0958-distro-basic-smithi/6481181/orig.config.yaml
2021-11-03T12:12:55.816 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/swagner-2021-11-03_11:47:26-orch:cephadm-wip-swagner-testing-2021-11-03-0958-distro-basic-smithi/6481181
2021-11-03T12:12:55.817 INFO:teuthology.dispatcher.supervisor:Job PID: 17801
2021-11-03T12:12:55.817 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-04T00:13:49.493 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-04T00:13:54.798 INFO:teuthology.kill:Killing Pids: {17801}
2021-11-04T00:13:55.927 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-11-04T00:13:55.928 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-11-04T00:13:55.928 INFO:teuthology.misc:Compressing logs...
2021-11-04T00:13:55.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com'
2021-11-04T00:13:56.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2021-11-04T00:13:56.451 INFO:teuthology.misc:Compressing logs...
2021-11-04T00:13:56.811 INFO:teuthology.misc:Compressing logs...
2021-11-04T00:14:09.336 INFO:teuthology.orchestra.run.smithi033.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-mgr.smithi033.ttfrpl.log: file size changed while zipping
2021-11-04T00:14:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-04T00:14:17.734 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi045.rfgpag.log: file size changed while zipping
2021-11-04T00:14:34.812 INFO:teuthology.orchestra.run.smithi033.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-mon.smithi033.log: file size changed while zipping
2021-11-04T00:14:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-04T00:14:51.686 INFO:teuthology.orchestra.run.smithi033.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-04T00:14:54.802 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-04T00:15:03.677 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-mon.smithi045.log: file size changed while zipping
2021-11-04T00:15:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi033.beuyex.log: file size changed while zipping
2021-11-04T00:15:35.672 INFO:teuthology.orchestra.run.smithi033.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-04T00:15:41.358 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi045.bbktzt.log: file size changed while zipping
2021-11-04T00:15:53.884 INFO:teuthology.orchestra.run.smithi033.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-04T00:16:02.043 INFO:teuthology.orchestra.run.smithi033.stderr:gzip: /var/log/ceph/1d16f272-3ca1-11ec-8c28-001a4aab830c/ceph-mds.cephfs.smithi033.rjydyw.log: file size changed while zipping
2021-11-04T00:16:47.298 INFO:teuthology.kill:No teuthology processes running
2021-11-04T00:16:48.450 INFO:teuthology.kill:Nuking machines: ['smithi033', 'smithi045']
2021-11-04T00:16:49.491 INFO:teuthology.kill:2021-11-04 00:16:49,491.491 INFO:teuthology.nuke:targets:
2021-11-04T00:16:49.492 INFO:teuthology.kill:  smithi033.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfSEU4+zWylQYG4SnHVnwmWmdf6mBdW+Vst+TD3aWEr/ge+lA2zHOMdawcDz9aUJBPnlTBnRJZob9MASh+sYnnJSOyblQgemoyon2yYF9LknXJsWRIrl4lEwcXiPdXnfDrQWVIrK6/mLiQ5uMujSvnqu+EsLC+M6XtDsL9HY/ZTvpMj9Grwm3GdnPdk7axqdCasTRZJAvYwWlM8o3p4ke1uS0Oo7Lt/6IpqXUUtYBqSs/HTubWZX6MKsW+3WKWTJyPZLOq1s3Z7NYCDBhMxLQJdmGJ6pJxxAhY2I/A9/7SeqhP2s8A9krPqT3iVBBJc1CZIR6IxO4i7LBeYINixVve68/CCHTbNr+0wM2X/E4slbVsM1iYApfX2R7+VcQ6GKu2PUS8R14pHCtDgPjoICM4yJtH6yN4Nu1yx0PvJebIJLOJK1JYWjSkEIjHgcTm09kV1UJluSkNgrS/k0az4J/J8q5MkicycxGfdevC1MPq/GKr4rnUh61wxD6vQFbuKT0=
2021-11-04T00:16:49.493 INFO:teuthology.kill:  smithi045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8sFNOLZ6eumjWOMjtVSUxz5q+TlBSlnABfSS3z37uIlyuNM9aWMEOVmlRtpQFl5zbIhCafzoA0PWA0b2M8JXqz96RRZ9UdnHDERDhqZ2gPJ+mmjh6pMZynkXQGtZlg9wuOag1A5GIkhQ3jdJnUduDEUlCg824Xj5nXJbXjUf2Mca8QfYEbisAMJfPenhF2erymmQ4nzFed8bpd1j+mSsR71bduw4Wk8NkISyaqBW8oSLWHSwnVkWLzXibEAtP3/7PvVE8MqLGyFx7xqscnTrWF9hFuZWEVOMx+DAhtpiS5kDdcPE0xfsAlxtqnxIbs8wuqiQTvLIyQNl22FGup7UgPt28gDQIYwlms1PnJI1vhRPXZEGOD/TJ1rRIdT1jiZIPG2FZ9CpFDGbHPgPHxGzG3ZhlQOGBmjUlD/wrCuusY6OmVj8iTRjo38EyArUFoBz4Z2g9S0TwxlduiK/TegVrhWnKnXIOv9+1yCsyVzMD9sT3QBruSXwyvaEpDc0UOts=
2021-11-04T00:16:49.518 INFO:teuthology.kill:2021-11-04 00:16:49,518.518 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-04T00:16:49.521 INFO:teuthology.kill:2021-11-04 00:16:49,521.521 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-04T00:16:49.602 INFO:teuthology.kill:2021-11-04 00:16:49,601.601 INFO:teuthology.orchestra.console:Power off smithi045
2021-11-04T00:16:49.616 INFO:teuthology.kill:2021-11-04 00:16:49,615.615 INFO:teuthology.orchestra.console:Power off smithi033
2021-11-04T00:16:57.990 INFO:teuthology.kill:2021-11-04 00:16:57,989.989 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2021-11-04T00:16:58.135 INFO:teuthology.kill:2021-11-04 00:16:58,134.134 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com
2021-11-04T00:17:02.092 INFO:teuthology.kill:2021-11-04 00:17:02,092.092 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2021-11-04T00:17:02.239 INFO:teuthology.kill:2021-11-04 00:17:02,239.239 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com
2021-11-04T00:19:02.555 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-04T00:19:02.681 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi045 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-03_20:04:59-rados-wip-yuri4-testing-2021-11-03-1142-pacific-distro-basic-smithi/6483125