2021-11-26T13:17:48.611 INFO:root:teuthology version: 1.1.0-a0bc3188
2021-11-26T13:17:48.756 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging
2021-11-26T13:17:48.757 INFO:teuthology.lock.ops:Updating [ubuntu@smithi077.front.sepia.ceph.com]: reset os type and version on server
2021-11-26T13:17:48.757 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2021-11-26T13:17:48.778 INFO:teuthology.lock.ops:Node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging is complete
2021-11-26T13:17:48.779 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi112.front.sepia.ceph.com' reimaging
2021-11-26T13:17:48.779 INFO:teuthology.lock.ops:Updating [ubuntu@smithi112.front.sepia.ceph.com]: reset os type and version on server
2021-11-26T13:17:48.779 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2021-11-26T13:17:48.801 INFO:teuthology.lock.ops:Node 'ubuntu@smithi112.front.sepia.ceph.com' reimaging is complete
2021-11-26T13:17:48.996 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 8.stream
2021-11-26T13:17:49.011 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 8.stream
2021-11-26T13:17:49.410 INFO:teuthology.orchestra.console:Power off smithi077
2021-11-26T13:17:49.428 INFO:teuthology.orchestra.console:Power off smithi112
2021-11-26T13:17:57.790 INFO:teuthology.orchestra.console:Power off for smithi077 completed
2021-11-26T13:17:57.797 INFO:teuthology.orchestra.console:Power off for smithi112 completed
2021-11-26T13:17:57.892 INFO:teuthology.orchestra.console:Power on smithi077
2021-11-26T13:17:57.899 INFO:teuthology.orchestra.console:Power on smithi112
2021-11-26T13:18:06.264 INFO:teuthology.orchestra.console:Power on for smithi112 completed
2021-11-26T13:18:06.367 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2021-11-26T13:18:06.372 INFO:teuthology.orchestra.console:Power on for smithi077 completed
2021-11-26T13:18:06.473 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish
2021-11-26T13:22:56.488 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-26T13:22:56.793 INFO:teuthology.provision.fog.smithi077:Node is ready
2021-11-26T13:22:56.809 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com
2021-11-26T13:22:56.867 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077
2021-11-26T13:22:57.206 INFO:teuthology.provision.fog.smithi077:Deploy complete!
2021-11-26T13:23:11.412 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-26T13:23:11.688 INFO:teuthology.provision.fog.smithi112:Node is ready
2021-11-26T13:23:11.706 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com
2021-11-26T13:23:11.763 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112
2021-11-26T13:23:12.108 INFO:teuthology.provision.fog.smithi112:Deploy complete!
2021-11-26T13:23:12.274 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com
2021-11-26T13:23:12.275 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-26T13:23:12.294 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com
2021-11-26T13:23:12.295 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-26T13:23:12.314 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server
2021-11-26T13:23:12.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com'
2021-11-26T13:23:12.551 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64
2021-11-26T13:23:12.607 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream"
2021-11-26T13:23:12.607 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8"
2021-11-26T13:23:12.607 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos"
2021-11-26T13:23:12.608 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora"
2021-11-26T13:23:12.608 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8"
2021-11-26T13:23:12.608 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8"
2021-11-26T13:23:12.608 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 8"
2021-11-26T13:23:12.609 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31"
2021-11-26T13:23:12.609 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-26T13:23:12.609 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/"
2021-11-26T13:23:12.610 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-26T13:23:12.610 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-26T13:23:12.610 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-11-26T13:23:12.611 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2021-11-26T13:23:12.631 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server
2021-11-26T13:23:12.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com'
2021-11-26T13:23:12.817 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64
2021-11-26T13:23:12.871 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream"
2021-11-26T13:23:12.872 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8"
2021-11-26T13:23:12.872 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos"
2021-11-26T13:23:12.872 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora"
2021-11-26T13:23:12.873 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8"
2021-11-26T13:23:12.873 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2021-11-26T13:23:12.873 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 8"
2021-11-26T13:23:12.873 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2021-11-26T13:23:12.873 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-11-26T13:23:12.874 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/"
2021-11-26T13:23:12.874 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-26T13:23:12.874 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-26T13:23:12.874 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-11-26T13:23:12.875 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2021-11-26T13:23:12.998 INFO:teuthology.dispatcher.supervisor:Running job 6526908
2021-11-26T13:23:12.998 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a0bc318848afe71da1fbf34e1e1b44738d8e3d6d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-11-25_15:23:56-rados-wip-yuriw-master-11.24.21-distro-basic-smithi/6526908 --name yuriw-2021-11-25_15:23:56-rados-wip-yuriw-master-11.24.21-distro-basic-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2021-11-25_15:23:56-rados-wip-yuriw-master-11.24.21-distro-basic-smithi/6526908/orig.config.yaml
2021-11-26T13:23:13.002 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-11-25_15:23:56-rados-wip-yuriw-master-11.24.21-distro-basic-smithi/6526908
2021-11-26T13:23:13.002 INFO:teuthology.dispatcher.supervisor:Job PID: 29088
2021-11-26T13:23:13.003 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-27T01:24:08.615 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-11-27T01:24:08.814 INFO:teuthology.kill:Killing Pids: {29088}
2021-11-27T01:24:10.088 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2021-11-27T01:24:10.089 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2021-11-27T01:24:10.090 INFO:teuthology.misc:Compressing logs...
2021-11-27T01:24:10.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com'
2021-11-27T01:24:10.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com'
2021-11-27T01:24:10.592 INFO:teuthology.misc:Compressing logs...
2021-11-27T01:24:11.641 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-11-27T01:24:12.034 INFO:teuthology.misc:Compressing logs...
2021-11-27T01:24:14.382 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-mds.cephfs.smithi112.ynmkda.log: file size changed while zipping
2021-11-27T01:24:33.437 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-mds.cephfs.smithi077.nprzbp.log: file size changed while zipping
2021-11-27T01:24:36.426 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-11-27T01:24:41.163 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-mgr.smithi077.zcvdle.log: file size changed while zipping
2021-11-27T01:24:53.692 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-11-27T01:24:55.055 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-11-27T01:24:58.364 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-mds.cephfs.smithi077.zvbedf.log: file size changed while zipping
2021-11-27T01:25:03.072 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-mon.smithi112.log: file size changed while zipping
2021-11-27T01:25:10.547 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-11-27T01:25:28.052 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-mds.cephfs.smithi112.jmladh.log: file size changed while zipping
2021-11-27T01:25:30.744 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-mon.smithi077.log: file size changed while zipping
2021-11-27T01:25:41.334 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-11-27T01:25:45.614 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/d34f2d38-4ebd-11ec-8c2d-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-11-27T01:26:22.707 INFO:teuthology.kill:No teuthology processes running
2021-11-27T01:26:23.975 INFO:teuthology.kill:Nuking machines: ['smithi077', 'smithi112']
2021-11-27T01:26:24.962 INFO:teuthology.kill:2021-11-27 01:26:24,961.961 INFO:teuthology.nuke:targets:
2021-11-27T01:26:24.963 INFO:teuthology.kill:  smithi077.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEuB5INkFhSdIYGGIyRDedBB2uPg9NavnS2CKOEegUuSZTJ9kXGF+WKtbuQgzZDhVfmP+VRPNwmdF0Yc4nNueBSRF876+tT3ddi3st6DcReBlyS5PgTF2MUpJ/T1xnqw4ZUE/0RZAWFFdzy5tz9m5zwlrVeWOehgJswU64t0Oh2yqwIYhtM+fT3lvuL7SQy7YE5/ttJZXj7W8v0i7hkZG5WjVqvMBmZrNdh8ZMPGPfq8+VSTWFGe2Ll6dLgz/7h0fMtjDdNvVIlZqBp3HrbUAY1fQvwY2ryuCyRWKUf9i36h+0mkHNcWz8sFm/0ntzF7L0yYGamkkw+B9ZqjvCy8D9WKCKiLuS/s3C6yrzHEtyTT8x2qmXG0VXsGGulFzMU9/CK7r4/vleF9rWws643uB/Rfeqm7azO/UPYlb0P5qn6zpaGyAG2TPYvA0AOyDD3ZPEtP82h2ADSthnknGz9K5bsWoPrsCaLaxK9tbYEGDxSzUvhnpG1azk2WFYAyMmtCk=
2021-11-27T01:26:24.963 INFO:teuthology.kill:  smithi112.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmPBZeAuMtPmM6CUW+BTzhWz9IKQ6WfgvA3t6sT1M/Md4GhlVxsgPGPfXFjfvSj28N3Fz4yRV3CaLBGlADUL0ztZxENbi7lg3VipjJiYrGhDJDYQhGMFHw70Omp9+f9Qk+J13jMML77M1W46ac9Z4pCfuMqoSDVtt1Ss0lt3eaeFvSBcDeloOR183H90SmwEmEPd8VBBbJ1q8Jvb8zJsEGA29XfJrsk2ZXSbx6d2BW9xrkhEE4CLTiCGx3aFo1nSpxwNpymU2IsQViSjDyp2aI2Vk+Jg/Wl5qARXIOPz4dvoIz0Td28u4SLg2/sm6o+eFT/SpUQT5l3qa/MxIHTQ54GZ97a2OmeE/J1ehopsfyv4AJ9ezdYLzQnu1bM2k4Tu8lcCkHrOxUSOV759rs/3rQCe15XWBqiq+Be8zITDPU6TxYqpdj7mxC5Vy8M8SmEHqFPibFNHapPL1Sf6jlX1qo981U2Zc8ju99UvZ+fae2f1vgMSqPNKVVzkanHdrnFvc=
2021-11-27T01:26:24.989 INFO:teuthology.kill:2021-11-27 01:26:24,989.989 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-27T01:26:24.992 INFO:teuthology.kill:2021-11-27 01:26:24,992.992 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-27T01:26:25.068 INFO:teuthology.kill:2021-11-27 01:26:25,068.068 INFO:teuthology.orchestra.console:Power off smithi112
2021-11-27T01:26:25.083 INFO:teuthology.kill:2021-11-27 01:26:25,082.082 INFO:teuthology.orchestra.console:Power off smithi077
2021-11-27T01:26:33.457 INFO:teuthology.kill:2021-11-27 01:26:33,456.456 INFO:teuthology.orchestra.console:Power off for smithi077 completed
2021-11-27T01:26:33.601 INFO:teuthology.kill:2021-11-27 01:26:33,600.600 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com
2021-11-27T01:26:37.555 INFO:teuthology.kill:2021-11-27 01:26:37,554.554 INFO:teuthology.orchestra.console:Power off for smithi112 completed
2021-11-27T01:26:37.701 INFO:teuthology.kill:2021-11-27 01:26:37,701.701 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com
2021-11-27T01:28:38.004 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-27T01:28:38.115 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi077 but it was locked by another job: /home/teuthworker/archive/soumyakoduri-2021-11-26_18:20:05-rgw-wip-skoduri-dbstore-mp-distro-basic-smithi/6529413
2021-11-27T01:28:38.115 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi112 but it was locked by another job: /home/teuthworker/archive/soumyakoduri-2021-11-26_18:20:05-rgw-wip-skoduri-dbstore-mp-distro-basic-smithi/6529413