2021-02-10T00:16:37.108 INFO:root:teuthology version: 1.1.0-17c09965
2021-02-10T00:16:37.224 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi071.front.sepia.ceph.com' reimaging
2021-02-10T00:16:37.225 INFO:teuthology.lock.ops:Updating [ubuntu@smithi071.front.sepia.ceph.com]: reset os type and version on server
2021-02-10T00:16:37.225 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server
2021-02-10T00:16:37.244 INFO:teuthology.lock.ops:Node 'ubuntu@smithi071.front.sepia.ceph.com' reimaging is complete
2021-02-10T00:16:37.244 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi072.front.sepia.ceph.com' reimaging
2021-02-10T00:16:37.244 INFO:teuthology.lock.ops:Updating [ubuntu@smithi072.front.sepia.ceph.com]: reset os type and version on server
2021-02-10T00:16:37.244 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2021-02-10T00:16:37.264 INFO:teuthology.lock.ops:Node 'ubuntu@smithi072.front.sepia.ceph.com' reimaging is complete
2021-02-10T00:16:37.457 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.3
2021-02-10T00:16:37.466 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of rhel 8.3
2021-02-10T00:16:37.822 INFO:teuthology.orchestra.console:Power off smithi071
2021-02-10T00:16:37.936 INFO:teuthology.orchestra.console:Power off smithi072
2021-02-10T00:16:46.219 INFO:teuthology.orchestra.console:Power off for smithi071 completed
2021-02-10T00:16:46.303 INFO:teuthology.orchestra.console:Power off for smithi072 completed
2021-02-10T00:16:46.320 INFO:teuthology.orchestra.console:Power on smithi071
2021-02-10T00:16:46.404 INFO:teuthology.orchestra.console:Power on smithi072
2021-02-10T00:16:54.728 INFO:teuthology.orchestra.console:Power on for smithi071 completed
2021-02-10T00:16:54.828 INFO:teuthology.orchestra.console:Power on for smithi072 completed
2021-02-10T00:16:54.829 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish
2021-02-10T00:16:54.929 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish
2021-02-10T00:19:26.014 ERROR:teuthology.orchestra.connection:Error authenticating with smithi071.front.sepia.ceph.com: Authentication failed.
2021-02-10T00:21:39.653 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-10T00:21:40.255 INFO:teuthology.provision.fog.smithi071:Node is ready
2021-02-10T00:21:40.273 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com
2021-02-10T00:21:40.330 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071
2021-02-10T00:21:40.672 INFO:teuthology.provision.fog.smithi071:Deploy complete!
2021-02-10T00:22:21.010 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-10T00:22:21.324 INFO:teuthology.provision.fog.smithi072:Node is ready
2021-02-10T00:22:21.337 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com
2021-02-10T00:22:21.391 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072
2021-02-10T00:22:21.709 INFO:teuthology.provision.fog.smithi072:Deploy complete!
2021-02-10T00:22:21.824 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com
2021-02-10T00:22:21.825 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-10T00:22:21.839 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com
2021-02-10T00:22:21.840 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-10T00:22:21.852 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server
2021-02-10T00:22:21.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-10T00:22:22.139 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64
2021-02-10T00:22:22.193 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Red Hat Enterprise Linux"
2021-02-10T00:22:22.193 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8.3 (Ootpa)"
2021-02-10T00:22:22.193 INFO:teuthology.orchestra.run.smithi071.stdout:ID="rhel"
2021-02-10T00:22:22.193 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="fedora"
2021-02-10T00:22:22.193 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8.3"
2021-02-10T00:22:22.193 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8"
2021-02-10T00:22:22.193 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-02-10T00:22:22.193 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31"
2021-02-10T00:22:22.194 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-02-10T00:22:22.194 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.redhat.com/"
2021-02-10T00:22:22.194 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-02-10T00:22:22.194 INFO:teuthology.orchestra.run.smithi071.stdout:
2021-02-10T00:22:22.194 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-02-10T00:22:22.194 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-02-10T00:22:22.194 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-02-10T00:22:22.194 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-02-10T00:22:22.195 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server
2021-02-10T00:22:22.210 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server
2021-02-10T00:22:22.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-10T00:22:22.489 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64
2021-02-10T00:22:22.544 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux"
2021-02-10T00:22:22.544 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.3 (Ootpa)"
2021-02-10T00:22:22.545 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel"
2021-02-10T00:22:22.545 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora"
2021-02-10T00:22:22.545 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.3"
2021-02-10T00:22:22.545 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8"
2021-02-10T00:22:22.545 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-02-10T00:22:22.545 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31"
2021-02-10T00:22:22.546 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-02-10T00:22:22.546 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/"
2021-02-10T00:22:22.546 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-02-10T00:22:22.546 INFO:teuthology.orchestra.run.smithi072.stdout:
2021-02-10T00:22:22.546 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-02-10T00:22:22.547 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-02-10T00:22:22.547 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-02-10T00:22:22.547 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-02-10T00:22:22.548 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2021-02-10T00:22:22.640 INFO:teuthology.dispatcher.supervisor:Running job 5871551
2021-02-10T00:22:22.641 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/virtualenv/bin/teuthology -v --owner scheduled_sseshasa@teuthology --archive /home/teuthworker/archive/sseshasa-2021-02-09_10:39:09-rados-wip-sseshasa-testing-2021-02-02-1136-distro-basic-smithi/5871551 --name sseshasa-2021-02-09_10:39:09-rados-wip-sseshasa-testing-2021-02-02-1136-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests} -- /home/teuthworker/archive/sseshasa-2021-02-09_10:39:09-rados-wip-sseshasa-testing-2021-02-02-1136-distro-basic-smithi/5871551/orig.config.yaml
2021-02-10T00:22:22.643 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sseshasa-2021-02-09_10:39:09-rados-wip-sseshasa-testing-2021-02-02-1136-distro-basic-smithi/5871551
2021-02-10T00:22:22.644 INFO:teuthology.dispatcher.supervisor:Job PID: 4335
2021-02-10T00:22:22.644 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-02-10T12:22:38.706 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-02-10T12:22:38.851 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-02-10T12:22:38.851 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-02-10T12:22:38.851 INFO:teuthology.misc:Compressing logs...
2021-02-10T12:22:38.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-10T12:22:39.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-10T12:22:39.610 INFO:teuthology.misc:Compressing logs...
2021-02-10T12:22:40.279 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-02-10T12:22:40.592 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-02-10T12:24:20.657 INFO:teuthology.misc:Compressing logs...
2021-02-10T12:25:49.440 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/ceph-osd.0.log: file size changed while zipping
2021-02-10T12:26:16.871 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/ceph-osd.5.log: file size changed while zipping
2021-02-10T12:26:22.654 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/ceph-mgr.x.log: file size changed while zipping
2021-02-10T12:27:18.607 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/ceph-mon.b.log: file size changed while zipping
2021-02-10T12:27:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/ceph.log: file size changed while zipping
2021-02-10T12:29:03.427 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/ceph-osd.1.log: file size changed while zipping
2021-02-10T12:32:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/ceph-osd.2.log: file size changed while zipping
2021-02-10T12:35:54.949 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/ceph-osd.3.log: file size changed while zipping
2021-02-10T12:37:54.101 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/ceph-mon.a.log: file size changed while zipping
2021-02-10T12:38:56.829 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/ceph-mon.c.log: file size changed while zipping
2021-02-10T12:39:27.361 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/ceph.log: file size changed while zipping
2021-02-10T12:41:53.365 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/ceph-mgr.y.log: file size changed while zipping
2021-02-10T12:41:53.950 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/ceph.audit.log: file size changed while zipping
2021-02-10T12:43:08.475 INFO:teuthology.orchestra.run.smithi071.stderr:tar: ./ceph-osd.3.log: file changed as we read it
2021-02-10T12:43:34.560 INFO:teuthology.orchestra.run.smithi071.stderr:tar: ./ceph-osd.2.log: file changed as we read it
2021-02-10T12:43:40.244 INFO:teuthology.orchestra.run.smithi071.stderr:tar: ./ceph-osd.0.log: file changed as we read it
2021-02-10T12:45:00.426 INFO:teuthology.orchestra.run.smithi071.stderr:tar: ./ceph-osd.1.log: file changed as we read it
2021-02-10T12:45:04.326 INFO:teuthology.orchestra.run.smithi071.stderr:tar: ./ceph.log: file changed as we read it
2021-02-10T12:45:54.141 INFO:teuthology.orchestra.run.smithi071.stderr:tar: .: file changed as we read it
2021-02-10T12:45:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:tar: ./ceph-osd.5.log: file changed as we read it
2021-02-10T12:46:45.129 INFO:teuthology.kill:Killing Pids: {4335}
2021-02-10T12:46:46.076 INFO:teuthology.kill:Nuking machines: ['smithi071', 'smithi072']
2021-02-10T12:46:46.817 INFO:teuthology.kill:2021-02-10 12:46:46,817.817 INFO:teuthology.nuke:targets:
2021-02-10T12:46:46.817 INFO:teuthology.kill:  smithi071.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDo3YCIOd7U1N0ylcn1WT+1434UVCW9zDsiyksK7o2Eb/rk6m3F0djkHPem5GjRGhKQxWKicO9NuABcuJHnJG0G9vGZW/Si6Qt0MJQMahxws/BGw1LGZShQ/G33IrIeAkM35g/E4Q0iGpDPCDVMBw945CN2vxfzXVxcqbRqdnbktjUp0ueDmEZmwqKos4s5Ha4afDdeofeMMa8CaNkcA8Q2t66hUjj4OxtNyJbcgjWa7Zdr/MQYJy2ejyxDDHGXGra38Gio4AIyjRPzHlFQ0l9Z3I/pXiAbKh3nDYzGHUx1RWHkAY5XEXklZPX8ZsuE/OcjJiH2J3JhEv7okiuh4vdTqkdtevL/cXCwYuKyh/RFSf6EpKpX9M7gPJSR7FXD8Z2Vsiny1txc5J2j9mJIA5KXdNITDvLTJ8O1F4bmC1EwGo27Qa5uR2afRyjL1IGPQRCAFk2R3nI6xJBj1DebgXNQFpBbRWGq97alX6HSwRpIWJxHJKrYgO2ELjNQWRoE5ts=
2021-02-10T12:46:46.817 INFO:teuthology.kill:  smithi072.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYrpWRFCr3mztF2A2z9X1iGKt2bochkMxv+g89SKWtI7nmTdra2vwfT0RvYr4L3M1ZuJ6AW1b49S9cVHmmLJn+wybIvjbtmdR5OEWpDanTAohFRroUVewqvPNdi00F2Qw+9gf/sK6gsLVD5JxJpTH9FoPajrL1id/IyY36OB9gS28foHIkZ8++VBiqa9FBOjEaGmGJhXVi7xPb9xT3W90KWpqsnUhP2zUuqqD0EgKdtFX/yoC/u+PPwQ3wQREHKtPgTfqm6cQLBGjous1IUaCTUqSTodZLnbyRFu6Bt3s4q558Run51cmiDRYq5evgoOvfxXfKD03SRzdY1u1QEWPtnzqATbBmvvxMZYFUTJkARSxC9zwNFYIxGl2CQIH9NFc5i23spQpz419OL1KcR9Ma0X2obBvxtsooEYR5lNQBynXb1cUHBNKreqqdZ+7JuHzsultI9wjcq5ZW3jo70PWrONnlC7iWfMD1cYqcR+DcsvCN4E3GR2GjZTPYk3ITCy8=
2021-02-10T12:46:46.841 INFO:teuthology.kill:2021-02-10 12:46:46,840.840 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-10T12:46:46.843 INFO:teuthology.kill:2021-02-10 12:46:46,843.843 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-10T12:46:46.900 INFO:teuthology.kill:2021-02-10 12:46:46,900.900 INFO:teuthology.orchestra.console:Power off smithi071
2021-02-10T12:46:46.912 INFO:teuthology.kill:2021-02-10 12:46:46,912.912 INFO:teuthology.orchestra.console:Power off smithi072
2021-02-10T12:46:55.270 INFO:teuthology.kill:2021-02-10 12:46:55,269.269 INFO:teuthology.orchestra.console:Power off for smithi072 completed
2021-02-10T12:46:55.412 INFO:teuthology.kill:2021-02-10 12:46:55,411.411 INFO:teuthology.lock.ops:unlocked smithi072.front.sepia.ceph.com
2021-02-10T12:46:59.375 INFO:teuthology.kill:2021-02-10 12:46:59,375.375 INFO:teuthology.orchestra.console:Power off for smithi071 completed
2021-02-10T12:46:59.515 INFO:teuthology.kill:2021-02-10 12:46:59,514.514 INFO:teuthology.lock.ops:unlocked smithi071.front.sepia.ceph.com
2021-02-10T12:48:59.676 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-02-10T12:48:59.768 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-02-10T12:48:59.768 INFO:teuthology.nuke:Checking targets against current locks
2021-02-10T12:48:59.842 INFO:teuthology.nuke:Not nuking smithi072.front.sepia.ceph.com because description doesn't match
2021-02-10T12:48:59.843 INFO:teuthology.nuke:Not nuking smithi071.front.sepia.ceph.com because description doesn't match