2022-02-07T15:27:31.492 INFO:root:teuthology version: 1.1.0-3094160c
2022-02-07T15:27:31.614 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging
2022-02-07T15:27:31.615 INFO:teuthology.lock.ops:Updating [ubuntu@smithi140.front.sepia.ceph.com]: reset os type and version on server
2022-02-07T15:27:31.616 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2022-02-07T15:27:31.634 INFO:teuthology.lock.ops:Node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging is complete
2022-02-07T15:27:31.634 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi152.front.sepia.ceph.com' reimaging
2022-02-07T15:27:31.634 INFO:teuthology.lock.ops:Updating [ubuntu@smithi152.front.sepia.ceph.com]: reset os type and version on server
2022-02-07T15:27:31.635 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2022-02-07T15:27:31.654 INFO:teuthology.lock.ops:Node 'ubuntu@smithi152.front.sepia.ceph.com' reimaging is complete
2022-02-07T15:27:31.873 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.4
2022-02-07T15:27:31.887 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of rhel 8.4
2022-02-07T15:27:32.175 INFO:teuthology.orchestra.console:Power off smithi140
2022-02-07T15:27:32.212 INFO:teuthology.orchestra.console:Power off smithi152
2022-02-07T15:27:40.549 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2022-02-07T15:27:40.651 INFO:teuthology.orchestra.console:Power on smithi140
2022-02-07T15:27:44.690 INFO:teuthology.orchestra.console:Power off for smithi152 completed
2022-02-07T15:27:44.792 INFO:teuthology.orchestra.console:Power on smithi152
2022-02-07T15:27:49.111 INFO:teuthology.orchestra.console:Power on for smithi140 completed
2022-02-07T15:27:49.212 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish
2022-02-07T15:27:53.160 INFO:teuthology.orchestra.console:Power on for smithi152 completed
2022-02-07T15:27:53.262 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish
2022-02-07T15:32:45.203 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-07T15:32:45.419 INFO:teuthology.provision.fog.smithi140:Node is ready
2022-02-07T15:32:45.435 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com
2022-02-07T15:32:45.492 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140
2022-02-07T15:32:45.820 INFO:teuthology.provision.fog.smithi140:Deploy complete!
2022-02-07T15:32:49.123 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-07T15:32:49.332 INFO:teuthology.provision.fog.smithi152:Node is ready
2022-02-07T15:32:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com
2022-02-07T15:32:49.402 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152
2022-02-07T15:32:49.726 INFO:teuthology.provision.fog.smithi152:Deploy complete!
2022-02-07T15:32:49.869 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com
2022-02-07T15:32:49.870 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-07T15:32:49.890 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com
2022-02-07T15:32:49.890 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-07T15:32:49.907 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server
2022-02-07T15:32:49.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com'
2022-02-07T15:32:50.142 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64
2022-02-07T15:32:50.198 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Red Hat Enterprise Linux"
2022-02-07T15:32:50.198 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8.4 (Ootpa)"
2022-02-07T15:32:50.198 INFO:teuthology.orchestra.run.smithi140.stdout:ID="rhel"
2022-02-07T15:32:50.198 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="fedora"
2022-02-07T15:32:50.199 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8.4"
2022-02-07T15:32:50.199 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8"
2022-02-07T15:32:50.199 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-02-07T15:32:50.199 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31"
2022-02-07T15:32:50.200 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-02-07T15:32:50.200 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.redhat.com/"
2022-02-07T15:32:50.200 INFO:teuthology.orchestra.run.smithi140.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-02-07T15:32:50.200 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-07T15:32:50.201 INFO:teuthology.orchestra.run.smithi140.stdout:
2022-02-07T15:32:50.201 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-07T15:32:50.201 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-02-07T15:32:50.201 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-02-07T15:32:50.202 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-02-07T15:32:50.203 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2022-02-07T15:32:50.222 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server
2022-02-07T15:32:50.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2022-02-07T15:32:50.441 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64
2022-02-07T15:32:50.496 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux"
2022-02-07T15:32:50.496 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.4 (Ootpa)"
2022-02-07T15:32:50.496 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel"
2022-02-07T15:32:50.497 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora"
2022-02-07T15:32:50.497 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.4"
2022-02-07T15:32:50.497 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2022-02-07T15:32:50.497 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-02-07T15:32:50.498 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2022-02-07T15:32:50.498 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-02-07T15:32:50.498 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/"
2022-02-07T15:32:50.498 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-02-07T15:32:50.499 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-07T15:32:50.499 INFO:teuthology.orchestra.run.smithi152.stdout:
2022-02-07T15:32:50.499 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-07T15:32:50.499 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-02-07T15:32:50.499 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-02-07T15:32:50.500 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-02-07T15:32:50.500 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2022-02-07T15:32:50.590 INFO:teuthology.dispatcher.supervisor:Running job 6666523
2022-02-07T15:32:50.591 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3094160cc590b786a43d55faaf7c99d5de71ce56/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi/6666523 --name benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi/6666523/orig.config.yaml
2022-02-07T15:32:50.594 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi/6666523
2022-02-07T15:32:50.595 INFO:teuthology.dispatcher.supervisor:Job PID: 14783
2022-02-07T15:32:50.595 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-07T22:03:19.967 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-07T22:03:20.190 INFO:teuthology.kill:Killing Pids: {14783}
2022-02-07T22:03:21.387 INFO:teuthology.task.internal:roles: ubuntu@smithi140.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-02-07T22:03:21.388 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-02-07T22:03:21.388 INFO:teuthology.misc:Compressing logs...
2022-02-07T22:03:21.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com'
2022-02-07T22:03:21.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2022-02-07T22:03:21.939 INFO:teuthology.misc:Compressing logs...
2022-02-07T22:03:22.497 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-07T22:03:22.616 INFO:teuthology.orchestra.run.smithi140.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-07T22:03:22.998 INFO:teuthology.misc:Compressing logs...
2022-02-07T22:03:30.267 INFO:teuthology.kill:No teuthology processes running
2022-02-07T22:03:31.420 INFO:teuthology.kill:Nuking machines: ['smithi140', 'smithi152']
2022-02-07T22:03:32.409 INFO:teuthology.kill:2022-02-07 22:03:32,408.408 INFO:teuthology.nuke:targets:
2022-02-07T22:03:32.410 INFO:teuthology.kill:  smithi140.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwutnv+0o7cIAf7Atqg94P46AaUkiuDTn1xUHrvuLCPww9mwqQRCcT4xZ3Act21Nj4BBTU1mii3hOtxL6gq+gWQy8VbltHaptmeCRmjGx14uLhrYj7A8bHSOkwcItOKNspmb6Z6CVa1CAJbPMpBo6wuEnbAxED66t0/MufdOMPUM2ieyEARrmcukQqRmHlqz7xhTPJ+dUAfg/xFMf92WijoNFKrqe1DvOt/IRDYnZPpDzE0UnCiLFpbqQaxIJUQj8h/wJrcFCu0rCE3LkfSo2IgvHEX6cgYEZKLAQ4Mo/vJq2KB68YogXdbxnsJQUS2wEisvbtRuW9zM+hGPixvptHuXJJMxjrbNVLIIE7yiVFp7y+c7SiFHxJy4kY48TP5hV8LMawfWAfH4xBgSy41vBL5sS7awPM2BRB1Dc4lRgfhYq7rEavO/eRv15yjlLd2wr4blGP23kwN71me7wqtfrdAcGKm3YwzAqbniJq7HYUSySmarT95AcIAXc5sfjNiKE=
2022-02-07T22:03:32.410 INFO:teuthology.kill:  smithi152.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtCJil1NySAo+YONKeDW+cHPCmWiW2AIsEScEMDd21b7nd9zAA+6iAhvGlcg506Kbq2UbRNvyJuD0xaxaDHKJ7ceKYHswSYy3XjShG5O6O2VUIicIPZ8hXIyxD/t129uPtI+XXxAGQbzY0wvxNnAbA0tFH9/I1NhBAF+gJ6jU8Sg36yVJ5AndZWxel4JuCHy+UtdJm2Xz2kIvcURTaXrrIzZVI3oYNc2XxEq5o5Ec2iBM2FCjj57sMLqPtmEblGwLY2QWCdn7gTvPlS0KcYir/RvJW1dLmlfCKjXtpUPKJY+tEOcr81KXlumt2DQmpCEP2JHRjqCDUJ9KY7hJQSsANNykRq0YcHf4bP5nq8//xlmIWdgqP5e+jS5YbcIENK42Xmd1sS3PJWVKR8C1wUnESN9UKIAbKw31yUMDzZc3bzyu9QBzFzuBwq3ixmZGzmhyhYiFEocKvvj0p5e+H/X7GYTxfOUFTb2QFFQXCa7lew+xk88qTxr4C0ctLHkZZIm8=
2022-02-07T22:03:32.437 INFO:teuthology.kill:2022-02-07 22:03:32,437.437 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-07T22:03:32.440 INFO:teuthology.kill:2022-02-07 22:03:32,440.440 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-07T22:03:32.520 INFO:teuthology.kill:2022-02-07 22:03:32,520.520 INFO:teuthology.orchestra.console:Power off smithi152
2022-02-07T22:03:32.534 INFO:teuthology.kill:2022-02-07 22:03:32,534.534 INFO:teuthology.orchestra.console:Power off smithi140
2022-02-07T22:03:45.007 INFO:teuthology.kill:2022-02-07 22:03:45,006.006 INFO:teuthology.orchestra.console:Power off for smithi152 completed
2022-02-07T22:03:45.013 INFO:teuthology.kill:2022-02-07 22:03:45,013.013 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2022-02-07T22:03:45.153 INFO:teuthology.kill:2022-02-07 22:03:45,153.153 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com
2022-02-07T22:03:45.157 INFO:teuthology.kill:2022-02-07 22:03:45,157.157 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com
2022-02-07T22:05:45.456 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-07T22:05:45.559 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi140 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-07_20:08:36-rados-wip-yuri4-testing-2022-02-07-1051-octopus-distro-default-smithi/6666998
2022-02-07T22:05:45.560 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi152 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-07_20:08:36-rados-wip-yuri4-testing-2022-02-07-1051-octopus-distro-default-smithi/6666998