2021-12-06T17:08:19.896 INFO:root:teuthology version: 1.1.0-844d1377
2021-12-06T17:08:20.018 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi148.front.sepia.ceph.com' reimaging
2021-12-06T17:08:20.019 INFO:teuthology.lock.ops:Updating [ubuntu@smithi148.front.sepia.ceph.com]: reset os type and version on server
2021-12-06T17:08:20.019 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2021-12-06T17:08:20.036 INFO:teuthology.lock.ops:Node 'ubuntu@smithi148.front.sepia.ceph.com' reimaging is complete
2021-12-06T17:08:20.037 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging
2021-12-06T17:08:20.037 INFO:teuthology.lock.ops:Updating [ubuntu@smithi164.front.sepia.ceph.com]: reset os type and version on server
2021-12-06T17:08:20.037 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2021-12-06T17:08:20.056 INFO:teuthology.lock.ops:Node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging is complete
2021-12-06T17:08:20.250 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of rhel 8.4
2021-12-06T17:08:20.272 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of rhel 8.4
2021-12-06T17:08:20.665 INFO:teuthology.orchestra.console:Power off smithi164
2021-12-06T17:08:20.682 INFO:teuthology.orchestra.console:Power off smithi148
2021-12-06T17:08:29.045 INFO:teuthology.orchestra.console:Power off for smithi164 completed
2021-12-06T17:08:29.053 INFO:teuthology.orchestra.console:Power off for smithi148 completed
2021-12-06T17:08:29.146 INFO:teuthology.orchestra.console:Power on smithi164
2021-12-06T17:08:29.154 INFO:teuthology.orchestra.console:Power on smithi148
2021-12-06T17:08:37.518 INFO:teuthology.orchestra.console:Power on for smithi148 completed
2021-12-06T17:08:37.570 INFO:teuthology.orchestra.console:Power on for smithi164 completed
2021-12-06T17:08:37.620 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish
2021-12-06T17:08:37.672 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish
2021-12-06T17:13:42.646 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-06T17:13:42.695 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-06T17:13:42.850 INFO:teuthology.provision.fog.smithi164:Node is ready
2021-12-06T17:13:42.866 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com
2021-12-06T17:13:42.908 INFO:teuthology.provision.fog.smithi148:Node is ready
2021-12-06T17:13:42.921 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164
2021-12-06T17:13:42.924 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com
2021-12-06T17:13:42.979 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148
2021-12-06T17:13:43.248 INFO:teuthology.provision.fog.smithi164:Deploy complete!
2021-12-06T17:13:43.305 INFO:teuthology.provision.fog.smithi148:Deploy complete!
2021-12-06T17:13:43.453 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com
2021-12-06T17:13:43.454 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-06T17:13:43.473 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com
2021-12-06T17:13:43.473 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-06T17:13:43.493 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server
2021-12-06T17:13:43.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com'
2021-12-06T17:13:43.715 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64
2021-12-06T17:13:43.769 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux"
2021-12-06T17:13:43.769 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.4 (Ootpa)"
2021-12-06T17:13:43.769 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel"
2021-12-06T17:13:43.770 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora"
2021-12-06T17:13:43.770 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.4"
2021-12-06T17:13:43.770 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8"
2021-12-06T17:13:43.770 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-12-06T17:13:43.771 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31"
2021-12-06T17:13:43.771 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-12-06T17:13:43.771 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/"
2021-12-06T17:13:43.771 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-12-06T17:13:43.772 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-06T17:13:43.772 INFO:teuthology.orchestra.run.smithi148.stdout:
2021-12-06T17:13:43.772 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-06T17:13:43.772 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-12-06T17:13:43.773 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-12-06T17:13:43.773 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-12-06T17:13:43.774 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2021-12-06T17:13:43.796 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server
2021-12-06T17:13:43.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2021-12-06T17:13:44.018 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64
2021-12-06T17:13:44.072 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux"
2021-12-06T17:13:44.072 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.4 (Ootpa)"
2021-12-06T17:13:44.072 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel"
2021-12-06T17:13:44.073 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora"
2021-12-06T17:13:44.073 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.4"
2021-12-06T17:13:44.073 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8"
2021-12-06T17:13:44.074 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-12-06T17:13:44.074 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2021-12-06T17:13:44.074 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-12-06T17:13:44.074 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/"
2021-12-06T17:13:44.074 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-12-06T17:13:44.075 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-06T17:13:44.075 INFO:teuthology.orchestra.run.smithi164.stdout:
2021-12-06T17:13:44.075 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-06T17:13:44.076 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-12-06T17:13:44.076 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-12-06T17:13:44.076 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-12-06T17:13:44.077 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2021-12-06T17:13:44.177 INFO:teuthology.dispatcher.supervisor:Running job 6547766
2021-12-06T17:13:44.178 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-12-06_16:41:40-rados-WIP_GBH_safe_fast_shutdown_2-distro-basic-smithi/6547766 --name benhanokh-2021-12-06_16:41:40-rados-WIP_GBH_safe_fast_shutdown_2-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} -- /home/teuthworker/archive/benhanokh-2021-12-06_16:41:40-rados-WIP_GBH_safe_fast_shutdown_2-distro-basic-smithi/6547766/orig.config.yaml
2021-12-06T17:13:44.181 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-12-06_16:41:40-rados-WIP_GBH_safe_fast_shutdown_2-distro-basic-smithi/6547766
2021-12-06T17:13:44.182 INFO:teuthology.dispatcher.supervisor:Job PID: 28603
2021-12-06T17:13:44.183 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-07T05:14:38.834 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-07T05:14:39.037 INFO:teuthology.kill:Killing Pids: {28603}
2021-12-07T05:14:40.212 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-12-07T05:14:40.213 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-12-07T05:14:40.213 INFO:teuthology.misc:Compressing logs...
2021-12-07T05:14:40.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com'
2021-12-07T05:14:40.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2021-12-07T05:14:40.733 INFO:teuthology.misc:Compressing logs...
2021-12-07T05:14:41.483 INFO:teuthology.orchestra.run.smithi148.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-07T05:14:41.758 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-07T05:14:50.442 INFO:teuthology.misc:Compressing logs...
2021-12-07T05:16:55.704 INFO:teuthology.kill:No teuthology processes running
2021-12-07T05:16:56.855 INFO:teuthology.kill:Nuking machines: ['smithi148', 'smithi164']
2021-12-07T05:16:57.849 INFO:teuthology.kill:2021-12-07 05:16:57,848.848 INFO:teuthology.nuke:targets:
2021-12-07T05:16:57.850 INFO:teuthology.kill:  smithi148.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQSrBtTEMLu8IFc6A75tZaMH89U3oY51UcF9s/sHlbS3NZImdMKJfnUK/2obO4HTdgd9/Pui2FEXCFhyWYZ/uEnMlBt7pLBvwaH7ppkIGYpEcYoorvX+RFQXUTa+HqLXvGS/A/kyPLue3WAo7Yxu55NUokqaHg8DXbwuv3HhGf1oHmWLGleyezN9VCUCm/pxTmOHNT6wwcWEc1WHj/lezlKRctBRMHlJ/ZgqCjeMD8ACFMr+MDjPaLM0n93bTzIgIC+xz2L0zsnt+AW7j29kPHJp/y0zEc9US3MSB2o8bfCXV/l7ZtlkWZdISL9YMb/KTlWjVvbPOOb5EZsLsZKQ3mz3RvL9e83mxdMpvnsz7lQlA2RqVpUUuUkr8/nxMEvUCu2L7OPyBFZWReMG3YPg26/Z+2qpP+nu9mhldCGTwdUthMJtO9j2SCInV9Fdnq9QW0FkhPjrtoz/X2dMLc1KgTM+gronuRblbDWsXajcRNTZbi/LXeEUdv43oOC2FpP58=
2021-12-07T05:16:57.850 INFO:teuthology.kill:  smithi164.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTmnGjyCHi7eKhhIKDp2+3YniOfZxUz+B61TpvDa63Fj/+pSHnIpdBuI/8RP3WV0TL9ktNSwhk9ykrht5g3cYxDDcmF8SGyX+8dle2QWuMXuToCK20HxL5ISvXjg2n2med4awoW7Y7Vv/gSi+VQyRtUcsKNZquHNlVQLgUPmvijBCPBOYw8u4HGf2QgtSeEn3d0IlIKX9+wHa2GyfinIa83/aqw2+UxM2EfWbZIybbWXm7OmFLi97Hp/NbTZCti8EzmzMQ5MQTLPSlkqexy4nqJZiVmXNCKCsk3hRq3WAtndvEugV9Gkje4wJJg7W84iGbObtMKI4B1d32dqOz1XCud/uInr5y/YWqGZuMX4jW6SLolZqEOLbDqIc4H6PdKyoI3oEXJ/8NZSHlTHRZuW1Fe1UYZ1bhs1U7aqBmYC4wKeP4ll7EAPnQFkrNFz8teMqTgjAlxbU18uj/bDKHuwknaRxBsudtziZPpXXkSpurpD26Iq1ZdXzdP+xrSvV5G+k=
2021-12-07T05:16:57.876 INFO:teuthology.kill:2021-12-07 05:16:57,876.876 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-07T05:16:57.879 INFO:teuthology.kill:2021-12-07 05:16:57,879.879 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-07T05:16:57.954 INFO:teuthology.kill:2021-12-07 05:16:57,954.954 INFO:teuthology.orchestra.console:Power off smithi148
2021-12-07T05:16:57.969 INFO:teuthology.kill:2021-12-07 05:16:57,968.968 INFO:teuthology.orchestra.console:Power off smithi164
2021-12-07T05:17:06.332 INFO:teuthology.kill:2021-12-07 05:17:06,331.331 INFO:teuthology.orchestra.console:Power off for smithi164 completed
2021-12-07T05:17:06.479 INFO:teuthology.kill:2021-12-07 05:17:06,478.478 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com
2021-12-07T05:17:10.438 INFO:teuthology.kill:2021-12-07 05:17:10,438.438 INFO:teuthology.orchestra.console:Power off for smithi148 completed
2021-12-07T05:17:10.582 INFO:teuthology.kill:2021-12-07 05:17:10,582.582 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com
2021-12-07T05:19:10.865 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-07T05:19:10.968 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi148 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-07_05:00:02-smoke-master-distro-default-smithi/6549836
2021-12-07T05:19:10.969 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi164 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-07_05:00:02-smoke-master-distro-default-smithi/6549837