2022-02-07T15:10:34.404 INFO:root:teuthology version: 1.1.0-3094160c
2022-02-07T15:10:34.532 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi117.front.sepia.ceph.com' reimaging
2022-02-07T15:10:34.533 INFO:teuthology.lock.ops:Updating [ubuntu@smithi117.front.sepia.ceph.com]: reset os type and version on server
2022-02-07T15:10:34.534 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2022-02-07T15:10:34.556 INFO:teuthology.lock.ops:Node 'ubuntu@smithi117.front.sepia.ceph.com' reimaging is complete
2022-02-07T15:10:34.556 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi198.front.sepia.ceph.com' reimaging
2022-02-07T15:10:34.556 INFO:teuthology.lock.ops:Updating [ubuntu@smithi198.front.sepia.ceph.com]: reset os type and version on server
2022-02-07T15:10:34.557 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server
2022-02-07T15:10:34.575 INFO:teuthology.lock.ops:Node 'ubuntu@smithi198.front.sepia.ceph.com' reimaging is complete
2022-02-07T15:10:34.778 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of rhel 8.4
2022-02-07T15:10:34.794 INFO:teuthology.provision.fog.smithi198:Scheduling deploy of rhel 8.4
2022-02-07T15:10:35.166 INFO:teuthology.orchestra.console:Power off smithi198
2022-02-07T15:10:35.212 INFO:teuthology.orchestra.console:Power off smithi117
2022-02-07T15:10:47.665 INFO:teuthology.orchestra.console:Power off for smithi198 completed
2022-02-07T15:10:47.691 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2022-02-07T15:10:47.766 INFO:teuthology.orchestra.console:Power on smithi198
2022-02-07T15:10:47.800 INFO:teuthology.orchestra.console:Power on smithi117
2022-02-07T15:10:52.025 INFO:teuthology.orchestra.console:Power on for smithi198 completed
2022-02-07T15:10:52.051 INFO:teuthology.orchestra.console:Power on for smithi117 completed
2022-02-07T15:10:52.127 INFO:teuthology.provision.fog.smithi198:Waiting for deploy to finish
2022-02-07T15:10:52.152 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish
2022-02-07T15:15:04.739 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-07T15:15:19.891 INFO:teuthology.provision.fog.smithi198:Node is ready
2022-02-07T15:15:19.910 INFO:teuthology.orchestra.run.smithi198.stdout:smithi204
2022-02-07T15:15:19.965 INFO:teuthology.orchestra.run.smithi198.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204
2022-02-07T15:15:20.288 INFO:teuthology.provision.fog.smithi198:Deploy complete!
2022-02-07T15:15:33.240 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-07T15:15:33.459 INFO:teuthology.provision.fog.smithi117:Node is ready
2022-02-07T15:15:33.475 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com
2022-02-07T15:15:33.531 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117
2022-02-07T15:15:33.846 INFO:teuthology.provision.fog.smithi117:Deploy complete!
2022-02-07T15:15:34.029 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com
2022-02-07T15:15:34.030 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-07T15:15:34.049 INFO:teuthology.lock.ops:Checking smithi198.front.sepia.ceph.com
2022-02-07T15:15:34.050 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-07T15:15:34.069 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server
2022-02-07T15:15:34.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2022-02-07T15:15:34.290 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64
2022-02-07T15:15:34.343 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Red Hat Enterprise Linux"
2022-02-07T15:15:34.344 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8.4 (Ootpa)"
2022-02-07T15:15:34.344 INFO:teuthology.orchestra.run.smithi117.stdout:ID="rhel"
2022-02-07T15:15:34.344 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="fedora"
2022-02-07T15:15:34.344 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8.4"
2022-02-07T15:15:34.345 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8"
2022-02-07T15:15:34.345 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-02-07T15:15:34.345 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2022-02-07T15:15:34.345 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-02-07T15:15:34.346 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.redhat.com/"
2022-02-07T15:15:34.346 INFO:teuthology.orchestra.run.smithi117.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-02-07T15:15:34.346 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-07T15:15:34.346 INFO:teuthology.orchestra.run.smithi117.stdout:
2022-02-07T15:15:34.346 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-07T15:15:34.347 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-02-07T15:15:34.347 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-02-07T15:15:34.347 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-02-07T15:15:34.349 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2022-02-07T15:15:34.367 INFO:teuthology.lock.ops:Updating [smithi198.front.sepia.ceph.com]: set os type and version on server
2022-02-07T15:15:34.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi198.front.sepia.ceph.com'
2022-02-07T15:15:34.609 INFO:teuthology.orchestra.run.smithi198.stdout:x86_64
2022-02-07T15:15:34.665 INFO:teuthology.orchestra.run.smithi198.stdout:NAME="Red Hat Enterprise Linux"
2022-02-07T15:15:34.665 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION="8.4 (Ootpa)"
2022-02-07T15:15:34.666 INFO:teuthology.orchestra.run.smithi198.stdout:ID="rhel"
2022-02-07T15:15:34.666 INFO:teuthology.orchestra.run.smithi198.stdout:ID_LIKE="fedora"
2022-02-07T15:15:34.666 INFO:teuthology.orchestra.run.smithi198.stdout:VERSION_ID="8.4"
2022-02-07T15:15:34.666 INFO:teuthology.orchestra.run.smithi198.stdout:PLATFORM_ID="platform:el8"
2022-02-07T15:15:34.667 INFO:teuthology.orchestra.run.smithi198.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-02-07T15:15:34.667 INFO:teuthology.orchestra.run.smithi198.stdout:ANSI_COLOR="0;31"
2022-02-07T15:15:34.667 INFO:teuthology.orchestra.run.smithi198.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-02-07T15:15:34.667 INFO:teuthology.orchestra.run.smithi198.stdout:HOME_URL="https://www.redhat.com/"
2022-02-07T15:15:34.668 INFO:teuthology.orchestra.run.smithi198.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-02-07T15:15:34.668 INFO:teuthology.orchestra.run.smithi198.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-07T15:15:34.668 INFO:teuthology.orchestra.run.smithi198.stdout:
2022-02-07T15:15:34.668 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-07T15:15:34.669 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-02-07T15:15:34.669 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-02-07T15:15:34.669 INFO:teuthology.orchestra.run.smithi198.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-02-07T15:15:34.670 INFO:teuthology.lock.ops:Updating smithi198.front.sepia.ceph.com on lock server
2022-02-07T15:15:34.873 INFO:teuthology.dispatcher.supervisor:Running job 6666509
2022-02-07T15:15:34.874 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3094160cc590b786a43d55faaf7c99d5de71ce56/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi/6666509 --name benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} -- /home/teuthworker/archive/benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi/6666509/orig.config.yaml
2022-02-07T15:15:34.877 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-02-07_14:20:29-rados-WIP_GBH_safe_shutdown_v2A-distro-basic-smithi/6666509
2022-02-07T15:15:34.878 INFO:teuthology.dispatcher.supervisor:Job PID: 7234
2022-02-07T15:15:34.878 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-07T21:46:04.095 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-07T21:46:04.305 INFO:teuthology.kill:Killing Pids: {7234}
2022-02-07T21:46:05.528 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-02-07T21:46:05.529 INFO:teuthology.task.internal:roles: ubuntu@smithi198.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-02-07T21:46:05.530 INFO:teuthology.misc:Compressing logs...
2022-02-07T21:46:05.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2022-02-07T21:46:05.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi198.front.sepia.ceph.com'
2022-02-07T21:46:06.068 INFO:teuthology.misc:Compressing logs...
2022-02-07T21:46:06.632 INFO:teuthology.orchestra.run.smithi198.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-07T21:46:06.758 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-07T21:46:07.140 INFO:teuthology.misc:Compressing logs...
2022-02-07T21:46:21.011 INFO:teuthology.kill:No teuthology processes running
2022-02-07T21:46:22.243 INFO:teuthology.kill:Nuking machines: ['smithi117', 'smithi198']
2022-02-07T21:46:23.311 INFO:teuthology.kill:2022-02-07 21:46:23,311.311 INFO:teuthology.nuke:targets:
2022-02-07T21:46:23.312 INFO:teuthology.kill:  smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJN7kPzt3ziz6jagkNeFTqQi4YfkjsFv/NkTqiORPMX3DucRAVkorcKCrWl3Yag8kg1auJZp/6ZoGCzc/Oq3mIXTPi+yOLyZPVmJrJcFSmp2fEH9yap6/eICx3TaDMBsGHriEGenA3q/W0A9KFgXdVUQ/cCaDMUXff5lDXWWJOVRi1+2INDG/830Zg3RkUIAYs1VbeAJgMA8APhreXft1R4KJlpLkL/5gsDMDH3XB6qtTzB0vs35NJLcb3fRFbIMAJvuiw2+11EqekO1wbTe4FFh4iBic+Vd0xdfVkGM8BA6zTSY2Rw37v2Mk8RTyaVj+PZMYETEJzJ9WSc19549DMy3h53jvlhbD4rXtcLRTy8RNV5MnUHXbRSGrHt4p/EywZGDOKNSR7nmSlqIvvRm1UvdYXGcveZvCv9U5zBBBTBJTDd+GDMfhRvaQ8e5QZKlJGow/qNGn6BlBwIy4yEaSWz6m4hd6Qh6VLaALhklrM7yPl3MkAlneKlraAYkFkiBs=
2022-02-07T21:46:23.312 INFO:teuthology.kill:  smithi198.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvZIX1T/HvYdq4jzsDrArIkrVLxWhhBIX2rgn7VPlkkdknyx3a55wGFgSzfDuR36LvMQ06rKFCbsl4T/N4mdNFMUJR1WCGxptnBOqbxL97eVizQE7KurU8Wz3/RwYckzPBy5RJ55xTVrOgWrPKYk7CbDM3qN+WlKzqGKK4Mbfdh8BiUOAUI1G0He8nxJw1IawsIPI3fOuHkeo2m3m1qvAiChzsQyWINEje39Mj2Yo1OIZlY2yyX5BeTWm5dlP4Mud3dePcqVPfSTrWX9q2VZH7GgMf/wKetE2tsC4BytDKSdXqEC/yhIvjS3hmyfsWnrR/VsrGn6MXyXb8scDU64z9oNkUiwCa2M8/5W1ix0J2lx05+WCDVdiKKdaiQDSeJIp1MZux9R8iUv0q8hm6iDwnTZ9N0GPMm31PvHTol9z92ifgSta6Ip9niF4j4KAZ1YqlpCp2GOqrMZmmE9+uYeN1WAtHzbdTrJAA8sgq7jeLaRvtytp3JiTZD0G8uTs6LE8=
2022-02-07T21:46:23.342 INFO:teuthology.kill:2022-02-07 21:46:23,342.342 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-07T21:46:23.349 INFO:teuthology.kill:2022-02-07 21:46:23,348.348 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-07T21:46:23.438 INFO:teuthology.kill:2022-02-07 21:46:23,438.438 INFO:teuthology.orchestra.console:Power off smithi198
2022-02-07T21:46:23.459 INFO:teuthology.kill:2022-02-07 21:46:23,458.458 INFO:teuthology.orchestra.console:Power off smithi117
2022-02-07T21:46:31.826 INFO:teuthology.kill:2022-02-07 21:46:31,825.825 INFO:teuthology.orchestra.console:Power off for smithi198 completed
2022-02-07T21:46:31.997 INFO:teuthology.kill:2022-02-07 21:46:31,997.997 INFO:teuthology.lock.ops:unlocked: smithi198.front.sepia.ceph.com
2022-02-07T21:46:35.956 INFO:teuthology.kill:2022-02-07 21:46:35,955.955 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2022-02-07T21:46:36.108 INFO:teuthology.kill:2022-02-07 21:46:36,108.108 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com
2022-02-07T21:48:36.465 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-07T21:48:36.584 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi117 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-07_20:08:36-rados-wip-yuri4-testing-2022-02-07-1051-octopus-distro-default-smithi/6666903
2022-02-07T21:48:36.584 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi198 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-02-07_20:08:36-rados-wip-yuri4-testing-2022-02-07-1051-octopus-distro-default-smithi/6666906