2021-12-05T18:19:42.973 INFO:root:teuthology version: 1.1.0-844d1377 2021-12-05T18:19:43.098 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi143.front.sepia.ceph.com' reimaging 2021-12-05T18:19:43.099 INFO:teuthology.lock.ops:Updating [ubuntu@smithi143.front.sepia.ceph.com]: reset os type and version on server 2021-12-05T18:19:43.100 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2021-12-05T18:19:43.118 INFO:teuthology.lock.ops:Node 'ubuntu@smithi143.front.sepia.ceph.com' reimaging is complete 2021-12-05T18:19:43.118 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi192.front.sepia.ceph.com' reimaging 2021-12-05T18:19:43.119 INFO:teuthology.lock.ops:Updating [ubuntu@smithi192.front.sepia.ceph.com]: reset os type and version on server 2021-12-05T18:19:43.119 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2021-12-05T18:19:43.139 INFO:teuthology.lock.ops:Node 'ubuntu@smithi192.front.sepia.ceph.com' reimaging is complete 2021-12-05T18:19:43.336 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of ubuntu 20.04 2021-12-05T18:19:43.348 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of ubuntu 20.04 2021-12-05T18:19:43.714 INFO:teuthology.orchestra.console:Power off smithi143 2021-12-05T18:19:43.793 INFO:teuthology.orchestra.console:Power off smithi192 2021-12-05T18:19:52.157 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2021-12-05T18:19:52.258 INFO:teuthology.orchestra.console:Power on smithi192 2021-12-05T18:19:56.196 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2021-12-05T18:19:56.297 INFO:teuthology.orchestra.console:Power on smithi143 2021-12-05T18:20:00.624 INFO:teuthology.orchestra.console:Power on for smithi192 completed 2021-12-05T18:20:00.725 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2021-12-05T18:20:04.669 INFO:teuthology.orchestra.console:Power on for smithi143 completed 2021-12-05T18:20:04.770 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2021-12-05T18:25:20.648 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-05T18:25:21.224 INFO:teuthology.provision.fog.smithi192:Node is ready 2021-12-05T18:25:21.231 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2021-12-05T18:25:21.238 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2021-12-05T18:25:21.459 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2021-12-05T18:25:24.558 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-05T18:25:25.074 INFO:teuthology.provision.fog.smithi143:Node is ready 2021-12-05T18:25:25.123 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2021-12-05T18:25:25.130 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2021-12-05T18:25:25.325 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2021-12-05T18:25:25.549 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2021-12-05T18:25:25.550 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-05T18:25:25.570 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2021-12-05T18:25:25.570 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-05T18:25:25.589 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2021-12-05T18:25:25.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2021-12-05T18:25:25.811 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2021-12-05T18:25:25.818 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2021-12-05T18:25:25.818 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-05T18:25:25.818 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2021-12-05T18:25:25.819 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2021-12-05T18:25:25.819 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-05T18:25:25.819 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="20.04" 2021-12-05T18:25:25.819 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-05T18:25:25.819 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-05T18:25:25.820 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-05T18:25:25.820 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-05T18:25:25.820 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=focal 2021-12-05T18:25:25.820 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=focal 2021-12-05T18:25:25.821 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2021-12-05T18:25:25.839 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2021-12-05T18:25:25.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2021-12-05T18:25:26.014 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2021-12-05T18:25:26.021 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2021-12-05T18:25:26.022 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-05T18:25:26.022 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2021-12-05T18:25:26.022 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2021-12-05T18:25:26.023 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-05T18:25:26.023 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="20.04" 2021-12-05T18:25:26.023 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-05T18:25:26.023 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-05T18:25:26.023 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-05T18:25:26.024 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-05T18:25:26.024 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=focal 2021-12-05T18:25:26.024 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=focal 2021-12-05T18:25:26.025 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2021-12-05T18:25:26.123 INFO:teuthology.dispatcher.supervisor:Running job 6546747 2021-12-05T18:25:26.124 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-12-05_15:06:27-rados-WIP_GBH_safe_fast_shutdown_1-distro-basic-smithi/6546747 --name benhanokh-2021-12-05_15:06:27-rados-WIP_GBH_safe_fast_shutdown_1-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} -- /home/teuthworker/archive/benhanokh-2021-12-05_15:06:27-rados-WIP_GBH_safe_fast_shutdown_1-distro-basic-smithi/6546747/orig.config.yaml 2021-12-05T18:25:26.127 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-12-05_15:06:27-rados-WIP_GBH_safe_fast_shutdown_1-distro-basic-smithi/6546747 2021-12-05T18:25:26.127 INFO:teuthology.dispatcher.supervisor:Job PID: 25231 2021-12-05T18:25:26.128 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-12-06T06:26:19.823 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-12-06T06:26:20.016 INFO:teuthology.kill:Killing Pids: {25231} 2021-12-06T06:26:21.280 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-12-06T06:26:21.281 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-12-06T06:26:21.282 INFO:teuthology.misc:Compressing logs... 2021-12-06T06:26:21.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2021-12-06T06:26:21.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2021-12-06T06:26:21.721 INFO:teuthology.misc:Compressing logs... 2021-12-06T06:26:23.197 INFO:teuthology.misc:Compressing logs... 2021-12-06T06:26:39.587 INFO:teuthology.kill:No teuthology processes running 2021-12-06T06:26:40.783 INFO:teuthology.kill:Nuking machines: ['smithi143', 'smithi192'] 2021-12-06T06:26:41.797 INFO:teuthology.kill:2021-12-06 06:26:41,796.796 INFO:teuthology.nuke:targets: 2021-12-06T06:26:41.798 INFO:teuthology.kill: smithi143.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8AHGgDkxuPScbodt45hpFKO3tVapVnqCITCKokepRQElMwW0a2s+ueJJUWjTjIw6ExxD4oB0m4QF5JIkyfj6U+LVNDAaGxjjxgOJkmfYZO/Ut+FmGCntRM0H4bEVIS5iRos3sQ1MmfLc/WlkNNG9+XFrVkNOXhP/PSz0OqFDdTQUAc2dgU3aN8hFCXLomLCXlAyru4MM4L+k+tLpDLyHiaGfI88Nhb+AJ3LTdFs7lk4m7YzdcmBNZLDRxW6CUF4a8CBSc6BX+qobSYUvKth0+HgCsD0kFmkbHzvuvs3uq4RiX1cEH7txdre3VKY1pfIi2YXnj+e/NSOh1GU/zh8g2XHMSe98R52cUnOyVztHGi4bnBNbIF4wVmVEz22sYm0+2wmXiPx0pWBpnP38LBam9GS1IvJnnGU/0T8i+AKqHot8XCcpxm2f9CAl7CmsT9jEqan6H8YaXG9mphUwfkXAHKfKW/Df+SiiJAo/OVj5iis7kYI7/fSlZGYUJ0jq2QUs= 2021-12-06T06:26:41.798 INFO:teuthology.kill: smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxmd6ygvjZhYJ9ZOoH43xuQA96NwtaPV8CF3hROUxuH89au6KYcf6fh58DYjqiwaHYnFd1S+Y8tlYYnNld9hNPvu49CVWLlxksOMgt0T7ZCo3QNRNbG8PvpEikhdO2W5umow9H0iy97qRi5uzcv+2riLPWK5fImulXk1L0T9GBvtl7gWcJul9+y7hTJ0J9iZ/hsrR/6W+Q+oxAznybfWPFAM97DRKg6+4jweNZ+79HMdwOuqquO19D+0T5tFLk1enR274YwrNieAciQ1aFGIEmA1gach3RuwlgILuAXZJSbxcXRR9jJzMZMfpDa555xz6+1XKcR9KA+eQAwLribFPSOXxt0ntyLkc3ds8Z2q3vIINaJbCyu1BdPrWAw/x80DPvbELb4s2o4ePdV3lYCl+w1B2K8jfqdPRPU7TqsH/3x0Cdwrf80Lye0whzd5dOIeoLd44Plp6zlVaDEt5h40UvHs0V0ZnDLaTRfLPJ9SJe45YZEIiPZmxTGCH1oVOjwMc= 2021-12-06T06:26:41.823 INFO:teuthology.kill:2021-12-06 06:26:41,823.823 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-06T06:26:41.826 INFO:teuthology.kill:2021-12-06 06:26:41,826.826 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-06T06:26:41.903 INFO:teuthology.kill:2021-12-06 06:26:41,902.902 INFO:teuthology.orchestra.console:Power off smithi143 2021-12-06T06:26:41.917 INFO:teuthology.kill:2021-12-06 06:26:41,917.917 INFO:teuthology.orchestra.console:Power off smithi192 2021-12-06T06:26:50.291 INFO:teuthology.kill:2021-12-06 06:26:50,290.290 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2021-12-06T06:26:50.295 INFO:teuthology.kill:2021-12-06 06:26:50,295.295 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2021-12-06T06:26:50.446 INFO:teuthology.kill:2021-12-06 06:26:50,445.445 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com 2021-12-06T06:26:50.448 INFO:teuthology.kill:2021-12-06 06:26:50,448.448 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com 2021-12-06T06:28:50.805 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-12-06T06:28:50.914 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi143 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-06_06:07:02-rbd-pacific-distro-default-smithi/6547410 2021-12-06T06:28:50.914 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi192 but it was locked by another job: /home/teuthworker/archive/teuthology-2021-12-06_06:07:02-rbd-pacific-distro-default-smithi/6547410