2021-12-06T23:19:40.984 INFO:root:teuthology version: 1.1.0-844d1377
2021-12-06T23:19:41.117 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi085.front.sepia.ceph.com' reimaging
2021-12-06T23:19:41.119 INFO:teuthology.lock.ops:Updating [ubuntu@smithi085.front.sepia.ceph.com]: reset os type and version on server
2021-12-06T23:19:41.119 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server
2021-12-06T23:19:41.140 INFO:teuthology.lock.ops:Node 'ubuntu@smithi085.front.sepia.ceph.com' reimaging is complete
2021-12-06T23:19:41.140 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi180.front.sepia.ceph.com' reimaging
2021-12-06T23:19:41.142 INFO:teuthology.lock.ops:Updating [ubuntu@smithi180.front.sepia.ceph.com]: reset os type and version on server
2021-12-06T23:19:41.142 INFO:teuthology.lock.ops:Updating smithi180.front.sepia.ceph.com on lock server
2021-12-06T23:19:41.162 INFO:teuthology.lock.ops:Node 'ubuntu@smithi180.front.sepia.ceph.com' reimaging is complete
2021-12-06T23:19:41.363 INFO:teuthology.provision.fog.smithi085:Scheduling deploy of ubuntu 20.04
2021-12-06T23:19:41.376 INFO:teuthology.provision.fog.smithi180:Scheduling deploy of ubuntu 20.04
2021-12-06T23:19:41.755 INFO:teuthology.orchestra.console:Power off smithi085
2021-12-06T23:19:41.800 INFO:teuthology.orchestra.console:Power off smithi180
2021-12-06T23:19:50.165 INFO:teuthology.orchestra.console:Power off for smithi180 completed
2021-12-06T23:19:50.266 INFO:teuthology.orchestra.console:Power on smithi180
2021-12-06T23:19:54.248 INFO:teuthology.orchestra.console:Power off for smithi085 completed
2021-12-06T23:19:54.349 INFO:teuthology.orchestra.console:Power on smithi085
2021-12-06T23:19:58.608 INFO:teuthology.orchestra.console:Power on for smithi085 completed
2021-12-06T23:19:58.629 INFO:teuthology.orchestra.console:Power on for smithi180 completed
2021-12-06T23:19:58.710 INFO:teuthology.provision.fog.smithi085:Waiting for deploy to finish
2021-12-06T23:19:58.730 INFO:teuthology.provision.fog.smithi180:Waiting for deploy to finish
2021-12-06T23:25:18.376 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-06T23:25:18.875 INFO:teuthology.provision.fog.smithi180:Node is ready
2021-12-06T23:25:18.882 INFO:teuthology.orchestra.run.smithi180.stdout:smithi180.front.sepia.ceph.com
2021-12-06T23:25:18.933 INFO:teuthology.orchestra.run.smithi180.stdout:172.21.15.180 smithi180.front.sepia.ceph.com smithi180
2021-12-06T23:25:19.116 INFO:teuthology.provision.fog.smithi180:Deploy complete!
2021-12-06T23:25:33.430 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-06T23:25:33.991 INFO:teuthology.provision.fog.smithi085:Node is ready
2021-12-06T23:25:33.998 INFO:teuthology.orchestra.run.smithi085.stdout:smithi085.front.sepia.ceph.com
2021-12-06T23:25:34.004 INFO:teuthology.orchestra.run.smithi085.stdout:172.21.15.85 smithi085.front.sepia.ceph.com smithi085
2021-12-06T23:25:34.248 INFO:teuthology.provision.fog.smithi085:Deploy complete!
2021-12-06T23:25:34.463 INFO:teuthology.lock.ops:Checking smithi085.front.sepia.ceph.com
2021-12-06T23:25:34.464 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-06T23:25:34.483 INFO:teuthology.lock.ops:Checking smithi180.front.sepia.ceph.com
2021-12-06T23:25:34.483 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-06T23:25:34.503 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: set os type and version on server
2021-12-06T23:25:34.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com'
2021-12-06T23:25:34.682 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64
2021-12-06T23:25:34.689 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="Ubuntu"
2021-12-06T23:25:34.690 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-12-06T23:25:34.690 INFO:teuthology.orchestra.run.smithi085.stdout:ID=ubuntu
2021-12-06T23:25:34.691 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE=debian
2021-12-06T23:25:34.691 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-12-06T23:25:34.691 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="20.04"
2021-12-06T23:25:34.691 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://www.ubuntu.com/"
2021-12-06T23:25:34.692 INFO:teuthology.orchestra.run.smithi085.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-12-06T23:25:34.692 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-12-06T23:25:34.692 INFO:teuthology.orchestra.run.smithi085.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-12-06T23:25:34.692 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_CODENAME=focal
2021-12-06T23:25:34.692 INFO:teuthology.orchestra.run.smithi085.stdout:UBUNTU_CODENAME=focal
2021-12-06T23:25:34.694 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server
2021-12-06T23:25:34.711 INFO:teuthology.lock.ops:Updating [smithi180.front.sepia.ceph.com]: set os type and version on server
2021-12-06T23:25:34.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi180.front.sepia.ceph.com'
2021-12-06T23:25:34.974 INFO:teuthology.orchestra.run.smithi180.stdout:x86_64
2021-12-06T23:25:34.981 INFO:teuthology.orchestra.run.smithi180.stdout:NAME="Ubuntu"
2021-12-06T23:25:34.981 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-12-06T23:25:34.982 INFO:teuthology.orchestra.run.smithi180.stdout:ID=ubuntu
2021-12-06T23:25:34.982 INFO:teuthology.orchestra.run.smithi180.stdout:ID_LIKE=debian
2021-12-06T23:25:34.982 INFO:teuthology.orchestra.run.smithi180.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-12-06T23:25:34.983 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION_ID="20.04"
2021-12-06T23:25:34.983 INFO:teuthology.orchestra.run.smithi180.stdout:HOME_URL="https://www.ubuntu.com/"
2021-12-06T23:25:34.983 INFO:teuthology.orchestra.run.smithi180.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-12-06T23:25:34.984 INFO:teuthology.orchestra.run.smithi180.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-12-06T23:25:34.984 INFO:teuthology.orchestra.run.smithi180.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-12-06T23:25:34.984 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION_CODENAME=focal
2021-12-06T23:25:34.984 INFO:teuthology.orchestra.run.smithi180.stdout:UBUNTU_CODENAME=focal
2021-12-06T23:25:34.985 INFO:teuthology.lock.ops:Updating smithi180.front.sepia.ceph.com on lock server
2021-12-06T23:25:35.110 INFO:teuthology.dispatcher.supervisor:Running job 6547870
2021-12-06T23:25:35.111 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-12-06_16:41:40-rados-WIP_GBH_safe_fast_shutdown_2-distro-basic-smithi/6547870 --name benhanokh-2021-12-06_16:41:40-rados-WIP_GBH_safe_fast_shutdown_2-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/benhanokh-2021-12-06_16:41:40-rados-WIP_GBH_safe_fast_shutdown_2-distro-basic-smithi/6547870/orig.config.yaml
2021-12-06T23:25:35.115 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-12-06_16:41:40-rados-WIP_GBH_safe_fast_shutdown_2-distro-basic-smithi/6547870
2021-12-06T23:25:35.116 INFO:teuthology.dispatcher.supervisor:Job PID: 32167
2021-12-06T23:25:35.117 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-07T11:26:29.103 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-07T11:26:29.315 INFO:teuthology.kill:Killing Pids: {32167}
2021-12-07T11:26:30.552 INFO:teuthology.task.internal:roles: ubuntu@smithi085.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2021-12-07T11:26:30.553 INFO:teuthology.task.internal:roles: ubuntu@smithi180.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2021-12-07T11:26:30.553 INFO:teuthology.misc:Compressing logs...
2021-12-07T11:26:30.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com'
2021-12-07T11:26:30.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi180.front.sepia.ceph.com'
2021-12-07T11:26:31.093 INFO:teuthology.misc:Compressing logs...
2021-12-07T11:26:36.690 INFO:teuthology.misc:Compressing logs...
2021-12-07T11:27:07.357 INFO:teuthology.kill:No teuthology processes running
2021-12-07T11:27:08.597 INFO:teuthology.kill:Nuking machines: ['smithi085', 'smithi180']
2021-12-07T11:27:09.657 INFO:teuthology.kill:2021-12-07 11:27:09,657.657 INFO:teuthology.nuke:targets:
2021-12-07T11:27:09.658 INFO:teuthology.kill:  smithi085.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+SP3qkJcqxfGIpKIVgqJE1yAzEgn2dRYBcMxGqRVf/xWuLXwTEQ98uDjqz41ZHyZOZtOnfVpggVAJEOAYMzM5OqKWp3OB5YS7c5diOzeHNqjReLhn+VicoZQJdTDSNV47Enj4J8pmw1wbdlxMBOAZr1HU/9vvdKNYAs4HQtvXvd4HPqEC1Zm1ee8t8Bi+qkD7dIKcPqm836zSlCNouE3hJXmC6uNZISV4Db40E2P/+2lxAQKSsUQ1VlNAvg0dMaUZ58pcTF5Seq4BQ8xeH4gcXKvIYPK1GifYKXEyrvOiTOHpfNOSbxSKdBaxAXvLHPuGmUNCaiFybmV0+GEzE/oAUscj/OJIph6zEugb5uGJFV8MGVFcukSmRTfSAC5g4xQghupyUHpeBIQbnf2WJDaxonAxyJsRihcHRIjH6YOlqCrP7hOkLTYl6RrCXDt8qZ3KXuW086lj2WkW9k8D+xI/vbcOt0XK/ccGKdTBfYmpwUgK+e/xZcTM6ZCHvjJ6KEU=
2021-12-07T11:27:09.659 INFO:teuthology.kill:  smithi180.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0F7K4BChJhdKFNrgkboHUI2vcEM8eDXJarrsGYnWUrIBMQR/zhb9niEqt3NwgIqhIqG8PwkMp0DXtBgKhIFzJu8bNsugoTYEOmhMZmC03pAIi2+XdPJBK3I97Y3K6rB1qKuK5FSOZU2ijA7g3THurM96MsA4trPFHl3Tax9CTbi0As3qP181140/VotNmjjSeEiFxo9mEVIvFBEJl+fL3L8445Vwp8s9mkE8yPHNv0EOkkLx8A3NQuf0YGTl8TlbfyhXhiH1koEBH/iXcRYigGfFV+ev+67XaPivzhpQJBS+P6B1VonaOTaOzvyuDv7FLMo5saqfaAa5+OKutlj6rgTcAadz/tU6I4J7uSC3Q6zMsrnFod76VuBb2EbeD8llgIOOzySIhwy0a80rEQcDdxarnUyu3UasU4+pUAJksqCfbuci0Pg8REAgOzZk5h/F0k2awhsJKhes++9GqSgd+5Af+O4aMSds4h6VAc1BEoRrRNmz6P4blXoTgvjHkx6M=
2021-12-07T11:27:09.685 INFO:teuthology.kill:2021-12-07 11:27:09,685.685 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-07T11:27:09.689 INFO:teuthology.kill:2021-12-07 11:27:09,689.689 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-07T11:27:09.768 INFO:teuthology.kill:2021-12-07 11:27:09,767.767 INFO:teuthology.orchestra.console:Power off smithi085
2021-12-07T11:27:09.788 INFO:teuthology.kill:2021-12-07 11:27:09,787.787 INFO:teuthology.orchestra.console:Power off smithi180
2021-12-07T11:27:18.150 INFO:teuthology.kill:2021-12-07 11:27:18,149.149 INFO:teuthology.orchestra.console:Power off for smithi180 completed
2021-12-07T11:27:18.300 INFO:teuthology.kill:2021-12-07 11:27:18,300.300 INFO:teuthology.lock.ops:unlocked: smithi180.front.sepia.ceph.com
2021-12-07T11:27:22.256 INFO:teuthology.kill:2021-12-07 11:27:22,256.256 INFO:teuthology.orchestra.console:Power off for smithi085 completed
2021-12-07T11:27:22.410 INFO:teuthology.kill:2021-12-07 11:27:22,410.410 INFO:teuthology.lock.ops:unlocked: smithi085.front.sepia.ceph.com
2021-12-07T11:29:22.755 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-07T11:29:22.873 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi085 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-07_00:28:11-rados-wip-master_12.6.21-distro-default-smithi/6549062
2021-12-07T11:29:22.873 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi180 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-07_00:28:11-rados-wip-master_12.6.21-distro-default-smithi/6549062