2022-01-04T03:42:52.603 INFO:root:teuthology version: 1.1.0-95a7d479
2022-01-04T03:42:52.755 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging
2022-01-04T03:42:52.756 INFO:teuthology.lock.ops:Updating [ubuntu@smithi156.front.sepia.ceph.com]: reset os type and version on server
2022-01-04T03:42:52.756 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2022-01-04T03:42:52.788 INFO:teuthology.lock.ops:Node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging is complete
2022-01-04T03:42:52.788 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging
2022-01-04T03:42:52.789 INFO:teuthology.lock.ops:Updating [ubuntu@smithi162.front.sepia.ceph.com]: reset os type and version on server
2022-01-04T03:42:52.789 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2022-01-04T03:42:52.811 INFO:teuthology.lock.ops:Node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging is complete
2022-01-04T03:42:52.812 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi168.front.sepia.ceph.com' reimaging
2022-01-04T03:42:52.812 INFO:teuthology.lock.ops:Updating [ubuntu@smithi168.front.sepia.ceph.com]: reset os type and version on server
2022-01-04T03:42:52.812 INFO:teuthology.lock.ops:Updating smithi168.front.sepia.ceph.com on lock server
2022-01-04T03:42:52.831 INFO:teuthology.lock.ops:Node 'ubuntu@smithi168.front.sepia.ceph.com' reimaging is complete
2022-01-04T03:42:53.033 INFO:teuthology.provision.fog.smithi168:Scheduling deploy of ubuntu 20.04
2022-01-04T03:42:53.037 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of ubuntu 20.04
2022-01-04T03:42:53.040 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of ubuntu 20.04
2022-01-04T03:42:53.384 INFO:teuthology.orchestra.console:Power off smithi162
2022-01-04T03:42:53.428 INFO:teuthology.orchestra.console:Power off smithi156
2022-01-04T03:42:53.443 INFO:teuthology.orchestra.console:Power off smithi168
2022-01-04T03:43:01.805 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2022-01-04T03:43:01.906 INFO:teuthology.orchestra.console:Power on smithi156
2022-01-04T03:43:05.912 INFO:teuthology.orchestra.console:Power off for smithi162 completed
2022-01-04T03:43:05.918 INFO:teuthology.orchestra.console:Power off for smithi168 completed
2022-01-04T03:43:06.014 INFO:teuthology.orchestra.console:Power on smithi162
2022-01-04T03:43:06.023 INFO:teuthology.orchestra.console:Power on smithi168
2022-01-04T03:43:10.275 INFO:teuthology.orchestra.console:Power on for smithi162 completed
2022-01-04T03:43:10.365 INFO:teuthology.orchestra.console:Power on for smithi156 completed
2022-01-04T03:43:10.377 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish
2022-01-04T03:43:10.466 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2022-01-04T03:43:14.391 INFO:teuthology.orchestra.console:Power on for smithi168 completed
2022-01-04T03:43:14.492 INFO:teuthology.provision.fog.smithi168:Waiting for deploy to finish
2022-01-04T03:49:13.717 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-04T03:49:13.738 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-04T03:49:14.233 INFO:teuthology.provision.fog.smithi162:Node is ready
2022-01-04T03:49:14.240 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com
2022-01-04T03:49:14.248 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162
2022-01-04T03:49:14.269 INFO:teuthology.provision.fog.smithi156:Node is ready
2022-01-04T03:49:14.275 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2022-01-04T03:49:14.324 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2022-01-04T03:49:14.491 INFO:teuthology.provision.fog.smithi162:Deploy complete!
2022-01-04T03:49:14.493 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2022-01-04T03:49:17.799 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-04T03:49:18.317 INFO:teuthology.provision.fog.smithi168:Node is ready
2022-01-04T03:49:18.324 INFO:teuthology.orchestra.run.smithi168.stdout:smithi168.front.sepia.ceph.com
2022-01-04T03:49:18.332 INFO:teuthology.orchestra.run.smithi168.stdout:172.21.15.168 smithi168.front.sepia.ceph.com smithi168
2022-01-04T03:49:18.507 INFO:teuthology.provision.fog.smithi168:Deploy complete!
2022-01-04T03:49:18.760 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2022-01-04T03:49:18.761 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-04T03:49:18.780 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com
2022-01-04T03:49:18.781 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-04T03:49:18.798 INFO:teuthology.lock.ops:Checking smithi168.front.sepia.ceph.com
2022-01-04T03:49:18.798 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-04T03:49:18.816 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2022-01-04T03:49:18.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2022-01-04T03:49:18.997 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2022-01-04T03:49:19.003 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Ubuntu"
2022-01-04T03:49:19.003 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-01-04T03:49:19.003 INFO:teuthology.orchestra.run.smithi156.stdout:ID=ubuntu
2022-01-04T03:49:19.004 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE=debian
2022-01-04T03:49:19.004 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-01-04T03:49:19.004 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="20.04"
2022-01-04T03:49:19.004 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.ubuntu.com/"
2022-01-04T03:49:19.005 INFO:teuthology.orchestra.run.smithi156.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-01-04T03:49:19.005 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-01-04T03:49:19.005 INFO:teuthology.orchestra.run.smithi156.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-01-04T03:49:19.005 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_CODENAME=focal
2022-01-04T03:49:19.005 INFO:teuthology.orchestra.run.smithi156.stdout:UBUNTU_CODENAME=focal
2022-01-04T03:49:19.007 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2022-01-04T03:49:19.025 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server
2022-01-04T03:49:19.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2022-01-04T03:49:19.202 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64
2022-01-04T03:49:19.253 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu"
2022-01-04T03:49:19.253 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-01-04T03:49:19.253 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu
2022-01-04T03:49:19.253 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian
2022-01-04T03:49:19.254 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-01-04T03:49:19.254 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="20.04"
2022-01-04T03:49:19.254 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/"
2022-01-04T03:49:19.255 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-01-04T03:49:19.255 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-01-04T03:49:19.256 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-01-04T03:49:19.256 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=focal
2022-01-04T03:49:19.257 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=focal
2022-01-04T03:49:19.257 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2022-01-04T03:49:19.276 INFO:teuthology.lock.ops:Updating [smithi168.front.sepia.ceph.com]: set os type and version on server
2022-01-04T03:49:19.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi168.front.sepia.ceph.com'
2022-01-04T03:49:19.446 INFO:teuthology.orchestra.run.smithi168.stdout:x86_64
2022-01-04T03:49:19.452 INFO:teuthology.orchestra.run.smithi168.stdout:NAME="Ubuntu"
2022-01-04T03:49:19.452 INFO:teuthology.orchestra.run.smithi168.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-01-04T03:49:19.453 INFO:teuthology.orchestra.run.smithi168.stdout:ID=ubuntu
2022-01-04T03:49:19.453 INFO:teuthology.orchestra.run.smithi168.stdout:ID_LIKE=debian
2022-01-04T03:49:19.453 INFO:teuthology.orchestra.run.smithi168.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-01-04T03:49:19.453 INFO:teuthology.orchestra.run.smithi168.stdout:VERSION_ID="20.04"
2022-01-04T03:49:19.454 INFO:teuthology.orchestra.run.smithi168.stdout:HOME_URL="https://www.ubuntu.com/"
2022-01-04T03:49:19.454 INFO:teuthology.orchestra.run.smithi168.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-01-04T03:49:19.454 INFO:teuthology.orchestra.run.smithi168.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-01-04T03:49:19.454 INFO:teuthology.orchestra.run.smithi168.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-01-04T03:49:19.455 INFO:teuthology.orchestra.run.smithi168.stdout:VERSION_CODENAME=focal
2022-01-04T03:49:19.455 INFO:teuthology.orchestra.run.smithi168.stdout:UBUNTU_CODENAME=focal
2022-01-04T03:49:19.455 INFO:teuthology.lock.ops:Updating smithi168.front.sepia.ceph.com on lock server
2022-01-04T03:49:19.547 INFO:teuthology.dispatcher.supervisor:Running job 6593034
2022-01-04T03:49:19.548 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-01-04_03:15:03-fs-master-distro-default-smithi/6593034 --name teuthology-2022-01-04_03:15:03-fs-master-distro-default-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}} -- /home/teuthworker/archive/teuthology-2022-01-04_03:15:03-fs-master-distro-default-smithi/6593034/orig.config.yaml
2022-01-04T03:49:19.551 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-01-04_03:15:03-fs-master-distro-default-smithi/6593034
2022-01-04T03:49:19.551 INFO:teuthology.dispatcher.supervisor:Job PID: 29924
2022-01-04T03:49:19.552 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-04T15:50:13.475 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-04T15:50:13.666 INFO:teuthology.kill:Killing Pids: {29924}
2022-01-04T15:50:14.938 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0']
2022-01-04T15:50:14.939 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10']
2022-01-04T15:50:14.939 INFO:teuthology.task.internal:roles: ubuntu@smithi168.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']
2022-01-04T15:50:14.939 INFO:teuthology.misc:Compressing logs...
2022-01-04T15:50:14.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2022-01-04T15:50:15.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2022-01-04T15:50:15.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi168.front.sepia.ceph.com'
2022-01-04T15:50:15.823 INFO:teuthology.misc:Compressing logs...
2022-01-04T15:50:16.024 INFO:teuthology.misc:Compressing logs...
2022-01-04T15:59:36.529 INFO:teuthology.kill:No teuthology processes running
2022-01-04T15:59:37.644 INFO:teuthology.kill:Nuking machines: ['smithi156', 'smithi162', 'smithi168']
2022-01-04T15:59:38.602 INFO:teuthology.kill:2022-01-04 15:59:38,601.601 INFO:teuthology.nuke:targets:
2022-01-04T15:59:38.603 INFO:teuthology.kill:  smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMvp89dKeigqgkt1GqKeRIoprw1x+VZGQOaGix+j+jwZ03axJQvem8Fw43/yQt/7NpLucX6O3AwhAVZFbjjPGGX9V8dpByZhsk/YezOVDV2hjoPl3vt9eY7Y2cEREnGJiQ9CSCNRw8gLebvCKnOGwuEWIS7V6qyIky5InwNgPkKoQyzOPkMRnnNH9WLJjr5hfZcWMT1HVJ3JveDLQ4r6aKB34UtH3KuCWw+N+3l34ZUrbOJwvWbS1ruFBKOkZbCQSE8ePMWmoHD0YVIFWGu3HkaFV13em65I9xWYZQ1YbbD3Pfopo8wMVl2DGosanVBXEzesZGv9vU4mjxgaQoWgeeEoGjR6+5z1cyejcQid2r3ZhcxUmPsBWypR8NOB7kMpcj6nH8bYN/qwawKYSIsxpmEu9Xm6IL9Z5zfzbLksjZvxQcCX2J1ByDa0s2Ep26gwISyfxWXMbRPbkZdN97sGe0T8zq7g3MuvczWOl+itq4i5Y/7jokMn2JUgyzF5k2Yo8=
2022-01-04T15:59:38.603 INFO:teuthology.kill:  smithi162.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzWKQf8N4wcm3thxUPDA08zOo2Ci93WMdrmV6NbGmPRf6FxHFW2+lOb5UjfDUYg4jAEHPdXyoUAkXfG05qmkeVOBrIDzqjuJlt2p/tX3vqXMe4GLHH0ceKKCRtHkbkMMpD1BFCzWEaimA7pT5KA6NeCn+3tlPzLOWtoyM+TV8R3dYasztDgqkX2Vytix3LGVwXt5kUFw6OfrFqfq1MywWuwGniHYGA4xQSXonLMRexrHbTfBdoixN97lWQbFziH1hV1fGwiKhc0mSLSmY05WikWv0d8DPR5NfWDeHNb4NHZ+JHlYBhjVRzt+4G/4SP8IWJARKMCS5PeuN4wTc3/ayCL3LCyOJBmlVoUnC8dxR7sK9xNtGLH3vCYCTG1hXqovgUDk8JVazdY14x/gIHN3LJ5EtMOte/6wvVVNby1xlDLrmuh6iGf08aDgjcc3BvkscZqgw1ADZfEoxs4MG6OFUCosUU/ix3TsAx/x35vEqLBLDKuUPNW3J9aWzMcDHill0=
2022-01-04T15:59:38.603 INFO:teuthology.kill:  smithi168.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM6qEPCVZfAdsfB1xNYhESDugY3P5SP2HilDpYCX3NnBA1mRE2iRGyEu5wvz9PaQaDPwKMx8hHgJazAOyL0amkUQo45vctIARKTARq67h6ppFCSTkj34eguSNeat7GGnf2Djnd31NLX+UVL5wHJaBt09rHqRczt4B9tds5bGhiqG+mVJefEYr402gOAqQiQYvIA/AFaOKhtBNhsgV8XRjPQK+IYBZBcXLrej7I3s9hkQE25pwFbKae8sAqwsq3A4L3zlBPzugLt1ZkOad7Pqc6TeOmfNX09oY520gwzAR855TBXyhmILTQ0xHVuk05MY1doLcBc9xAOf4wC5LXr84dBjhnjG85Be4nmEgBZA+ye4pAeUtgL0y0x+HNfylh4ShkDljOB8nwPA4ZYqQcWaGjosmZt3lRhyd8fTPnOslZsPYqXEdiqlZRL0X07jljOxS07IPcV/kYcD2QQR/ylSDLF2t2HsH/vE2ZNhtyS8rkDrCaByAYWda/SYLsFEJIgP8=
2022-01-04T15:59:38.630 INFO:teuthology.kill:2022-01-04 15:59:38,629.629 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-04T15:59:38.633 INFO:teuthology.kill:2022-01-04 15:59:38,633.633 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-04T15:59:38.635 INFO:teuthology.kill:2022-01-04 15:59:38,634.634 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-04T15:59:38.703 INFO:teuthology.kill:2022-01-04 15:59:38,702.702 INFO:teuthology.orchestra.console:Power off smithi156
2022-01-04T15:59:38.716 INFO:teuthology.kill:2022-01-04 15:59:38,716.716 INFO:teuthology.orchestra.console:Power off smithi168
2022-01-04T15:59:38.729 INFO:teuthology.kill:2022-01-04 15:59:38,729.729 INFO:teuthology.orchestra.console:Power off smithi162
2022-01-04T15:59:47.083 INFO:teuthology.kill:2022-01-04 15:59:47,082.082 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2022-01-04T15:59:47.087 INFO:teuthology.kill:2022-01-04 15:59:47,087.087 INFO:teuthology.orchestra.console:Power off for smithi168 completed
2022-01-04T15:59:47.240 INFO:teuthology.kill:2022-01-04 15:59:47,239.239 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com
2022-01-04T15:59:47.243 INFO:teuthology.kill:2022-01-04 15:59:47,243.243 INFO:teuthology.lock.ops:unlocked: smithi168.front.sepia.ceph.com
2022-01-04T15:59:51.205 INFO:teuthology.kill:2022-01-04 15:59:51,205.205 INFO:teuthology.orchestra.console:Power off for smithi162 completed
2022-01-04T15:59:51.351 INFO:teuthology.kill:2022-01-04 15:59:51,351.351 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com
2022-01-04T16:01:51.667 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-04T16:01:51.810 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi156 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-04_05:15:02-krbd-octopus-testing-default-smithi/6593641
2022-01-04T16:01:51.810 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi162 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-04_05:15:02-krbd-octopus-testing-default-smithi/6593641
2022-01-04T16:01:51.810 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi168 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-01-04_05:15:02-krbd-octopus-testing-default-smithi/6593641