2021-12-22T14:54:58.135 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-22T14:54:58.284 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi061.front.sepia.ceph.com' reimaging
2021-12-22T14:54:58.286 INFO:teuthology.lock.ops:Updating [ubuntu@smithi061.front.sepia.ceph.com]: reset os type and version on server
2021-12-22T14:54:58.286 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2021-12-22T14:54:58.305 INFO:teuthology.lock.ops:Node 'ubuntu@smithi061.front.sepia.ceph.com' reimaging is complete
2021-12-22T14:54:58.306 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi098.front.sepia.ceph.com' reimaging
2021-12-22T14:54:58.306 INFO:teuthology.lock.ops:Updating [ubuntu@smithi098.front.sepia.ceph.com]: reset os type and version on server
2021-12-22T14:54:58.306 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2021-12-22T14:54:58.328 INFO:teuthology.lock.ops:Node 'ubuntu@smithi098.front.sepia.ceph.com' reimaging is complete
2021-12-22T14:54:58.329 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging
2021-12-22T14:54:58.329 INFO:teuthology.lock.ops:Updating [ubuntu@smithi140.front.sepia.ceph.com]: reset os type and version on server
2021-12-22T14:54:58.330 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2021-12-22T14:54:58.350 INFO:teuthology.lock.ops:Node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging is complete
2021-12-22T14:54:58.517 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of ubuntu 20.04
2021-12-22T14:54:58.554 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of ubuntu 20.04
2021-12-22T14:54:58.565 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of ubuntu 20.04
2021-12-22T14:54:58.902 INFO:teuthology.orchestra.console:Power off smithi061
2021-12-22T14:54:58.966 INFO:teuthology.orchestra.console:Power off smithi140
2021-12-22T14:54:59.030 INFO:teuthology.orchestra.console:Power off smithi098
2021-12-22T14:55:07.271 INFO:teuthology.orchestra.console:Power off for smithi061 completed
2021-12-22T14:55:07.334 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2021-12-22T14:55:07.373 INFO:teuthology.orchestra.console:Power on smithi061
2021-12-22T14:55:07.401 INFO:teuthology.orchestra.console:Power off for smithi098 completed
2021-12-22T14:55:07.435 INFO:teuthology.orchestra.console:Power on smithi140
2021-12-22T14:55:07.503 INFO:teuthology.orchestra.console:Power on smithi098
2021-12-22T14:55:11.628 INFO:teuthology.orchestra.console:Power on for smithi061 completed
2021-12-22T14:55:11.692 INFO:teuthology.orchestra.console:Power on for smithi140 completed
2021-12-22T14:55:11.730 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish
2021-12-22T14:55:11.793 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish
2021-12-22T14:55:15.872 INFO:teuthology.orchestra.console:Power on for smithi098 completed
2021-12-22T14:55:15.973 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2021-12-22T15:00:59.371 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-22T15:00:59.897 INFO:teuthology.provision.fog.smithi061:Node is ready
2021-12-22T15:00:59.904 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com
2021-12-22T15:00:59.954 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061
2021-12-22T15:01:00.166 INFO:teuthology.provision.fog.smithi061:Deploy complete!
2021-12-22T15:01:02.467 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-22T15:01:03.051 INFO:teuthology.provision.fog.smithi140:Node is ready
2021-12-22T15:01:03.116 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com
2021-12-22T15:01:03.138 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140
2021-12-22T15:01:03.443 INFO:teuthology.provision.fog.smithi140:Deploy complete!
2021-12-22T15:01:04.554 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-22T15:01:05.093 INFO:teuthology.provision.fog.smithi098:Node is ready
2021-12-22T15:01:05.100 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com
2021-12-22T15:01:05.107 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098
2021-12-22T15:01:05.355 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2021-12-22T15:01:05.595 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com
2021-12-22T15:01:05.596 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-22T15:01:05.619 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2021-12-22T15:01:05.620 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-22T15:01:05.638 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com
2021-12-22T15:01:05.639 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-22T15:01:05.658 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server
2021-12-22T15:01:05.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com'
2021-12-22T15:01:05.885 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64
2021-12-22T15:01:05.891 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Ubuntu"
2021-12-22T15:01:05.892 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-12-22T15:01:05.892 INFO:teuthology.orchestra.run.smithi061.stdout:ID=ubuntu
2021-12-22T15:01:05.892 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE=debian
2021-12-22T15:01:05.892 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-12-22T15:01:05.893 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="20.04"
2021-12-22T15:01:05.893 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.ubuntu.com/"
2021-12-22T15:01:05.893 INFO:teuthology.orchestra.run.smithi061.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-12-22T15:01:05.893 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-12-22T15:01:05.894 INFO:teuthology.orchestra.run.smithi061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-12-22T15:01:05.894 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_CODENAME=focal
2021-12-22T15:01:05.894 INFO:teuthology.orchestra.run.smithi061.stdout:UBUNTU_CODENAME=focal
2021-12-22T15:01:05.895 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2021-12-22T15:01:05.915 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2021-12-22T15:01:05.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2021-12-22T15:01:06.091 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2021-12-22T15:01:06.097 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu"
2021-12-22T15:01:06.098 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-12-22T15:01:06.098 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu
2021-12-22T15:01:06.098 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian
2021-12-22T15:01:06.098 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-12-22T15:01:06.099 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="20.04"
2021-12-22T15:01:06.099 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/"
2021-12-22T15:01:06.099 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-12-22T15:01:06.099 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-12-22T15:01:06.099 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-12-22T15:01:06.100 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=focal
2021-12-22T15:01:06.100 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=focal
2021-12-22T15:01:06.100 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2021-12-22T15:01:06.123 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server
2021-12-22T15:01:06.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com'
2021-12-22T15:01:06.302 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64
2021-12-22T15:01:06.351 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Ubuntu"
2021-12-22T15:01:06.351 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2021-12-22T15:01:06.352 INFO:teuthology.orchestra.run.smithi140.stdout:ID=ubuntu
2021-12-22T15:01:06.352 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE=debian
2021-12-22T15:01:06.352 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2021-12-22T15:01:06.352 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="20.04"
2021-12-22T15:01:06.353 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.ubuntu.com/"
2021-12-22T15:01:06.353 INFO:teuthology.orchestra.run.smithi140.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-12-22T15:01:06.353 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-12-22T15:01:06.354 INFO:teuthology.orchestra.run.smithi140.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-12-22T15:01:06.354 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_CODENAME=focal
2021-12-22T15:01:06.354 INFO:teuthology.orchestra.run.smithi140.stdout:UBUNTU_CODENAME=focal
2021-12-22T15:01:06.355 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2021-12-22T15:01:06.453 INFO:teuthology.dispatcher.supervisor:Running job 6578281
2021-12-22T15:01:06.454 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2021-12-22_14:33:01-fs-wip-pdonnell-testing-20211222.014316-distro-basic-smithi/6578281 --name pdonnell-2021-12-22_14:33:01-fs-wip-pdonnell-testing-20211222.014316-distro-basic-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}} -- /home/teuthworker/archive/pdonnell-2021-12-22_14:33:01-fs-wip-pdonnell-testing-20211222.014316-distro-basic-smithi/6578281/orig.config.yaml
2021-12-22T15:01:06.457 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2021-12-22_14:33:01-fs-wip-pdonnell-testing-20211222.014316-distro-basic-smithi/6578281
2021-12-22T15:01:06.458 INFO:teuthology.dispatcher.supervisor:Job PID: 17076
2021-12-22T15:01:06.458 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-23T03:02:00.481 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-23T03:02:00.678 INFO:teuthology.kill:Killing Pids: {17076}
2021-12-23T03:02:01.911 INFO:teuthology.task.internal:roles: ubuntu@smithi061.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0']
2021-12-23T03:02:01.912 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10']
2021-12-23T03:02:01.912 INFO:teuthology.task.internal:roles: ubuntu@smithi140.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']
2021-12-23T03:02:01.913 INFO:teuthology.misc:Compressing logs...
2021-12-23T03:02:01.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com'
2021-12-23T03:02:02.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2021-12-23T03:02:02.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com'
2021-12-23T03:02:02.837 INFO:teuthology.misc:Compressing logs...
2021-12-23T03:02:03.051 INFO:teuthology.misc:Compressing logs...
2021-12-23T03:06:12.386 INFO:teuthology.kill:No teuthology processes running
2021-12-23T03:06:13.494 INFO:teuthology.kill:Nuking machines: ['smithi061', 'smithi098', 'smithi140']
2021-12-23T03:06:14.417 INFO:teuthology.kill:2021-12-23 03:06:14,412.412 INFO:teuthology.nuke:targets:
2021-12-23T03:06:14.418 INFO:teuthology.kill:  smithi061.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWnoiJ3uRY4+Jdr1G/LFZNpX5CPNKFNNfei8HEe4x+fNcAkCcuasYJ61puNLtvXzFAG6hAnyZXVihTh2SUzOoCvZ8kw1CTebRp9yNBg1MO208GRhfeGQ5ABDD/77Kf4y1Dt1qjLBV6ciGUw+a2ckcE2gG3oKT26uUwXmCNA6MB4/yiix3YXgI+YKr2vKdsZ0ztK5uJOKYc/SWk8Kr4lQ0ArQNwmcUd2tjr9J8XDrPeWN76Cj65mVHFw1J54F9urWhVcjpoWOqKPQOretjBv/+H43WGYJ5pIAWG0j8E/Q6CRRbBBoE6Be6mBf6WA5+rU8qJrcGUYOZBrQt+bSFvHFVqi+6mU76CP1k8TM63RlwrFnrNfAoJMdd/AfzyuBekFhKRbp84uyCqwPdiufUKX1W7SvGjdQvQeOtpML7UxS+t6tU+J2fnnotMYABwinAuBwvErPjbKkbuYRkZiZg1caYeXS/aYtx6NmupihlqMwzobq1Dvv10F/BNoLjHH7+++nE=
2021-12-23T03:06:14.418 INFO:teuthology.kill:  smithi098.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQClB2Dlli8lvZjql3UN9mhnJzbXsB5EC3R5X/2fH4WVwkTyim6nTTL0RngVvSiimjJpG7Y59UaMnBJt8MCnA84gMTxAg2KUgJc9eVAJgMrZDVEoMtWFdEbOdkQCv8V2tc9b3pB8JtSKdMkl1fXFrZzGf9ztCG0lRePMGotMQ+S4atFlFe/1MFnRZySGAZYirQxVrhMjbVLJzHlY+bnScjdO+I1LeREARCvOW9qKQ8eqdzeCWfWzW9avDdCc3fHTDImr5bepYxyDGV2jXEgyPxfsmfqryjhXIg7iSMs7qK0kb0/Piqzsz7bbW+lA2OZbA/EWs387QqQ+/vQ0nx7E3etZmksTk4+4grmrd24fmq6eX0Hm8F1Cp/wLmUxfFvS9cCDB/JT64szHU2jUTdGFwDzFqaSIa5dpODUjY3C69SjKetEIfAK83+Z4MaP46pV+HtZpzywcVl7hXQdb8TyM94YqkXa5ISrRl+YpD4hV48cC2Jhe7svpLegLIkYycMel3+U=
2021-12-23T03:06:14.418 INFO:teuthology.kill:  smithi140.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJKD95YSOR622T8c3HkhUwHTSus9CD5P8Yhh2G5ssC6nuu+KCXK3adTtiPPfHUOP9k1TpxZljYRJBdwVrMuig5maBE0OPus089FOnEIuwg1ISwpZ1cUJECvAaRkO7gg1rVijyxrO4uUFjVqvdVUvVrSZY29BFqW3mERPkIAWktjqFEU+M/1nvt5ElC206SEw0kJlrq6ft79IpiiHGcBb9V5xPc4/kdrMTAUewcsuoIIWzolm3cSDMwsA2GHB2i/Oq3EUsDb/REiiYdgSiFY7xskxp1uAxqf/qpdfOf0Iji0vlgPCvrDBM01aVjPWrPH+OVDW4XjaZbxkGlXJJ5/c102//LF5qtGwK5PVHyeTFXqVSmWzU5vH4s32a1nDBWVFF+4hO5nGxd/Uq6SoJPhTAK7+m9962mb9n98eYIEuc8uqe8CQZmkLydMFHz6ZVzAU+t8oPTCiPZwoBaLE6sxQH1ag7Zv3wbosKgfB63/fx0cPAs06wgL4pSifqVsyUVsn8=
2021-12-23T03:06:14.446 INFO:teuthology.kill:2021-12-23 03:06:14,446.446 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-23T03:06:14.450 INFO:teuthology.kill:2021-12-23 03:06:14,450.450 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-23T03:06:14.452 INFO:teuthology.kill:2021-12-23 03:06:14,451.451 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-23T03:06:14.533 INFO:teuthology.kill:2021-12-23 03:06:14,532.532 INFO:teuthology.orchestra.console:Power off smithi061
2021-12-23T03:06:14.547 INFO:teuthology.kill:2021-12-23 03:06:14,547.547 INFO:teuthology.orchestra.console:Power off smithi140
2021-12-23T03:06:14.557 INFO:teuthology.kill:2021-12-23 03:06:14,557.557 INFO:teuthology.orchestra.console:Power off smithi098
2021-12-23T03:06:22.917 INFO:teuthology.kill:2021-12-23 03:06:22,917.917 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2021-12-23T03:06:22.922 INFO:teuthology.kill:2021-12-23 03:06:22,922.922 INFO:teuthology.orchestra.console:Power off for smithi061 completed
2021-12-23T03:06:23.067 INFO:teuthology.kill:2021-12-23 03:06:23,066.066 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com
2021-12-23T03:06:23.069 INFO:teuthology.kill:2021-12-23 03:06:23,069.069 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com
2021-12-23T03:06:27.040 INFO:teuthology.kill:2021-12-23 03:06:27,040.040 INFO:teuthology.orchestra.console:Power off for smithi098 completed
2021-12-23T03:06:27.188 INFO:teuthology.kill:2021-12-23 03:06:27,187.187 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com
2021-12-23T03:08:27.510 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-23T03:08:27.644 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi098 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-22_22:11:35-rados-wip-yuri3-testing-2021-12-22-1047-distro-default-smithi/6580258
2021-12-23T03:08:27.644 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi140 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-12-22_22:11:35-rados-wip-yuri3-testing-2021-12-22-1047-distro-default-smithi/6580259