2022-01-21T09:40:37.363 INFO:root:teuthology version: 1.1.0-75f1bcd2 2022-01-21T09:40:37.547 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging 2022-01-21T09:40:37.549 INFO:teuthology.lock.ops:Updating [ubuntu@smithi131.front.sepia.ceph.com]: reset os type and version on server 2022-01-21T09:40:37.549 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2022-01-21T09:40:37.574 INFO:teuthology.lock.ops:Node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging is complete 2022-01-21T09:40:37.574 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging 2022-01-21T09:40:37.574 INFO:teuthology.lock.ops:Updating [ubuntu@smithi140.front.sepia.ceph.com]: reset os type and version on server 2022-01-21T09:40:37.575 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2022-01-21T09:40:37.596 INFO:teuthology.lock.ops:Node 'ubuntu@smithi140.front.sepia.ceph.com' reimaging is complete 2022-01-21T09:40:37.598 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi141.front.sepia.ceph.com' reimaging 2022-01-21T09:40:37.599 INFO:teuthology.lock.ops:Updating [ubuntu@smithi141.front.sepia.ceph.com]: reset os type and version on server 2022-01-21T09:40:37.599 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2022-01-21T09:40:37.624 INFO:teuthology.lock.ops:Node 'ubuntu@smithi141.front.sepia.ceph.com' reimaging is complete 2022-01-21T09:40:37.800 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of ubuntu 20.04 2022-01-21T09:40:37.813 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of ubuntu 20.04 2022-01-21T09:40:37.835 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of ubuntu 20.04 2022-01-21T09:40:38.151 INFO:teuthology.orchestra.console:Power off smithi140 2022-01-21T09:40:38.195 INFO:teuthology.orchestra.console:Power off smithi131 2022-01-21T09:40:38.210 INFO:teuthology.orchestra.console:Power off smithi141 2022-01-21T09:40:46.561 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2022-01-21T09:40:46.570 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2022-01-21T09:40:46.586 INFO:teuthology.orchestra.console:Power off for smithi141 completed 2022-01-21T09:40:46.662 INFO:teuthology.orchestra.console:Power on smithi140 2022-01-21T09:40:46.672 INFO:teuthology.orchestra.console:Power on smithi131 2022-01-21T09:40:46.690 INFO:teuthology.orchestra.console:Power on smithi141 2022-01-21T09:40:55.074 INFO:teuthology.orchestra.console:Power on for smithi131 completed 2022-01-21T09:40:55.092 INFO:teuthology.orchestra.console:Power on for smithi141 completed 2022-01-21T09:40:55.109 INFO:teuthology.orchestra.console:Power on for smithi140 completed 2022-01-21T09:40:55.176 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2022-01-21T09:40:55.194 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2022-01-21T09:40:55.210 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2022-01-21T09:45:52.826 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-21T09:45:53.378 INFO:teuthology.provision.fog.smithi131:Node is ready 2022-01-21T09:45:53.385 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2022-01-21T09:45:53.390 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2022-01-21T09:45:53.563 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2022-01-21T09:46:05.122 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-21T09:46:05.634 INFO:teuthology.provision.fog.smithi141:Node is ready 2022-01-21T09:46:05.642 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com 2022-01-21T09:46:05.648 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2022-01-21T09:46:05.895 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2022-01-21T09:46:21.677 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-21T09:46:22.360 INFO:teuthology.provision.fog.smithi140:Node is ready 2022-01-21T09:46:22.367 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com 2022-01-21T09:46:22.375 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140 2022-01-21T09:46:22.558 INFO:teuthology.provision.fog.smithi140:Deploy complete! 2022-01-21T09:46:22.780 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2022-01-21T09:46:22.781 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-21T09:46:22.806 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com 2022-01-21T09:46:22.806 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-21T09:46:22.823 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2022-01-21T09:46:22.823 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-21T09:46:22.841 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2022-01-21T09:46:22.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2022-01-21T09:46:23.115 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2022-01-21T09:46:23.122 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu" 2022-01-21T09:46:23.122 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-21T09:46:23.122 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu 2022-01-21T09:46:23.122 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian 2022-01-21T09:46:23.123 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-21T09:46:23.123 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="20.04" 2022-01-21T09:46:23.123 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-21T09:46:23.123 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-21T09:46:23.124 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-21T09:46:23.124 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-21T09:46:23.124 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=focal 2022-01-21T09:46:23.124 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=focal 2022-01-21T09:46:23.125 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2022-01-21T09:46:23.143 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server 2022-01-21T09:46:23.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2022-01-21T09:46:23.319 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64 2022-01-21T09:46:23.326 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Ubuntu" 2022-01-21T09:46:23.326 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-21T09:46:23.327 INFO:teuthology.orchestra.run.smithi140.stdout:ID=ubuntu 2022-01-21T09:46:23.327 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE=debian 2022-01-21T09:46:23.327 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-21T09:46:23.327 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="20.04" 2022-01-21T09:46:23.327 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-21T09:46:23.328 INFO:teuthology.orchestra.run.smithi140.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-21T09:46:23.328 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-21T09:46:23.328 INFO:teuthology.orchestra.run.smithi140.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-21T09:46:23.329 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_CODENAME=focal 2022-01-21T09:46:23.329 INFO:teuthology.orchestra.run.smithi140.stdout:UBUNTU_CODENAME=focal 2022-01-21T09:46:23.329 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2022-01-21T09:46:23.347 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2022-01-21T09:46:23.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2022-01-21T09:46:23.531 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2022-01-21T09:46:23.538 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Ubuntu" 2022-01-21T09:46:23.539 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-21T09:46:23.539 INFO:teuthology.orchestra.run.smithi141.stdout:ID=ubuntu 2022-01-21T09:46:23.539 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE=debian 2022-01-21T09:46:23.539 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-21T09:46:23.540 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="20.04" 2022-01-21T09:46:23.540 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-21T09:46:23.540 INFO:teuthology.orchestra.run.smithi141.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-21T09:46:23.540 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-21T09:46:23.541 INFO:teuthology.orchestra.run.smithi141.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-21T09:46:23.541 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_CODENAME=focal 2022-01-21T09:46:23.541 INFO:teuthology.orchestra.run.smithi141.stdout:UBUNTU_CODENAME=focal 2022-01-21T09:46:23.542 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2022-01-21T09:46:23.648 INFO:teuthology.dispatcher.supervisor:Running job 6631537 2022-01-21T09:46:23.648 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-01-21_07:36:21-fs-wip-vshankar-fscrypt-20220121-095846-testing-default-smithi/6631537 --name vshankar-2022-01-21_07:36:21-fs-wip-vshankar-fscrypt-20220121-095846-testing-default-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}} -- /home/teuthworker/archive/vshankar-2022-01-21_07:36:21-fs-wip-vshankar-fscrypt-20220121-095846-testing-default-smithi/6631537/orig.config.yaml 2022-01-21T09:46:23.653 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-01-21_07:36:21-fs-wip-vshankar-fscrypt-20220121-095846-testing-default-smithi/6631537 2022-01-21T09:46:23.654 INFO:teuthology.dispatcher.supervisor:Job PID: 28260 2022-01-21T09:46:23.654 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-21T16:16:54.143 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-21T16:16:54.372 INFO:teuthology.kill:Killing Pids: {28260} 2022-01-21T16:16:55.582 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2022-01-21T16:16:55.583 INFO:teuthology.task.internal:roles: ubuntu@smithi140.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2022-01-21T16:16:55.583 INFO:teuthology.task.internal:roles: ubuntu@smithi141.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2022-01-21T16:16:55.583 INFO:teuthology.misc:Compressing logs... 2022-01-21T16:16:55.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2022-01-21T16:16:55.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2022-01-21T16:16:56.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2022-01-21T16:16:56.467 INFO:teuthology.misc:Compressing logs... 2022-01-21T16:16:56.663 INFO:teuthology.misc:Compressing logs... 2022-01-21T16:22:00.434 INFO:teuthology.kill:No teuthology processes running 2022-01-21T16:22:01.595 INFO:teuthology.kill:Nuking machines: ['smithi131', 'smithi140', 'smithi141'] 2022-01-21T16:22:02.596 INFO:teuthology.kill:2022-01-21 16:22:02,596.596 INFO:teuthology.nuke:targets: 2022-01-21T16:22:02.597 INFO:teuthology.kill: smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2OoUGJkEge0s8J4jpRXyubIW+r6wQk0adai+Ne8tYFX9ADnLxWYVfdwLcFbH8n4E9a055rpv+vmWxe6iaKZQ313csXE2Hc01ZKqbMhBf9h25LerFlNu95CAsTDBo0bgGc2m+/Twpx9ADqiEH+Q0wRJtA9HPK7MzZclB0Pd3ADYPLTPVFogZPoFnkOcHpIEq9kNvP7LDTr/aafxpqo0g8FhV/MHKxHW38lx3yJw/62cyzNI177Sf2GrKexb5x45zZ5Ieq6va5fsu0CHyJV7KBLJXH+IK6aPfls5qx9+3fr/zI9c3+DtoI0BpGCYICYosMuYCa2PCveqUFaS0EdNae0kMq5R1sKAhglOryzdp9kvoUUqD7EZx/wMXwr++7lz2LDSHugaK9wKm//fK9xzE6G5UoirkgSvCJTTeiGzp22ez061tnBPY8jZ7nlR01jkfV8axctWGJv8VLHLUXZW5AWbHR7G4TMfNvx2wity0YyFkU/ETdQWUH/ZStJL4YhQU8= 2022-01-21T16:22:02.597 INFO:teuthology.kill: smithi140.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHeSat7XFB13ezaNHJmXAxJgk5sCu9nS6beHWAtp1OmUBq4doCB1wGZKzIlWdv7RVnBR7kq4fBFn01QFyw459H8gb2AYpn1A/khHajeIgY3YpFDUkPRpOqhjZW3yzrcF+iYpUO6maOzSslc2xD1gKdyz5o6Mto8JHXye+ELhkMF7xPqg8MHziR1j+GwUn30715BOKch3yzxL9X1gUTL6c+uY89QkQRaUzcUrEI+Fr7D/aWJ+GI7G9dtdF+PDDKwqjBLqxszTuviLGlrru6I5VX3ol5+yyQcC2cPCJIJp0nvYHHHVD9uivZycuUiTPLosJECZmbTIOpuf3jbWAtEizQT0Uqsd/B1lzt6C74I5B8eZwcYMXsdEjkDxXmb62t+7W7GTnCWxQUbG1wrt96+dwVRs3rjk8o6waLMOJ1RMvVdXnxTLrFkau+U3ifrduNPLOxnciV5WxTkfMWarq6XqikENjJ6gWD2QRoha7yVDoblfr1dXPFleCDA0MZPeQYIqM= 2022-01-21T16:22:02.597 INFO:teuthology.kill: smithi141.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsDiPI+RuRUu/xC5mdMAFVOH718xys1ZEttB7cKg1IbFnw/4RhKyuuyS3edKX0b2zRLtHJ+RX0eprIEuXdyaPn25XeKmZf2alEARswc3BeEKIA7Oux7s1vfkqu1EmkGVwEtSw8cKqFlffbQkVUclaI2PL4sIVmJNhBd8QzukWb5JTIqswyYunnQ5+Mpb/OQouJJwp6KspUco/ZPxNKHIlPvYIOc2BUzHCwFEep+kGxZoiR7dTfVojGjCynv2beBILFL/kFjAJzu5lE0yOs2NN4CE79rouXO1yN4GVvs9M0/wcij/UXlzYOzBkZyPcs47cZFJCnQCTwSrcIJIdmw9J0Cz9lG7L05LzlPyPeQGb2dYGuUVyQlpQRv2pVCA2Tw1vSEb3rgUfLce2+Q2iZJZmfrdn5q7yMNAlLcpUGDHH5oiP8AhUb4XeI8jma/SwpzIxeaOZGdXSNPjy70aRdXx5JzLuX5RBRTGchk5OrQiqN6FWriuK/e3RMqy6wpCfbR3M= 2022-01-21T16:22:02.629 INFO:teuthology.kill:2022-01-21 16:22:02,629.629 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-21T16:22:02.633 INFO:teuthology.kill:2022-01-21 16:22:02,633.633 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-21T16:22:02.635 INFO:teuthology.kill:2022-01-21 16:22:02,634.634 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-21T16:22:02.729 INFO:teuthology.kill:2022-01-21 16:22:02,728.728 INFO:teuthology.orchestra.console:Power off smithi131 2022-01-21T16:22:02.744 INFO:teuthology.kill:2022-01-21 16:22:02,743.743 INFO:teuthology.orchestra.console:Power off smithi141 2022-01-21T16:22:02.759 INFO:teuthology.kill:2022-01-21 16:22:02,758.758 INFO:teuthology.orchestra.console:Power off smithi140 2022-01-21T16:22:11.117 INFO:teuthology.kill:2022-01-21 16:22:11,117.117 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2022-01-21T16:22:11.124 INFO:teuthology.kill:2022-01-21 16:22:11,124.124 INFO:teuthology.orchestra.console:Power off for smithi141 completed 2022-01-21T16:22:11.137 INFO:teuthology.kill:2022-01-21 16:22:11,137.137 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2022-01-21T16:22:11.266 INFO:teuthology.kill:2022-01-21 16:22:11,265.265 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com 2022-01-21T16:22:11.270 INFO:teuthology.kill:2022-01-21 16:22:11,270.270 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com 2022-01-21T16:22:11.287 INFO:teuthology.kill:2022-01-21 16:22:11,287.287 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2022-01-21T16:24:11.653 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-21T16:24:11.799 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi131 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-21_15:22:24-rados-wip-yuri7-testing-2022-01-20-1609-distro-default-smithi/6632061 2022-01-21T16:24:11.800 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi140 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-21_15:22:24-rados-wip-yuri7-testing-2022-01-20-1609-distro-default-smithi/6632059 2022-01-21T16:24:11.800 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi141 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-21_15:22:24-rados-wip-yuri7-testing-2022-01-20-1609-distro-default-smithi/6632060