2022-05-25T08:51:59.148 INFO:root:teuthology version: 1.1.1.dev341+g1b30281f 2022-05-25T08:51:59.293 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2022-05-25T08:51:59.294 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2022-05-25T08:51:59.294 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2022-05-25T08:51:59.315 INFO:teuthology.lock.ops:Node 'smithi027.front.sepia.ceph.com' reimaging is complete 2022-05-25T08:51:59.315 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2022-05-25T08:51:59.315 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2022-05-25T08:51:59.315 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2022-05-25T08:51:59.334 INFO:teuthology.lock.ops:Node 'smithi057.front.sepia.ceph.com' reimaging is complete 2022-05-25T08:51:59.528 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of rhel 8.5 2022-05-25T08:51:59.547 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.5 2022-05-25T08:51:59.912 INFO:teuthology.orchestra.console:Power off smithi027 2022-05-25T08:52:00.028 INFO:teuthology.orchestra.console:Power off smithi057 2022-05-25T08:52:00.053 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2022-05-25T08:52:00.155 INFO:teuthology.orchestra.console:Power on smithi027 2022-05-25T08:52:00.167 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2022-05-25T08:52:00.269 INFO:teuthology.orchestra.console:Power on smithi057 2022-05-25T08:52:04.525 INFO:teuthology.orchestra.console:Power on for smithi057 completed 2022-05-25T08:52:04.625 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2022-05-25T08:52:08.520 INFO:teuthology.orchestra.console:Power on for smithi027 completed 2022-05-25T08:52:08.621 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2022-05-25T08:56:45.400 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-25T08:56:45.637 INFO:teuthology.provision.fog.smithi057:Node is ready 2022-05-25T08:56:45.653 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2022-05-25T08:56:45.711 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2022-05-25T08:56:46.037 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2022-05-25T08:58:01.649 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-25T08:58:01.914 INFO:teuthology.provision.fog.smithi027:Node is ready 2022-05-25T08:58:01.930 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2022-05-25T08:58:01.987 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2022-05-25T08:58:02.329 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2022-05-25T08:58:02.498 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2022-05-25T08:58:02.498 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-25T08:58:02.518 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2022-05-25T08:58:02.519 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-25T08:58:02.539 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2022-05-25T08:58:02.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2022-05-25T08:58:02.741 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2022-05-25T08:58:02.796 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2022-05-25T08:58:02.797 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.5 (Ootpa)" 2022-05-25T08:58:02.797 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2022-05-25T08:58:02.797 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2022-05-25T08:58:02.797 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.5" 2022-05-25T08:58:02.797 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2022-05-25T08:58:02.797 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.5 (Ootpa)" 2022-05-25T08:58:02.797 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2022-05-25T08:58:02.797 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-05-25T08:58:02.797 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2022-05-25T08:58:02.797 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-05-25T08:58:02.798 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-25T08:58:02.798 INFO:teuthology.orchestra.run.smithi027.stdout: 2022-05-25T08:58:02.798 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-25T08:58:02.798 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.5 2022-05-25T08:58:02.798 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-05-25T08:58:02.798 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.5" 2022-05-25T08:58:02.799 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2022-05-25T08:58:02.820 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2022-05-25T08:58:02.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2022-05-25T08:58:03.075 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2022-05-25T08:58:03.132 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2022-05-25T08:58:03.132 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.5 (Ootpa)" 2022-05-25T08:58:03.132 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2022-05-25T08:58:03.132 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2022-05-25T08:58:03.133 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.5" 2022-05-25T08:58:03.133 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2022-05-25T08:58:03.133 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.5 (Ootpa)" 2022-05-25T08:58:03.133 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2022-05-25T08:58:03.133 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-05-25T08:58:03.133 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2022-05-25T08:58:03.133 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-05-25T08:58:03.133 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-25T08:58:03.133 INFO:teuthology.orchestra.run.smithi057.stdout: 2022-05-25T08:58:03.133 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-25T08:58:03.133 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.5 2022-05-25T08:58:03.134 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-05-25T08:58:03.134 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.5" 2022-05-25T08:58:03.136 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2022-05-25T08:58:03.242 INFO:teuthology.dispatcher.supervisor:Running job 6847737 2022-05-25T08:58:03.243 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-05-25_01:31:28-fs-wip-vshankar-fscrypt-20220524-112530-testing-default-smithi/6847737 --name vshankar-2022-05-25_01:31:28-fs-wip-vshankar-fscrypt-20220524-112530-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2022-05-25_01:31:28-fs-wip-vshankar-fscrypt-20220524-112530-testing-default-smithi/6847737/orig.config.yaml 2022-05-25T08:58:03.247 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-05-25_01:31:28-fs-wip-vshankar-fscrypt-20220524-112530-testing-default-smithi/6847737 2022-05-25T08:58:03.248 INFO:teuthology.dispatcher.supervisor:Job PID: 23332 2022-05-25T08:58:03.248 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-25T15:28:32.746 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-25T15:28:33.053 INFO:teuthology.kill:Killing Pids: {23332} 2022-05-25T15:28:34.442 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-05-25T15:28:34.442 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-05-25T15:28:34.443 INFO:teuthology.misc:Compressing logs... 2022-05-25T15:28:34.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2022-05-25T15:28:34.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2022-05-25T15:28:35.032 INFO:teuthology.misc:Compressing logs... 2022-05-25T15:28:35.224 INFO:teuthology.misc:Compressing logs... 2022-05-25T15:39:47.396 INFO:teuthology.kill:No teuthology processes running 2022-05-25T15:39:48.803 INFO:teuthology.kill:Nuking machines: ['smithi027', 'smithi057'] 2022-05-25T15:39:49.887 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-25T15:39:49.887 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-25T15:39:49.888 INFO:teuthology.kill:2022-05-25 15:39:49,886.886 INFO:teuthology.nuke:targets: 2022-05-25T15:39:49.888 INFO:teuthology.kill: smithi027.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCb9rE8IDmNfIKBxJVT1q9N14pby1OngDFGbWE1v32ne++b+VV8rnRn2HdiXl5HLBO9zFTzSROXg8V1ch1XmBvu8R305VEgWieQyik070+UsArhdz/qecVdf1Jcy0cqADG5UWrFXmf82EAEOb8V2kW2RwcGDalQewT7zPowFJSjVTGeohKxFCi/2e5FNLc2MV0xAx76nbeWFLqXUxg1KkBQTHFLle4NH1amQzTPJFDqEfKV2uxqq0xzwo3xzo2pPV8OBj9CIyR2hLIbSdZkLrdacgkJqrVya3q93Pt3Y9e9zPV1LlcZXS8++K78HpKIcvUkJEBvQjBJ6jkUvi6ZANP3vbFSwHNrmvd4NOlI62I9jsvKWOMGUiBe/nVGOUkbX8B3dhoJmoPEiEeVrdgy0Dnp2Mu5lpHc+HXGn8ur4bYYp51OxAQ4HqN7Cf2NgMqzh1Ha6/uBFNsUeOVUcFmvZfwZ5gVKFT9QSoE4BZIqRWmgH6h9cH9dGyTYit/8CcUDTp0= 2022-05-25T15:39:49.888 INFO:teuthology.kill: smithi057.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCeUXGNniQA+jDFE99ABxMKQX9KwS+5zX8LGVOlazxeYIWGX0HEF9/Oly3yxofvmZb/QJZM0UPgetRx/Ueh0j7L+HsLVErHWplFSwgOEFLLTpdxzB8NQGF0ItAw3OY53sHWDSdHDYuDZHmi3mjhUIv0pOCCdM6B9BTIN7iOMEF/Lkm4ObxB/YfFdx0hPyWwdRuELqGPMURvNBu3+dPv9masoX4n1bpPeJrXQ5NfTk6AvpdxKRWavfFnplYKwTYkOfjX+NvlfPuU+hbczrwy4Ti0pRpMR4xdgN0YjEutYkcX5qYGy3jXz02rq6V6pob5UWxD1jfodyY0CYF04U5MgR+mpAi9myPRoULLEDOI0/ZkJIBkr5PiwX1l7PqHRG6NXNJYtqAPh3VcdJfMRL1uVyQ90VLX4Le5BvVVSPYpuONfNhzYYDjuscdaCMN6rLYN0oQ8EoCcAty4v2cWZ8IlFy7IT1X2GEXjP2ZPc62M9Ps/HzOi49rfx4VPIrFPO6xMFgM= 2022-05-25T15:39:49.915 INFO:teuthology.kill:2022-05-25 15:39:49,915.915 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-25T15:39:49.919 INFO:teuthology.kill:2022-05-25 15:39:49,918.918 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-25T15:39:49.996 INFO:teuthology.kill:2022-05-25 15:39:49,996.996 INFO:teuthology.orchestra.console:Power off smithi027 2022-05-25T15:39:50.010 INFO:teuthology.kill:2022-05-25 15:39:50,009.009 INFO:teuthology.orchestra.console:Power off smithi057 2022-05-25T15:39:58.370 INFO:teuthology.kill:2022-05-25 15:39:58,370.370 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2022-05-25T15:39:58.519 INFO:teuthology.kill:2022-05-25 15:39:58,519.519 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com 2022-05-25T15:40:02.488 INFO:teuthology.kill:2022-05-25 15:40:02,488.488 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2022-05-25T15:40:02.633 INFO:teuthology.kill:2022-05-25 15:40:02,633.633 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com 2022-05-25T15:42:02.942 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15