2022-05-25T07:14:37.844 INFO:root:teuthology version: 1.1.1.dev341+g1b30281f 2022-05-25T07:14:37.987 INFO:teuthology.lock.ops:Start node 'smithi035.front.sepia.ceph.com' reimaging 2022-05-25T07:14:37.987 INFO:teuthology.lock.ops:Updating [smithi035.front.sepia.ceph.com]: reset os type and version on server 2022-05-25T07:14:37.988 INFO:teuthology.lock.ops:Updating smithi035.front.sepia.ceph.com on lock server 2022-05-25T07:14:38.007 INFO:teuthology.lock.ops:Node 'smithi035.front.sepia.ceph.com' reimaging is complete 2022-05-25T07:14:38.007 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2022-05-25T07:14:38.007 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2022-05-25T07:14:38.007 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2022-05-25T07:14:38.028 INFO:teuthology.lock.ops:Node 'smithi059.front.sepia.ceph.com' reimaging is complete 2022-05-25T07:14:38.234 INFO:teuthology.provision.fog.smithi035:Scheduling deploy of centos 8.stream 2022-05-25T07:14:38.247 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 8.stream 2022-05-25T07:14:38.545 INFO:teuthology.orchestra.console:Power off smithi035 2022-05-25T07:14:38.562 INFO:teuthology.orchestra.console:Power off smithi059 2022-05-25T07:14:38.695 INFO:teuthology.orchestra.console:Power off for smithi035 completed 2022-05-25T07:14:38.708 INFO:teuthology.orchestra.console:Power off for smithi059 completed 2022-05-25T07:14:38.797 INFO:teuthology.orchestra.console:Power on smithi035 2022-05-25T07:14:38.809 INFO:teuthology.orchestra.console:Power on smithi059 2022-05-25T07:14:43.057 INFO:teuthology.orchestra.console:Power on for smithi035 completed 2022-05-25T07:14:43.062 INFO:teuthology.orchestra.console:Power on for smithi059 completed 2022-05-25T07:14:43.158 INFO:teuthology.provision.fog.smithi035:Waiting for deploy to finish 2022-05-25T07:14:43.163 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2022-05-25T07:16:59.097 ERROR:teuthology.orchestra.connection:Error authenticating with smithi059.front.sepia.ceph.com: Authentication failed. 2022-05-25T07:18:56.995 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-25T07:18:57.245 INFO:teuthology.provision.fog.smithi035:Node is ready 2022-05-25T07:18:57.264 INFO:teuthology.orchestra.run.smithi035.stdout:smithi035.front.sepia.ceph.com 2022-05-25T07:18:57.323 INFO:teuthology.orchestra.run.smithi035.stdout:172.21.15.35 smithi035.front.sepia.ceph.com smithi035 2022-05-25T07:18:57.680 INFO:teuthology.provision.fog.smithi035:Deploy complete! 2022-05-25T07:18:58.976 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-25T07:18:59.220 INFO:teuthology.provision.fog.smithi059:Node is ready 2022-05-25T07:18:59.281 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2022-05-25T07:18:59.342 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2022-05-25T07:18:59.714 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2022-05-25T07:18:59.888 INFO:teuthology.lock.ops:Checking smithi035.front.sepia.ceph.com 2022-05-25T07:18:59.889 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-25T07:18:59.911 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2022-05-25T07:18:59.911 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-25T07:18:59.930 INFO:teuthology.lock.ops:Updating [smithi035.front.sepia.ceph.com]: set os type and version on server 2022-05-25T07:18:59.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2022-05-25T07:19:00.097 INFO:teuthology.orchestra.run.smithi035.stdout:x86_64 2022-05-25T07:19:00.159 INFO:teuthology.orchestra.run.smithi035.stdout:NAME="CentOS Stream" 2022-05-25T07:19:00.159 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION="8" 2022-05-25T07:19:00.159 INFO:teuthology.orchestra.run.smithi035.stdout:ID="centos" 2022-05-25T07:19:00.159 INFO:teuthology.orchestra.run.smithi035.stdout:ID_LIKE="rhel fedora" 2022-05-25T07:19:00.160 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION_ID="8" 2022-05-25T07:19:00.160 INFO:teuthology.orchestra.run.smithi035.stdout:PLATFORM_ID="platform:el8" 2022-05-25T07:19:00.160 INFO:teuthology.orchestra.run.smithi035.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-25T07:19:00.160 INFO:teuthology.orchestra.run.smithi035.stdout:ANSI_COLOR="0;31" 2022-05-25T07:19:00.160 INFO:teuthology.orchestra.run.smithi035.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-25T07:19:00.160 INFO:teuthology.orchestra.run.smithi035.stdout:HOME_URL="https://centos.org/" 2022-05-25T07:19:00.160 INFO:teuthology.orchestra.run.smithi035.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-25T07:19:00.160 INFO:teuthology.orchestra.run.smithi035.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-25T07:19:00.160 INFO:teuthology.orchestra.run.smithi035.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-25T07:19:00.162 INFO:teuthology.lock.ops:Updating smithi035.front.sepia.ceph.com on lock server 2022-05-25T07:19:00.181 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2022-05-25T07:19:00.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2022-05-25T07:19:00.394 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2022-05-25T07:19:00.455 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2022-05-25T07:19:00.455 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8" 2022-05-25T07:19:00.455 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2022-05-25T07:19:00.455 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2022-05-25T07:19:00.455 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8" 2022-05-25T07:19:00.455 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2022-05-25T07:19:00.455 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-25T07:19:00.455 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2022-05-25T07:19:00.455 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-25T07:19:00.456 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2022-05-25T07:19:00.456 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-25T07:19:00.456 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-25T07:19:00.456 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-25T07:19:00.456 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2022-05-25T07:19:00.566 INFO:teuthology.dispatcher.supervisor:Running job 6847691 2022-05-25T07:19:00.566 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-05-25_01:31:28-fs-wip-vshankar-fscrypt-20220524-112530-testing-default-smithi/6847691 --name vshankar-2022-05-25_01:31:28-fs-wip-vshankar-fscrypt-20220524-112530-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}} -- /home/teuthworker/archive/vshankar-2022-05-25_01:31:28-fs-wip-vshankar-fscrypt-20220524-112530-testing-default-smithi/6847691/orig.config.yaml 2022-05-25T07:19:00.571 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-05-25_01:31:28-fs-wip-vshankar-fscrypt-20220524-112530-testing-default-smithi/6847691 2022-05-25T07:19:00.571 INFO:teuthology.dispatcher.supervisor:Job PID: 20004 2022-05-25T07:19:00.571 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-25T13:49:12.761 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-25T13:49:12.936 INFO:teuthology.kill:Killing Pids: {20004} 2022-05-25T13:49:14.521 INFO:teuthology.task.internal:roles: ubuntu@smithi035.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-05-25T13:49:14.521 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-05-25T13:49:14.522 INFO:teuthology.misc:Compressing logs... 2022-05-25T13:49:14.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2022-05-25T13:49:14.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2022-05-25T13:49:15.312 INFO:teuthology.misc:Compressing logs... 2022-05-25T13:49:15.610 INFO:teuthology.misc:Compressing logs... 2022-05-25T14:00:08.403 INFO:teuthology.kill:No teuthology processes running 2022-05-25T14:00:09.960 INFO:teuthology.kill:Nuking machines: ['smithi035', 'smithi059'] 2022-05-25T14:00:11.177 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-25T14:00:11.177 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-25T14:00:11.177 INFO:teuthology.kill:2022-05-25 14:00:11,176.176 INFO:teuthology.nuke:targets: 2022-05-25T14:00:11.177 INFO:teuthology.kill: smithi035.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDK/Ki7uG6oR2o5LRjwSwflQtgJDjgwMxl1/r3Sq0BPoUw4gk8IWeH+vGYCPgDKCBSQ/iqzNFYhWkXt0fdzQUaXeULKFvnkAKxtER1FUWWyh7jxkLwrNHFttJNESZ7wFrsBKi4Y2E+I5g6B5u1MDRqvx1/97o6B31P+NL82y8fcwWUnBZjWeA4g0xj5/TZru5GnMcpG/t0gxsDFGFJJmWB3ULAITgSYa3Nk4ZurluJdrOBHMzjA7CTOQTSBpQa+R1EHLdorXBAb/SNXfMLGuZlxTA4VnLAKgEZMFcxMHJ0T5UfSpChn2W3DS0ZjKCMdpMD161nSYtokj0lyv7UxIpDgT8mGCZtLMDB9x+zrh/o/jnwtOVBoJzWUED8tRDkbdoVq2W2rdJkCeJtQ0RcFK+no4P/3MCPk3e8kBWaAEf17SNJF5Q4S62Tlz+pyUkA6t98zr6+VKouJ7gUkXbi1pWE9LFBPWM+sxwOajBTjwh1E4+Ff+qOoV/x9QoI33ThcND8= 2022-05-25T14:00:11.177 INFO:teuthology.kill: smithi059.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBKY1bAiEh+jPWDzcCRKj3UuEHFO5nHfvD1ugzDXnSQA0kI01b2pA2asSODEQVp1Fo4ETt8k/P1IK8HA+igShOk66hnz7FRu3wT2tS3iqEckAsLXWdD5s+W9112pCiyaYcybd13FDxrm4wDs0E59+67pdyDrKZ52gto6W7zIp8rPKLUc98zvDvXZWTbCDHVEqPVU5K3YftP1JC4D3FoFXhR4OiJhVCfLAu3JphGZIU3Y5RGfbl469U6qpCxMZO6RlrFSFikEJw7Fv7Sj3ADmT62X6bHw5BnkUBO8NI25X2Spy/txcOswrxAYDojSo3KkRdyqUKgPqC01/tuEVzKklQyhd/+brbZf336qeyKHRI4bZbh7J9Pp4oiKKRZOAG1rPg8GYxRAnTe+oNBXmF6IcSVmN3uJXncJNDKV/LDCTisf0flcR+tIABR43GSjDY7UNvMnxK/rJe0j95lYya2uYGSIWg/mX9Wb8Sbby8WhYQb3fwOzmjGAGfDjts/GFil4s= 2022-05-25T14:00:11.210 INFO:teuthology.kill:2022-05-25 14:00:11,210.210 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-25T14:00:11.214 INFO:teuthology.kill:2022-05-25 14:00:11,214.214 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-25T14:00:11.293 INFO:teuthology.kill:2022-05-25 14:00:11,293.293 INFO:teuthology.orchestra.console:Power off smithi059 2022-05-25T14:00:11.309 INFO:teuthology.kill:2022-05-25 14:00:11,308.308 INFO:teuthology.orchestra.console:Power off smithi035 2022-05-25T14:00:23.790 INFO:teuthology.kill:2022-05-25 14:00:23,789.789 INFO:teuthology.orchestra.console:Power off for smithi059 completed 2022-05-25T14:00:24.429 INFO:teuthology.kill:2022-05-25 14:00:23,795.795 INFO:teuthology.orchestra.console:Power off for smithi035 completed 2022-05-25T14:00:24.429 INFO:teuthology.kill:2022-05-25 14:00:23,957.957 INFO:teuthology.lock.ops:unlocked: smithi035.front.sepia.ceph.com 2022-05-25T14:00:24.429 INFO:teuthology.kill:2022-05-25 14:00:23,960.960 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com 2022-05-25T14:02:24.577 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15