2022-05-31T06:09:13.920 INFO:root:teuthology version: 1.1.1.dev341+g1b30281f 2022-05-31T06:09:14.060 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2022-05-31T06:09:14.061 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2022-05-31T06:09:14.061 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2022-05-31T06:09:14.081 INFO:teuthology.lock.ops:Node 'smithi066.front.sepia.ceph.com' reimaging is complete 2022-05-31T06:09:14.081 INFO:teuthology.lock.ops:Start node 'smithi085.front.sepia.ceph.com' reimaging 2022-05-31T06:09:14.081 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: reset os type and version on server 2022-05-31T06:09:14.082 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2022-05-31T06:09:14.101 INFO:teuthology.lock.ops:Node 'smithi085.front.sepia.ceph.com' reimaging is complete 2022-05-31T06:09:14.300 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of ubuntu 20.04 2022-05-31T06:09:14.334 INFO:teuthology.provision.fog.smithi085:Scheduling deploy of ubuntu 20.04 2022-05-31T06:09:14.655 INFO:teuthology.orchestra.console:Power off smithi066 2022-05-31T06:09:14.716 INFO:teuthology.orchestra.console:Power off smithi085 2022-05-31T06:09:14.806 INFO:teuthology.orchestra.console:Power off for smithi066 completed 2022-05-31T06:09:14.856 INFO:teuthology.orchestra.console:Power off for smithi085 completed 2022-05-31T06:09:14.907 INFO:teuthology.orchestra.console:Power on smithi066 2022-05-31T06:09:14.957 INFO:teuthology.orchestra.console:Power on smithi085 2022-05-31T06:09:19.165 INFO:teuthology.orchestra.console:Power on for smithi066 completed 2022-05-31T06:09:19.266 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2022-05-31T06:09:23.323 INFO:teuthology.orchestra.console:Power on for smithi085 completed 2022-05-31T06:09:23.424 INFO:teuthology.provision.fog.smithi085:Waiting for deploy to finish 2022-05-31T06:12:50.714 ERROR:teuthology.orchestra.connection:Error authenticating with smithi066.front.sepia.ceph.com: Authentication failed. 2022-05-31T06:14:17.575 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-31T06:14:18.120 INFO:teuthology.provision.fog.smithi085:Node is ready 2022-05-31T06:14:18.127 INFO:teuthology.orchestra.run.smithi085.stdout:smithi085.front.sepia.ceph.com 2022-05-31T06:14:18.134 INFO:teuthology.orchestra.run.smithi085.stdout:172.21.15.85 smithi085.front.sepia.ceph.com smithi085 2022-05-31T06:14:18.304 INFO:teuthology.provision.fog.smithi085:Deploy complete! 2022-05-31T06:15:36.070 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-31T06:15:36.642 INFO:teuthology.provision.fog.smithi066:Node is ready 2022-05-31T06:15:36.648 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2022-05-31T06:15:36.698 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2022-05-31T06:15:36.855 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2022-05-31T06:15:37.055 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2022-05-31T06:15:37.056 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-31T06:15:37.077 INFO:teuthology.lock.ops:Checking smithi085.front.sepia.ceph.com 2022-05-31T06:15:37.077 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-31T06:15:37.096 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2022-05-31T06:15:37.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2022-05-31T06:15:37.333 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2022-05-31T06:15:37.339 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Ubuntu" 2022-05-31T06:15:37.340 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-31T06:15:37.340 INFO:teuthology.orchestra.run.smithi066.stdout:ID=ubuntu 2022-05-31T06:15:37.340 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE=debian 2022-05-31T06:15:37.340 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-31T06:15:37.340 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="20.04" 2022-05-31T06:15:37.340 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-31T06:15:37.340 INFO:teuthology.orchestra.run.smithi066.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-31T06:15:37.340 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-31T06:15:37.340 INFO:teuthology.orchestra.run.smithi066.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-31T06:15:37.340 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_CODENAME=focal 2022-05-31T06:15:37.341 INFO:teuthology.orchestra.run.smithi066.stdout:UBUNTU_CODENAME=focal 2022-05-31T06:15:37.342 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2022-05-31T06:15:37.361 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: set os type and version on server 2022-05-31T06:15:37.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2022-05-31T06:15:37.624 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64 2022-05-31T06:15:37.631 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="Ubuntu" 2022-05-31T06:15:37.632 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-31T06:15:37.632 INFO:teuthology.orchestra.run.smithi085.stdout:ID=ubuntu 2022-05-31T06:15:37.632 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE=debian 2022-05-31T06:15:37.632 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-31T06:15:37.633 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="20.04" 2022-05-31T06:15:37.633 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-31T06:15:37.633 INFO:teuthology.orchestra.run.smithi085.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-31T06:15:37.633 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-31T06:15:37.633 INFO:teuthology.orchestra.run.smithi085.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-31T06:15:37.633 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_CODENAME=focal 2022-05-31T06:15:37.634 INFO:teuthology.orchestra.run.smithi085.stdout:UBUNTU_CODENAME=focal 2022-05-31T06:15:37.634 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2022-05-31T06:15:37.741 INFO:teuthology.dispatcher.supervisor:Running job 6853865 2022-05-31T06:15:37.742 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-05-31_02:47:51-fs-wip-vshankar-fscrypt-20220530-091336-testing-default-smithi/6853865 --name vshankar-2022-05-31_02:47:51-fs-wip-vshankar-fscrypt-20220530-091336-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/iozone}} -- /home/teuthworker/archive/vshankar-2022-05-31_02:47:51-fs-wip-vshankar-fscrypt-20220530-091336-testing-default-smithi/6853865/orig.config.yaml 2022-05-31T06:15:37.747 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-05-31_02:47:51-fs-wip-vshankar-fscrypt-20220530-091336-testing-default-smithi/6853865 2022-05-31T06:15:37.747 INFO:teuthology.dispatcher.supervisor:Job PID: 5072 2022-05-31T06:15:37.747 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-31T12:45:49.404 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-31T12:45:49.634 INFO:teuthology.kill:Killing Pids: {5072} 2022-05-31T12:45:51.112 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-05-31T12:45:51.112 INFO:teuthology.task.internal:roles: ubuntu@smithi085.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-05-31T12:45:51.113 INFO:teuthology.misc:Compressing logs... 2022-05-31T12:45:51.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2022-05-31T12:45:51.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2022-05-31T12:45:51.819 INFO:teuthology.misc:Compressing logs... 2022-05-31T12:45:51.988 INFO:teuthology.misc:Compressing logs... 2022-05-31T12:48:21.012 INFO:teuthology.kill:No teuthology processes running 2022-05-31T12:48:22.480 INFO:teuthology.kill:Nuking machines: ['smithi066', 'smithi085'] 2022-05-31T12:48:23.734 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-31T12:48:23.734 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-31T12:48:23.735 INFO:teuthology.kill:2022-05-31 12:48:23,733.733 INFO:teuthology.nuke:targets: 2022-05-31T12:48:23.735 INFO:teuthology.kill: smithi066.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC430/N1X9AN1L1tAUC+WlYPMr4hAKutWGNyw66yo0f4QWdtSAfNff6+gIQYEjXlW6HKjcF399JSlKMMeuQny4qH5GPj8rCOBJ7h6dQa1WsrG7ocZ2u+fRcRie7aMiHhLp5En0TMvEuNPIwVeF/IufrbU+KULKfAiYt8MDgzlaH2r4JX5GZToWg/AdkWo+WQK10SsL+vs62Vz+7NS6QxgNxUMcXSN4/LphOlKCOELqqLue9F0X1+CDzkqNUkS/Hlboj0I1D4ZzmMVLN6QRDO+yo3zb2KWOApaSh6zRL4bYsHBEOZhpV1xd18aeVq84TJ5KEsYSRyLNU6wSk2/Hy92ziJnQdbzSX5GowFtqgJXhm/QST9eOqrB9vxlfs6qZuGkIdfCGDblcUs9nNZxru/b35/lRT/NXwJvHlD15kOpvloYctiqZwto1ATjJOyV3t6FDUM+0FvR8B3pJ6QbiM65I+O5jSG/FTUxY+3k9rwQppWBamK+RThGXLP9shuKJRTBs= 2022-05-31T12:48:23.735 INFO:teuthology.kill: smithi085.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTAiwNLrDIBXnIZ/oVnQN3ztg5QSlx6EKLmoEPPrMtVb2bdtEpiVbVyiGvBTY7WW6vPeYWrbZ59TC+DRQ8D5ag2fJECoWkAp5UgIBA9mvr0I1zLktJTx4dDKPnAq5P2zHMkHL+6OQKPzaC1uqXmX5K7viJODsatvJb5gYlvn/KaeWqdCn7PmQYu0arX0Sg4t8AmFB5rdEFOHWV/l3GMuXt4GqkOUqZmrwEmqeMe3wJOrB4VIZRXin7eU5WPhlHgGnZ04k+olgqP/T94/LiDdoLgCkV4oFsyR1s9482+z2Lp+aYKyqXycw1cX3cOx6hzXWzz85I4+rYIF9HgT3wXf9t5khsSV83OyFoE+6e9EoXy3/Jlf4Py1Kxfz06/+2aDle+hV8n51F/Gtyz1XAk5wnkQnEky/oOA/3hVuftY2MoG0qwovjqCsvzYNcmue13T/g/+RExm7XVDLxzGkCR+vtyZfk+TzSxMNx1De922f+P3UPiAfDbn9BEl0Ck/rjmGB8= 2022-05-31T12:48:23.763 INFO:teuthology.kill:2022-05-31 12:48:23,763.763 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-31T12:48:23.766 INFO:teuthology.kill:2022-05-31 12:48:23,766.766 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-31T12:48:23.846 INFO:teuthology.kill:2022-05-31 12:48:23,846.846 INFO:teuthology.orchestra.console:Power off smithi085 2022-05-31T12:48:23.860 INFO:teuthology.kill:2022-05-31 12:48:23,860.860 INFO:teuthology.orchestra.console:Power off smithi066 2022-05-31T12:48:36.328 INFO:teuthology.kill:2022-05-31 12:48:36,327.327 INFO:teuthology.orchestra.console:Power off for smithi085 completed 2022-05-31T12:48:36.334 INFO:teuthology.kill:2022-05-31 12:48:36,334.334 INFO:teuthology.orchestra.console:Power off for smithi066 completed 2022-05-31T12:48:36.486 INFO:teuthology.kill:2022-05-31 12:48:36,485.485 INFO:teuthology.lock.ops:unlocked: smithi085.front.sepia.ceph.com 2022-05-31T12:48:36.497 INFO:teuthology.kill:2022-05-31 12:48:36,497.497 INFO:teuthology.lock.ops:unlocked: smithi066.front.sepia.ceph.com 2022-05-31T12:50:36.742 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-31T12:50:36.858 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi066 but it was locked by another job: /home/teuthworker/archive/soumyakoduri-2022-05-31_12:08:32-rgw-wip-skoduri-tests-distro-basic-smithi/6855420 2022-05-31T12:50:36.858 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi085 but it was locked by another job: /home/teuthworker/archive/soumyakoduri-2022-05-31_12:08:32-rgw-wip-skoduri-tests-distro-basic-smithi/6855420