2022-03-18T12:29:07.529 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-18T12:29:07.651 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi111.front.sepia.ceph.com' reimaging
2022-03-18T12:29:07.652 INFO:teuthology.lock.ops:Updating [ubuntu@smithi111.front.sepia.ceph.com]: reset os type and version on server
2022-03-18T12:29:07.652 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2022-03-18T12:29:07.671 INFO:teuthology.lock.ops:Node 'ubuntu@smithi111.front.sepia.ceph.com' reimaging is complete
2022-03-18T12:29:07.671 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging
2022-03-18T12:29:07.672 INFO:teuthology.lock.ops:Updating [ubuntu@smithi131.front.sepia.ceph.com]: reset os type and version on server
2022-03-18T12:29:07.672 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2022-03-18T12:29:07.690 INFO:teuthology.lock.ops:Node 'ubuntu@smithi131.front.sepia.ceph.com' reimaging is complete
2022-03-18T12:29:07.886 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 8.stream
2022-03-18T12:29:07.895 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream
2022-03-18T12:29:08.237 INFO:teuthology.orchestra.console:Power off smithi131
2022-03-18T12:29:08.280 INFO:teuthology.orchestra.console:Power off smithi111
2022-03-18T12:29:16.614 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2022-03-18T12:29:16.640 INFO:teuthology.orchestra.console:Power off for smithi111 completed
2022-03-18T12:29:16.715 INFO:teuthology.orchestra.console:Power on smithi131
2022-03-18T12:29:16.743 INFO:teuthology.orchestra.console:Power on smithi111
2022-03-18T12:29:25.079 INFO:teuthology.orchestra.console:Power on for smithi131 completed
2022-03-18T12:29:25.176 INFO:teuthology.orchestra.console:Power on for smithi111 completed
2022-03-18T12:29:25.181 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish
2022-03-18T12:29:25.277 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2022-03-18T12:33:47.948 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-18T12:33:48.206 INFO:teuthology.provision.fog.smithi131:Node is ready
2022-03-18T12:33:48.224 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com
2022-03-18T12:33:48.283 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131
2022-03-18T12:33:48.630 INFO:teuthology.provision.fog.smithi131:Deploy complete!
2022-03-18T12:35:15.589 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-18T12:35:15.838 INFO:teuthology.provision.fog.smithi111:Node is ready
2022-03-18T12:35:15.858 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2022-03-18T12:35:15.917 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2022-03-18T12:35:16.275 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2022-03-18T12:35:16.458 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2022-03-18T12:35:16.459 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-18T12:35:16.478 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com
2022-03-18T12:35:16.479 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-18T12:35:16.498 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2022-03-18T12:35:16.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2022-03-18T12:35:16.688 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2022-03-18T12:35:16.745 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2022-03-18T12:35:16.746 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8"
2022-03-18T12:35:16.746 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2022-03-18T12:35:16.746 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2022-03-18T12:35:16.746 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8"
2022-03-18T12:35:16.747 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2022-03-18T12:35:16.747 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-18T12:35:16.747 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2022-03-18T12:35:16.747 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-18T12:35:16.748 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2022-03-18T12:35:16.748 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-18T12:35:16.748 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-18T12:35:16.748 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-18T12:35:16.749 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2022-03-18T12:35:16.768 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server
2022-03-18T12:35:16.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2022-03-18T12:35:17.009 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64
2022-03-18T12:35:17.067 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream"
2022-03-18T12:35:17.067 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8"
2022-03-18T12:35:17.067 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos"
2022-03-18T12:35:17.068 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora"
2022-03-18T12:35:17.068 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8"
2022-03-18T12:35:17.068 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8"
2022-03-18T12:35:17.068 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8"
2022-03-18T12:35:17.068 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2022-03-18T12:35:17.069 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-03-18T12:35:17.069 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/"
2022-03-18T12:35:17.069 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-18T12:35:17.069 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-18T12:35:17.070 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-03-18T12:35:17.070 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2022-03-18T12:35:17.173 INFO:teuthology.dispatcher.supervisor:Running job 6744643
2022-03-18T12:35:17.174 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_aa078dbed6d14c1ad98beb5a02b956bbe0a741c8/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744643 --name vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744643/orig.config.yaml
2022-03-18T12:35:17.177 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744643
2022-03-18T12:35:17.178 INFO:teuthology.dispatcher.supervisor:Job PID: 19467
2022-03-18T12:35:17.178 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-18T19:05:45.591 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-18T19:05:45.791 INFO:teuthology.kill:Killing Pids: {19467}
2022-03-18T19:05:46.960 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-18T19:05:46.961 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-18T19:05:46.962 INFO:teuthology.misc:Compressing logs...
2022-03-18T19:05:46.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2022-03-18T19:05:47.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2022-03-18T19:05:47.517 INFO:teuthology.misc:Compressing logs...
2022-03-18T19:05:47.750 INFO:teuthology.misc:Compressing logs...
2022-03-18T19:08:13.362 INFO:teuthology.kill:No teuthology processes running
2022-03-18T19:08:14.515 INFO:teuthology.kill:Nuking machines: ['smithi111', 'smithi131']
2022-03-18T19:08:15.477 INFO:teuthology.kill:2022-03-18 19:08:15,477.477 INFO:teuthology.nuke:targets:
2022-03-18T19:08:15.478 INFO:teuthology.kill:  smithi111.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwVfjIepuPOcqAlh1Sv0wkjdLJtdhsa/C3tarNwFCrGDKifcrtdHxHoAV8PJUIymBkaTrJcR7ouvpzdgopvlqEBKfYVOJKzZRyDqsmh28m22Tp5laMTrbqJYCRpHViMyRBmDSKPdYs6g/k7wBt7jZ3EPSGl/SvBx/7XdkvcypGU0ZJsDpFQzpeOqiUGnX7tEBXjI5sLcyNatfv23oDgFlFr9tQtOURiwIzC4F8KjsZJTveYEsnUKxGHyPCFAMHMyH4QCz5E4zLI9G+nYWi0TEV7MCkBn6I3WKRVz3YI/UVzRy9EIn04/mlHSIUhJnK/nRJbnkfycv7Iv3l1/hDoEJ+4ciYpe0EBSqW6oh/S1DOocwBH3CwIX/LQXtT/wuAMbER71GiwmSck4K5XiYJSOeZxpbfbI0lhTmaVc934kTvrb51YsF8XgluVmEroQKOBeYohJgYjom0PyZPNdPy+y9bMmVmgcNciBUd92ifHZhtg3A2tX3grs51/8BYotTrECk=
2022-03-18T19:08:15.479 INFO:teuthology.kill:  smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD5ub1lQd338dv5EpskXG5iNwDolZsXc0PyhEa3+NTxk3bBVWI+bQRvPkr/lDeSbYIrgY7PvdkL80MNDS/6KJKZtaRogUerS0Rr00o7tRdWF3GUfrbBzX9y86MenWIymNQc1BpxyNc5wdsjSNbrwCR6Qr4wKznKjJpnEipf1EgLDEr6ajhHds+FsStmh3I6EFPAuZwSi9/zHnBycJycAIA4NqnTEc5+Idb32RwzBhO4s+BsCy3XaevbkhI7C9pSYAbcGVKYhli4Q+8cCIYQ3+SuVfxtTmm99jMHFYTGYfYOTws1Y8rllv8EwjIETAu/nV7xfakYCp2Oq7a9NzFi/NRcrbtNwhStHSpS9mUUJ2IcbUTQ132hegPlKNYrNg5RK3st2jDdnejNA1uTcmCf6f5zg3/g6oUmTrZ9zGt4/Pg39x8TueNDgH2IrwXu+xQhFk9fNftjPXI/ru9HRW1M5oYf/W+Df0qIZm2iNgtj80BGjglPCnLBggtfVs4YvxoarY8=
2022-03-18T19:08:15.508 INFO:teuthology.kill:2022-03-18 19:08:15,508.508 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-18T19:08:15.512 INFO:teuthology.kill:2022-03-18 19:08:15,511.511 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-18T19:08:15.586 INFO:teuthology.kill:2022-03-18 19:08:15,586.586 INFO:teuthology.orchestra.console:Power off smithi111
2022-03-18T19:08:15.598 INFO:teuthology.kill:2022-03-18 19:08:15,598.598 INFO:teuthology.orchestra.console:Power off smithi131
2022-03-18T19:08:23.960 INFO:teuthology.kill:2022-03-18 19:08:23,959.959 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2022-03-18T19:08:24.107 INFO:teuthology.kill:2022-03-18 19:08:24,106.106 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com
2022-03-18T19:08:28.066 INFO:teuthology.kill:2022-03-18 19:08:28,065.065 INFO:teuthology.orchestra.console:Power off for smithi111 completed
2022-03-18T19:08:28.211 INFO:teuthology.kill:2022-03-18 19:08:28,211.211 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com
2022-03-18T19:10:28.538 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-18T19:10:28.658 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi111 but it was locked by another job: /home/teuthworker/archive/mrfreezeex-2022-03-18_14:52:08-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6745290
2022-03-18T19:10:28.658 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi131 but it was locked by another job: /home/teuthworker/archive/mrfreezeex-2022-03-18_14:52:08-rbd-wip-mrfreezeex-multipeer-distro-default-smithi/6745290