2022-03-19T05:02:10.389 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-19T05:02:10.522 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi165.front.sepia.ceph.com' reimaging
2022-03-19T05:02:10.524 INFO:teuthology.lock.ops:Updating [ubuntu@smithi165.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T05:02:10.524 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2022-03-19T05:02:10.541 INFO:teuthology.lock.ops:Node 'ubuntu@smithi165.front.sepia.ceph.com' reimaging is complete
2022-03-19T05:02:10.542 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging
2022-03-19T05:02:10.542 INFO:teuthology.lock.ops:Updating [ubuntu@smithi183.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T05:02:10.543 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2022-03-19T05:02:10.561 INFO:teuthology.lock.ops:Node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging is complete
2022-03-19T05:02:10.766 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of rhel 8.4
2022-03-19T05:02:10.770 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of rhel 8.4
2022-03-19T05:02:11.085 INFO:teuthology.orchestra.console:Power off smithi183
2022-03-19T05:02:11.099 INFO:teuthology.orchestra.console:Power off smithi165
2022-03-19T05:02:11.227 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2022-03-19T05:02:11.239 INFO:teuthology.orchestra.console:Power off for smithi165 completed
2022-03-19T05:02:11.328 INFO:teuthology.orchestra.console:Power on smithi183
2022-03-19T05:02:11.341 INFO:teuthology.orchestra.console:Power on smithi165
2022-03-19T05:02:15.589 INFO:teuthology.orchestra.console:Power on for smithi165 completed
2022-03-19T05:02:15.690 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish
2022-03-19T05:02:19.702 INFO:teuthology.orchestra.console:Power on for smithi183 completed
2022-03-19T05:02:19.803 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2022-03-19T05:06:25.661 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T05:06:46.049 INFO:teuthology.provision.fog.smithi183:Node is ready
2022-03-19T05:06:46.068 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com
2022-03-19T05:06:46.125 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2022-03-19T05:06:46.478 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2022-03-19T05:07:08.657 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T05:07:08.917 INFO:teuthology.provision.fog.smithi165:Node is ready
2022-03-19T05:07:08.933 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com
2022-03-19T05:07:08.989 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165
2022-03-19T05:07:09.322 INFO:teuthology.provision.fog.smithi165:Deploy complete!
2022-03-19T05:07:09.466 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com
2022-03-19T05:07:09.467 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T05:07:09.485 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2022-03-19T05:07:09.485 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T05:07:09.503 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server
2022-03-19T05:07:09.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2022-03-19T05:07:09.726 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64
2022-03-19T05:07:09.780 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T05:07:09.780 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T05:07:09.781 INFO:teuthology.orchestra.run.smithi165.stdout:ID="rhel"
2022-03-19T05:07:09.781 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="fedora"
2022-03-19T05:07:09.781 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8.4"
2022-03-19T05:07:09.781 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8"
2022-03-19T05:07:09.782 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T05:07:09.782 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2022-03-19T05:07:09.782 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T05:07:09.782 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T05:07:09.783 INFO:teuthology.orchestra.run.smithi165.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T05:07:09.783 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T05:07:09.783 INFO:teuthology.orchestra.run.smithi165.stdout:
2022-03-19T05:07:09.783 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T05:07:09.783 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T05:07:09.784 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T05:07:09.784 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T05:07:09.785 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2022-03-19T05:07:09.802 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2022-03-19T05:07:09.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2022-03-19T05:07:10.036 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2022-03-19T05:07:10.091 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T05:07:10.091 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T05:07:10.091 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel"
2022-03-19T05:07:10.092 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora"
2022-03-19T05:07:10.092 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.4"
2022-03-19T05:07:10.092 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8"
2022-03-19T05:07:10.092 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T05:07:10.093 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2022-03-19T05:07:10.093 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T05:07:10.093 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T05:07:10.093 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T05:07:10.094 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T05:07:10.094 INFO:teuthology.orchestra.run.smithi183.stdout:
2022-03-19T05:07:10.094 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T05:07:10.094 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T05:07:10.095 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T05:07:10.095 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T05:07:10.095 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2022-03-19T05:07:10.190 INFO:teuthology.dispatcher.supervisor:Running job 6744819
2022-03-19T05:07:10.190 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_aa078dbed6d14c1ad98beb5a02b956bbe0a741c8/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744819 --name vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/pjd}} -- /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744819/orig.config.yaml
2022-03-19T05:07:10.194 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744819
2022-03-19T05:07:10.195 INFO:teuthology.dispatcher.supervisor:Job PID: 27732
2022-03-19T05:07:10.195 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-19T11:37:37.843 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-19T11:37:38.010 INFO:teuthology.kill:Killing Pids: {27732}
2022-03-19T11:37:39.136 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-19T11:37:39.137 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-19T11:37:39.138 INFO:teuthology.misc:Compressing logs...
2022-03-19T11:37:39.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2022-03-19T11:37:39.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2022-03-19T11:37:39.842 INFO:teuthology.misc:Compressing logs...
2022-03-19T11:37:40.009 INFO:teuthology.misc:Compressing logs...
2022-03-19T11:48:42.585 INFO:teuthology.kill:No teuthology processes running
2022-03-19T11:48:43.717 INFO:teuthology.kill:Nuking machines: ['smithi165', 'smithi183']
2022-03-19T11:48:44.653 INFO:teuthology.kill:2022-03-19 11:48:44,652.652 INFO:teuthology.nuke:targets:
2022-03-19T11:48:44.654 INFO:teuthology.kill:  smithi165.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCf66sucSpFZuVjO5uPMHTqqQgOYUW63U4oMD7ST48flgzU0tsWsfsltqM5DSaYuE72VuacRN+Oha6XZ8jdZ+tCQpqvDM7dEOxETFuAYB4SOgDH4d9j+9dvRW2oysg1FFhJDvGJJrhmG33BYeatITUl5q84TPxwBw95lGH3CdDL29NZxKuNDLdoXIFkw3Jf1yKF3ogWaIWd+obRdBzF6bJTKNSwlz8wE1ltal+fz1jlYo8h6tQChMqvaCd3uMtXnILS39YpAPrHGegX9x0jMQFdZPnJ0QJF6dFk4XXx0406XwEIqWnciWUMR/R8q6VgUN5Ihq/6dYjazkMTm+VmuVO8ZwyhflGKtgiUkKTvo6hJVsbSuksE9wu2jEDBtlxkdPfzVPQiahSlUljrFTc30qMtLhYocZnauA6uvYLcq2/8/ViMapdcd+hSGB8bdTVlK5/Nf2Yigq7wR6YNgHRkNO8fw720AhvgAkhhMqTXSgGTM2Oqk2PsfTcCr2hWmj87cas=
2022-03-19T11:48:44.654 INFO:teuthology.kill:  smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8nx2jAFGz+Kf1aFLGK25yMBNqRA8mOaGhWHljCu4rapeMKNUIBMkYiFG9IwiA5fv2xV0WbpncRdgWVr1JCkjS9i1enjVEhrCk+AGzhRWBO9g51oLazU9ql+lxjC6IDBl/kL5F9aRjd9aN++3S7hW9GaGjqmxi/IM14ZJSA6kCYUzJ1Td8aGrJ+cbtU1uMHiQNpfJkXX+uGrvpm75+Y3GZL0MLz2+f94aG+4wyNLbaAdUVCJK0lwdRoKLE1hzV2hAWra64vTRq83ametjr01HCUPftQEoWuNYRFBP3iA/dc8P1QM9zJ+YFXxhDZK/GZ7ANzkxPvEGT7dmyjbJHwoM+6ERuxbiUmUAIGZ7ocSpNk5cJ6Ib/XIVRzasfNdUnKWysBdcET34fZQh9Q3Xrx6KP4PCeo5fSUyOPJMbl5JsxvBe2iH2VEPI2tz/3gZEA56HTMUJvpLbpCOmZASuWOGsGkebwa7x3u0OlzCsMrNqxo5EH8JdImvhHLCoyzq3yO1s=
2022-03-19T11:48:44.679 INFO:teuthology.kill:2022-03-19 11:48:44,679.679 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T11:48:44.682 INFO:teuthology.kill:2022-03-19 11:48:44,682.682 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T11:48:44.755 INFO:teuthology.kill:2022-03-19 11:48:44,754.754 INFO:teuthology.orchestra.console:Power off smithi165
2022-03-19T11:48:44.768 INFO:teuthology.kill:2022-03-19 11:48:44,767.767 INFO:teuthology.orchestra.console:Power off smithi183
2022-03-19T11:48:53.133 INFO:teuthology.kill:2022-03-19 11:48:53,133.133 INFO:teuthology.orchestra.console:Power off for smithi183 completed
2022-03-19T11:48:53.316 INFO:teuthology.kill:2022-03-19 11:48:53,316.316 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com
2022-03-19T11:48:57.241 INFO:teuthology.kill:2022-03-19 11:48:57,241.241 INFO:teuthology.orchestra.console:Power off for smithi165 completed
2022-03-19T11:48:57.384 INFO:teuthology.kill:2022-03-19 11:48:57,384.384 INFO:teuthology.lock.ops:unlocked: smithi165.front.sepia.ceph.com
2022-03-19T11:50:57.601 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-19T11:50:57.707 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi183 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744927