2022-03-21T06:59:56.486 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-21T06:59:56.603 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi055.front.sepia.ceph.com' reimaging
2022-03-21T06:59:56.604 INFO:teuthology.lock.ops:Updating [ubuntu@smithi055.front.sepia.ceph.com]: reset os type and version on server
2022-03-21T06:59:56.605 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server
2022-03-21T06:59:56.628 INFO:teuthology.lock.ops:Node 'ubuntu@smithi055.front.sepia.ceph.com' reimaging is complete
2022-03-21T06:59:56.629 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi066.front.sepia.ceph.com' reimaging
2022-03-21T06:59:56.629 INFO:teuthology.lock.ops:Updating [ubuntu@smithi066.front.sepia.ceph.com]: reset os type and version on server
2022-03-21T06:59:56.629 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2022-03-21T06:59:56.648 INFO:teuthology.lock.ops:Node 'ubuntu@smithi066.front.sepia.ceph.com' reimaging is complete
2022-03-21T06:59:56.833 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of rhel 8.4
2022-03-21T06:59:56.846 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of rhel 8.4
2022-03-21T06:59:57.136 INFO:teuthology.orchestra.console:Power off smithi055
2022-03-21T06:59:57.156 INFO:teuthology.orchestra.console:Power off smithi066
2022-03-21T07:00:05.517 INFO:teuthology.orchestra.console:Power off for smithi055 completed
2022-03-21T07:00:05.522 INFO:teuthology.orchestra.console:Power off for smithi066 completed
2022-03-21T07:00:05.619 INFO:teuthology.orchestra.console:Power on smithi055
2022-03-21T07:00:05.629 INFO:teuthology.orchestra.console:Power on smithi066
2022-03-21T07:00:13.991 INFO:teuthology.orchestra.console:Power on for smithi055 completed
2022-03-21T07:00:13.997 INFO:teuthology.orchestra.console:Power on for smithi066 completed
2022-03-21T07:00:14.093 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish
2022-03-21T07:00:14.099 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish
2022-03-21T07:04:27.715 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-21T07:04:27.943 INFO:teuthology.provision.fog.smithi055:Node is ready
2022-03-21T07:04:27.959 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com
2022-03-21T07:04:28.015 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055
2022-03-21T07:04:28.348 INFO:teuthology.provision.fog.smithi055:Deploy complete!
2022-03-21T07:05:31.180 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-21T07:05:31.414 INFO:teuthology.provision.fog.smithi066:Node is ready
2022-03-21T07:05:31.471 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com
2022-03-21T07:05:31.527 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066
2022-03-21T07:05:31.846 INFO:teuthology.provision.fog.smithi066:Deploy complete!
2022-03-21T07:05:31.997 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com
2022-03-21T07:05:31.998 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-21T07:05:32.016 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com
2022-03-21T07:05:32.016 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-21T07:05:32.036 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server
2022-03-21T07:05:32.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com'
2022-03-21T07:05:32.274 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64
2022-03-21T07:05:32.331 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux"
2022-03-21T07:05:32.331 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.4 (Ootpa)"
2022-03-21T07:05:32.331 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel"
2022-03-21T07:05:32.332 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora"
2022-03-21T07:05:32.332 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.4"
2022-03-21T07:05:32.332 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8"
2022-03-21T07:05:32.332 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-21T07:05:32.332 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31"
2022-03-21T07:05:32.333 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-21T07:05:32.333 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/"
2022-03-21T07:05:32.333 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-21T07:05:32.333 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-21T07:05:32.334 INFO:teuthology.orchestra.run.smithi055.stdout:
2022-03-21T07:05:32.334 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-21T07:05:32.334 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-21T07:05:32.334 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-21T07:05:32.335 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-21T07:05:32.336 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server
2022-03-21T07:05:32.354 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server
2022-03-21T07:05:32.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2022-03-21T07:05:32.580 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64
2022-03-21T07:05:32.634 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Red Hat Enterprise Linux"
2022-03-21T07:05:32.635 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8.4 (Ootpa)"
2022-03-21T07:05:32.635 INFO:teuthology.orchestra.run.smithi066.stdout:ID="rhel"
2022-03-21T07:05:32.635 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="fedora"
2022-03-21T07:05:32.635 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8.4"
2022-03-21T07:05:32.636 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8"
2022-03-21T07:05:32.636 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-21T07:05:32.636 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2022-03-21T07:05:32.636 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-21T07:05:32.636 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.redhat.com/"
2022-03-21T07:05:32.637 INFO:teuthology.orchestra.run.smithi066.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-21T07:05:32.637 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-21T07:05:32.637 INFO:teuthology.orchestra.run.smithi066.stdout:
2022-03-21T07:05:32.637 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-21T07:05:32.638 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-21T07:05:32.638 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-21T07:05:32.638 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-21T07:05:32.639 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2022-03-21T07:05:32.749 INFO:teuthology.dispatcher.supervisor:Running job 6749781
2022-03-21T07:05:32.749 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749781 --name vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} -- /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749781/orig.config.yaml
2022-03-21T07:05:32.752 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749781
2022-03-21T07:05:32.753 INFO:teuthology.dispatcher.supervisor:Job PID: 11260
2022-03-21T07:05:32.753 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-21T13:36:01.164 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-21T13:36:01.310 INFO:teuthology.kill:Killing Pids: {11260}
2022-03-21T13:36:02.495 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-21T13:36:02.496 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-21T13:36:02.497 INFO:teuthology.misc:Compressing logs...
2022-03-21T13:36:02.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com'
2022-03-21T13:36:02.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2022-03-21T13:36:05.059 INFO:teuthology.misc:Compressing logs...
2022-03-21T13:36:05.274 INFO:teuthology.misc:Compressing logs...
2022-03-21T13:46:27.175 INFO:teuthology.kill:No teuthology processes running
2022-03-21T13:46:28.334 INFO:teuthology.kill:Nuking machines: ['smithi055', 'smithi066']
2022-03-21T13:46:29.209 INFO:teuthology.kill:2022-03-21 13:46:29,208.208 INFO:teuthology.nuke:targets:
2022-03-21T13:46:29.210 INFO:teuthology.kill:  smithi055.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmWJwA/GRkPaVmTsh184r+2v5dJXjTPIzH6hi+NNAEz3mL3Hcc8gdKnoDe+tGdklrl1oHww5Rc3i0PC2T8fCpb1qsA1C6rMFxl7OySgoX4xmz6Q5imcB0YT6DyK14z2ds+rtau/gEIhRm1tFF4naw0wGq6zIl68gNXssyVRwdeRa/2pGMtmd5ZpMCfmrxOIodDzgM4TCjM+a/7u7NtYzzCp/TSDlKhHwGpyf65gUx2JEqMIVmPyClxC3tTpk6ow3FCRrELcaYAieYEdNY5Q61Ur3UCcrbjVsJZ/IVrfx+wSE4W8ALueauTA3mzt4p6SL8IycO5iEGVnX56IH6YwI44wKnbbdBNJweVr7oCye1U10oNduaWAW88JHJCUcSxacmhgWHHaPYxAdIBj5HjMdZNbngpMI2B9Tx19wq/Az9CI1za7zu7hu7f7QmNZ1foGtsclPH3LmJbunGTyvQf0bpBDQN8BtCOa2kKtNdIbBRrCPc7iZjskEOmxU3J46/dZus=
2022-03-21T13:46:29.210 INFO:teuthology.kill:  smithi066.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuMJ/bHmQeESkvIHvN/CoSRuduVp/wYo9VUUopuVoZN8ylfxR+Z4nzPeUAffNg7nKG7K7UdI43eCm+AQ4xirt2OZFbi7vttW8SJhhzipJLJ5SuoNuE2SUuHQ6Gxad10xLag4Pd5LY+LHJnRfwAn4OMABn/RjfFoNZIwpovl/7u5HdGAUKwFxF0I50dCxNrb1XsUxa3WqnOwCG46d+TaDwPUHRrF1/amIGU/b7+xIa6T7ZwJzV3OXK9/kS4GfYDgilPf9jdUAlBaRXrnYE2CQX1h3PbwjeRfgSydw2CQ50qv8YnUEXsSozPRLkrKAgo3+I6Zeu/FTZiIcfOHypbFFxnu33XqpXIgCHC5b4IbvsjlgQi1t725eifK0ghFvz9P1DSOt3CAGp6Fketf19XXUfMabmGMJwnbysa1SWvw2kCtsydNoQiWaH798cTO9hsgNqx/s12425ZkrTgYhGic7CA2Sj8NjDp0nFEdw+Wm8Utc0wQ7LiX75u/SFQQmjp+yBE=
2022-03-21T13:46:29.234 INFO:teuthology.kill:2022-03-21 13:46:29,234.234 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-21T13:46:29.237 INFO:teuthology.kill:2022-03-21 13:46:29,237.237 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-21T13:46:29.312 INFO:teuthology.kill:2022-03-21 13:46:29,312.312 INFO:teuthology.orchestra.console:Power off smithi055
2022-03-21T13:46:29.325 INFO:teuthology.kill:2022-03-21 13:46:29,325.325 INFO:teuthology.orchestra.console:Power off smithi066
2022-03-21T13:46:41.796 INFO:teuthology.kill:2022-03-21 13:46:41,795.795 INFO:teuthology.orchestra.console:Power off for smithi055 completed
2022-03-21T13:46:41.801 INFO:teuthology.kill:2022-03-21 13:46:41,801.801 INFO:teuthology.orchestra.console:Power off for smithi066 completed
2022-03-21T13:46:41.941 INFO:teuthology.kill:2022-03-21 13:46:41,941.941 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com
2022-03-21T13:46:41.945 INFO:teuthology.kill:2022-03-21 13:46:41,945.945 INFO:teuthology.lock.ops:unlocked: smithi066.front.sepia.ceph.com
2022-03-21T13:48:42.232 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-21T13:48:42.349 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi055 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749912
2022-03-21T13:48:42.350 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi066 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749912