2022-03-21T12:46:22.307 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-21T12:46:22.418 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi080.front.sepia.ceph.com' reimaging
2022-03-21T12:46:22.419 INFO:teuthology.lock.ops:Updating [ubuntu@smithi080.front.sepia.ceph.com]: reset os type and version on server
2022-03-21T12:46:22.420 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server
2022-03-21T12:46:22.437 INFO:teuthology.lock.ops:Node 'ubuntu@smithi080.front.sepia.ceph.com' reimaging is complete
2022-03-21T12:46:22.437 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi157.front.sepia.ceph.com' reimaging
2022-03-21T12:46:22.438 INFO:teuthology.lock.ops:Updating [ubuntu@smithi157.front.sepia.ceph.com]: reset os type and version on server
2022-03-21T12:46:22.438 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2022-03-21T12:46:22.455 INFO:teuthology.lock.ops:Node 'ubuntu@smithi157.front.sepia.ceph.com' reimaging is complete
2022-03-21T12:46:22.641 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of rhel 8.4
2022-03-21T12:46:22.670 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.4
2022-03-21T12:46:22.969 INFO:teuthology.orchestra.console:Power off smithi080
2022-03-21T12:46:22.984 INFO:teuthology.orchestra.console:Power off smithi157
2022-03-21T12:46:31.341 INFO:teuthology.orchestra.console:Power off for smithi080 completed
2022-03-21T12:46:31.346 INFO:teuthology.orchestra.console:Power off for smithi157 completed
2022-03-21T12:46:31.443 INFO:teuthology.orchestra.console:Power on smithi080
2022-03-21T12:46:31.449 INFO:teuthology.orchestra.console:Power on smithi157
2022-03-21T12:46:35.694 INFO:teuthology.orchestra.console:Power on for smithi080 completed
2022-03-21T12:46:35.795 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish
2022-03-21T12:46:39.836 INFO:teuthology.orchestra.console:Power on for smithi157 completed
2022-03-21T12:46:39.937 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2022-03-21T12:50:47.887 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-21T12:51:07.887 INFO:teuthology.provision.fog.smithi080:Node is ready
2022-03-21T12:51:07.905 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com
2022-03-21T12:51:07.961 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080
2022-03-21T12:51:08.310 INFO:teuthology.provision.fog.smithi080:Deploy complete!
2022-03-21T12:51:59.682 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-21T12:51:59.897 INFO:teuthology.provision.fog.smithi157:Node is ready
2022-03-21T12:51:59.913 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com
2022-03-21T12:51:59.968 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157
2022-03-21T12:52:00.291 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2022-03-21T12:52:00.431 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com
2022-03-21T12:52:00.432 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-21T12:52:00.450 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2022-03-21T12:52:00.451 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-21T12:52:00.467 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server
2022-03-21T12:52:00.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com'
2022-03-21T12:52:00.713 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64
2022-03-21T12:52:00.769 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Red Hat Enterprise Linux"
2022-03-21T12:52:00.770 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8.4 (Ootpa)"
2022-03-21T12:52:00.770 INFO:teuthology.orchestra.run.smithi080.stdout:ID="rhel"
2022-03-21T12:52:00.770 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="fedora"
2022-03-21T12:52:00.770 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8.4"
2022-03-21T12:52:00.771 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8"
2022-03-21T12:52:00.771 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-21T12:52:00.771 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31"
2022-03-21T12:52:00.772 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-21T12:52:00.772 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.redhat.com/"
2022-03-21T12:52:00.772 INFO:teuthology.orchestra.run.smithi080.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-21T12:52:00.772 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-21T12:52:00.772 INFO:teuthology.orchestra.run.smithi080.stdout:
2022-03-21T12:52:00.773 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-21T12:52:00.773 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-21T12:52:00.773 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-21T12:52:00.773 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-21T12:52:00.775 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server
2022-03-21T12:52:00.792 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2022-03-21T12:52:00.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2022-03-21T12:52:01.014 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2022-03-21T12:52:01.068 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux"
2022-03-21T12:52:01.068 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.4 (Ootpa)"
2022-03-21T12:52:01.069 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel"
2022-03-21T12:52:01.069 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora"
2022-03-21T12:52:01.069 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.4"
2022-03-21T12:52:01.069 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2022-03-21T12:52:01.070 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-21T12:52:01.070 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2022-03-21T12:52:01.070 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-21T12:52:01.070 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/"
2022-03-21T12:52:01.071 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-21T12:52:01.071 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-21T12:52:01.071 INFO:teuthology.orchestra.run.smithi157.stdout:
2022-03-21T12:52:01.071 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-21T12:52:01.072 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-21T12:52:01.072 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-21T12:52:01.072 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-21T12:52:01.073 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2022-03-21T12:52:01.171 INFO:teuthology.dispatcher.supervisor:Running job 6749875
2022-03-21T12:52:01.172 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749875 --name vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749875/orig.config.yaml
2022-03-21T12:52:01.175 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749875
2022-03-21T12:52:01.176 INFO:teuthology.dispatcher.supervisor:Job PID: 29178
2022-03-21T12:52:01.176 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-21T19:22:29.323 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-21T19:22:29.510 INFO:teuthology.kill:Killing Pids: {29178}
2022-03-21T19:22:30.838 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-21T19:22:30.839 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-21T19:22:30.840 INFO:teuthology.misc:Compressing logs...
2022-03-21T19:22:30.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com'
2022-03-21T19:22:31.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2022-03-21T19:22:31.395 INFO:teuthology.misc:Compressing logs...
2022-03-21T19:22:31.543 INFO:teuthology.misc:Compressing logs...
2022-03-21T19:24:35.265 INFO:teuthology.kill:No teuthology processes running
2022-03-21T19:24:36.430 INFO:teuthology.kill:Nuking machines: ['smithi080', 'smithi157']
2022-03-21T19:24:37.374 INFO:teuthology.kill:2022-03-21 19:24:37,373.373 INFO:teuthology.nuke:targets:
2022-03-21T19:24:37.375 INFO:teuthology.kill:  smithi080.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0nxSEMvqe4k90kzSdILsRapC+A082VN4wpnBGH7vkxFwewMRG3YMFt0Fl+KzqlbY3znE2flWnk9AaVkBj6U9cEKFkocmlZihel1bsM9g7og6u2sea369sDtSHtKg5NbYYBLDwvUtrwFYjaYTBztLxlvpkadmBNwHtTPLkqLt5hzdfo/yqa1BvvgtHfbS6srNYmiVSjnF9/t42dsJ4Pwmf58MVnYObuB9J7dZ6AhGcXcsS5pWIk/+oew3e8dCDNPYTt9QQV86KrKx5YMzChk8LTloyguK6LBruIEIVedfmukGyul6J1pW4p8kR+94zsFFqc4pMV/BcUAI0492Bzxt4hKKlMUTWY26bXnsWGF4LfJ4YhQ+/jSoyrBdmYFb9Ut4zA6WkqrhLt+geIyETABUgfakt8Z+Ka3Iun2EGZcrxDaeCjgyR7RcDI1zfF4UrZTk0ml4VSmtGa8RDMoM9vPzSovzahOuhZp2MbKKd6J9BkWz3/+hM2Nz29z3Z76qKs48=
2022-03-21T19:24:37.375 INFO:teuthology.kill:  smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtkX082WGLmd968/wNaU8euWrm+lSHH0psblhFbtA4I6GkbdntZN//Ba79koj2+9SGd+j5ZEA3XNjSv94CI7rqOwc2kNe+N5Yrl6zmkkw54FmmMSzgtqNkmVy1nPboPi3S/ZmO2DFA0/2jBUiFUyDyFCDnrXiDbel1lUNdTLPMiQbZ3Xt/9DX9ksP9I6wU/GFd7virTRO4Rl1Haznu2t6o/8OCISye7UzYtueeaaheYlJMvA89ng9XZK/PZ+SB8RDvTVxdmi1z4Jj5GvTJyOqkXwwfCjoMTTGJITL+ozxt4gKkFmgptN40WuVxT1lKQEfJDt2Rro22MsFqiVuleW2BEQ1E6yD40bJ7hW4OEpWhv/4iC7Ss3HLxuyFOhOsSkRUbfVk0IgguZRhnZ8xVJwnutr2a17ORELs0ELgxZJ1zRVrphiQZCDUO3lZa2wQWfVCui7IIhpGFsFcB8yBsbNVvHjZZ0dtr/kTeAk8UyX8lhxMssoZcR5VhwAYW5TL9UwE=
2022-03-21T19:24:37.400 INFO:teuthology.kill:2022-03-21 19:24:37,400.400 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-21T19:24:37.404 INFO:teuthology.kill:2022-03-21 19:24:37,404.404 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-21T19:24:37.487 INFO:teuthology.kill:2022-03-21 19:24:37,486.486 INFO:teuthology.orchestra.console:Power off smithi157
2022-03-21T19:24:37.501 INFO:teuthology.kill:2022-03-21 19:24:37,501.501 INFO:teuthology.orchestra.console:Power off smithi080
2022-03-21T19:24:45.861 INFO:teuthology.kill:2022-03-21 19:24:45,861.861 INFO:teuthology.orchestra.console:Power off for smithi157 completed
2022-03-21T19:24:46.006 INFO:teuthology.kill:2022-03-21 19:24:46,005.005 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com
2022-03-21T19:24:49.981 INFO:teuthology.kill:2022-03-21 19:24:49,981.981 INFO:teuthology.orchestra.console:Power off for smithi080 completed
2022-03-21T19:24:50.128 INFO:teuthology.kill:2022-03-21 19:24:50,127.127 INFO:teuthology.lock.ops:unlocked: smithi080.front.sepia.ceph.com
2022-03-21T19:26:50.438 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-21T19:26:50.560 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi080 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-21_13:12:20-fs-master-testing-default-smithi/6750282
2022-03-21T19:26:50.560 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi157 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-21_13:12:20-fs-master-testing-default-smithi/6750282