2022-04-03T08:54:58.517 INFO:root:teuthology version: 1.1.0-d877b023
2022-04-03T08:54:58.642 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi141.front.sepia.ceph.com' reimaging
2022-04-03T08:54:58.643 INFO:teuthology.lock.ops:Updating [ubuntu@smithi141.front.sepia.ceph.com]: reset os type and version on server
2022-04-03T08:54:58.643 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2022-04-03T08:54:58.662 INFO:teuthology.lock.ops:Node 'ubuntu@smithi141.front.sepia.ceph.com' reimaging is complete
2022-04-03T08:54:58.662 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi166.front.sepia.ceph.com' reimaging
2022-04-03T08:54:58.663 INFO:teuthology.lock.ops:Updating [ubuntu@smithi166.front.sepia.ceph.com]: reset os type and version on server
2022-04-03T08:54:58.663 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server
2022-04-03T08:54:58.681 INFO:teuthology.lock.ops:Node 'ubuntu@smithi166.front.sepia.ceph.com' reimaging is complete
2022-04-03T08:54:58.867 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of rhel 8.4
2022-04-03T08:54:58.887 INFO:teuthology.provision.fog.smithi166:Scheduling deploy of rhel 8.4
2022-04-03T08:54:59.156 INFO:teuthology.orchestra.console:Power off smithi141
2022-04-03T08:54:59.196 INFO:teuthology.orchestra.console:Power off smithi166
2022-04-03T08:54:59.306 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2022-04-03T08:54:59.336 INFO:teuthology.orchestra.console:Power off for smithi166 completed
2022-04-03T08:54:59.407 INFO:teuthology.orchestra.console:Power on smithi141
2022-04-03T08:54:59.437 INFO:teuthology.orchestra.console:Power on smithi166
2022-04-03T08:55:03.660 INFO:teuthology.orchestra.console:Power on for smithi141 completed
2022-04-03T08:55:03.762 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish
2022-04-03T08:55:07.800 INFO:teuthology.orchestra.console:Power on for smithi166 completed
2022-04-03T08:55:07.901 INFO:teuthology.provision.fog.smithi166:Waiting for deploy to finish
2022-04-03T08:59:09.174 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-03T08:59:11.247 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-03T08:59:29.750 INFO:teuthology.provision.fog.smithi141:Node is ready
2022-04-03T08:59:29.769 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com
2022-04-03T08:59:29.825 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141
2022-04-03T08:59:30.184 INFO:teuthology.provision.fog.smithi141:Deploy complete!
2022-04-03T08:59:31.446 INFO:teuthology.provision.fog.smithi166:Node is ready
2022-04-03T08:59:31.465 INFO:teuthology.orchestra.run.smithi166.stdout:smithi166.front.sepia.ceph.com
2022-04-03T08:59:31.521 INFO:teuthology.orchestra.run.smithi166.stdout:172.21.15.166 smithi166.front.sepia.ceph.com smithi166
2022-04-03T08:59:31.857 INFO:teuthology.provision.fog.smithi166:Deploy complete!
2022-04-03T08:59:32.006 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com
2022-04-03T08:59:32.007 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-03T08:59:32.035 INFO:teuthology.lock.ops:Checking smithi166.front.sepia.ceph.com
2022-04-03T08:59:32.036 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-03T08:59:32.053 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server
2022-04-03T08:59:32.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2022-04-03T08:59:32.284 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64
2022-04-03T08:59:32.337 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Red Hat Enterprise Linux"
2022-04-03T08:59:32.338 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8.4 (Ootpa)"
2022-04-03T08:59:32.338 INFO:teuthology.orchestra.run.smithi141.stdout:ID="rhel"
2022-04-03T08:59:32.338 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="fedora"
2022-04-03T08:59:32.339 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8.4"
2022-04-03T08:59:32.339 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8"
2022-04-03T08:59:32.339 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-04-03T08:59:32.339 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31"
2022-04-03T08:59:32.340 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-04-03T08:59:32.340 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.redhat.com/"
2022-04-03T08:59:32.340 INFO:teuthology.orchestra.run.smithi141.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-04-03T08:59:32.340 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-03T08:59:32.341 INFO:teuthology.orchestra.run.smithi141.stdout:
2022-04-03T08:59:32.341 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-03T08:59:32.341 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-04-03T08:59:32.341 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-04-03T08:59:32.341 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-04-03T08:59:32.343 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2022-04-03T08:59:32.360 INFO:teuthology.lock.ops:Updating [smithi166.front.sepia.ceph.com]: set os type and version on server
2022-04-03T08:59:32.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi166.front.sepia.ceph.com'
2022-04-03T08:59:32.581 INFO:teuthology.orchestra.run.smithi166.stdout:x86_64
2022-04-03T08:59:32.634 INFO:teuthology.orchestra.run.smithi166.stdout:NAME="Red Hat Enterprise Linux"
2022-04-03T08:59:32.635 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION="8.4 (Ootpa)"
2022-04-03T08:59:32.635 INFO:teuthology.orchestra.run.smithi166.stdout:ID="rhel"
2022-04-03T08:59:32.635 INFO:teuthology.orchestra.run.smithi166.stdout:ID_LIKE="fedora"
2022-04-03T08:59:32.635 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION_ID="8.4"
2022-04-03T08:59:32.635 INFO:teuthology.orchestra.run.smithi166.stdout:PLATFORM_ID="platform:el8"
2022-04-03T08:59:32.636 INFO:teuthology.orchestra.run.smithi166.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-04-03T08:59:32.636 INFO:teuthology.orchestra.run.smithi166.stdout:ANSI_COLOR="0;31"
2022-04-03T08:59:32.636 INFO:teuthology.orchestra.run.smithi166.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-04-03T08:59:32.636 INFO:teuthology.orchestra.run.smithi166.stdout:HOME_URL="https://www.redhat.com/"
2022-04-03T08:59:32.637 INFO:teuthology.orchestra.run.smithi166.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-04-03T08:59:32.637 INFO:teuthology.orchestra.run.smithi166.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-03T08:59:32.637 INFO:teuthology.orchestra.run.smithi166.stdout:
2022-04-03T08:59:32.637 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-03T08:59:32.637 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-04-03T08:59:32.638 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-04-03T08:59:32.638 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-04-03T08:59:32.638 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server
2022-04-03T08:59:32.734 INFO:teuthology.dispatcher.supervisor:Running job 6775249
2022-04-03T08:59:32.734 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-04-03_07:59:05-fs-wip-55110-for-testing-testing-default-smithi/6775249 --name vshankar-2022-04-03_07:59:05-fs-wip-55110-for-testing-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2022-04-03_07:59:05-fs-wip-55110-for-testing-testing-default-smithi/6775249/orig.config.yaml
2022-04-03T08:59:32.738 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-04-03_07:59:05-fs-wip-55110-for-testing-testing-default-smithi/6775249
2022-04-03T08:59:32.739 INFO:teuthology.dispatcher.supervisor:Job PID: 24511
2022-04-03T08:59:32.739 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-03T15:30:00.772 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-03T15:30:00.944 INFO:teuthology.kill:Killing Pids: {24511}
2022-04-03T15:30:02.125 INFO:teuthology.task.internal:roles: ubuntu@smithi141.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-04-03T15:30:02.125 INFO:teuthology.task.internal:roles: ubuntu@smithi166.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-04-03T15:30:02.126 INFO:teuthology.misc:Compressing logs...
2022-04-03T15:30:02.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2022-04-03T15:30:02.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi166.front.sepia.ceph.com'
2022-04-03T15:30:02.775 INFO:teuthology.misc:Compressing logs...
2022-04-03T15:31:05.215 INFO:teuthology.misc:Compressing logs...
2022-04-03T15:34:21.627 INFO:teuthology.kill:No teuthology processes running
2022-04-03T15:34:22.879 INFO:teuthology.kill:Nuking machines: ['smithi141', 'smithi166']
2022-04-03T15:34:23.896 INFO:teuthology.kill:2022-04-03 15:34:23,895.895 INFO:teuthology.nuke:targets:
2022-04-03T15:34:23.896 INFO:teuthology.kill:  smithi141.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbk7tTlGsWYE6JwYvbffzYMz2F3QGQLJiOXz2mCmgaUeDqvI3Yu5cpEYkcQWr4j69YnabxGRWMqm9XfxVqb9CnCKhLYakpqiR4taDB0kJMBTgVWyaWyaAPU9jHyuEfP2IMlrENkC5VpkG2tC4fOkGg/2dEsj4AaIePpvt5qb/WY6ks2uw+0r7iggPZC8E3UcSb2m01ILcIbfgWYLInsz2Epm5fFq7V3Dw5B4C9gDTZyRdK6qli42hK3XWk3DvkEXO2GcUS8IE1VDkvr6dyD/QCipTBNXNtTWU4wjj8Ln7goq0wvSCQM74b+hkDFN07ON6/jvtrqwC8kgX0vTGvhMTwPZLTFRk89WAn7BMz/OicBo3hfJJWwJqNU2zAJWieWG4Qm7LKR7Bm9kF5JNLxRuG2OS1ILX6+Cm+Pl9nDd9UTPGPvwJ032zHOTrJ9wK0EXw6SHbH12C1uIrQUO/j+frcUpOW+lqPP/gaT40QURn/mCmOw3kfom15dPNBQlRjlF3s=
2022-04-03T15:34:23.897 INFO:teuthology.kill:  smithi166.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDooG8NEJGEE9xZfZnWnKBUkxcnHXOxFd7Npy8AB+X0VyQPkNtar+5r6lOdWhlLmGjfnZ6GgzqjDPYI0g+LQfnnwcjU1Sbu76nq9HyutGYyQJPK052Y+Ye2713wOq+H6wvTYv2X92VBkRFbgFgORtshi8+loxfzgRbNspr6Wt6Fxnj+ey65ARagdbSbM6R/d2iHGaWx7rCU8TWueNuiXmFHftqiM2gAvO/+nx8qEzfUqIbX6w+v+0CtT+JINtojqs4O72MuXwI2VRbINEIKCQ+5LJTRIBEU8NYNHb0Kh0fWGDvvrCzeIO3fP+ygusIEaLvvixUQ0DK76oxv7ICLFvRHFR5suEU11tvHnB2WcTSw7c46AHAe+EWUwVQ7psO382fst1yJ/2eydjEvM53clO+nHrgZlI04xl9c2wxAyE0bjl+aOd2/qp5Dt9PStoIlwnNX8TBF9RvUesAhOPFOwHu3YszNpA99Ms2llqTXVEcyGkWBpjWcbaf9NrlxAV2MSxU=
2022-04-03T15:34:23.922 INFO:teuthology.kill:2022-04-03 15:34:23,922.922 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-03T15:34:23.930 INFO:teuthology.kill:2022-04-03 15:34:23,929.929 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-03T15:34:23.997 INFO:teuthology.kill:2022-04-03 15:34:23,996.996 INFO:teuthology.orchestra.console:Power off smithi141
2022-04-03T15:34:24.011 INFO:teuthology.kill:2022-04-03 15:34:24,011.011 INFO:teuthology.orchestra.console:Power off smithi166
2022-04-03T15:34:36.480 INFO:teuthology.kill:2022-04-03 15:34:36,479.479 INFO:teuthology.orchestra.console:Power off for smithi141 completed
2022-04-03T15:34:36.483 INFO:teuthology.kill:2022-04-03 15:34:36,483.483 INFO:teuthology.orchestra.console:Power off for smithi166 completed
2022-04-03T15:34:36.628 INFO:teuthology.kill:2022-04-03 15:34:36,627.627 INFO:teuthology.lock.ops:unlocked: smithi166.front.sepia.ceph.com
2022-04-03T15:34:36.631 INFO:teuthology.kill:2022-04-03 15:34:36,631.631 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com
2022-04-03T15:36:36.934 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-04-03T15:36:37.036 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi141 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775352
2022-04-03T15:36:37.036 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi166 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-04-03_15:22:48-fs-wip-vshankar-testing-20220403-170344-testing-default-smithi/6775353