2022-03-19T11:08:43.934 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-19T11:08:44.060 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi145.front.sepia.ceph.com' reimaging
2022-03-19T11:08:44.061 INFO:teuthology.lock.ops:Updating [ubuntu@smithi145.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T11:08:44.061 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2022-03-19T11:08:44.080 INFO:teuthology.lock.ops:Node 'ubuntu@smithi145.front.sepia.ceph.com' reimaging is complete
2022-03-19T11:08:44.081 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi146.front.sepia.ceph.com' reimaging
2022-03-19T11:08:44.081 INFO:teuthology.lock.ops:Updating [ubuntu@smithi146.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T11:08:44.082 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2022-03-19T11:08:44.101 INFO:teuthology.lock.ops:Node 'ubuntu@smithi146.front.sepia.ceph.com' reimaging is complete
2022-03-19T11:08:44.289 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.4
2022-03-19T11:08:44.297 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of rhel 8.4
2022-03-19T11:08:44.600 INFO:teuthology.orchestra.console:Power off smithi146
2022-03-19T11:08:44.615 INFO:teuthology.orchestra.console:Power off smithi145
2022-03-19T11:08:44.746 INFO:teuthology.orchestra.console:Power off for smithi146 completed
2022-03-19T11:08:44.758 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2022-03-19T11:08:44.848 INFO:teuthology.orchestra.console:Power on smithi146
2022-03-19T11:08:44.859 INFO:teuthology.orchestra.console:Power on smithi145
2022-03-19T11:08:49.114 INFO:teuthology.orchestra.console:Power on for smithi145 completed
2022-03-19T11:08:49.215 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2022-03-19T11:08:53.214 INFO:teuthology.orchestra.console:Power on for smithi146 completed
2022-03-19T11:08:53.315 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish
2022-03-19T11:13:33.289 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T11:13:33.537 INFO:teuthology.provision.fog.smithi145:Node is ready
2022-03-19T11:13:33.552 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com
2022-03-19T11:13:33.607 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145
2022-03-19T11:13:33.918 INFO:teuthology.provision.fog.smithi145:Deploy complete!
2022-03-19T11:13:46.364 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T11:13:46.615 INFO:teuthology.provision.fog.smithi146:Node is ready
2022-03-19T11:13:46.631 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com
2022-03-19T11:13:46.687 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146
2022-03-19T11:13:47.011 INFO:teuthology.provision.fog.smithi146:Deploy complete!
2022-03-19T11:13:47.190 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com
2022-03-19T11:13:47.191 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T11:13:47.212 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com
2022-03-19T11:13:47.213 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T11:13:47.231 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server
2022-03-19T11:13:47.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2022-03-19T11:13:47.464 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64
2022-03-19T11:13:47.519 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T11:13:47.519 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T11:13:47.519 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel"
2022-03-19T11:13:47.520 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora"
2022-03-19T11:13:47.520 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.4"
2022-03-19T11:13:47.520 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8"
2022-03-19T11:13:47.520 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T11:13:47.520 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2022-03-19T11:13:47.521 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T11:13:47.521 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T11:13:47.521 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T11:13:47.521 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T11:13:47.522 INFO:teuthology.orchestra.run.smithi145.stdout:
2022-03-19T11:13:47.522 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T11:13:47.522 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T11:13:47.522 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T11:13:47.522 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T11:13:47.524 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2022-03-19T11:13:47.542 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server
2022-03-19T11:13:47.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com'
2022-03-19T11:13:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64
2022-03-19T11:13:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T11:13:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T11:13:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:ID="rhel"
2022-03-19T11:13:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="fedora"
2022-03-19T11:13:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8.4"
2022-03-19T11:13:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8"
2022-03-19T11:13:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T11:13:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31"
2022-03-19T11:13:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T11:13:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T11:13:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T11:13:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T11:13:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:
2022-03-19T11:13:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T11:13:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T11:13:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T11:13:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T11:13:47.820 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2022-03-19T11:13:47.916 INFO:teuthology.dispatcher.supervisor:Running job 6744911
2022-03-19T11:13:47.916 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_aa078dbed6d14c1ad98beb5a02b956bbe0a741c8/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744911 --name vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/pjd}} -- /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744911/orig.config.yaml
2022-03-19T11:13:47.920 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744911
2022-03-19T11:13:47.921 INFO:teuthology.dispatcher.supervisor:Job PID: 25840
2022-03-19T11:13:47.921 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-19T17:44:15.938 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-19T17:44:16.098 INFO:teuthology.kill:Killing Pids: {25840}
2022-03-19T17:44:17.315 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-19T17:44:17.316 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-19T17:44:17.317 INFO:teuthology.misc:Compressing logs...
2022-03-19T17:44:17.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2022-03-19T17:44:17.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com'
2022-03-19T17:44:18.143 INFO:teuthology.misc:Compressing logs...
2022-03-19T17:44:18.293 INFO:teuthology.misc:Compressing logs...
2022-03-19T17:54:54.076 INFO:teuthology.kill:No teuthology processes running
2022-03-19T17:54:55.269 INFO:teuthology.kill:Nuking machines: ['smithi145', 'smithi146']
2022-03-19T17:54:56.208 INFO:teuthology.kill:2022-03-19 17:54:56,208.208 INFO:teuthology.nuke:targets:
2022-03-19T17:54:56.209 INFO:teuthology.kill:  smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJv1eOVNG8u9yX79mXCCKMdcVapWX+ls71hNutmeVEqwl8xRhSADByRiNjXPhKmxlta4DnUnU2e0QwkaieJoHUEpuSQ2loNkmvZKfq1hint94YSTY1oeW7VT5RgE84zyPcS9npHXB4rDJv9R6caI+x3tnvWlVlXv3TzFHKIznQeml2So198B7NloEIGmB4xgLrMGumyP8Gk+KAWCt6Sp09eYtuD6G2N/tqd8tm2oExelkuqYASXurRwQNIcUpb2/+muiycZxFN/Bi9NQ6VrlrYuISRcuR3Y5k0wT0YbRI/74lUItbiDaVEyg0g0Yqjh1LXj3kuReBGtZTYSGCRGGLr1tAscWR+zHyfDaAsVEDIaFMF22AC7u02TgrkoZKSDVqG+EGpEz0g8rOxdsxvFtyHbfoOCEvxItJXWgc/tvak2oxAFba9IDoMMjMyHC5tjsEOV0lVm0E0Iuh7OR07dR0untqNbux3/fTF1oUI2u1VsOI2I1UWuKy6ANnYyB4zzzc=
2022-03-19T17:54:56.209 INFO:teuthology.kill:  smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDC7SR2BmI1ulM/9hdXtS7fo/aAN2khaPWPf1E0X9I7c1N2+9FLawDxivizDNko59U8912nsqzPtqP7wgSH0tNs6/vq//Rn9MU0XOGDrYyg5bQSxT2cRrkRub+Y0xDVG5uOLQywqvYkHOh+1Ob289pXCYE45nvVYXZRAHfiR1/iYLjSnooznxdNDWvhV+ZBGYLMennxBope6uVUSLjOTphfIocDyS5biGh2/4xHvS2CrrxDjKhIxU/CS/NaLRCOILUnLhzgVrbhbhi1bICgEG8cn8YsM+YVgpKBMHKWDw4PIWjmCQ7h0RStfgtGN3UpjPRQLAJE75U0mpI/xgdd3pTH25VZqcFzQaVbIvw41F4CrLJH1qTmKDn3OeeQ/hhElXZeEVj6l8I5aDPHwjXzIDKOEimcCrlF67BMo4uNYuK0dMZeiOIjHT8pJINH/vtnV6vmVq1xIE8CS5CWFLBwbKR53INgnL7hvgNfoOaXsRTgc90/zS2IoyIbkGawkOGrMM0=
2022-03-19T17:54:56.233 INFO:teuthology.kill:2022-03-19 17:54:56,233.233 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T17:54:56.236 INFO:teuthology.kill:2022-03-19 17:54:56,236.236 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T17:54:56.311 INFO:teuthology.kill:2022-03-19 17:54:56,311.311 INFO:teuthology.orchestra.console:Power off smithi145
2022-03-19T17:54:56.325 INFO:teuthology.kill:2022-03-19 17:54:56,324.324 INFO:teuthology.orchestra.console:Power off smithi146
2022-03-19T17:55:04.689 INFO:teuthology.kill:2022-03-19 17:55:04,688.688 INFO:teuthology.orchestra.console:Power off for smithi146 completed
2022-03-19T17:55:04.840 INFO:teuthology.kill:2022-03-19 17:55:04,839.839 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com
2022-03-19T17:55:08.792 INFO:teuthology.kill:2022-03-19 17:55:08,792.792 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2022-03-19T17:55:08.937 INFO:teuthology.kill:2022-03-19 17:55:08,936.936 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com
2022-03-19T17:57:09.277 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-19T17:57:09.392 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi145 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-19_14:37:23-rados-wip-yuri6-testing-2022-03-18-1104-distro-default-smithi/6746931
2022-03-19T17:57:09.392 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi146 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-19_14:37:23-rados-wip-yuri6-testing-2022-03-18-1104-distro-default-smithi/6746927