2022-03-19T14:16:21.370 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-19T14:16:21.496 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging
2022-03-19T14:16:21.497 INFO:teuthology.lock.ops:Updating [ubuntu@smithi002.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T14:16:21.498 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2022-03-19T14:16:21.517 INFO:teuthology.lock.ops:Node 'ubuntu@smithi002.front.sepia.ceph.com' reimaging is complete
2022-03-19T14:16:21.517 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi117.front.sepia.ceph.com' reimaging
2022-03-19T14:16:21.518 INFO:teuthology.lock.ops:Updating [ubuntu@smithi117.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T14:16:21.518 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2022-03-19T14:16:21.539 INFO:teuthology.lock.ops:Node 'ubuntu@smithi117.front.sepia.ceph.com' reimaging is complete
2022-03-19T14:16:21.727 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of rhel 8.4
2022-03-19T14:16:21.746 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of rhel 8.4
2022-03-19T14:16:22.034 INFO:teuthology.orchestra.console:Power off smithi002
2022-03-19T14:16:22.048 INFO:teuthology.orchestra.console:Power off smithi117
2022-03-19T14:16:22.176 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2022-03-19T14:16:22.188 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2022-03-19T14:16:22.278 INFO:teuthology.orchestra.console:Power on smithi002
2022-03-19T14:16:22.289 INFO:teuthology.orchestra.console:Power on smithi117
2022-03-19T14:16:26.538 INFO:teuthology.orchestra.console:Power on for smithi117 completed
2022-03-19T14:16:26.644 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish
2022-03-19T14:16:30.644 INFO:teuthology.orchestra.console:Power on for smithi002 completed
2022-03-19T14:16:30.745 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish
2022-03-19T14:20:38.216 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T14:20:44.502 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T14:20:44.736 INFO:teuthology.provision.fog.smithi002:Node is ready
2022-03-19T14:20:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com
2022-03-19T14:20:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002
2022-03-19T14:20:45.127 INFO:teuthology.provision.fog.smithi002:Deploy complete!
2022-03-19T14:20:58.566 INFO:teuthology.provision.fog.smithi117:Node is ready
2022-03-19T14:20:58.586 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com
2022-03-19T14:20:58.642 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117
2022-03-19T14:20:58.979 INFO:teuthology.provision.fog.smithi117:Deploy complete!
2022-03-19T14:20:59.126 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com
2022-03-19T14:20:59.127 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T14:20:59.144 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com
2022-03-19T14:20:59.145 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T14:20:59.162 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server
2022-03-19T14:20:59.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2022-03-19T14:20:59.403 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64
2022-03-19T14:20:59.459 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T14:20:59.459 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T14:20:59.459 INFO:teuthology.orchestra.run.smithi002.stdout:ID="rhel"
2022-03-19T14:20:59.459 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="fedora"
2022-03-19T14:20:59.460 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8.4"
2022-03-19T14:20:59.460 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8"
2022-03-19T14:20:59.460 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T14:20:59.460 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31"
2022-03-19T14:20:59.461 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T14:20:59.461 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T14:20:59.461 INFO:teuthology.orchestra.run.smithi002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T14:20:59.461 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T14:20:59.461 INFO:teuthology.orchestra.run.smithi002.stdout:
2022-03-19T14:20:59.462 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T14:20:59.462 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T14:20:59.462 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T14:20:59.462 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T14:20:59.464 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server
2022-03-19T14:20:59.482 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server
2022-03-19T14:20:59.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2022-03-19T14:20:59.706 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64
2022-03-19T14:20:59.760 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T14:20:59.760 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T14:20:59.760 INFO:teuthology.orchestra.run.smithi117.stdout:ID="rhel"
2022-03-19T14:20:59.761 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="fedora"
2022-03-19T14:20:59.761 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8.4"
2022-03-19T14:20:59.761 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8"
2022-03-19T14:20:59.761 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T14:20:59.762 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2022-03-19T14:20:59.762 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T14:20:59.762 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T14:20:59.762 INFO:teuthology.orchestra.run.smithi117.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T14:20:59.763 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T14:20:59.763 INFO:teuthology.orchestra.run.smithi117.stdout:
2022-03-19T14:20:59.763 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T14:20:59.763 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T14:20:59.763 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T14:20:59.764 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T14:20:59.764 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2022-03-19T14:20:59.860 INFO:teuthology.dispatcher.supervisor:Running job 6744966
2022-03-19T14:20:59.860 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_aa078dbed6d14c1ad98beb5a02b956bbe0a741c8/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744966 --name vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/pjd}} -- /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744966/orig.config.yaml
2022-03-19T14:20:59.863 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744966
2022-03-19T14:20:59.864 INFO:teuthology.dispatcher.supervisor:Job PID: 17999
2022-03-19T14:20:59.864 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-19T20:51:27.768 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-19T20:51:27.966 INFO:teuthology.kill:Killing Pids: {17999}
2022-03-19T20:51:29.125 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-19T20:51:29.126 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-19T20:51:29.127 INFO:teuthology.misc:Compressing logs...
2022-03-19T20:51:29.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com'
2022-03-19T20:51:30.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2022-03-19T20:51:30.486 INFO:teuthology.misc:Compressing logs...
2022-03-19T20:51:30.632 INFO:teuthology.misc:Compressing logs...
2022-03-19T21:03:59.840 INFO:teuthology.kill:No teuthology processes running
2022-03-19T21:04:01.075 INFO:teuthology.kill:Nuking machines: ['smithi002', 'smithi117']
2022-03-19T21:04:02.065 INFO:teuthology.kill:2022-03-19 21:04:02,065.065 INFO:teuthology.nuke:targets:
2022-03-19T21:04:02.066 INFO:teuthology.kill:  smithi002.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDITvS4tQXRGA1JUoJQW4U+JKry1gtA43dS3mXCPJ1HHDtRukSr9frDGZ+ZadjovPvB/HMKahAhdSSj9McC8dE1GJ4f8L/wOGgYGk/7vJIMfBl2f7pdUv5ODYaJ7rT2OJYeymf/p9xaytgdwLxkrFfVZKxm3x9e0rxALjyrjZn98ovtYwNviGRKeeOyG7Gk+dlPgsYy84aGMy4P0dojx82BnVMsKyTe/T0iTsPCnYdAXCuFoZq0LEM5OgtX7H1nGJSaDmGoA+kYNmdvDX7dh+JNj8c8uVujZEk6tGfJFdTdft6niwMmfEQFoRnfzNjG2OY1OcQMrCz+53cBMPjkqa2L+fDLIJTTTL6K5Q8LRnBDKcq/G3bZ/6OVnqwiPOfMiEL7r84/2cWjO7HWA+vXmAkDVtkiv8H2Wnqt5hiHdrvdTGG3te5anuPMjB3CEuOULmHjsn/qSK6KEA3rUxW2Sh8xwZ2TQ6Wj+y0tU0fp5dvx2ettZr4B6XtzEZq77GbLqJs=
2022-03-19T21:04:02.066 INFO:teuthology.kill:  smithi117.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCog4JcCZfnwB8+W4rfWOZ01TVktvSEA5rjuRtqDZmJOiGHdUiJXLMZCC41FPLFavEqOtY9DVzfW3PlrdbupzpRw/eLx2pG0ppyOORSleMzQAsHGsv36Gq+Muf5nvVqwvb3L8yf3PPuDEM2Wq2Y7bz1QMKe1lqPH8F+FJIjivwbWKlOADYbX0Snw/dOXjIU5DXMlS9f+yHaH8Netpxq22MflhWLbslhV5PQPkkWNZaKHixDmdhvopsa+j5a+0VxuqvcrnEVjOOCvPvOtvfiTRqozAjeeA7NEgFKuI4Ld37s9zj6b30oa6bWWKuR01Mlyj2FqQI4grxP8TDbk3IMwE8OEzSUESRAlaa5C/jrNfDjqrJMhoTTdkiCLlnDz9W3qKkuG41r6dta5rhIxSOa4dMP16J3h2rtOR99xNUH2a7V+UX5B1crxl47OKjc+L5FR7zqCAVhe/a57czGvcXtmbV/OJZb6pWVYQvm+Qv7Z0tTzvmzPf+5Dqtf05dQ/vZXJB0=
2022-03-19T21:04:02.091 INFO:teuthology.kill:2022-03-19 21:04:02,091.091 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T21:04:02.095 INFO:teuthology.kill:2022-03-19 21:04:02,094.094 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T21:04:02.170 INFO:teuthology.kill:2022-03-19 21:04:02,170.170 INFO:teuthology.orchestra.console:Power off smithi002
2022-03-19T21:04:02.183 INFO:teuthology.kill:2022-03-19 21:04:02,182.182 INFO:teuthology.orchestra.console:Power off smithi117
2022-03-19T21:04:10.546 INFO:teuthology.kill:2022-03-19 21:04:10,545.545 INFO:teuthology.orchestra.console:Power off for smithi117 completed
2022-03-19T21:04:10.694 INFO:teuthology.kill:2022-03-19 21:04:10,693.693 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com
2022-03-19T21:04:14.652 INFO:teuthology.kill:2022-03-19 21:04:14,651.651 INFO:teuthology.orchestra.console:Power off for smithi002 completed
2022-03-19T21:04:14.796 INFO:teuthology.kill:2022-03-19 21:04:14,795.795 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com
2022-03-19T21:06:15.071 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15