2022-03-19T06:29:25.549 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-19T06:29:25.710 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi037.front.sepia.ceph.com' reimaging
2022-03-19T06:29:25.711 INFO:teuthology.lock.ops:Updating [ubuntu@smithi037.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T06:29:25.712 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2022-03-19T06:29:25.733 INFO:teuthology.lock.ops:Node 'ubuntu@smithi037.front.sepia.ceph.com' reimaging is complete
2022-03-19T06:29:25.733 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi061.front.sepia.ceph.com' reimaging
2022-03-19T06:29:25.734 INFO:teuthology.lock.ops:Updating [ubuntu@smithi061.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T06:29:25.734 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2022-03-19T06:29:25.753 INFO:teuthology.lock.ops:Node 'ubuntu@smithi061.front.sepia.ceph.com' reimaging is complete
2022-03-19T06:29:25.949 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of rhel 8.4
2022-03-19T06:29:25.953 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of rhel 8.4
2022-03-19T06:29:26.254 INFO:teuthology.orchestra.console:Power off smithi037
2022-03-19T06:29:26.292 INFO:teuthology.orchestra.console:Power off smithi061
2022-03-19T06:29:34.632 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2022-03-19T06:29:34.652 INFO:teuthology.orchestra.console:Power off for smithi061 completed
2022-03-19T06:29:34.734 INFO:teuthology.orchestra.console:Power on smithi037
2022-03-19T06:29:34.753 INFO:teuthology.orchestra.console:Power on smithi061
2022-03-19T06:29:43.111 INFO:teuthology.orchestra.console:Power on for smithi037 completed
2022-03-19T06:29:43.158 INFO:teuthology.orchestra.console:Power on for smithi061 completed
2022-03-19T06:29:43.213 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2022-03-19T06:29:43.259 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish
2022-03-19T06:33:57.109 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T06:33:57.358 INFO:teuthology.provision.fog.smithi037:Node is ready
2022-03-19T06:33:57.374 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2022-03-19T06:33:57.430 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2022-03-19T06:33:57.756 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2022-03-19T06:34:01.939 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T06:34:22.137 INFO:teuthology.provision.fog.smithi061:Node is ready
2022-03-19T06:34:22.157 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com
2022-03-19T06:34:22.215 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061
2022-03-19T06:34:22.563 INFO:teuthology.provision.fog.smithi061:Deploy complete!
2022-03-19T06:34:22.722 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2022-03-19T06:34:22.723 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T06:34:22.742 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com
2022-03-19T06:34:22.742 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T06:34:22.760 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2022-03-19T06:34:22.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2022-03-19T06:34:23.004 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2022-03-19T06:34:23.061 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T06:34:23.061 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T06:34:23.061 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel"
2022-03-19T06:34:23.062 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora"
2022-03-19T06:34:23.062 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.4"
2022-03-19T06:34:23.062 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8"
2022-03-19T06:34:23.062 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T06:34:23.062 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2022-03-19T06:34:23.063 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T06:34:23.063 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T06:34:23.063 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T06:34:23.063 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T06:34:23.064 INFO:teuthology.orchestra.run.smithi037.stdout:
2022-03-19T06:34:23.064 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T06:34:23.064 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T06:34:23.064 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T06:34:23.065 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T06:34:23.066 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2022-03-19T06:34:23.084 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server
2022-03-19T06:34:23.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com'
2022-03-19T06:34:23.326 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64
2022-03-19T06:34:23.382 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T06:34:23.382 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T06:34:23.382 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel"
2022-03-19T06:34:23.383 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora"
2022-03-19T06:34:23.383 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.4"
2022-03-19T06:34:23.383 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8"
2022-03-19T06:34:23.383 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T06:34:23.384 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31"
2022-03-19T06:34:23.384 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T06:34:23.384 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T06:34:23.385 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T06:34:23.385 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T06:34:23.385 INFO:teuthology.orchestra.run.smithi061.stdout:
2022-03-19T06:34:23.385 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T06:34:23.386 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T06:34:23.386 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T06:34:23.386 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T06:34:23.387 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2022-03-19T06:34:23.483 INFO:teuthology.dispatcher.supervisor:Running job 6744844
2022-03-19T06:34:23.484 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_aa078dbed6d14c1ad98beb5a02b956bbe0a741c8/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744844 --name vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/pjd}} -- /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744844/orig.config.yaml
2022-03-19T06:34:23.487 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744844
2022-03-19T06:34:23.488 INFO:teuthology.dispatcher.supervisor:Job PID: 13993
2022-03-19T06:34:23.488 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-19T13:04:50.487 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-19T13:04:50.662 INFO:teuthology.kill:Killing Pids: {13993}
2022-03-19T13:04:51.795 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-19T13:04:51.796 INFO:teuthology.task.internal:roles: ubuntu@smithi061.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-19T13:04:51.796 INFO:teuthology.misc:Compressing logs...
2022-03-19T13:04:51.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2022-03-19T13:04:52.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com'
2022-03-19T13:04:52.336 INFO:teuthology.misc:Compressing logs...
2022-03-19T13:04:52.485 INFO:teuthology.misc:Compressing logs...
2022-03-19T13:16:53.667 INFO:teuthology.kill:No teuthology processes running
2022-03-19T13:16:54.822 INFO:teuthology.kill:Nuking machines: ['smithi037', 'smithi061']
2022-03-19T13:16:55.755 INFO:teuthology.kill:2022-03-19 13:16:55,754.754 INFO:teuthology.nuke:targets:
2022-03-19T13:16:55.755 INFO:teuthology.kill:  smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7bX8oJsIeno/hU/tx37amXPukLaUUX66Fi7AcSukBEAMwcNYUzlfp7DCXCINMy2NysWb+8JpRtBrSBFtfrwEZUYawzFmg2trCkqQTW+l/xXGe9zkTUQIYhr6n026M8SKgx+DQnAdcLZsYpUoZptI/nOJ3K36P5bdTLleHxLcMcSeSgG56LESsp9QkjtP/SZsiDMjg6PuySc4ckTK9CzzmlhNWQwiYtoaImbdereqNscPAOsV3Vtwp3Fy2kdLlnVeCnLWNY4meV4P+2aFpaoekjewiCJ0omL1z0Z6AB2OoOYFJz2h531O3jR7Qet/L6sZUbxxc1zAO9UwDG6hPc4nIFLflDqf9KFaEuzDLCK/6sLQF1R/yfRNjd4E92bv8X5CkupDB3F7wTffA9N9cpPTm1kPy20uneo8W07nMcdMLwzROUEjM4MBtAkL2/QamnfVCzhjB+jarevotMUkOnhXKST2oGoFNBRbd+3B+swV24oNsLzihzSJArOUbOLaM5hk=
2022-03-19T13:16:55.756 INFO:teuthology.kill:  smithi061.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyozNNwrr0S1VtD8ZylN4hmmfnFMp/1y+P81sU1RTTmH8ULrxw0bgbz7m6w9d3PQhFO2jPg98+nzuYIF7cFECYviIpGTdU3Yj1TN46zDjlvFG4xT1V1RZl91XveSFz+u5n8zCrmX/PatSB9LLd7oL21LL3M2xooXApSw4s79FDlPkO6pOp3Rq1Z3uyowAXV4K/wm+t1W2b+8Zw6nULJleufZIMFns4Z8w2IHAGfgVFxUyUR2cTQc155r+zrhoZc6MePxDoBu5jfbN1DivApU/2nTO5JjL0moXe3wSoyhhh8DJRmqMYRWY6xcr7mUGBwLykz5/kSgBDHIvZhJWFWG3yWYNmnS9rdta8LrxfO6lyDzWd2S0ojNfXW+ogMR9Ln/9crKl86uns9cxuuHZnSrEotArU+U6/5LGtU7NX3xexvqFLwUsyMmL+cayJb1113TgX2hAddy5YV+dK3phCb8b4VDV750Bi+eP4WJRNL/AnHUY2DYRo6gz3stopnEorF/0=
2022-03-19T13:16:55.782 INFO:teuthology.kill:2022-03-19 13:16:55,782.782 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T13:16:55.787 INFO:teuthology.kill:2022-03-19 13:16:55,787.787 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T13:16:55.864 INFO:teuthology.kill:2022-03-19 13:16:55,864.864 INFO:teuthology.orchestra.console:Power off smithi037
2022-03-19T13:16:55.886 INFO:teuthology.kill:2022-03-19 13:16:55,885.885 INFO:teuthology.orchestra.console:Power off smithi061
2022-03-19T13:17:04.253 INFO:teuthology.kill:2022-03-19 13:17:04,253.253 INFO:teuthology.orchestra.console:Power off for smithi061 completed
2022-03-19T13:17:04.408 INFO:teuthology.kill:2022-03-19 13:17:04,407.407 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com
2022-03-19T13:17:08.361 INFO:teuthology.kill:2022-03-19 13:17:08,360.360 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2022-03-19T13:17:08.504 INFO:teuthology.kill:2022-03-19 13:17:08,504.504 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com
2022-03-19T13:19:08.781 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-19T13:19:08.894 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi037 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744953
2022-03-19T13:19:08.895 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi061 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744953