2022-03-19T03:04:44.923 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-19T03:04:45.044 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging
2022-03-19T03:04:45.045 INFO:teuthology.lock.ops:Updating [ubuntu@smithi136.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T03:04:45.046 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2022-03-19T03:04:45.065 INFO:teuthology.lock.ops:Node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging is complete
2022-03-19T03:04:45.065 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging
2022-03-19T03:04:45.066 INFO:teuthology.lock.ops:Updating [ubuntu@smithi170.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T03:04:45.066 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2022-03-19T03:04:45.085 INFO:teuthology.lock.ops:Node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging is complete
2022-03-19T03:04:45.267 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of rhel 8.4
2022-03-19T03:04:45.283 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of rhel 8.4
2022-03-19T03:04:45.546 INFO:teuthology.orchestra.console:Power off smithi136
2022-03-19T03:04:45.560 INFO:teuthology.orchestra.console:Power off smithi170
2022-03-19T03:04:53.913 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2022-03-19T03:04:53.916 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2022-03-19T03:04:54.014 INFO:teuthology.orchestra.console:Power on smithi136
2022-03-19T03:04:54.022 INFO:teuthology.orchestra.console:Power on smithi170
2022-03-19T03:05:02.380 INFO:teuthology.orchestra.console:Power on for smithi136 completed
2022-03-19T03:05:02.471 INFO:teuthology.orchestra.console:Power on for smithi170 completed
2022-03-19T03:05:02.482 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2022-03-19T03:05:02.576 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish
2022-03-19T03:09:31.386 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T03:09:31.600 INFO:teuthology.provision.fog.smithi170:Node is ready
2022-03-19T03:09:31.614 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com
2022-03-19T03:09:31.670 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170
2022-03-19T03:09:31.996 INFO:teuthology.provision.fog.smithi170:Deploy complete!
2022-03-19T03:09:40.470 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T03:09:40.713 INFO:teuthology.provision.fog.smithi136:Node is ready
2022-03-19T03:09:40.728 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2022-03-19T03:09:40.785 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2022-03-19T03:09:41.107 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2022-03-19T03:09:41.255 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2022-03-19T03:09:41.255 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T03:09:41.280 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com
2022-03-19T03:09:41.280 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T03:09:41.297 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2022-03-19T03:09:41.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2022-03-19T03:09:41.526 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2022-03-19T03:09:41.580 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T03:09:41.580 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T03:09:41.580 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel"
2022-03-19T03:09:41.580 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora"
2022-03-19T03:09:41.581 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.4"
2022-03-19T03:09:41.581 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2022-03-19T03:09:41.581 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T03:09:41.581 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2022-03-19T03:09:41.582 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T03:09:41.582 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T03:09:41.582 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T03:09:41.582 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T03:09:41.583 INFO:teuthology.orchestra.run.smithi136.stdout:
2022-03-19T03:09:41.583 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T03:09:41.583 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T03:09:41.583 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T03:09:41.584 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T03:09:41.585 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2022-03-19T03:09:41.602 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server
2022-03-19T03:09:41.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2022-03-19T03:09:41.832 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64
2022-03-19T03:09:41.887 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T03:09:41.887 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T03:09:41.887 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel"
2022-03-19T03:09:41.887 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora"
2022-03-19T03:09:41.888 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.4"
2022-03-19T03:09:41.888 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8"
2022-03-19T03:09:41.888 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T03:09:41.888 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31"
2022-03-19T03:09:41.888 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T03:09:41.889 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T03:09:41.889 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T03:09:41.889 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T03:09:41.889 INFO:teuthology.orchestra.run.smithi170.stdout:
2022-03-19T03:09:41.890 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T03:09:41.890 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T03:09:41.890 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T03:09:41.890 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T03:09:41.891 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server
2022-03-19T03:09:41.992 INFO:teuthology.dispatcher.supervisor:Running job 6744787
2022-03-19T03:09:41.993 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_aa078dbed6d14c1ad98beb5a02b956bbe0a741c8/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744787 --name vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/pjd}} -- /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744787/orig.config.yaml
2022-03-19T03:09:41.996 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744787
2022-03-19T03:09:41.997 INFO:teuthology.dispatcher.supervisor:Job PID: 27819
2022-03-19T03:09:41.997 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-19T09:40:09.155 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-19T09:40:09.327 INFO:teuthology.kill:Killing Pids: {27819}
2022-03-19T09:40:10.534 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-19T09:40:10.535 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-19T09:40:10.536 INFO:teuthology.misc:Compressing logs...
2022-03-19T09:40:10.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2022-03-19T09:40:10.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com'
2022-03-19T09:40:14.391 INFO:teuthology.misc:Compressing logs...
2022-03-19T09:40:14.544 INFO:teuthology.misc:Compressing logs...
2022-03-19T09:51:13.151 INFO:teuthology.kill:No teuthology processes running
2022-03-19T09:51:14.755 INFO:teuthology.kill:Nuking machines: ['smithi136', 'smithi170']
2022-03-19T09:51:15.748 INFO:teuthology.kill:2022-03-19 09:51:15,748.748 INFO:teuthology.nuke:targets:
2022-03-19T09:51:15.749 INFO:teuthology.kill:  smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCw7T3ZeIHczOQDxuLLjWCPRkjegj6L6r/jSyi9gl0SKpyPbICGKObGbJ9Ooz542w2PRBmJFq70f0vnToZ72UMNb1iECaHpiCFa7oq8KvI79uTq2NLLLXbVQhSMBXHeB7Gttnkylv+BHnHIBoQXSui5bi2CfgRJE5ifjM5eiYTA7kdttx12hyH9271fD9NyX9R+T8CKOMkWcC61Y/ZxmDhbc4L9TQqdQETlpJqJRxaT+wqB/YsO9oVX7xAAs2sC9l0pEHKMZaAj30X+KoxomSns4bQwMFz+b7hXEPuIDJGyXKQDU89si+oXKteBNP9RUoyoBxtcEjzczd2nXRzm+xdj3xY8U4Fvf3/a7FeWvkdYVqgLIxjFQsWX2R06T8PZzF0HrWKnAmK7N9lyw6t+z7DtxalQc7llimx0hfa74ofFKsZtz+l7fCkQBWcUxI/DR1KjNjimEt09MAf1TJbeApJgKYo4jafRzMrJTB61zSYRn5ZpF1g9lxezfyRSvvihb/0=
2022-03-19T09:51:15.750 INFO:teuthology.kill:  smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmwgwqDAmEplD+wohtTys/bOsMIZ683dbmOattJ1rPRGzWeoFQsBB7BKXh3FqUw0nk/IitJIublQkd+tQSla5bvkU8u1hTlRizOj3vdh78Ql5EiRuSR1nlztjv7vPEJtM60FiKn3YsarwfAlxMfH895wBvW1qPc1SrcdF3NyY1ieG/pkND8nq4KTntgbYiE1Re/r5Du8m9sDbZJGeh5f4kC8QNiGrU/zzhA7dF0mGrLWyPOfC7OVH37RhbV0rVL+s7J3fAEObEj1KKAUzeRbvIMgS7XkFbn6w8WjMJb+Fp/Eq8m6mbPQEIBoiGbzJ4ay0iWVt2OnuURDf+KFvNAtLO9FKdK7+RL8tTk/eYJ4aaHBquD/pvkNVopgTrfiOuwHOUImf8oEAQ3Oj2uG5KZ9umFIYUdSOuq9aPM5Z3YwWWp6UB5YPAOikvMXT0hTcToxXzMSAeE75ke2Erru2m2o9xFUo+R1Me5qlLDB+RKaAQCc4h39SrTGbfLyM9APlQ/BU=
2022-03-19T09:51:15.775 INFO:teuthology.kill:2022-03-19 09:51:15,775.775 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T09:51:15.779 INFO:teuthology.kill:2022-03-19 09:51:15,779.779 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T09:51:15.856 INFO:teuthology.kill:2022-03-19 09:51:15,855.855 INFO:teuthology.orchestra.console:Power off smithi170
2022-03-19T09:51:15.870 INFO:teuthology.kill:2022-03-19 09:51:15,870.870 INFO:teuthology.orchestra.console:Power off smithi136
2022-03-19T09:51:24.232 INFO:teuthology.kill:2022-03-19 09:51:24,232.232 INFO:teuthology.orchestra.console:Power off for smithi170 completed
2022-03-19T09:51:24.240 INFO:teuthology.kill:2022-03-19 09:51:24,240.240 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2022-03-19T09:51:24.386 INFO:teuthology.kill:2022-03-19 09:51:24,385.385 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com
2022-03-19T09:51:24.389 INFO:teuthology.kill:2022-03-19 09:51:24,389.389 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com
2022-03-19T09:53:24.647 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-19T09:53:24.750 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi136 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744887
2022-03-19T09:53:24.751 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi170 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744887