2022-03-20T09:56:32.364 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-20T09:56:32.485 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging
2022-03-20T09:56:32.486 INFO:teuthology.lock.ops:Updating [ubuntu@smithi022.front.sepia.ceph.com]: reset os type and version on server
2022-03-20T09:56:32.487 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2022-03-20T09:56:32.503 INFO:teuthology.lock.ops:Node 'ubuntu@smithi022.front.sepia.ceph.com' reimaging is complete
2022-03-20T09:56:32.504 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi033.front.sepia.ceph.com' reimaging
2022-03-20T09:56:32.504 INFO:teuthology.lock.ops:Updating [ubuntu@smithi033.front.sepia.ceph.com]: reset os type and version on server
2022-03-20T09:56:32.504 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2022-03-20T09:56:32.526 INFO:teuthology.lock.ops:Node 'ubuntu@smithi033.front.sepia.ceph.com' reimaging is complete
2022-03-20T09:56:32.712 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of rhel 8.4
2022-03-20T09:56:32.737 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.4
2022-03-20T09:56:33.021 INFO:teuthology.orchestra.console:Power off smithi022
2022-03-20T09:56:33.066 INFO:teuthology.orchestra.console:Power off smithi033
2022-03-20T09:56:41.401 INFO:teuthology.orchestra.console:Power off for smithi022 completed
2022-03-20T09:56:41.502 INFO:teuthology.orchestra.console:Power on smithi022
2022-03-20T09:56:45.535 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2022-03-20T09:56:45.637 INFO:teuthology.orchestra.console:Power on smithi033
2022-03-20T09:56:49.866 INFO:teuthology.orchestra.console:Power on for smithi022 completed
2022-03-20T09:56:49.967 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish
2022-03-20T09:56:54.002 INFO:teuthology.orchestra.console:Power on for smithi033 completed
2022-03-20T09:56:54.104 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish
2022-03-20T10:01:10.497 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-20T10:01:10.743 INFO:teuthology.provision.fog.smithi033:Node is ready
2022-03-20T10:01:10.758 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com
2022-03-20T10:01:10.815 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033
2022-03-20T10:01:11.134 INFO:teuthology.provision.fog.smithi033:Deploy complete!
2022-03-20T10:01:12.354 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-20T10:01:12.561 INFO:teuthology.provision.fog.smithi022:Node is ready
2022-03-20T10:01:12.577 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com
2022-03-20T10:01:12.633 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2022-03-20T10:01:12.957 INFO:teuthology.provision.fog.smithi022:Deploy complete!
2022-03-20T10:01:13.104 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com
2022-03-20T10:01:13.105 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-20T10:01:13.125 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com
2022-03-20T10:01:13.125 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-20T10:01:13.143 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server
2022-03-20T10:01:13.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2022-03-20T10:01:13.371 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64
2022-03-20T10:01:13.426 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux"
2022-03-20T10:01:13.426 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.4 (Ootpa)"
2022-03-20T10:01:13.427 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel"
2022-03-20T10:01:13.427 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora"
2022-03-20T10:01:13.427 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.4"
2022-03-20T10:01:13.427 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8"
2022-03-20T10:01:13.428 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-20T10:01:13.428 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31"
2022-03-20T10:01:13.428 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-20T10:01:13.428 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/"
2022-03-20T10:01:13.429 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-20T10:01:13.429 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-20T10:01:13.429 INFO:teuthology.orchestra.run.smithi022.stdout:
2022-03-20T10:01:13.429 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-20T10:01:13.429 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-20T10:01:13.430 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-20T10:01:13.430 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-20T10:01:13.431 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2022-03-20T10:01:13.448 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server
2022-03-20T10:01:13.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com'
2022-03-20T10:01:13.686 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64
2022-03-20T10:01:13.742 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux"
2022-03-20T10:01:13.742 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.4 (Ootpa)"
2022-03-20T10:01:13.743 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel"
2022-03-20T10:01:13.743 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora"
2022-03-20T10:01:13.743 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.4"
2022-03-20T10:01:13.743 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2022-03-20T10:01:13.744 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-20T10:01:13.744 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2022-03-20T10:01:13.744 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-20T10:01:13.744 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/"
2022-03-20T10:01:13.744 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-20T10:01:13.745 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-20T10:01:13.745 INFO:teuthology.orchestra.run.smithi033.stdout:
2022-03-20T10:01:13.745 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-20T10:01:13.745 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-20T10:01:13.746 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-20T10:01:13.746 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-20T10:01:13.746 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2022-03-20T10:01:13.854 INFO:teuthology.dispatcher.supervisor:Running job 6747730
2022-03-20T10:01:13.855 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747730 --name vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747730/orig.config.yaml
2022-03-20T10:01:13.858 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747730
2022-03-20T10:01:13.858 INFO:teuthology.dispatcher.supervisor:Job PID: 22188
2022-03-20T10:01:13.859 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-20T16:31:42.175 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-20T16:31:42.485 INFO:teuthology.kill:Killing Pids: {22188}
2022-03-20T16:31:43.713 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-20T16:31:43.714 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-20T16:31:43.715 INFO:teuthology.misc:Compressing logs...
2022-03-20T16:31:43.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2022-03-20T16:31:43.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com'
2022-03-20T16:31:44.237 INFO:teuthology.misc:Compressing logs...
2022-03-20T16:31:44.394 INFO:teuthology.misc:Compressing logs...
2022-03-20T16:33:46.820 INFO:teuthology.kill:No teuthology processes running
2022-03-20T16:33:47.994 INFO:teuthology.kill:Nuking machines: ['smithi022', 'smithi033']
2022-03-20T16:33:48.967 INFO:teuthology.kill:2022-03-20 16:33:48,967.967 INFO:teuthology.nuke:targets:
2022-03-20T16:33:48.968 INFO:teuthology.kill:  smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU+irwg9aF8TsP+PiF9U/2/EwyOGYLV2YCMQyIqC+ttX+oHA4IxlisLKvMN+osmeLoe3YilTRbf8DeJLsMfKFPLaS/R7mc/s/ldw3qceVIUk62gum8vq4Bf9pI+H8BFwKKLBDSz8CnzA0iPe2UG6uU7BsjIEFdqF5cjfOSxqEznuem4Cx8UjaK+uxc1s+sx9HuLcicrMK7TA1AUBcAtiVH4rVT/gEp7K57RBi/IgQcDM6zqzVsKSSUweGdilICA7NwM1HX2J0pIJWpZG2fcRq+LfzOJnXisRFpML8WZ5MMX4NF6x3MZKfBJjVuPPo1QOsgTt1/x5ZpruNecd8WGVVwe3Bsx55R9EZbpJ0Vc6Z0/Hxny9Jv71GVwIYrXbOdySMVESFbFeZP11cka1tcqeWRn34BAbfBOqGZCxK867Pf87skutryBoq1qQCjbVnOf72PEfIg0ojwOvziy8Sxb1Ku/hWYUNLQyTs4Lbkst9yzLubbVmgh5jV+WgKKZTjBDTk=
2022-03-20T16:33:48.968 INFO:teuthology.kill:  smithi033.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqjFUBivszSYyN0rr4hohgZ91q8fQO6XRU2yqxrMjAVWMUE4IhShh2fvV5VclOkb0jwoa8ce+IxcVZ9sHLA1TJUL0Qjow1Qy1PS7up0uK/lRc+u4xCcH5An0gS4qWLt134NF0oB5r9CkRVqF2I9grpj6zDfY0CoOXW3HEBTD0bPkWNn8pTzv35tKjEgEGG38BjLi6CcMG4gMzTHhNejXt2jLvPqUBxnJ+4h8nCtd8W3hCY4+ywnPNaggWf/UlFNUMLq1kihMLx4ZeJs+Z2hKteyshilEkBgHGfXDWMkymYNqrCXPst4Yzteks5lZnkVQLQ/HMrZL/2XxJ1yvW228NSsGi8CIn454qaoDuvwbdS/ahiIfj863lvAAigE4W2jkvAJBeiqdhoyBkFgbqOZwF2hYvE6mrGvoGUrE0v6pFc+ucL75IAMqSfkCRinEaLd4dy+5T0PTeGbLvbAnzBs+1Xv55+2CbnNQV6V/EmbPn3NlzI4D9ycykzrU6rvGL59sE=
2022-03-20T16:33:48.994 INFO:teuthology.kill:2022-03-20 16:33:48,994.994 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-20T16:33:48.997 INFO:teuthology.kill:2022-03-20 16:33:48,997.997 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-20T16:33:49.072 INFO:teuthology.kill:2022-03-20 16:33:49,071.071 INFO:teuthology.orchestra.console:Power off smithi022
2022-03-20T16:33:49.085 INFO:teuthology.kill:2022-03-20 16:33:49,085.085 INFO:teuthology.orchestra.console:Power off smithi033
2022-03-20T16:33:57.452 INFO:teuthology.kill:2022-03-20 16:33:57,452.452 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2022-03-20T16:33:57.602 INFO:teuthology.kill:2022-03-20 16:33:57,601.601 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com
2022-03-20T16:34:01.556 INFO:teuthology.kill:2022-03-20 16:34:01,556.556 INFO:teuthology.orchestra.console:Power off for smithi022 completed
2022-03-20T16:34:01.702 INFO:teuthology.kill:2022-03-20 16:34:01,702.702 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com
2022-03-20T16:36:02.037 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-20T16:36:02.148 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi022 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-20_14:30:27-orch-quincy-distro-default-smithi/6748994
2022-03-20T16:36:02.148 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi033 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-20_14:30:27-orch-quincy-distro-default-smithi/6748994