2022-03-19T13:17:11.358 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-19T13:17:11.516 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi037.front.sepia.ceph.com' reimaging
2022-03-19T13:17:11.517 INFO:teuthology.lock.ops:Updating [ubuntu@smithi037.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T13:17:11.517 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2022-03-19T13:17:11.543 INFO:teuthology.lock.ops:Node 'ubuntu@smithi037.front.sepia.ceph.com' reimaging is complete
2022-03-19T13:17:11.544 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi061.front.sepia.ceph.com' reimaging
2022-03-19T13:17:11.544 INFO:teuthology.lock.ops:Updating [ubuntu@smithi061.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T13:17:11.544 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2022-03-19T13:17:11.564 INFO:teuthology.lock.ops:Node 'ubuntu@smithi061.front.sepia.ceph.com' reimaging is complete
2022-03-19T13:17:11.754 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of rhel 8.4
2022-03-19T13:17:11.768 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of rhel 8.4
2022-03-19T13:17:12.038 INFO:teuthology.orchestra.console:Power off smithi037
2022-03-19T13:17:12.053 INFO:teuthology.orchestra.console:Power off smithi061
2022-03-19T13:17:12.183 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2022-03-19T13:17:12.192 INFO:teuthology.orchestra.console:Power off for smithi061 completed
2022-03-19T13:17:12.285 INFO:teuthology.orchestra.console:Power on smithi037
2022-03-19T13:17:12.294 INFO:teuthology.orchestra.console:Power on smithi061
2022-03-19T13:17:16.540 INFO:teuthology.orchestra.console:Power on for smithi037 completed
2022-03-19T13:17:16.546 INFO:teuthology.orchestra.console:Power on for smithi061 completed
2022-03-19T13:17:16.642 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2022-03-19T13:17:16.648 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish
2022-03-19T13:21:30.481 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T13:21:30.697 INFO:teuthology.provision.fog.smithi037:Node is ready
2022-03-19T13:21:30.721 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2022-03-19T13:21:30.777 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2022-03-19T13:21:31.108 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2022-03-19T13:22:09.415 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T13:22:09.640 INFO:teuthology.provision.fog.smithi061:Node is ready
2022-03-19T13:22:09.655 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com
2022-03-19T13:22:09.711 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061
2022-03-19T13:22:10.045 INFO:teuthology.provision.fog.smithi061:Deploy complete!
2022-03-19T13:22:10.222 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2022-03-19T13:22:10.223 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T13:22:10.241 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com
2022-03-19T13:22:10.241 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T13:22:10.259 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2022-03-19T13:22:10.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2022-03-19T13:22:10.502 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2022-03-19T13:22:10.558 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T13:22:10.559 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T13:22:10.559 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel"
2022-03-19T13:22:10.559 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora"
2022-03-19T13:22:10.560 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.4"
2022-03-19T13:22:10.560 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8"
2022-03-19T13:22:10.560 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T13:22:10.560 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2022-03-19T13:22:10.561 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T13:22:10.561 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T13:22:10.561 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T13:22:10.561 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T13:22:10.562 INFO:teuthology.orchestra.run.smithi037.stdout:
2022-03-19T13:22:10.562 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T13:22:10.562 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T13:22:10.562 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T13:22:10.562 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T13:22:10.564 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2022-03-19T13:22:10.584 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server
2022-03-19T13:22:10.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com'
2022-03-19T13:22:10.806 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64
2022-03-19T13:22:10.860 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T13:22:10.861 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T13:22:10.861 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel"
2022-03-19T13:22:10.861 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora"
2022-03-19T13:22:10.861 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.4"
2022-03-19T13:22:10.862 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8"
2022-03-19T13:22:10.862 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T13:22:10.862 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31"
2022-03-19T13:22:10.862 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T13:22:10.863 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T13:22:10.863 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T13:22:10.863 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T13:22:10.863 INFO:teuthology.orchestra.run.smithi061.stdout:
2022-03-19T13:22:10.864 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T13:22:10.864 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T13:22:10.864 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T13:22:10.864 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T13:22:10.865 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2022-03-19T13:22:10.967 INFO:teuthology.dispatcher.supervisor:Running job 6744953
2022-03-19T13:22:10.968 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_aa078dbed6d14c1ad98beb5a02b956bbe0a741c8/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744953 --name vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/pjd}} -- /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744953/orig.config.yaml
2022-03-19T13:22:10.971 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744953
2022-03-19T13:22:10.972 INFO:teuthology.dispatcher.supervisor:Job PID: 29204
2022-03-19T13:22:10.972 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-19T19:52:39.659 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-19T19:52:39.820 INFO:teuthology.kill:Killing Pids: {29204}
2022-03-19T19:52:40.999 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-19T19:52:41.000 INFO:teuthology.task.internal:roles: ubuntu@smithi061.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-19T19:52:41.001 INFO:teuthology.misc:Compressing logs...
2022-03-19T19:52:41.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2022-03-19T19:52:41.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com'
2022-03-19T19:52:42.691 INFO:teuthology.misc:Compressing logs...
2022-03-19T19:52:42.822 INFO:teuthology.misc:Compressing logs...
2022-03-19T20:04:19.826 INFO:teuthology.kill:No teuthology processes running
2022-03-19T20:04:20.994 INFO:teuthology.kill:Nuking machines: ['smithi037', 'smithi061']
2022-03-19T20:04:21.899 INFO:teuthology.kill:2022-03-19 20:04:21,898.898 INFO:teuthology.nuke:targets:
2022-03-19T20:04:21.899 INFO:teuthology.kill:  smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzgckdvToEDYVBoZniUO2eS2ZGyZ8bxWBi9seuv4dl7V6Z6OSEeVLxnr4cIV6KokrbmkYvRucoPEPWSds5uZBiJF5Gq5Bwb2SvhhXLIqU6fOzZJTs3CKr6mxWJHhSb8yH5G17g9AHxY7Y0dh71/rDDSdVHGhTHNTMH8XU19N4tehOpCfZB3691esZqdRpjheJv0hZ27ou+wkVND1SSnAVIzZ4Uvhjvhxp5+wkY5gzWRtNK9l1XxdCGxteHUm25C+20UFn1q46DoxXLUvjL561XapI+7w2Uh1zUHv2hFynX/VCbncpfuO/PZRuVJ2k7vK8vAKoAyJ5D2XQTS4z05lr3r9d63icSxRJXWKffsKIag4tDT/2oLtx+iS8Ya0Ojit6+BcTZH0yiE34G53G+qEL4MtTmO+1iapIDVTClc9aRHr+RcEmPyNeJAQaXbpIj2KYgRFRKKnPBNmGp9C+n7K1+3GE3ZjiP/k6amaaoEAbTdNskL4ek7yfj4RtlA1iOiqE=
2022-03-19T20:04:21.900 INFO:teuthology.kill:  smithi061.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFIfOK6UiRs3dGcW1R2dlM0XLBzoFLX/UFf/vrdqh5p95jE62rtOVv/bqfZMaOq+ldNmokAFugNlKXRnqUEzjzgDAmrmNG8Q99kCsQ9B7lSFYubwypIgEWePW1ItPqs8+tf3ksLcu/nyFKy2CbwiAYVwye3HdP00xSqgyT+JLmsxmkMSVgmC9eP5o9xL20ci//v+ywyDkSJcjTtrAwo43C99yPfzzpT1r2wWDri80DjF4+pcvX+VjNBo9v9Uhce4/PTUOIy1OTj5d9Z7iBcUDnoFd8H9yJkie7+GspRtMvFZJtoQyQsUk1UrE0ZpC1N7/zFFMklHjpUgGA8MRO+Om3avP6DmwPhkNKOzClmpXScxj3DkQtP2hRr/QOINDq6/bQ3s/ngt/DRkc6gH6Uh2q8Ukp07si9k1isHJjvNMW6gjvSNJpzhRcDJs9yAxuY1OATyY3WikikYvkJZF+sRQrDVCib7r61f3XnnwtGyOvMybK5yUW3l+lqz6anQZPaYgk=
2022-03-19T20:04:21.925 INFO:teuthology.kill:2022-03-19 20:04:21,925.925 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T20:04:21.929 INFO:teuthology.kill:2022-03-19 20:04:21,928.928 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T20:04:22.002 INFO:teuthology.kill:2022-03-19 20:04:22,002.002 INFO:teuthology.orchestra.console:Power off smithi061
2022-03-19T20:04:22.014 INFO:teuthology.kill:2022-03-19 20:04:22,014.014 INFO:teuthology.orchestra.console:Power off smithi037
2022-03-19T20:04:30.372 INFO:teuthology.kill:2022-03-19 20:04:30,371.371 INFO:teuthology.orchestra.console:Power off for smithi061 completed
2022-03-19T20:04:30.377 INFO:teuthology.kill:2022-03-19 20:04:30,377.377 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2022-03-19T20:04:30.518 INFO:teuthology.kill:2022-03-19 20:04:30,518.518 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com
2022-03-19T20:04:30.522 INFO:teuthology.kill:2022-03-19 20:04:30,522.522 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com
2022-03-19T20:06:30.814 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-19T20:06:30.936 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi037 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-19_14:37:37-upgrade-quincy-distro-default-smithi/6746622
2022-03-19T20:06:30.937 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi061 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-19_14:37:37-upgrade-quincy-distro-default-smithi/6746622