2022-03-19T01:15:12.861 INFO:root:teuthology version: 1.1.0-aa078dbe
2022-03-19T01:15:12.986 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging
2022-03-19T01:15:12.987 INFO:teuthology.lock.ops:Updating [ubuntu@smithi156.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T01:15:12.987 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2022-03-19T01:15:13.006 INFO:teuthology.lock.ops:Node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging is complete
2022-03-19T01:15:13.006 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi159.front.sepia.ceph.com' reimaging
2022-03-19T01:15:13.006 INFO:teuthology.lock.ops:Updating [ubuntu@smithi159.front.sepia.ceph.com]: reset os type and version on server
2022-03-19T01:15:13.007 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2022-03-19T01:15:13.024 INFO:teuthology.lock.ops:Node 'ubuntu@smithi159.front.sepia.ceph.com' reimaging is complete
2022-03-19T01:15:13.217 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of rhel 8.4
2022-03-19T01:15:13.237 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of rhel 8.4
2022-03-19T01:15:13.529 INFO:teuthology.orchestra.console:Power off smithi156
2022-03-19T01:15:13.543 INFO:teuthology.orchestra.console:Power off smithi159
2022-03-19T01:15:21.901 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2022-03-19T01:15:22.002 INFO:teuthology.orchestra.console:Power on smithi156
2022-03-19T01:15:26.015 INFO:teuthology.orchestra.console:Power off for smithi159 completed
2022-03-19T01:15:26.116 INFO:teuthology.orchestra.console:Power on smithi159
2022-03-19T01:15:30.366 INFO:teuthology.orchestra.console:Power on for smithi156 completed
2022-03-19T01:15:30.467 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2022-03-19T01:15:34.483 INFO:teuthology.orchestra.console:Power on for smithi159 completed
2022-03-19T01:15:34.584 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2022-03-19T01:20:08.613 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T01:20:08.853 INFO:teuthology.provision.fog.smithi156:Node is ready
2022-03-19T01:20:08.868 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2022-03-19T01:20:08.923 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2022-03-19T01:20:09.248 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2022-03-19T01:20:18.448 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-19T01:20:18.662 INFO:teuthology.provision.fog.smithi159:Node is ready
2022-03-19T01:20:18.677 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2022-03-19T01:20:18.733 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2022-03-19T01:20:19.062 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2022-03-19T01:20:19.221 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2022-03-19T01:20:19.222 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T01:20:19.239 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2022-03-19T01:20:19.239 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-19T01:20:19.256 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2022-03-19T01:20:19.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2022-03-19T01:20:19.488 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2022-03-19T01:20:19.543 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T01:20:19.544 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T01:20:19.544 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel"
2022-03-19T01:20:19.544 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora"
2022-03-19T01:20:19.545 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.4"
2022-03-19T01:20:19.545 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8"
2022-03-19T01:20:19.545 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T01:20:19.545 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2022-03-19T01:20:19.545 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T01:20:19.546 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T01:20:19.546 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T01:20:19.546 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T01:20:19.546 INFO:teuthology.orchestra.run.smithi156.stdout:
2022-03-19T01:20:19.547 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T01:20:19.547 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T01:20:19.547 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T01:20:19.547 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T01:20:19.549 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2022-03-19T01:20:19.567 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2022-03-19T01:20:19.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2022-03-19T01:20:19.795 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2022-03-19T01:20:19.850 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2022-03-19T01:20:19.851 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.4 (Ootpa)"
2022-03-19T01:20:19.851 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2022-03-19T01:20:19.852 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2022-03-19T01:20:19.852 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.4"
2022-03-19T01:20:19.852 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2022-03-19T01:20:19.853 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-19T01:20:19.853 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2022-03-19T01:20:19.854 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-19T01:20:19.854 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2022-03-19T01:20:19.855 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-19T01:20:19.855 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-19T01:20:19.855 INFO:teuthology.orchestra.run.smithi159.stdout:
2022-03-19T01:20:19.855 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-19T01:20:19.856 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-19T01:20:19.856 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-19T01:20:19.856 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-19T01:20:19.857 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2022-03-19T01:20:19.954 INFO:teuthology.dispatcher.supervisor:Running job 6744705
2022-03-19T01:20:19.954 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_aa078dbed6d14c1ad98beb5a02b956bbe0a741c8/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744705 --name vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snapshots} -- /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744705/orig.config.yaml
2022-03-19T01:20:19.957 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744705
2022-03-19T01:20:19.958 INFO:teuthology.dispatcher.supervisor:Job PID: 7288
2022-03-19T01:20:19.958 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-19T07:50:47.759 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-19T07:50:47.914 INFO:teuthology.kill:Killing Pids: {7288}
2022-03-19T07:50:49.044 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2']
2022-03-19T07:50:49.045 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']
2022-03-19T07:50:49.046 INFO:teuthology.misc:Compressing logs...
2022-03-19T07:50:49.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2022-03-19T07:50:49.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2022-03-19T07:50:49.847 INFO:teuthology.misc:Compressing logs...
2022-03-19T07:50:50.106 INFO:teuthology.misc:Compressing logs...
2022-03-19T07:51:53.024 INFO:teuthology.kill:No teuthology processes running
2022-03-19T07:51:54.076 INFO:teuthology.kill:Nuking machines: ['smithi156', 'smithi159']
2022-03-19T07:51:54.967 INFO:teuthology.kill:2022-03-19 07:51:54,966.966 INFO:teuthology.nuke:targets:
2022-03-19T07:51:54.967 INFO:teuthology.kill:  smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD3b4DPZJkNRrEPRCUm95cmtkmDT/GqhvbSDv6xR7KizcGpDxBwYpcipuoL0k0/ZFDPZD2zVaTjgkTWndT3xtHv5XGvwIxum9efJid4foONl5BNRv4LY2Bc0uta7i0MhWAtKSvhlPFQCgQBzF6pwAPFxcZMYMRjEGO9M+13xTJ7qoRiuKm/V40onn1iDucued+BXLpH7QHmqQtrN8Uu4lSyXHkf6JMUDafoEb0iO8elayrsHnrkg27KoCg/u7N9yJ5sfv1hNAgtsnEzGQzQv5gnsMOjn/m2fEDIgJDy7to3bvQOGmLN2Oim9x2y8CKVjiZkmxR/tTk/9nOMDN/muTN6qu64jKKWbhE3YbDF5HhvJeTh6pXnQuCJHmvsACy4XLuqVPRPESnMrNbg5YKulpfpJ1Z4TXaar8kuYHSLApq0ArhKvDHRgANVc9Tgra1FFS3aAmTIKQxPnZBZqCdQO9eWjTPxp6ifCu5bM3Mdo9u3i1/+6vw5vPrGJDlNXY8G4U=
2022-03-19T07:51:54.968 INFO:teuthology.kill:  smithi159.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4+1QRkH3/WOijxRmFFsojWIck8RXmatfkKtAGNMnVdFbTmma2Ifn0L7sn9ST3jP2BXkgzy1eTnEi+/qa1S2u9LxoDzD1wTTxhpCGyIVXwo1Tko0UOCYuJRqwkC0eIyxTFHxWydu7DncB87Le9UlZdSHPjFURYYMAor2cdtnsse9Cpt04t61+0A21bVUlZHc+AgV2sI3v6BFtCBNgpc8mjASJk/p421PzoE5MfB2KXwLutDLef2Wxlyi7LlJtAf0ymo/kgJ78qmWt4TAFLb7dWQ47C3c+eb87gJgQUHCbfChX1wLzeAF6v0MXhUejfopV7trQKo5hd9Ywp+FfYrs0jYi3eETpF08AwaJoXoYYAAyn9fs/6wB6967E+omWFkfVggqkqmqUsxZ7oShUHdydgdD/dluJz7A2mmHSj3ZOy1eEbLEMAkvKGrCV6royCdg2yQzzOv2bnb8Cyv90JB+aIDGbde76SPFT+17Pxr8BpY1JIjP7ft4IIFL/ix0vMlos=
2022-03-19T07:51:54.993 INFO:teuthology.kill:2022-03-19 07:51:54,993.993 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T07:51:54.996 INFO:teuthology.kill:2022-03-19 07:51:54,996.996 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-19T07:51:55.066 INFO:teuthology.kill:2022-03-19 07:51:55,066.066 INFO:teuthology.orchestra.console:Power off smithi159
2022-03-19T07:51:55.079 INFO:teuthology.kill:2022-03-19 07:51:55,079.079 INFO:teuthology.orchestra.console:Power off smithi156
2022-03-19T07:52:07.548 INFO:teuthology.kill:2022-03-19 07:52:07,547.547 INFO:teuthology.orchestra.console:Power off for smithi159 completed
2022-03-19T07:52:07.553 INFO:teuthology.kill:2022-03-19 07:52:07,553.553 INFO:teuthology.orchestra.console:Power off for smithi156 completed
2022-03-19T07:52:07.692 INFO:teuthology.kill:2022-03-19 07:52:07,691.691 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com
2022-03-19T07:52:07.700 INFO:teuthology.kill:2022-03-19 07:52:07,700.700 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com
2022-03-19T07:54:07.997 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-19T07:54:08.114 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi156 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744870
2022-03-19T07:54:08.115 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi159 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-18_07:57:03-fs-wip-vshankar-testing1-20220317-183011-testing-default-smithi/6744870