2022-03-20T12:08:18.791 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-20T12:08:18.912 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging
2022-03-20T12:08:18.914 INFO:teuthology.lock.ops:Updating [ubuntu@smithi077.front.sepia.ceph.com]: reset os type and version on server
2022-03-20T12:08:18.914 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2022-03-20T12:08:18.932 INFO:teuthology.lock.ops:Node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging is complete
2022-03-20T12:08:18.933 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi101.front.sepia.ceph.com' reimaging
2022-03-20T12:08:18.933 INFO:teuthology.lock.ops:Updating [ubuntu@smithi101.front.sepia.ceph.com]: reset os type and version on server
2022-03-20T12:08:18.933 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server
2022-03-20T12:08:18.951 INFO:teuthology.lock.ops:Node 'ubuntu@smithi101.front.sepia.ceph.com' reimaging is complete
2022-03-20T12:08:19.149 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of rhel 8.4
2022-03-20T12:08:19.152 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of rhel 8.4
2022-03-20T12:08:19.473 INFO:teuthology.orchestra.console:Power off smithi101
2022-03-20T12:08:19.486 INFO:teuthology.orchestra.console:Power off smithi077
2022-03-20T12:08:19.615 INFO:teuthology.orchestra.console:Power off for smithi101 completed
2022-03-20T12:08:19.624 INFO:teuthology.orchestra.console:Power off for smithi077 completed
2022-03-20T12:08:19.717 INFO:teuthology.orchestra.console:Power on smithi101
2022-03-20T12:08:19.725 INFO:teuthology.orchestra.console:Power on smithi077
2022-03-20T12:08:28.087 INFO:teuthology.orchestra.console:Power on for smithi101 completed
2022-03-20T12:08:28.093 INFO:teuthology.orchestra.console:Power on for smithi077 completed
2022-03-20T12:08:28.189 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish
2022-03-20T12:08:28.194 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish
2022-03-20T12:12:57.079 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-20T12:12:57.313 INFO:teuthology.provision.fog.smithi077:Node is ready
2022-03-20T12:12:57.328 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com
2022-03-20T12:12:57.384 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077
2022-03-20T12:12:57.703 INFO:teuthology.provision.fog.smithi077:Deploy complete!
2022-03-20T12:13:06.142 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-20T12:13:06.384 INFO:teuthology.provision.fog.smithi101:Node is ready
2022-03-20T12:13:06.399 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com
2022-03-20T12:13:06.455 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101
2022-03-20T12:13:06.775 INFO:teuthology.provision.fog.smithi101:Deploy complete!
2022-03-20T12:13:06.950 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com
2022-03-20T12:13:06.951 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-20T12:13:06.979 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com
2022-03-20T12:13:06.980 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-20T12:13:06.998 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server
2022-03-20T12:13:06.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com'
2022-03-20T12:13:07.227 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64
2022-03-20T12:13:07.282 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Red Hat Enterprise Linux"
2022-03-20T12:13:07.283 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8.4 (Ootpa)"
2022-03-20T12:13:07.283 INFO:teuthology.orchestra.run.smithi077.stdout:ID="rhel"
2022-03-20T12:13:07.283 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="fedora"
2022-03-20T12:13:07.283 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8.4"
2022-03-20T12:13:07.284 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8"
2022-03-20T12:13:07.284 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-20T12:13:07.284 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31"
2022-03-20T12:13:07.284 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-20T12:13:07.284 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.redhat.com/"
2022-03-20T12:13:07.285 INFO:teuthology.orchestra.run.smithi077.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-20T12:13:07.285 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-20T12:13:07.285 INFO:teuthology.orchestra.run.smithi077.stdout:
2022-03-20T12:13:07.285 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-20T12:13:07.285 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-20T12:13:07.286 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-20T12:13:07.286 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-20T12:13:07.287 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2022-03-20T12:13:07.307 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server
2022-03-20T12:13:07.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com'
2022-03-20T12:13:07.521 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64
2022-03-20T12:13:07.575 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Red Hat Enterprise Linux"
2022-03-20T12:13:07.575 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8.4 (Ootpa)"
2022-03-20T12:13:07.576 INFO:teuthology.orchestra.run.smithi101.stdout:ID="rhel"
2022-03-20T12:13:07.576 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="fedora"
2022-03-20T12:13:07.576 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8.4"
2022-03-20T12:13:07.576 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8"
2022-03-20T12:13:07.577 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-20T12:13:07.577 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31"
2022-03-20T12:13:07.577 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-20T12:13:07.577 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.redhat.com/"
2022-03-20T12:13:07.578 INFO:teuthology.orchestra.run.smithi101.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-20T12:13:07.578 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-20T12:13:07.578 INFO:teuthology.orchestra.run.smithi101.stdout:
2022-03-20T12:13:07.578 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-20T12:13:07.578 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-20T12:13:07.579 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-20T12:13:07.579 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-20T12:13:07.579 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server
2022-03-20T12:13:07.686 INFO:teuthology.dispatcher.supervisor:Running job 6747763
2022-03-20T12:13:07.687 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747763 --name vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} -- /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747763/orig.config.yaml
2022-03-20T12:13:07.690 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-20_02:16:37-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6747763
2022-03-20T12:13:07.691 INFO:teuthology.dispatcher.supervisor:Job PID: 3871
2022-03-20T12:13:07.691 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-20T18:43:36.284 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-20T18:43:36.463 INFO:teuthology.kill:Killing Pids: {3871}
2022-03-20T18:43:37.608 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2']
2022-03-20T18:43:37.609 INFO:teuthology.task.internal:roles: ubuntu@smithi101.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']
2022-03-20T18:43:37.609 INFO:teuthology.misc:Compressing logs...
2022-03-20T18:43:37.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com'
2022-03-20T18:43:37.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com'
2022-03-20T18:43:38.175 INFO:teuthology.misc:Compressing logs...
2022-03-20T18:43:38.326 INFO:teuthology.misc:Compressing logs...
2022-03-20T18:44:43.716 INFO:teuthology.kill:No teuthology processes running
2022-03-20T18:44:44.831 INFO:teuthology.kill:Nuking machines: ['smithi077', 'smithi101']
2022-03-20T18:44:45.765 INFO:teuthology.kill:2022-03-20 18:44:45,765.765 INFO:teuthology.nuke:targets:
2022-03-20T18:44:45.766 INFO:teuthology.kill:  smithi077.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeK9A5MLdyiSQri1RTYlyXXaP/oMoR66jSd/9Opsb2iAVxLolguyS7+HbqTT3ykFaxcxRMQHlqMES9ZRkmlXoS9b37uRRjWXZABgSlbH35Sz8S738QfDVAxyG9xMdP5yOD8dvQ+0Cykjb7kasM6pMH879KuQM7bWJ3E5rwnHuwLvzgYpZMz3zEJrMx1FnQQ1SCQsE5+4xQ+UF0pG3nzlmX3ML52w0YePHlZ8JAy0HjDwDACqkBBbBvuPxrouNjPoIYdxgkQ8S1fakcN9gKDsQrO1Mjc2DkVEGkxWXtGzSl5AkKQE2II0/K8ADlvSYQO+UZFzNEd6PBPthQQtgpHdyAX6ZAb/PCoNhOw9ck5ER5ORQsnreYB2tIDigeW87UKTRE+m4PHqBbNIYJwtWxnS/1eVw8htUr2jJPx9Ouvlja/NCUjD4V1raJK4e1rfWINP+qfyty6d+8zdlsE32EM5DtFY4CFcMQ615QWUzUkksDUJ4Qy3q7FqpaCxKOhmjm/gM=
2022-03-20T18:44:45.766 INFO:teuthology.kill:  smithi101.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMxHpt+cSawpMmbRkYoNcChlN3rXKAerL7F3iIZFgfIa5OurxjuyaR51cEAtTvQYHu6wmz8an/9SPYKMaYGLmA53ZOgYdgLdEm78RwJuKyT5EqvRs5VOpUWyMV+o4vQbaUTXJOvnelMssO0Xns6BncLSmD3Kj3eauF/Ig32baKyMuXXaIZm9eHUnn0Vkkvl2/v6eJ8tAM6Ue5FyUAwr32k8lHDBQomjjHF0eSACV10Erh7IMkC9FhoQagcJwBku0XB5KIiEm0zG9lvzf/ymOjF0K3p+JnzxQbS4TKM6E/i5aDqbHaZ6HzvstMeVb6pI72d/b/OM3uUvkBaRRKZmEE+aoTDE9OyGxXc2ebDz5KjZ0OcRuaOuuNbEmZNot3roc+eq75fm4ubdr1TNUbN66gLKC1YG22NbzhyeYKxqXdfmbFeQUJ50/mBmDk8rx3MVuOnwmByU/meqjIzAU11bc9v6clDxIaWF5xhxm40F446MwOGMeyGAmtZor7ddsPtTpc=
2022-03-20T18:44:45.792 INFO:teuthology.kill:2022-03-20 18:44:45,791.791 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-20T18:44:45.794 INFO:teuthology.kill:2022-03-20 18:44:45,794.794 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-20T18:44:45.866 INFO:teuthology.kill:2022-03-20 18:44:45,866.866 INFO:teuthology.orchestra.console:Power off smithi101
2022-03-20T18:44:45.879 INFO:teuthology.kill:2022-03-20 18:44:45,879.879 INFO:teuthology.orchestra.console:Power off smithi077
2022-03-20T18:44:54.244 INFO:teuthology.kill:2022-03-20 18:44:54,244.244 INFO:teuthology.orchestra.console:Power off for smithi077 completed
2022-03-20T18:44:54.391 INFO:teuthology.kill:2022-03-20 18:44:54,390.390 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com
2022-03-20T18:44:58.350 INFO:teuthology.kill:2022-03-20 18:44:58,350.350 INFO:teuthology.orchestra.console:Power off for smithi101 completed
2022-03-20T18:44:58.494 INFO:teuthology.kill:2022-03-20 18:44:58,493.493 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com
2022-03-20T18:46:58.788 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-20T18:46:58.887 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi101 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-03-18_05:17:02-krbd-pacific-testing-default-smithi/6744367