2022-01-07T13:57:28.277 INFO:root:teuthology version: 1.1.0-95a7d479
2022-01-07T13:57:28.406 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi055.front.sepia.ceph.com' reimaging
2022-01-07T13:57:28.407 INFO:teuthology.lock.ops:Updating [ubuntu@smithi055.front.sepia.ceph.com]: reset os type and version on server
2022-01-07T13:57:28.407 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server
2022-01-07T13:57:28.425 INFO:teuthology.lock.ops:Node 'ubuntu@smithi055.front.sepia.ceph.com' reimaging is complete
2022-01-07T13:57:28.425 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi149.front.sepia.ceph.com' reimaging
2022-01-07T13:57:28.426 INFO:teuthology.lock.ops:Updating [ubuntu@smithi149.front.sepia.ceph.com]: reset os type and version on server
2022-01-07T13:57:28.426 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2022-01-07T13:57:28.446 INFO:teuthology.lock.ops:Node 'ubuntu@smithi149.front.sepia.ceph.com' reimaging is complete
2022-01-07T13:57:28.647 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of rhel 8.4
2022-01-07T13:57:28.672 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of rhel 8.4
2022-01-07T13:57:29.054 INFO:teuthology.orchestra.console:Power off smithi055
2022-01-07T13:57:29.155 INFO:teuthology.orchestra.console:Power off smithi149
2022-01-07T13:57:37.438 INFO:teuthology.orchestra.console:Power off for smithi055 completed
2022-01-07T13:57:37.540 INFO:teuthology.orchestra.console:Power on smithi055
2022-01-07T13:57:41.637 INFO:teuthology.orchestra.console:Power off for smithi149 completed
2022-01-07T13:57:41.739 INFO:teuthology.orchestra.console:Power on smithi149
2022-01-07T13:57:45.913 INFO:teuthology.orchestra.console:Power on for smithi055 completed
2022-01-07T13:57:45.992 INFO:teuthology.orchestra.console:Power on for smithi149 completed
2022-01-07T13:57:46.015 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish
2022-01-07T13:57:46.094 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish
2022-01-07T14:02:20.453 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-07T14:02:20.681 INFO:teuthology.provision.fog.smithi055:Node is ready
2022-01-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com
2022-01-07T14:02:20.753 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055
2022-01-07T14:02:21.079 INFO:teuthology.provision.fog.smithi055:Deploy complete!
2022-01-07T14:02:50.603 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-07T14:02:50.854 INFO:teuthology.provision.fog.smithi149:Node is ready
2022-01-07T14:02:50.870 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com
2022-01-07T14:02:50.927 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149
2022-01-07T14:02:51.262 INFO:teuthology.provision.fog.smithi149:Deploy complete!
2022-01-07T14:02:51.419 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com
2022-01-07T14:02:51.420 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-07T14:02:51.440 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com
2022-01-07T14:02:51.440 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-07T14:02:51.459 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server
2022-01-07T14:02:51.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com'
2022-01-07T14:02:51.702 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64
2022-01-07T14:02:51.757 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux"
2022-01-07T14:02:51.758 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.4 (Ootpa)"
2022-01-07T14:02:51.758 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel"
2022-01-07T14:02:51.758 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora"
2022-01-07T14:02:51.758 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.4"
2022-01-07T14:02:51.759 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8"
2022-01-07T14:02:51.759 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-07T14:02:51.759 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31"
2022-01-07T14:02:51.759 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-07T14:02:51.759 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/"
2022-01-07T14:02:51.760 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-07T14:02:51.760 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-07T14:02:51.760 INFO:teuthology.orchestra.run.smithi055.stdout:
2022-01-07T14:02:51.760 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-07T14:02:51.761 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-07T14:02:51.761 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-07T14:02:51.761 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-07T14:02:51.762 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server
2022-01-07T14:02:51.781 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server
2022-01-07T14:02:51.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2022-01-07T14:02:51.969 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64
2022-01-07T14:02:52.026 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux"
2022-01-07T14:02:52.026 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.4 (Ootpa)"
2022-01-07T14:02:52.026 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel"
2022-01-07T14:02:52.027 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora"
2022-01-07T14:02:52.027 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.4"
2022-01-07T14:02:52.027 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8"
2022-01-07T14:02:52.027 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-01-07T14:02:52.028 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2022-01-07T14:02:52.028 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-01-07T14:02:52.028 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/"
2022-01-07T14:02:52.028 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-01-07T14:02:52.029 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-01-07T14:02:52.029 INFO:teuthology.orchestra.run.smithi149.stdout:
2022-01-07T14:02:52.029 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-01-07T14:02:52.029 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-01-07T14:02:52.029 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-01-07T14:02:52.030 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-01-07T14:02:52.030 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2022-01-07T14:02:52.128 INFO:teuthology.dispatcher.supervisor:Running job 6598599
2022-01-07T14:02:52.129 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-01-06_14:42:22-rados-WIP_GBH_safe_fast_shutdown_A3-distro-basic-smithi/6598599 --name benhanokh-2022-01-06_14:42:22-rados-WIP_GBH_safe_fast_shutdown_A3-distro-basic-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/benhanokh-2022-01-06_14:42:22-rados-WIP_GBH_safe_fast_shutdown_A3-distro-basic-smithi/6598599/orig.config.yaml
2022-01-07T14:02:52.132 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-01-06_14:42:22-rados-WIP_GBH_safe_fast_shutdown_A3-distro-basic-smithi/6598599
2022-01-07T14:02:52.133 INFO:teuthology.dispatcher.supervisor:Job PID: 11602
2022-01-07T14:02:52.134 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-08T02:03:12.672 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-08T02:03:12.880 INFO:teuthology.kill:Killing Pids: {11602}
2022-01-08T02:03:14.079 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['host.a', 'client.0']
2022-01-08T02:03:14.080 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['host.b', 'client.1']
2022-01-08T02:03:14.080 INFO:teuthology.misc:Compressing logs...
2022-01-08T02:03:14.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com'
2022-01-08T02:03:14.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2022-01-08T02:03:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-08T02:03:14.622 INFO:teuthology.orchestra.run.smithi149.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-01-08T02:03:14.669 INFO:teuthology.orchestra.run.smithi055.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-08T02:03:14.669 INFO:teuthology.orchestra.run.smithi055.stderr:tar: Error is not recoverable: exiting now
2022-01-08T02:03:14.709 INFO:teuthology.orchestra.run.smithi149.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-01-08T02:03:14.709 INFO:teuthology.orchestra.run.smithi149.stderr:tar: Error is not recoverable: exiting now
2022-01-08T02:03:14.719 INFO:teuthology.misc:Compressing logs...
2022-01-08T02:03:15.029 INFO:teuthology.misc:Compressing logs...
2022-01-08T02:03:47.877 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/09b02248-6fc4-11ec-8c32-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-01-08T02:03:53.247 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /var/log/ceph/09b02248-6fc4-11ec-8c32-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-01-08T02:03:53.902 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/09b02248-6fc4-11ec-8c32-001a4aab830c/ceph-mon.smithi149.log: file size changed while zipping
2022-01-08T02:04:17.487 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/09b02248-6fc4-11ec-8c32-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-01-08T02:04:23.859 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /var/log/ceph/09b02248-6fc4-11ec-8c32-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-01-08T02:04:41.952 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /var/log/ceph/09b02248-6fc4-11ec-8c32-001a4aab830c/ceph-mon.smithi055.log: file size changed while zipping
2022-01-08T02:04:46.255 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /var/log/ceph/09b02248-6fc4-11ec-8c32-001a4aab830c/ceph-mgr.smithi055.fitkqf.log: file size changed while zipping
2022-01-08T02:04:49.536 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/09b02248-6fc4-11ec-8c32-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-01-08T02:05:17.737 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /var/log/ceph/09b02248-6fc4-11ec-8c32-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-01-08T02:05:21.664 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/09b02248-6fc4-11ec-8c32-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-01-08T02:05:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /var/log/ceph/09b02248-6fc4-11ec-8c32-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-01-08T02:06:56.367 INFO:teuthology.kill:No teuthology processes running
2022-01-08T02:06:57.540 INFO:teuthology.kill:Nuking machines: ['smithi055', 'smithi149']
2022-01-08T02:06:58.548 INFO:teuthology.kill:2022-01-08 02:06:58,547.547 INFO:teuthology.nuke:targets:
2022-01-08T02:06:58.548 INFO:teuthology.kill:  smithi055.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2duiWEv3ns7jHkqazAyURlAEHqURXw8BjlWQnNsFAcWzkcG6jEQAh2EhHk5M2QV7RLlBgqpwNu9G1EC87kiBNL2LNtFxQFYSjVG4h+G/rPd1UjiHWccCrpBTKCs7cbkPBD58zoGbZug5bozvIGZNUE/334i3P33jawOJYFIZOLOP+ZyBKNXIqR+LDw2F2w+BvM9hKAHTWe16F2wR6CZfVJH6k8TMnbN3ofugjoCBjwtOi2dFcjDSliQRBiupjSN/UI+xLXJyfx1Ot6gvgZqNwhiNIafWfymt10jG7HsGBoV1u3Ydvo2iGuzEwpCmBgWjYqFQ2q9yQ564QmJQgBaAIFEdceHyh25KKnTDacdtRlmcFyUWG9Gar5bKQKut9tG0+m5IocaWqgUZodva073YljJErNNYs0+0x5oyBLrezYvNbJw79twgqUQO++mQX4JB51f3+fwXHOQZe64xlKFT3brIOiCF6k0LOIK1qReyS2imFiPAx4a3EIM64S0f34yU=
2022-01-08T02:06:58.549 INFO:teuthology.kill:  smithi149.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaSoOr/NmJcovutOJ3yziRTRUUyNEnhiqTxl//SApBC9SOohsRPBxQ0sJ4usac5kY5vX+it5WzaRvuDffZp6/KsefEzqMg4SdhRF2lMtHSPQYwppJRstamokVmCE5EWd5w8acrY08dpDw5gS5ccYcXUx/riaIErAy6mzGbwusSXAag5qRK2Qt5vPi62vnOMMSkghFT0dxYzQg2k0nXHSOscToKP86dRggSSY/v3A8xjJ/1hFvorrwgwPQNt2xpsmfVfG8M5aHTCxjbFbqC2C6fK0JvHrA02Hw4KHZQG0RCBa2uFPbmfHFmlf1x6k8gryaQCTvG1bb0W7uGKwyNS0ePKIqqeK+Xv+UMFU5KGfF9G53YqGo+YsqaLFYIG7N5jl8b57bAW0O/u6U7WqPorXb26VdAuOtJSyXQsqc0QXSMQUdfA82SmdpCzMG6oCadwkA5IWepuVD2OFzOlUI7DdEdhtEkL73GV4edxdUlEUu+mdD2ud5THM1MawHxvKsHtgE=
2022-01-08T02:06:58.581 INFO:teuthology.kill:2022-01-08 02:06:58,581.581 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-08T02:06:58.585 INFO:teuthology.kill:2022-01-08 02:06:58,585.585 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-08T02:06:58.659 INFO:teuthology.kill:2022-01-08 02:06:58,659.659 INFO:teuthology.orchestra.console:Power off smithi149
2022-01-08T02:06:58.672 INFO:teuthology.kill:2022-01-08 02:06:58,672.672 INFO:teuthology.orchestra.console:Power off smithi055
2022-01-08T02:07:07.032 INFO:teuthology.kill:2022-01-08 02:07:07,032.032 INFO:teuthology.orchestra.console:Power off for smithi149 completed
2022-01-08T02:07:07.040 INFO:teuthology.kill:2022-01-08 02:07:07,040.040 INFO:teuthology.orchestra.console:Power off for smithi055 completed
2022-01-08T02:07:07.191 INFO:teuthology.kill:2022-01-08 02:07:07,190.190 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com
2022-01-08T02:07:07.195 INFO:teuthology.kill:2022-01-08 02:07:07,195.195 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com
2022-01-08T02:09:07.550 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-08T02:09:07.649 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi055 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-07_20:51:42-rados-wip-yuri-testing-2022-01-07-0928-pacific-distro-default-smithi/6601818
2022-01-08T02:09:07.650 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi149 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-07_20:51:42-rados-wip-yuri-testing-2022-01-07-0928-pacific-distro-default-smithi/6601818